A cross-party report has called for safer conditions for the record number of families living in temporary accommodation.