Lone parents and minority groups suffering most from housing