Critics say survey suggests Labour seems less keen on listen