Trudeau would have been 'better served' to listen to party's