Polls find that less than a third of Americans are in favor