It's not just young white liberals who are leaving religion