Census Numbers Show Shrinking Population in Parts of Upper M