Voters asked if Caledonia County town should declare itself