Brown County, population by residency