Madison County lost 3,911 residents between 2010 and 2017, but the ages of those lost was different that it was elsewhere in Illinois. Millennials grew slightly. The biggest losses were among those in their later working years. The median age shifted from 38.7 to 40 years old.