About 4.8 million receive some type of housing assistance from the federal government, split between three programs.