U.S. population growth was already under pressure from a falling number of births, and then the pandemic hit and caused a spike in deaths.