The rapid expansion of refinance lending by mortgage companies in 2020 was responsible for most of the growth in mortgage lending that year.