Student loans were cited by more than half of potential home buyers who delayed saving for a down payment as their biggest expense.