Middle income households have the highest owner-occupier housing debt relative to the value of the home they live in.