Many experts and officials are worried as home ownership slowly slips out of reach for many Americans.