Rising mortgage rates and record high prices are putting off potential home buyers. Consumers are also expressing other concerns about the economy.