Many people think real estate agents are to blame for rapidly rising real estate prices.