Building remains a key relief valve in the extreme supply-demand imbalance the housing market has sustained for years. But with affordability hampered by rising interest rates, builders are getting skittish as exemplified in the latest housing starts data from the U.S. Census Bureau, which shows that starts dropped 14.4 percent from April to May.