Earlier this year, housing builders and potential homebuyers were struggling with rising affordability issues, largely due to soaring lumber prices.