High mortgage rates and the lack of inventory for sale pushed the sector into a downturn twice recently – between May and November last year and in May of 2023 – according to First American