But still-elevated interest rates contributed to a “deteriorating outlook” for independent mortgage banks this year, Fitch Ratings said.