Refinancing has been one of the bright spots in a difficult year for lending, and the industry has concerns that a fee to be imposed by Fannie Mae and Freddie Mac could slow down the business.