Mortgage brokers are telling the company that they “are looking for another large source,” according to President and CEO Willie Newman.