High street banks are seriously interested in the specialist lending sector, attracted by high returns and opportunities, and could enter the sector by the end of the year, it has been suggested.