Borrowers from underrepresented groups often face more barriers to get a mortgage because lenders fail to understand cultural differences in finances and households.