← Back to incidents
Upstart AI Lending Platform Accused of Racial Discrimination Through HBCU-Linked Higher Interest Rates
HighStudent Borrower Protection Center found Upstart's AI lending algorithm charged HBCU graduates higher interest rates, revealing algorithmic discrimination despite regulatory approval.
Category
Bias
Industry
Finance
Status
Resolved
Date Occurred
Jan 1, 2020
Date Reported
Oct 27, 2020
Jurisdiction
US
AI Provider
Other/Unknown
Application Type
api integration
Harm Type
financial
Human Review in Place
No
Litigation Filed
No
Regulatory Body
Consumer Financial Protection Bureau
algorithmic_biaslending_discriminationHBCUfair_lendingproxy_discriminationCFPBno_action_letter
Full Description
In October 2020, the Student Borrower Protection Center (SBPC) released a comprehensive analysis revealing that Upstart Holdings Inc.'s AI-powered lending platform systematically charged higher annual percentage rates (APRs) to borrowers who attended historically Black colleges and universities (HBCUs). The SBPC's research examined loan pricing data and found that Upstart's algorithm, which claimed to use over 1,600 data points including educational background to assess creditworthiness, resulted in discriminatory outcomes against Black borrowers.
Upstart, founded in 2012, marketed itself as a revolutionary lending platform that could expand credit access by using artificial intelligence and machine learning to evaluate borrowers beyond traditional credit scores. The company's algorithm incorporated non-traditional factors including the borrower's educational institution, area of study, and academic performance. However, the SBPC's analysis demonstrated that these seemingly neutral factors served as proxies for race, leading to systematic discrimination against HBCU graduates who were predominantly Black.
The controversy was compounded by the Consumer Financial Protection Bureau's (CFPB) 2017 decision to issue a no-action letter to Upstart, effectively providing regulatory safe harbor for the company's AI lending practices. This letter, issued during the Trump administration, stated that the CFPB would not take enforcement action against Upstart for using its alternative underwriting model, provided the company met certain conditions including regular monitoring for discriminatory impacts. Critics argued that this regulatory blessing enabled discriminatory practices to continue unchecked.
The SBPC's findings sparked broader debate about algorithmic redlining and the use of AI in financial services. The report highlighted how seemingly objective algorithms could perpetuate and amplify existing racial disparities in lending, even when race was not explicitly used as a factor. The case became emblematic of the challenges in regulating AI systems that could discriminate through proxy variables while maintaining plausible deniability about intentional bias. Following the report's publication, Upstart faced increased scrutiny from regulators, advocacy groups, and potential investors concerned about fair lending compliance and reputational risks.
Root Cause
Upstart's AI algorithm incorporated educational institution data and other non-traditional factors that served as proxies for race, resulting in discriminatory pricing against borrowers from historically Black colleges despite claims of fair lending practices.
Mitigation Analysis
Algorithmic bias testing and regular auditing for disparate impact could have identified discriminatory patterns. Removing educational institution data or implementing bias correction mechanisms would have prevented the discriminatory pricing. The CFPB's no-action letter created regulatory uncertainty that may have delayed proper oversight.
Lessons Learned
The incident demonstrates how AI systems can perpetuate discrimination through proxy variables even when protected characteristics are not explicitly used. Regulatory approval does not guarantee fair outcomes, and continuous monitoring for disparate impact is essential for AI-driven financial services.
Sources
Upstart's Upside-Down Algorithm
Student Borrower Protection Center · Oct 27, 2020 · academic paper
CFPB Issues No-Action Letter to Upstart Network for Innovative Student Loan Underwriting
Consumer Financial Protection Bureau · Sep 14, 2017 · regulatory action