Tag: analytics

5 Model Classification Blind Spots to Watch in 2026

Model inventories are rapidly expanding. AI-enabled tools are entering workflows that were once deterministic and decisioning environments are more interconnected than ever. At the same time, regulatory scrutiny around model risk management continues to intensify. In many institutions, classification determines validation depth, monitoring intensity, and escalation pathways while informing board reporting. If classification is wrong, every downstream control is misaligned. And, in 2026, model classification is no longer just about assigning a tier, but rather about understanding data lineage, use case evolution, interdependencies, and governance accountability in a decentralized, AI-driven environment. We recently spoke with Mark Longman, Director of Analytics and Regulatory Technology, and here are some of his thoughts around five blind spots risk and compliance leaders should consider addressing now. 1. The “Set It and Forget It” Mentality The Blind Spot Model classification frameworks are often designed during a regulatory remediation effort or inventory modernization initiative. Once documented and approved, they can remain largely unchanged for years. However, model risk management is an ongoing process. “There’s really no sort of one and done when it comes to model risk management,” said Longman. Why It Matters Classification is not merely descriptive, it’s prescriptive. It drives the depth of validation, the frequency of monitoring, the intensity of governance oversight and the level of senior management visibility. As Longman notes, data fragmentation is compounding the challenge. “There’s data everywhere – internal, cloud, even shadow IT – and it’s tough to get a clear view into the inputs into the models,” he said. When inputs are unclear, tiering becomes inherently subjective and if classification frameworks are not reviewed regularly, governance intensity can become misaligned with real exposure. Therefore, static classification is a growing risk, especially in a world of rapidly expanding AI use cases. In a supervisory environment that continues to scrutinize model definitions, particularly as AI tools proliferate, a dynamic, periodically refreshed classification process can demonstrate institutional vigilance. 2. Assuming Third-Party Models Reduce Governance Accountability The Blind SpotThere is often an implicit belief that vendor-provided models carry less governance burden because they were developed externally. Why It Matters Vendor provided models continue to grow, particularly in AI-driven solutions, but supervisory expectations remain firm. “Third-party models do not diminish the responsibility of the institution for its governance and oversight of the model – whether it’s monitoring, ongoing validation, just evaluating model drift” Longman said. “The board and senior managers are responsible to make sure that these models are performing as expected and that includes third-party models.” Regulators consistently emphasize that institutions remain responsible for the outcomes produced by models used in their decisioning environments, regardless of origin. If a vendor model influences credit approvals, pricing, fraud decisions, or capital calculations, it directly affects customers, financial performance and compliance exposure. Treating third-party models as inherently lower risk can also distort internal tiering frameworks. When vendor models are under-classified, validation depth and monitoring rigor may be insufficient relative to their true impact. 3. Limited Situational Awareness of Model Interdependencies The Blind SpotModern decisioning environments are interconnected ecosystems. Forecasting models may influence reserve calculations. Marketing models may be repurposed across product lines. Data transformations may feed multiple downstream models simultaneously. Why It Matters Risk often flows across interdependencies. When upstream models degrade in performance or introduce bias, downstream models inherit that exposure. If multiple material decisions depend on the same data transformation or feature engineering process, concentration risk emerges. Without visibility into these dependencies, tiering assessments may underestimate cumulative risk, and monitoring frameworks may fail to detect systemic vulnerabilities. “There has to be a holistic view of what models are being used for – and really somebody to ensure there’s not that overlap across models,” Longman said. Supervisors are increasingly interested in understanding how model risk propagates through business processes. When institutions cannot articulate how models interact, it raises broader concerns about situational awareness and control effectiveness. Therefore, capturing interdependencies within the classification framework enhances more than documentation. It enables more accurate tiering, more targeted monitoring and more informed governance oversight. 4. Excluding Models Without Defensible Rationale The Blind SpotGray-area tools frequently sit outside formal inventories: rule-based engines, spreadsheet models, scenario calculators, heuristic decision aids, or emerging AI tools used for analysis and summarization. These tools may not neatly fit legacy definitions of a “model,” and so they are sometimes excluded without robust documentation. Why It Matters Regulatory definitions of “model” have broadened over time. What creates risk is the absence of defensible reasoning and documentation. Longman describes the risk clearly: “Some [teams] are deploying AI solutions that are sort of unbeknownst to the model risk management community – and almost creating what you might think of as a shadow model inventory.” Without visibility, institutions cannot confidently characterize use, trace inputs, or assign appropriate tiers, according to Longman. It also undermines the credibility of the official inventory during examinations. A well-governed program can articulate why certain tools fall outside model risk management scope, referencing documented criteria aligned with regulatory guidance. Without that evidence, exclusions can appear arbitrary, suggesting gaps in oversight. 5. Inconsistent or Subjective Classification Frameworks The Blind SpotAs inventories scale and governance teams expand, classification decisions are often distributed across reviewers. Over time, discrepancies can emerge. Why It Matters Inconsistency undermines both risk management and regulatory confidence. If two models with comparable use cases and impact profiles are assigned different tiers without clear justification, it signals that the framework is not being applied uniformly. AI adds even more complexity. When it comes to emerging AI model governance versus traditional model governance, there’s a lot to unpack, says Longman: “The AI models themselves are a lot more complicated than your traditional logistic or multiple regression models. The data, the prompting, you need to monitor the prompts that the LLMs for example are responding to and you need to make sure you can have what you may think of as prompt drift,” Longman said. As frameworks evolve, particularly to incorporate AI, automation, and new regulatory interpretations, institutions must ensure that changes are cascaded across the entire inventory. Partial updates or selective reclassification introduce fragmentation. Longman recommends formalizing classification through a structured decision tree embedded in policy to ensure consistent outcomes across business units. Beyond clear documentation, a strong classification program is applied consistently, measured objectively, and periodically reassessed across the full portfolio. BONUS – 6. Elevating Classification with Data-Level Visibility Some institutions are extending classification discipline beyond models to the data layer itself. Longman describes organizations that maintain not only a model inventory, but a data inventory, mapping variables to the models they influence. This approach allows institutions to quickly assess downstream effects when operational or environmental changes occur including system updates or even natural disasters affecting payment behavior. In an AI-driven environment, traceability may become a competitive differentiator. Conclusion Model classification is foundational. It determines how risk is measured, monitored, escalated, and reported. In a rapidly evolving regulatory and technological environment, it cannot remain static. Institutions that invest now in transparency, consistency, and data-level visibility will not only reduce supervisory friction – they will build a governance framework capable of supporting the next generation of AI-enabled decisioning. Learn more

Published: March 20, 2026 by Stefani Wendel
How Terrace Finance Protects its Customers with NeuroID and Experian

In today’s digital lending landscape, fraudsters are more sophisticated, coordinated, and relentless than ever. For companies like Terrace Finance — a specialty finance platform connecting over 5,000 merchants, consumers, and lenders — effectively staying ahead of these threats is a major competitive advantage. That is why Terrace Finance partnered with NeuroID, a part of Experian, to bring behavioral analytics into their fraud prevention strategy. It has given Terrace’s team a proactive, real-time defense that is transforming how they detect and respond to attacks — potentially stopping fraud before it ever reaches their lending partners. The challenge: Sophisticated fraud in a high-stakes ecosystem Terrace Finance operates in a complex environment, offering financing across a wide range of industries and credit profiles. With applications flowing in from countless channels, the risk of fraud is ever-present. A single fraudulent transaction can damage lender relationships or even cut off financing access for entire merchant groups. According to CEO Andy Hopkins, protecting its partners is a top priority for Terrace:“We know that each individual fraud attack can be very costly for merchants, and some merchants will get shut off from their lending partners because fraud was let through ... It is necessary in this business to keep fraud at a tolerable level, with the ultimate goal to eliminate it entirely.” Prior to NeuroID, Terrace was confident in its ability to validate submitted data. But with concerns about GenAI-powered fraud growing, including the threat of next-generation fraud bots, Terrace sought out a solution that could provide visibility into how data was being entered and detect risk before applications are submitted. The solution: Behavioral analytics from NeuroID via Experian After integrating NeuroID through Experian’s orchestration platform, Terrace gained access to real-time behavioral signals that detected fraud before data was even submitted. Just hours after Terrace turned NeuroID on, behavioral signals revealed a major attack in progress — NeuroID enabled Terrace to respond faster than ever and reduce risk immediately. “Going live was my most nerve-wracking day. We knew we would see data that we have never seen before and sure enough, we were right in the middle of an attack,” Hopkins said. “We thought the fraud was a little more generic and a little more spread out. What we found was much more coordinated activities, but this also meant we could bring more surgical solutions to the problem instead of broad strokes.” Terrace has seen significant results with NeuroID in place, including: Together, NeuroID and Experian enabled Terrace to build a layered, intelligent fraud defense that adapts in real time. A partnership built on innovation Terrace Finance’s success is a testament to what is  possible when forward-thinking companies partner with innovative technology providers. With Experian’s fraud analytics and NeuroID’s behavioral intelligence, they have built a fraud prevention strategy that is proactive, precise, and scalable. And they are not stopping there. Terrace is now working with Experian to explore additional tools and insights across the ecosystem, continuing to refine their fraud defenses and deliver the best possible experience for genuine users. “We use the analogy of a stream,” Hopkins explained. “Rocks block the flow, and as you remove them, it flows better. But that means smaller rocks are now exposed. We can repeat these improvements until the water flows smoothly.” Learn more about Terrace Finance and NeuroID Want more of the story? Read the full case study to explore how behavioral analytics provided immediate and long-term value to Terrace Finance’s innovative fraud prevention strategy. Read case study

Published: September 3, 2025 by Allison Lemaster
From Data to Decisions: How Financial Institutions Can Unlock Value Through Analytics 

Financial institutions can unlock value through analytics to gain insights that drive smarter decisions and better business results.

Published: July 24, 2025 by Brian Funicelli
Win More Business and Minimize Risk with Loan Loss Analysis

By leveraging loan loss analysis, lenders can create more profitable business opportunities throughout the entire customer lifecycle.

Published: April 22, 2025 by Alan Ikemura
Leveraging Analytics in Utilities: Navigating Market Challenges with Data-Driven Insights

Discover how data analytics in utilities helps energy providers navigate regulatory, economic, and operational challenges. Learn how utility analytics and advanced analytics solutions from Experian can optimize operations and enhance customer engagement.

Published: March 10, 2025 by Stefani Wendel
How Financial Institutions Can Maximize Success During the Holiday Shopping Season

We are squarely in the holiday shopping season. From the flurry of promotional emails to the endless shopping lists, there are many to-dos and even more opportunities for financial institutions at this time of year. The holiday shopping season is not just a peak period for consumer spending; it’s also a critical time for financial institutions to strategize, innovate, and drive value. According to the National Retail Federation, U.S. holiday retail sales are projected to approach $1 trillion in 2024, , and with an ever-evolving consumer behavior landscape, financial institutions need actionable strategies to stand out, secure loyalty, and drive growth during this period of heightened spending. Download our playbook: "How to prepare for the Holiday Shopping Season" Here’s how financial institutions can capitalize on the holiday shopping season, including key insights, actionable strategies, and data-backed trends. 1. Understand the holiday shopping landscape Key stats to consider: U.S. consumers spent $210 billion online during the 2022 holiday season, according to Adobe Analytics, marking a 3.5% increase from 2021. Experian data reveals that 31% of all holiday purchases in 2022 occurred in October, highlighting the extended shopping season. Cyber Week accounted for just 8% of total holiday spending, according to Experian’s Holiday Spending Trends and Insights Report, emphasizing the importance of a broad, season-long strategy. What this means for financial institutions: Timing is crucial. Your campaigns are already underway if you get an early start, and it’s critical to sustain them through December. Focus beyond Cyber Week. Develop long-term engagement strategies to capture spending throughout the season. 2. Leverage Gen Z’s growing spending power With an estimated $360 billion in disposable income, according to Bloomberg, Gen Z is a powerful force in the holiday market​. This generation values personalized, seamless experiences and is highly active online. Strategies to capture Gen Z: Offer digital-first solutions that enhance the holiday shopping journey, such as interactive portals or AI-powered customer support. Provide loyalty incentives tailored to this demographic, like cash-back rewards or exclusive access to services. Learn more about Gen Z in our State of Gen Z Report. To learn more about all generations' projected consumer spending, read new insights from Experian here, including 45% of Gen X and 52% of Boomers expect their spending to remain consistent with last year. 3. Optimize pre-holiday strategies Portfolio Review: Assess consumer behavior trends and adjust risk models to align with changing economic conditions. Identify opportunities to engage dormant accounts or offer tailored credit lines to existing customers. Actionable tactics: Expand offerings. Position your products and services with promotional campaigns targeting high-value segments. Personalize experiences. Use advanced analytics to segment clients and craft offers that resonate with their holiday needs or anticipate their possible post-holiday needs. 4. Ensure top-of-mind awareness During the holiday shopping season, competition to be the “top of wallet” is fierce. Experian’s data shows that 58% of high spenders shop evenly across the season, while 31% of average spenders do most of their shopping in December​. Strategies for success: Early engagement: Launch educational campaigns to empower credit education and identity protection during this period of increased transactions. Loyalty programs: Offer incentives, such as discounts or rewards, that encourage repeat engagement during the season. Omnichannel presence: Utilize digital, email, and event marketing to maintain visibility across platforms. 5. Combat fraud with multi-layered strategies The holiday shopping season sees an increase in fraud, with card testing being the number one attack vector in the U.S. according to Experian’s 2024 Identity and Fraud Study. Fraudulent activity such as identity theft and synthetic IDs can also escalate​. Fight tomorrow’s fraud today: Identity verification: Use advanced fraud detection tools, like Experian’s Ascend Fraud Sandbox, to validate accounts in real-time. Monitor dormant accounts: Watch these accounts with caution and assess for potential fraud risk. Strengthen cybersecurity: Implement multi-layered strategies, including behavioral analytics and artificial intelligence (AI), to reduce vulnerabilities. 6. Post-holiday follow-up: retain and manage risk Once the holiday rush is over, the focus shifts to managing potential payment stress and fostering long-term relationships. Post-holiday strategies: Debt monitoring: Keep an eye on debt-to-income and debt-to-limit ratios to identify clients at risk of defaulting. Customer support: Offer tailored assistance programs for clients showing signs of financial stress, preserving goodwill and loyalty. Fraud checks: Watch for first-party fraud and unusual return patterns, which can spike in January. 7. Anticipate consumer trends in the New Year The aftermath of the holidays often reveals deeper insights into consumer health: Rising credit balances: January often sees an uptick in outstanding balances, highlighting the need for proactive credit management. Shifts in spending behavior: According to McKinsey, consumers are increasingly cautious post-holiday, favoring savings and value-based spending. What this means for financial institutions: Align with clients’ needs for financial flexibility. The holiday shopping season is a time that demands precise planning and execution. Financial institutions can maximize their impact during this critical period by starting early, leveraging advanced analytics, and maintaining a strong focus on fraud prevention. And remember, success in the holiday season extends beyond December. Building strong relationships and managing risk ensures a smooth transition into the new year, setting the stage for continued growth. Ready to optimize your strategy? Contact us for tailored recommendations during the holiday season and beyond. Download the Holiday Shopping Season Playbook

Published: November 22, 2024 by Stefani Wendel
The Future of Fintech Fraud Detection and Prevention

With fraudsters continuously refining their methods, fintechs must invest in advanced fintech fraud detection and prevention solutions.

Published: October 15, 2024 by Theresa Nguyen
Fair Lending and Machine Learning Models: Navigating Bias and Ensuring Compliance

Ensuring fair lending practices while leveraging machine learning models is crucial for organizations committed to ethical and compliant operations.

Published: June 13, 2024 by Julie.JLee@experian.com
Introducing New Enhancements to Experian Ascend Platform™

Experian’s award-winning platform now brings together market-leading data, generative AI and cutting-edge machine learning solutions.

Published: May 22, 2024 by Julie.JLee@experian.com
How Optimization Modeling Can Increase Your Marketing ROI

Optimization modeling provides actionable insights that drive decisioning, allowing businesses to achieve their marketing and growth goals.

Published: March 12, 2024 by Julie.JLee@experian.com
What Is Advanced Analytics?

Companies depend on quality information to make decisions that move their business objectives forward while minimizing risk exposure. And in today’s modern, tech-driven, innovation-led world, there’s more  information available than ever before. Expansive datasets from sources, both internal and external, allow decision-makers to leverage a wide range of intelligence to fuel how they plan, forecast and set priorities. But how can business leaders be sure that their data is as robust, up-to-date and thorough as they need — and, most importantly, that they’re able to use it to its fullest potential? That’s where the power of advanced analytics comes in. By making use of cutting-edge datasets and analytics insights, businesses can stay on the vanguard of business intelligence and ahead of their competitors. What is advanced analytics? Advanced analytics is a form of business intelligence that takes full advantage of the most modern data sources and analytics tools to create forward-thinking analysis that can help businesses make well-informed, data-driven decisions that are tailored to their needs. Simply put, advanced analytics is an essential component of any proactive business strategy that aims to maximize the future potential of both customers and campaigns. These advanced business intelligence and analytics solutions  help leaders make profitable decisions no matter the state of the current economic climate. They use both traditional and non-traditional data sources to provide businesses with actionable insights in the formats best suited to their needs and goals. One key aspect of advanced analytics is the use of AI analytics solutions. These efficient and effective tools help businesses save time and money by harnessing the power of cutting-edge technologies and deploying them in optimal use-case scenarios. These AI and machine-learning solutions use a wide range of tools, such as neural network methodologies, to help organizations optimize their allocation of resources, expediting and automating some processes while creating valuable insights to help human decision-makers navigate others. Benefits of advanced analytics Traditional business intelligence tends to be limited by the scope and quality of available data and ability of analysts to make use of it in an effective, comprehensive way. Modern business intelligence analytics, on the other hand, integrates machine learning and analytics to maximize the potential of data sets that, in today's technology-driven world, are often overwhelmingly large and complex: think not just databases of customer decisions and actions but behavioral data points tied to online and offline activity and the internet of things. What's more, advanced analytics does this in a way that's accessible to an entire organization — not just those who know their way around data, like IT departments and trained analysts. With the right advanced analytics solution, decision-makers can access convenient cloud-based dashboards designed to give them the information they want and need — with no clutter, noise or confusing terminology. Another key advantage of advanced analytics solutions is that they don't just analyze data — they optimize it, too. Advanced analytics offers the ability to clean up and integrate multiple data sets to remove duplicates, correct errors and inaccuracies and standardize formats, leading to high-quality data that creates clarity, not confusion. The result? By analyzing and identifying relationships across data, businesses can uncover hidden insights and issues. Advanced analytics also automate some aspects of the decision-making process to make workflows quicker and nimbler. For example, a business might choose to automate credit scoring, product recommendations for existing customers or the identification of potential fraud. Reducing manual interventions translates to increased agility and operational efficiency and, ultimately, a better competitive advantage. Use cases in the financial services industry Advanced analytics gives businesses in the financial world the power to go deeper into their data — and to integrate alternative data sources as well. With predictive analytics models, this data can be transformed into highly usable, next-level insights that help decision-makers optimize their business strategies. Credit risk, for instance, is a major concern for financial organizations that want to offer customers the best possible options while ensuring their credit products remain profitable. By utilizing advanced analytics solutions combined with a broad range of datasets, lenders can create highly accurate credit risk scores that forecast future customer behavior and identify and mitigate risk, leading to better lending decisions across the credit lifecycle. Advanced analytics solutions can also help businesses problem-solve. Let's say, for instance, that uptake of a new loan product has been slower than desired. By using business intelligence analytics, companies can determine what factors might be causing the issue and predict the tweaks and changes they can make to improve results. Advanced analytics means better, more detailed segmentation, which allows for more predictive insights. Businesses taking advantage of advanced analytics services are simply better informed: not only do they have access to more and better data, but they're able to convert it into actionable insights that help them lower risk, better predict outcomes, and boost the performance of their business. How we can help Experian offers a wide range of advanced analytics tools aimed at helping businesses in all kinds of industries succeed through better use of data. From custom machine learning models that help financial institutions assess risk more accurately to self-service dashboards designed to facilitate more agile responses to changes in the market, we have a solution that's right for every business. Plus, our advanced analytics offerings include a vast data repository with insights on 245 million credit-active individuals and 25 million businesses, as well as the industry's largest alternative data set from non-traditional lenders. Ready to explore? Click below to learn about our advanced analytics solutions. Learn more

Published: February 7, 2024 by Julie.JLee@experian.com
Maximize Profitability and Mitigate Risk with Proactive Credit Limit Management

Automate your credit limit management process to better serve your customers and quickly respond to the volatile market.

Published: January 22, 2024 by Lauren Makowski
A Quick Guide to Model Explainability

Being able to explain how an ML model works and what drives its decisions is important if you want to use ML-powered models for underwriting.

Published: January 11, 2024 by Julie.JLee@experian.com
What Is a Customer Identification Program?

For companies that regularly engage in financial transactions, having a customer identification program (CIP) is mandatory to comply with the regulations around identity verification requirements across the customer lifecycle. In this blog post, we will delve into the essentials of a customer identification program, what it entails, and why it is important for businesses to implement one. What is a customer identification program? A CIP is a set of procedures implemented by financial institutions to verify the identity of their customers. The purpose of a CIP is to be a part of a financial institution’s fraud management solutions, with similar goals as to detect and prevent fraud like money laundering, identity theft, and other fraudulent activities. The program enables financial institutions to assess the risk level associated with a particular customer and determine whether their business dealings are legitimate. An effective CIP program should check the following boxes: Confidently verify customer identities Seamless authentication Understand and anticipate customer activities Where does Know Your Customer (KYC) fit in? KYC policies must include a robust CIP across the customer lifecycle from initial onboarding through portfolio management. KYC solutions encompass the financial institution’s customer identification program, customer due diligence and ongoing monitoring. What are the requirements for a CIP? Customer identification program requirements vary depending on the type of financial institution, the type of account opened, and other factors. However, the essential components of a CIP include verifying the customer's identity using government-issued identification, obtaining and verifying the customer's address, and checking the customer against a list of known criminals, terrorists, or suspicious individuals. These measures  help detect and prevent financial crimes. Why is a CIP important for businesses? CIP helps businesses mitigate risk by ensuring they have accurate and up-to-date information about their customers. This also helps financial institutions comply with laws and regulations that require them to monitor financial transactions for any suspicious activities. By having a robust CIP in place, businesses can establish trust and rapport with their customers. According to Experian’s 2024 U.S. Identity and Fraud Report, 63% of consumers say it's extremely or very important for businesses to recognize them online. Having an effective CIP in place is part of financial institutions showing their consumers that they have their best interests top of mind. Finding the right partner It’s important to find a partner you trust when working to establish processes and procedures for verifying customer identity, address, and other relevant information. Companies can also utilize specialized software that can help streamline the CIP process and ensure that it is being carried out accurately and consistently. Experian’s proprietary and partner data sources and flexible monitoring and segmentation tools allow you to resolve CIP discrepancies and fraud risk in a single step, all while keeping pace with emerging fraud threats with effective customer identification software. Putting consumers first is paramount. The security of their identity is priority one, but financial institutions must pay equal attention to their consumers’ preferences and experiences. It is not just enough to verify customer identities. Leading financial institutions will automate customer identification to reduce manual intervention and verify with a reasonable belief that the identity is valid and eligible to use the services you provide. Seamless experiences with the right amount of friction (I.e., multi-factor authentication) should also be pursued to preserve the quality of the customer experience. Putting it all together As cybersecurity threats are becoming more sophisticated, it is essential for financial institutions to protect their customerinformation and level up their fraud prevention solutions. Implementing a customer identification program is an essential component in achieving that objective. A robust CIP helps organizations detect, prevent, and deter fraudulent activities while ensuring compliance with regulatory requirements. While implementing a CIP can be complex, having a solid plan and establishing clear guidelines is the best way for companies to safeguard customer information and maintain their reputation. CIPs are an integral part of financial institutions security infrastructures and must be a business priority. By ensuring that they have accurate and up-to-date data on their customers, they can mitigate risk, establish trust, and comply with regulatory requirements. A sound CIP program can help financial institutions detect and prevent financial crimes and cyber threats while ensuring that legitimate business transactions are not disrupted, therefore safeguarding their customers' information and protecting their own reputation. Learn more

Published: November 7, 2023 by Stefani Wendel
What Is Model Governance?

Model governance is growing increasingly important as more companies implement machine learning model deployment and AI analytics solutions into their decision-making processes. Models are used by institutions to influence business decisions and identify risks based on data analysis and forecasting. While models do increase business efficiency, they also bring their own set of unique risks. Robust model governance can help mitigate these concerns, while still maintaining efficiency and a competitive edge. What is model governance? Model governance refers to the framework your organization has in place for overseeing how you manage your development, model deployment, validation and usage.1 This can involve policies like who has access to your models, how they are tested, how new versions are rolled out or how they are monitored for accuracy and bias.2 Because models analyze data and hypotheses to make predictions, there's inherent uncertainty in their forecasts.3 This uncertainty can sometimes make them vulnerable to errors, which makes robust governance so important. Machine learning model governance in banks, for example, might include internal controls, audits, a thorough inventory of models, proper documentation, oversight and ensuring transparent policies and procedures. One significant part of model governance is ensuring your business complies with federal regulations. The Federal Reserve Board and the Office of the Comptroller of the Currency (OCC) have published guidance protocols for how models are developed, implemented and used. Financial institutions that utilize models must ensure their internal policies are consistent with these regulations. The OCC requirements for financial institutions include: Model validations at least once a year Critical review by an independent party Proper model documentation Risk assessment of models' conceptual soundness, intended performance and comparisons to actual outcomes Vigorous validation procedures that mitigate risk Why is model governance important — especially now? More and more organizations are implementing AI, machine learning and analytics into their models. This means that in order to keep up with the competition's efficiency and accuracy, your business may need complex models as well. But as these models become more sophisticated, so does the need for robust governance.3 Undetected model errors can lead to financial loss, reputation damage and a host of other serious issues. These errors can be introduced at any point from design to implementation or even after deployment via inappropriate usage of the model, drift or other issues. With model governance, your organization can understand the intricacies of all the variables that can affect your models' results, controlling production closely with even greater efficiency and accuracy. Some common issues that model governance monitors for include:2 Testing for drift to ensure that accuracy is maintained over time. Ensuring models maintain accuracy if deployed in new locations or new demographics. Providing systems to continuously audit models for speed and accuracy. Identifying biases that may unintentionally creep into the model as it analyzes and learns from data. Ensuring transparency that meets federal regulations, rather than operating within a black box. Good model governance includes documentation that explains data sources and how decisions are reached. Model governance use cases Below are just three examples of use cases for model governance that can aid in advanced analytics solutions. Credit scoring A credit risk score can be used to help banks determine the risks of loans (and whether certain loans are approved at all). Governance can catch biases early, such as unintentionally only accepting lower credit scores from certain demographics. Audits can also catch biases for the bank that might result in a qualified applicant not getting a loan they should. Interest rate risk Governance can catch if a model is making interest rate errors, such as determining that a high-risk account is actually low-risk or vice versa. Sometimes changing market conditions, like a pandemic or recession, can unintentionally introduce errors into interest rate data analysis that governance will catch. Security challenges One department in a company might be utilizing a model specifically for their demographic to increase revenue, but if another department used the same model, they might be violating regulatory compliance.4 Governance can monitor model security and usage, ensuring compliance is maintained. Why Experian? Experian® provides risk mitigation tools and objective and comprehensive model risk management expertise that can help your company implement custom models, achieve robust governance and comply with any relevant federal regulations. In addition, Experian can provide customized modeling services that provide unique analytical insights to ensure your models are tailored to your specific needs. Experian's model risk governance services utilize business consultants with tenured experience who can provide expert independent, third-party reviews of your model risk management practices. Key services include: Back-testing and benchmarking: Experian validates performance and accuracy, including utilizing statistical metrics that compare your model's performance to previous years and industry benchmarks. Sensitivity analysis: While all models have some degree of uncertainty, Experian helps ensure your models still fall within the expected ranges of stability. Stress testing: Experian's experts will perform a series of characteristic-level stress tests to determine sensitivity to small changes and extreme changes. Gap analysis and action plan: Experts will provide a comprehensive gap analysis report with best-practice recommendations, including identifying discrepancies with regulatory requirements. Traditionally, model governance can be time-consuming and challenging, with numerous internal hurdles to overcome. Utilizing Experian's business intelligence and analytics solutions, alongside its model risk management expertise, allows clients to seamlessly pass requirements and experience accelerated implementation and deployment. Experian can optimize your model governance Experian is committed to helping you optimize your model governance and risk management. Learn more here. References 1Model Governance," Open Risk Manual, accessed September 29, 2023. https://www.openriskmanual.org/wiki/Model_Governance2Lorica, Ben, Doddi, Harish, and Talby, David. "What Are Model Governance and Model Operations?" O'Reilly, June 19, 2019. https://www.oreilly.com/radar/what-are-model-governance-and-model-operations/3"Comptroller's Handbook: Model Risk Management," Office of the Comptroller of the Currency. August 2021. https://www.occ.treas.gov/publications-and-resources/publications/comptrollers-handbook/files/model-risk-management/pub-ch-model-risk.pdf4Doddi, Harish. "What is AI Model Governance?" Forbes. August 2, 2021. https://www.forbes.com/sites/forbestechcouncil/2021/08/02/what-is-ai-model-governance/?sh=5f85335f15cd

Published: October 24, 2023 by Julie.JLee@experian.com

Subscribe to our thought leadership

Enter your name and email for the latest updates.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Subscribe to our thought leadership

Don't miss out on the latest industry trends and insights!
Subscribe