Loading...

Measuring data performance

Published: January 20, 2010 by Guest Contributor

Meat and potatoes
Data are the meat and potatoes of fraud detection. You can have the brightest and most capable statistical modeling team in the world. But if they have crappy data, they will build crappy models. Fraud prevention models, predictive scores, and decisioning strategies in general are only as good as the data upon which they are built.

How do you measure data performance?
If a key part of my fraud risk strategy deals with the ability to match a name with an address, for example, then I am going to be interested in overall coverage and match rate statistics. I will want to know basic metrics like how many records I have in my database with name and address populated. And how many addresses do I typically have for consumers? Just one, or many? I will want to know how often, on average, we are able to match a name with an address. It doesn’t do much good to tell you your name and address don’t match when, in reality, they do.

With any fraud product, I will definitely want to know how often we can locate the consumer in the first place. If you send me a name, address, and social security number, what is the likelihood that I will be able to find that particular consumer in my database? This process of finding a consumer based on certain input data (such as name and address) is called pinning. If you have incomplete or stale data, your pin rate will undoubtedly suffer. And my fraud tool isn’t much good if I don’t recognize many of the people you are sending me.

Data need to be fresh. Old and out-of-date information will hurt your strategies, often punishing good consumers. Let’s say I moved one year ago, but your address dataare two-years old, what are the chances that you are going to be able to match my name and address? Stale dataare yucky.

Quality Data = WIN
It is all too easy to focus on the more sexy aspects of fraud detection (such as predictive scoring, out of wallet questions, red flag rules, etc.) while ignoring the foundation upon which all of these strategies are built.

Related Posts

Learn what lending fraud is, what you can do to safeguard your organization and consumers and how we can help. Read more!

Published: August 7, 2025 by Laura Burrows

Experian is proud to be a Thought Leadership Sponsor at this year’s Federal Identity Forum & Expo. Meet us on site at FedID!

Published: August 1, 2025 by Kim Le

Now in its tenth year, Experian’s U.S. Identity and Fraud Report continues to uncover the shifting tides of fraud threats and how consumers and businesses are adapting. Our latest edition sheds light on a decade of change and unveils what remains consistent: trust is still the cornerstone of digital interactions. This year’s report draws on insights from over 2,000 U.S. consumers and 200 businesses to explore how identity, fraud and trust are evolving in a world increasingly shaped by generative artificial intelligence (GenAI) and other emerging technologies. Highlights: Over a third of companies are using AI, including generative AI, to combat fraud. 72% of business leaders anticipate AI-generated fraud and deepfakes as major challenges by 2026. Nearly 60% of companies report rising fraud losses, with identity theft and payment fraud as top concerns. Digital anxiety persists with 57% of consumers worried about doing things online. Ready to go deeper? Explore the full findings and discover how your organization can lead with confidence in an evolving fraud landscape. Download report Watch on-demand webinar Read press release  

Published: August 1, 2025 by Julie Lee