When is Big Data too much data?

by Kelly Kent 2 min read September 9, 2015

big_data_the_force_thats_good_for_consumers_and_society_2_638As Big Data becomes the norm in the credit industry and others, the seemingly non-stop efforts to accumulate more and more data leads me to ask the question – when is Big Data too much data?  The answer doesn’t lie in the quantity of data itself, but rather in the application of it – Big Data is too much data when you can’t use it to make better decisions.

So what do I mean by a better decision? From any number of perspectives, the answer to that question will vary. From the viewpoint of a marketer, maybe that decision is about whether new data will result in better response rates through improved segmentation. From a lender perspective, that decision might be about whether a borrower will repay a loan or the right interest rate to charge the borrower.

That is one the points of the hype around Big Data – it is helping companies and individuals in all sorts of situations make better decisions – but regardless of the application, it appears that the science of Big Data must not just be based on an assumption that more data will always lead to better decisions, but that more data can lead to better decisions – if it is also the “right data”.

Then how does one know when another new data source is helping? It’s not obvious that additional data won’t help make a better decision. It takes an expert to understand not only the data employed, but ultimately the use of the data in the decision-making process. It takes expertise that is not found just anywhere.

At Experian, one of our core capabilities is based on the ability to distinguish between data that is predictive and can help our clients make better decisions, and that which is noise and is not helpful to our clients.  Our scores and models, whether they be used for prospecting new customers, measuring risk in offering new credit, or determining how to best collect on an outstanding receivable, are all designed to optimize the decision making process.

Learn more about our big data capabilities

Related Posts

Building for Bots in the AI Age: Separating Legitimate Agents From Fraudsters

See how NeuroID helps businesses distinguish legitimate AI agents from fraud bots, while Agent Trust verifies agent-initiated transactions.

October 29, 2026 by Laura Burrows
2026 Retail Banking Identity and Fraud Report 

Learn how banks can convert rising fraud investment into protection customers recognize, value and feel in our recent report. Read more!

October 28, 2026 by Laura Burrows
One Platform, Fewer Handoffs, Faster Decisions

The average credit union manages between 100-300 vendor relationships, and nearly a third have no dedicated staff managing them. What was supposed to drive efficiency is stunting growth and compromising the member experience. Application volume is continuing to rise, and consumers expect a loan decision at digital speed. But for credit unions, meeting that expectation isn't the only goal. They must also continue to make the right lending decisions while also prioritizing risk management. The institutions pulling ahead aren't the ones with the most tools. They're the ones that have turned credit, fraud and decisioning into a single, coordinated system. A single loan decision touches: Credit data Identity verification Fraud signals Decisioning logic Reporting Rarely does all of that live in one place. More often, it’s stitched together across separate platforms, each with its own contract and its own support line. When a credit view and a fraud view are generated separately, they must be reconciled instead of read together in the same instant. Every handoff is a place where a decision slows down and a signal gets missed. It's why a fraud pattern that would be obvious next to the credit file often surfaces only after the funds are already gone. Fragmentation also makes it harder to optimize lending strategies over time. When data, analytics and decisioning are disconnected, credit unions have less visibility into what's working, what's changing and where strategies need to be adjusted. An integrated decisioning ecosystem closes those seams by design, with credit, fraud and lending strategy running on one platform and accessed through a single Application Programming Interface (API). Identity and compliance capabilities can be an integrated decisioning flow. The data doesn't need to be reconciled after the fact because it was never separated in the first place. Stop overengineering, start removing friction When decisioning underperforms, the instinct is to build something more custom: a proprietary model, tighter segmentation, more configuration.  Custom modeling has its place for institutions with the scale and data to justify it. But often, for small or mid-sized credit unions, the bigger opportunity is a flexible decisioning strategy that uses a strong, continuously refreshed model. This shouldn't be either/or. The right approach gives credit unions a strong decisioning strategy today, with the ability to introduce more customized analytics and modeling as their needs evolve.  The same principle applies to strategy management: credit unions can gain greater control through self-service capabilities as they build a more sophisticated data science team.   That kind of flexibility is important as credit unions modernize their decisioning infrastructure. Research surveying more than 2,000 senior credit risk and fraud decision-makers across 11 countries found that organizations investing in unified platforms and modern infrastructure are moving faster and realizing the greatest Return on Investment (ROI).   As their needs evolve, credit unions can adjust decisioning strategies without introducing another layer of technology or relying on third parties to make every change. Until self-service is the right fit, choose a partner that understands what makes your credit union’s membership and risk appetite different from others.  Same member, same afternoon, faster answer Consider a credit union growing its auto and personal loan originations.  A member applies for an auto loan on Saturday afternoon. Credit data, identity and fraud signals are read together in a single real-time pass instead of separate reviews:  Most applications resolve immediately, approved or declined based on a more comprehensive view of the applicant. A smaller number are flagged for quick step-up verification and cleared within minutes. Only genuinely ambiguous cases reach an underwriter, who is working from one complete picture instead of reconciling multiple signals. The member has an answer before the weekend is over. The credit union books the loan before competitors even open on Monday. Built to scale This kind of process holds up today. However, the better test is whether it holds up eighteen months from now when application volume has grown, new products are live and the data flowing through the system looks nothing like it does right now. Future-proofing isn't only about handling more volume. It's about having room to be nimbler and make adjustments as quickly as the market changes. A credit union that relies on standard models within a decisioning strategy may want more customized analytics and greater control over its strategies tomorrow. Connect with us With more than three decades of credit expertise and one of the industry's largest data footprints, Experian helps credit unions do more than solve this year's friction. We're helping to build a decisioning foundation that scales, so growth becomes something the system absorbs, rather than something it must be rebuilt around. Explore More

October 21, 2026 by Zohreen Ismail

Subscribe to our Newsletter

Enter your name and email for the latest updates.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Subscribe to our Newsletter

Don't miss out on the latest industry trends and insights!
Subscribe