When is Big Data too much data?

by Kelly Kent 2 min read September 9, 2015

big_data_the_force_thats_good_for_consumers_and_society_2_638As Big Data becomes the norm in the credit industry and others, the seemingly non-stop efforts to accumulate more and more data leads me to ask the question – when is Big Data too much data?  The answer doesn’t lie in the quantity of data itself, but rather in the application of it – Big Data is too much data when you can’t use it to make better decisions.

So what do I mean by a better decision? From any number of perspectives, the answer to that question will vary. From the viewpoint of a marketer, maybe that decision is about whether new data will result in better response rates through improved segmentation. From a lender perspective, that decision might be about whether a borrower will repay a loan or the right interest rate to charge the borrower.

That is one the points of the hype around Big Data – it is helping companies and individuals in all sorts of situations make better decisions – but regardless of the application, it appears that the science of Big Data must not just be based on an assumption that more data will always lead to better decisions, but that more data can lead to better decisions – if it is also the “right data”.

Then how does one know when another new data source is helping? It’s not obvious that additional data won’t help make a better decision. It takes an expert to understand not only the data employed, but ultimately the use of the data in the decision-making process. It takes expertise that is not found just anywhere.

At Experian, one of our core capabilities is based on the ability to distinguish between data that is predictive and can help our clients make better decisions, and that which is noise and is not helpful to our clients.  Our scores and models, whether they be used for prospecting new customers, measuring risk in offering new credit, or determining how to best collect on an outstanding receivable, are all designed to optimize the decision making process.

Learn more about our big data capabilities

Related Posts

Cash Flow Insights: Powering the Next Evolution in Lending

For decades, credit data has given lenders a trusted foundation for assessing risk. Now, consumer-permissioned cash flow data is adding another layer of insight into consumers’ financial lives, including income, spending, liquidity and changing financial obligations. The opportunity is significant. Nearly one in five consumers lacks access to or has damaged credit. New Experian research also shows that 60% of consumers who have previously been denied credit or received less favorable terms than expected believe the outcome would have been different if lenders had considered their recent income and banking activity alongside their credit history. 1,2 For lenders, cash flow insights can provide additional context about a consumer’s financial capacity and support more informed underwriting decisions. The next challenge is making those insights easier to use consistently and responsibly at scale. What are cash flow insights? Cash flow insights are derived from consumer-permissioned banking data and provide visibility into how money moves into and out of a consumer’s accounts. Depending on the information available, cash flow data can provide insight into financial behaviors such as: Income and income stability: Regular and irregular income streams and changes over time Spending and recurring expenses: Everyday spending patterns and ongoing financial obligations Account balances and liquidity: Available funds and changes in account balances Debt obligations: Loan payments and other recurring debt commitments Cash flow patterns: How money moves into and out of accounts over time Traditional credit information provides a rich history of how consumers have managed credit. Cash flow insights add context about their current financial activity and capacity, providing lenders with a more complete view of financial health. Cash flow insights can also add predictive value to risk assessment. Experian analysis shows Cashflow Score can deliver up to a 25% lift in predictive performance over conventional credit scores when tailored to targeted risk tiers.3 How lenders can put cash flow insights to work at scale As interest in cash flow insights grows, the conversation is moving beyond what the data can reveal to how financial institutions can use it consistently and responsibly. That requires standardized consumer reporting, clear governance and decision-ready insights that can work within established lending processes. The launch of Experian Cashflow Data Bureau at Vision 2026 reflects this shift from access to adoption. The new consumer reporting agency operates under the Fair Credit Reporting Act (FCRA) and is designed to help financial institutions adopt consumer-permissioned cash flow insights at scale. A key part of that foundation is the cash flow consumer report, which organizes consumer-permissioned banking information into a standardized consumer report regulated under the FCRA. This gives lenders a consistent foundation for incorporating cash flow information into lending decisions while providing consumers with access to the information in their report. Turning greater visibility into better decisions The next evolution in credit isn’t about choosing between traditional credit and cash flow data. Each provides a different perspective. Traditional credit information offers deep insight into how consumers have managed credit over time. Cash flow insights can add context about financial activity and capacity. Bringing those perspectives together can give lenders greater visibility into consumers’ financial health and help them better distinguish between risk and resilience, support more informed decisions and identify opportunities to responsibly expand access to credit. As cash flow adoption continues to grow, its value will come from how effectively it complements the information lenders already use. The opportunity isn't simply to see more data. It's to turn that additional visibility into smarter, more informed decisions. Explore how Experian Cashflow Data Bureau is helping financial institutions put consumer-permissioned cash flow insights into practice at scale. Learn more [1] Federal Reserve Bank of New York, The Market for Credit Building: Demand, Product Characteristics and Consumer Uses, 2026. [2] Experian commissioned Atomik Research to conduct an online survey of 2,000 U.S. adults age 18+. Fieldwork took place July 16–21, 2026. Margin of error: +/- 2.2 percentage points at a 95% confidence level. [3] Based on Experian analysis when Cashflow Score is compared with conventional credit scores, tailored to targeted risk tiers. Predictability based on KS.

October 14, 2026 by Julie Lee
The Three Onboarding Fraud Pain Points That Slow Growth (And How to Solve Them) 

Effective fraud prevention is critical to balancing security and customer experience during onboarding. Learn more!

October 12, 2026 by Charles Hunter
How Rental Data Is Expanding Financial Opportunity for Millions of Renters 

Discover how rental payment reporting can expand credit access, strengthen credit profiles and improve risk assessment for renters and housing providers.

October 8, 2026 by Manjit Sohal

Subscribe to our Newsletter

Enter your name and email for the latest updates.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Subscribe to our Newsletter

Don't miss out on the latest industry trends and insights!
Subscribe