Loading...

Understanding Validation Samples

Published: July 6, 2018 by Guest Contributor


When developing a risk model, validation is an essential step in evaluating and verifying a model’s predictive performance. There are two types of data samples that can be used to validate a model.

In-time validation or holdout sample: Random partitioning of the development sample is used to separate the data into a sample set for development and another set aside for validation.

Out-of-time validation sample: Data from an entirely different period or customer campaign is used to determine the model’s performance.

We live in a complicated world. Models can help reduce that complexity. Understanding a model’s predictive ability prior to implementation is critical to reducing risk and growing your bottom line.

Learn more

Related Posts

We are squarely in the holiday shopping season. From the flurry of promotional emails to the endless shopping lists,...

Published: November 22, 2024 by Stefani Wendel

Ensuring fair lending practices while leveraging machine learning models is crucial for organizations committed to ethical and compliant operations.

Published: June 13, 2024 by Julie Lee

Experian’s award-winning platform now brings together market-leading data, generative AI and cutting-edge machine learning solutions.

Published: May 22, 2024 by Julie Lee