Use of Swap Sets to Measure Impact of Model Changes

Updated: July 14, 2026 by Guest Contributor 3 min read January 7, 2018

Swap Set

You just finished redeveloping an existing scorecard, and now it’s time to replace the old with the new. If not properly planned, switching from one scorecard to another within a decisioning or scoring system can be disruptive. Once a scorecard has been redeveloped, it’s important to measure the impact of changes within the strategy as a result of replacing the old model with the new one. Evaluating such changes and modifying the strategy where needed will not only optimize strategy performance, but also maximize the full value of the newly redeveloped model. Such an impact assessment can be completed with a swap set analysis.

The phrase swap set refers to “swapping out” a set of customer accounts — generally bad accounts — and replacing them with, or “swapping in,” a set of good customer accounts. Swap-ins are the customer population segment you didn’t previously approve under the old model but would approve with the new model. Swap-outs are the customer population segment you previously approved with the old model but wouldn’t approve with the new model. A worthy objective is to replace bad accounts with good accounts, thereby reducing the overall bad rate. However, different approaches can be used when evaluating swap sets to optimize your strategy and keep:

  • The same overall bad rate while increasing the approval rate.
  • The same approval rate while lowering the bad rate.
  • The same approval and bad rate but increase the customer activation or customer response rates.

It’s also important to assess the population that doesn’t change — the population that would be approved or declined using either the old or new model. The following chart highlights the three customer segments within a swap set analysis.

With the incumbent model, the bad rate is 8.3%. With the new model, however, the bad rate is 4.9%. This is a reduction in the bad rate of 3.4 percentage points or a 41% improvement in the bad rate.

This type of planning also is beneficial when replacing a generic model with another or a custom-developed model.

Click here to learn more about how the Experian Decision Analytics team can help you manage the impacts of migrating from a legacy model to a newly developed model.

Related Posts

How GenAI Fraud Bots Fly Under the Radar (and How to Ground Them Before It’s Too Late)

Today’s AI-powered fraud bots are exceptionally good at mimicking human behavior. Learn why a modern defense strategy is key.

November 18, 2026 by Laura Burrows
What Is Incident Response? Key Steps, Planning and Best Practices

Learn what incident response is, the key steps in the process and how to build and test an incident response plan for a data breach.

November 17, 2026 by Laura Burrows
Rethinking Charged-Off Portfolio Prioritization

Experian’s new Recovery Scores model turns portfolio intelligence into more focused recovery strategies, helping organizations improve returns, direct effort and accelerate speed to cash. The challenge isn’t simply working more accounts. Whether a debt buyer is evaluating an acquisition, an agency is deciding where to assign collector time or a lender is managing its own post-charge-off accounts, the question is similar: How can limited capacity be directed toward accounts with the greatest potential for recovery? Prioritizing accounts mainly by age, balance or when they were last worked may not show which ones are most likely to generate a recovery. With the new Recovery Scores model, organizations can rank charged-off accounts by expected collectability, providing a consistent signal to inform placement strategy and treatment decisions across the recovery lifecycle. Make collector capacity a strategic resource Working every account with the same level of attention isn’t always practical. The more useful question is: Where should teams focus first to protect speed to cash? Our model performance analysis found: 80% of recovered dollars come from the top 40% of accounts worked. The value isn’t simply a better ranking. It’s how organizations can use it for collections optimization. Score bands can inform different strategies for placement, outsourcing, auction and legal channel treatment rather than applying the same approach across an entire portfolio. For debt buyers: The scores can inform acquisition pricing and how a newly purchased portfolio is divided across internal collections, legal channels and resale. Expected collectability can shape debt portfolio analysis, including how a portfolio is valued and segmented before collection work begins. For agencies: Score bands can help teams focus collector resources on accounts with stronger recovery potential. For first-party lenders: Managing recovery internally, the scores provide another signal to help structure decisions about which accounts to work and in what order. Look beyond collectability alone Prioritization rarely comes down to a single variable. Consider two accounts that both rank highly for expected collectability, but one has a substantially larger balance. Their recovery likelihood may be similar, but the potential dollars recovered are not. The Recovery Scores model uses debt collections analytics by combining Experian’s bureau-based score with current balance information. This helps organizations consider both the likelihood of recovery and the potential dollars at stake, while sensitive balance information remains within the organization’s working environment. Monitor accounts as they change The first decision about an account is rarely the last. Teams continually make choices about treatment, placement and resource allocation as accounts move through the recovery process. Recovery Scores is also available as a trigger. When underlying information changes, teams can receive an update and reconsider an account’s placement without waiting for the next portfolio-wide re-score. An account that shows lower recovery potential today may have a different recovery outlook later. Turn recovery potential into a portfolio strategy When portfolios contain more accounts than teams can work at once, the question isn’t simply, “How many accounts can we work?” It is, “Where can our resources have the greatest impact?” The latest Recovery Scores model helps organizations sharpen placement and treatment decisions. It gives debt buyers a way to price and segment portfolios with greater confidence and gives lenders another tool to direct limited collector time across their own post-charge-off portfolios. Learn more about Experian Recovery Scores

November 10, 2026 by Zohreen Ismail

Subscribe to our Newsletter

Enter your name and email for the latest updates.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Subscribe to our Newsletter

Don't miss out on the latest industry trends and insights!
Subscribe