Regular validation of scorecards and rating models is vital for the optimal functioning of decision tools. The operating environment of models is not stable — changes arise from systems, policies, processes, customer profile shifts, behavioural patterns, the economic environment, competition, and marketing initiatives.
The 2008 financial crisis triggered increasing supervisory scrutiny of model development and validation practices. The subsequent adoption of IFRS 9 and the full roll-out of CRR3 have further reinforced the importance of a holistic, independent, and multi-layered validation framework. Independence of the validation function is now a regulatory prerequisite, encompassing internal validation units, Internal Audit, and independent external validators.
Validation Types
Full Validation vs. Ongoing Monitoring
Regulatory frameworks and sound model risk management practices distinguish between two complementary validation regimes. StatDec supports both with appropriate depth and rigour.
Full Validation
A comprehensive, end-to-end review covering conceptual soundness, data integrity, development methodology, implementation accuracy, and ongoing performance. Required by the ECB Guide (July 2025) and EBA/GL/2023/01 at defined intervals or upon material model changes.
Triggered by:
- Initial model deployment and regulatory approval
- Material changes to model design, data inputs, or scope
- Deterioration in ongoing monitoring metrics
- Regulatory environment changes (e.g. CRR3 alignment requirements)
- Periodically per model risk policy — typically every 3 years for IRB
Full Validations include Challenger Model analysis, where the incumbent model's conceptual soundness is benchmarked against an independently developed alternative — explicitly referenced in the ECB's July 2025 Guide and increasingly expected by supervisors.
Periodic / Ongoing Validation
Annual or semi-annual performance reviews focused on stability, discrimination, and calibration accuracy. Designed to provide early warning of model drift and inform remediation decisions before a Full Validation cycle is triggered.
Components include:
- Discrimination and rank-ordering (Gini, KS, AUC)
- Population Stability Index (PSI) and characteristic drift
- Calibration accuracy and backtesting
- Exclusion and override analysis
- Action plan tracking from prior validations
Post-Implementation Review
Conducted 6–12 months after deployment of a new or materially changed model. Verifies live performance and implementation accuracy, aligned with the ECB's 3-month implementation deadline introduced in July 2025.
- Implementation accuracy assessment
- First-cycle performance benchmarking
- Data pipeline and integration review
- Early indicator monitoring setup
Targeted / Thematic Validation
Focused deep-dive on a specific dimension of model risk, commissioned in response to supervisory findings, audit observations, or specific business concerns.
- Data quality and representativeness
- Definition of default alignment (CRR3/EBA)
- Margin of Conservatism (MoC) review
- LGD Reference Value challenge
- Override and exception policies
Test Framework
Validation Test Blocks
Validation tests are structured as independent blocks. When examined holistically, they provide a complete picture of both model health and underlying portfolio dynamics. Findings on systems, policies, marketing activities, and collections can be identified and presented as part of the validation output.
Expanded Model Coverage
Beyond Credit Risk: Non-Credit Model Validation
The regulatory validation mandate extends well beyond credit scoring. EBA guidelines and Pillar 2 requirements impose validation obligations on provisioning models, treasury risk models, liquidity models, and behavioural models integral to the institution's risk management framework.
IFRS 9 ECL models carry direct P&L impact and are under increasing scrutiny from auditors and supervisors. StatDec provides independent validation covering all model components and the macro-economic overlay framework, alongside its IFRS 9 and Basel IRB development work.
SICR Models
Validation of Significant Increase in Credit Risk criteria for Stage 1→2 migration, including relative and absolute PD change approaches and qualitative backstop triggers.
Lifetime ECL Component Models
Full validation of point-in-time PD term structures, downturn LGD estimates, and EAD/CCF models — including conversion from TTC to IFRS 9 PiT parameters.
Forward-Looking Information & Overlay Models
Assessment of macro-economic scenario design, probability weighting, and satellite models linking macro variables to PD and LGD.
Portfolio-Level & Collective ECL Models
Validation of grouping criteria, loss emergence period assumptions, and benchmarking of collective provisions against actual loss experience.
Governed by EBA/GL/2022/14 on IRRBB and CSRBB, institutions must validate models for interest rate risk in the banking book, including behavioural models critical for accurate EVE and NII sensitivity computation.
Non-Maturity Deposit (NMD) Models
Validation of core deposit volume stability, repricing assumptions, and behavioural maturity estimates, benchmarked against EBA supervisory outlier thresholds.
Loan Prepayment Models
Assessment of prepayment speed assumptions for fixed-rate retail and corporate loans, with sensitivity analysis across interest rate scenarios and credit quality strata.
EVE & NII Sensitivity Models
Review of interest rate shock and stress scenarios (per EBA standard shocks), repricing gap methodology, and alignment with supervisory benchmarks.
CSRBB Models
Validation of credit spread risk in the banking book, including spread sensitivity measurement and scenario design for securities portfolios.
Liquidity risk models underpin LCR, NSFR, and ILAAP requirements. Their validation ensures that stress outflow assumptions and behavioural parameters remain conservative and realistic.
Regulatory Liquidity Ratio Models
Validation of inflow and outflow rate assumptions, HQLA haircut methodology, and classification of liabilities and committed facilities under stress conditions.
Liquidity Stress Testing Models
Assessment of scenario design (idiosyncratic, market-wide, combined), survival horizon computation, and behavioural assumptions on deposits, credit lines, and collateral calls.
Deposit Run-Off Models
Validation of segmented run-off rates for retail, SME, and institutional deposits, reviewed against historical crisis observations and regulatory floors.
Internal Liquidity Adequacy Models
Independent review of ILAAP liquidity buffer sizing, risk appetite metrics, and models supporting internal liquidity transfer pricing.
StatDec's validation expertise extends to the broader model inventory relevant to risk management and capital planning, including the ML-specific validation expectations introduced in the ECB's July 2025 Guide.
Internal Models for Market Risk (IMA)
Validation of VaR, Expected Shortfall, and stress VaR models, including backtesting under FRTB/CRR3. Separate CRR2 and CRR3 treatment per ECB July 2025.
Machine Learning Models
Specialist validation of ML-based credit risk and fraud models addressing explainability (SHAP, LIME), bias testing, and governance — aligned with ECB July 2025, EBA/GL/2020/02 and EU AI Act readiness.
ICAAP / Stress Testing Models
Review of internal capital adequacy models, Pillar 2 add-on estimation, macroeconomic stress scenario design, and capital projection models.
Propensity & Behavioural Models
Validation of early warning systems, pre-approval propensity, customer lifetime value, and churn prediction models used in commercial decision-making.
Why StatDec
Our Validation Approach
Regulatory Alignment
All validations are designed in full alignment with the ECB Guide (July 2025), EBA guidelines, and CRR3 requirements, ensuring defensible, supervisory-ready findings.
Business Perspective
Beyond statistical metrics, we assess whether models are being used properly, decisions are optimal, and risk estimates are fit for business purpose.
Customised Frameworks
Validation scope, tests, and reporting are tailored to the client's existing framework, portfolio characteristics, and specific regulatory context.
Portfolio Insights
Validation outputs include portfolio-level findings — shifts in borrower behaviour, policy effects, and market changes — not just model-level statistics.
Independent External Validator
As a specialist external validator, StatDec satisfies the independence requirement under EBA/GL/2023/01 for institutions requiring a third validation layer.
Actionable Outcomes
Every validation concludes with a structured, prioritised action plan — with best practice recommendations extending beyond model changes to governance and process.
FAQ
Frequently asked questions
Independent model validation is a review of a model carried out by a function separate from the one that developed it, covering conceptual soundness, data integrity, development methodology, implementation accuracy and ongoing performance. Independence of the validation function is a regulatory prerequisite, and can be satisfied by internal validation units, Internal Audit and independent external validators.
A Full Validation is a comprehensive end-to-end review of conceptual soundness, data, methodology, implementation and performance, required on initial deployment, after material model changes and at defined intervals. Ongoing or periodic validation is an annual or semi-annual review of stability, discrimination and calibration that gives early warning of model drift between full cycles.
A Full Validation is performed periodically in line with the institution's model risk policy, typically every three years for IRB models. It is also triggered by initial deployment and regulatory approval, material changes to model design, data or scope, deterioration in monitoring metrics, and regulatory changes such as CRR3 alignment. Ongoing monitoring runs in between.
Yes. IFRS 9 ECL models carry direct profit and loss impact and face increasing scrutiny from auditors and supervisors. Validation covers the significant increase in credit risk criteria for Stage 1 to Stage 2 migration, point-in-time PD term structures, downturn LGD and EAD or CCF models, the forward-looking macroeconomic overlay and collective ECL assessment.
A Margin of Conservatism is an add-on applied to a risk parameter estimate to account for identified deficiencies in data or methodology and for general estimation uncertainty, so the estimate is not understated. It is set out in the EBA guidelines on IRB PD, LGD and EAD estimation, EBA/GL/2017/16, and is a common subject of targeted validation.
A Challenger Model is an independently developed alternative against which the incumbent model's conceptual soundness and performance are benchmarked. StatDec includes Challenger Model analysis in every Full Validation. The approach is explicitly referenced in the ECB's revised Guide to Internal Models of July 2025 and is increasingly expected by supervisors.
Commission an Independent Validation
Whether you require a Full Validation under the ECB's July 2025 Guide, ongoing monitoring, or validation of IFRS 9, IRRBB or liquidity models, StatDec delivers expert, independent assessments of the highest quality.
Get in touch