Skip to main content
New: Deck Doctor. Upload your deck, get CPO-level feedback. 7-day free trial.
Back to Glossary
AI and Machine LearningM

Model Drift

Model drift is the degradation of AI model performance over time as the distribution of production data diverges from training data. Unlike traditional software, which performs consistently until code changes, AI models can decline in accuracy without any code modifications because the world they operate in evolves.

A customer support chatbot trained on January support tickets learns patterns from features that existed in January. By April, the product has shipped new capabilities and changed UI terminology. Users ask questions the training data never covered. The model's answers become outdated.

Put it into practice

Tools and resources related to Model Drift.

Frequently Asked Questions

How quickly does model drift occur?+
Depends on how fast your domain changes. Customer support bots drift within 4-8 weeks as products evolve. Financial prediction models drift in days during market volatility. Content moderation models drift gradually over months as language norms shift.
How do you detect model drift before users complain?+
Monitor quality metrics continuously: accuracy scores, user satisfaction ratings, escalation rates. Set automated alerts when metrics drop 5-10% from baseline. Compare predictions on a held-out test set monthly. Track input distribution shifts using statistical tests.
What causes model drift in AI products?+
Product changes (new features users ask about), user behavior shifts (different question patterns), seasonal variations, competitive dynamics (users compare your product to new alternatives), and language evolution (new slang, terminology). External events like regulations or market disruptions also trigger drift.
Free PDF

Get the PM Toolkit Cheat Sheet

All key PM concepts, tools, and frameworks in a printable 2-page PDF. The reference card for terms like this one.

or use email

Join 10,000+ product leaders. Instant PDF download.

Want full SaaS idea playbooks with market research?

Explore Ideas Pro →

Keep exploring

380+ PM terms defined, plus free tools and frameworks to put them to work.