A practical framework for detecting when a model has been silently changed and building automations that survive the swap.
What's inside
by Divjot Sahni · EZYE Consulting · ezye.com.au
The Three Signals of a Quiet Nerf
Signal one: output quality drops with no changelog or announcement
Signal two: the same prompt starts hitting refusals it used to clear
Signal three: latency and reasoning depth shift on identical inputs
Your Baseline Benchmark Pack
Save five prompts that stress reasoning, code, and long context
Record the exact outputs the day a model releases
Re-run the pack weekly and diff the results
Free access — enter your email below