LLM workflows
Model upgrades are breaking changes
A new model version is a dependency upgrade to the least deterministic component in the system, and it usually arrives without a changelog that describes what will change about your behaviour.
LLM workflows
A new model version is a dependency upgrade to the least deterministic component in the system, and it usually arrives without a changelog that describes what will change about your behaviour.
LLM workflows
A prompt change alters system behaviour in production. If it can reach users without review, a test, or a way to roll back, then the most volatile part of your system is also the least governed.
Data and integration
The model is rarely the hard part. Getting clean, current, permissioned data out of the systems of record is the hard part, and it is where most projects quietly stop.