AWS DevOps & Developer Productivity Blog

Category: Amazon OpenSearch Service

How A/B Testing and Multi-Model Hosting Accelerate Generative AI Feature Development in Amazon Q

How A/B Testing and Multi-Model Hosting Accelerate Generative AI Feature Development in Amazon Q

Introduction In the rapidly evolving landscape of Generative AI, the ability to deploy and iterate on features quickly and reliably is paramount. We, the Amazon Q Developer service team, relied on several offline and online testing methods, such as evaluating models on datasets, to gauge improvements. Once positive results are observed, features were rolled out […]