https://www.infoq.com InfoQ Test Automation News feed https://www.infoq.com/news/2026/03/doordash-llm-chatbot-simulator/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Test+Automation-news <img src="https://res.infoq.com/news/2026/03/doordash-llm-chatbot-simulator/en/headerimage/llmsimulation-1772868016503.jpeg"/><p>DoorDash engineers built a simulation and evaluation flywheel to test large language model customer support chatbots at scale. The system generates multi-turn synthetic conversations using historical transcripts and backend mocks, evaluates outcomes with an LLM-as-judge framework, and enables rapid iteration on prompts, context, and system design before production deployment.</p> <i>By Leela Kumili</i> ChatBots Test Automation Large language models Design Automated testing Automated Machine Learning Architecture Automation Artificial Intelligence Software Engineering Testing Prompt Engineering Simulation AI, ML & Data Engineering Development Architecture & Design news Fri, 13 Mar 2026 14:12:00 GMT https://www.infoq.com/news/2026/03/doordash-llm-chatbot-simulator/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Test+Automation-news Leela Kumili 2026-03-13T14:12:00Z /news/2026/03/doordash-llm-chatbot-simulator/en