InfoQ - Availability - Presentations https://www.infoq.com InfoQ Availability Presentations feed Presentation: How GitHub Copilot Serves 400 Million Completion Requests a Day https://www.infoq.com/presentations/github-copilot/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Availability-presentations <img src="https://res.infoq.com/presentations/github-copilot/en/mediumimage/davidcheney-medium-1741334769344.jpeg"/><p>David Cheney discusses the intricate architecture of GitHub Copilot's code completion service, explaining the challenges of achieving low-latency responses for millions of daily requests. He delves into HTTP/2 optimizations, global scaling strategies, and the critical role of their internal proxy.</p> <i>By David Cheney</i> Transcripts Scalability QCon San Francisco 2024 Large language models Availability AI, ML & Data Engineering Architecture & Design presentation Mon, 24 Mar 2025 13:02:00 GMT https://www.infoq.com/presentations/github-copilot/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Availability-presentations David Cheney 2025-03-24T13:02:00Z /presentations/github-copilot/en