Product Engineering

Presenters Yan Avlasov Takeshi Yoneda Source EnvoyCon NA 2025 Unleashing the Power of GenAI: How Envoy AI Gateway is Revolutionizing LLM Traffic 🚀 The world of Artificial Intelligence is buzzing, and at the forefront are Large Language Models (LLMs) and Generative AI (GenAI). These powerful tools promise to transform how we work, create, and interact with technology. But as we embrace their potential, we also face a new set of complex challenges in managing the traffic they generate. Enter the Envoy AI Gateway project, a groundbreaking sub-project of Envoy Proxy, designed to specifically address these unique demands and make GenAI accessible and manageable for everyone. ...

Presenters Takeshi Yoneda Source EnvoyCon NA 2025 Unleashing Envoy’s Potential: Beyond C++ with Dynamic Modules 🚀 Ever felt the power of Envoy but wished you could extend its capabilities without diving headfirst into C++ or wrestling with complex build systems? You’re not alone! While Envoy is a powerhouse out of the box, there are times when custom logic is a must. This is where the magic of dynamic modules comes in, opening up a universe of possibilities for extending Envoy’s functionality in ways that are both powerful and surprisingly accessible. ...

Presenters Will Betts Jay Chauhan Source EnvoyCon NA 2025 Beyond Quotas: How Tesco Mastered Dynamic Rate Limiting with Envoy 🚀 Hey tech enthusiasts! Ever felt the sting of a rate limit kicking in when you least expect it, even when you know you’re not going overboard? Well, the brilliant minds at Tesco, the UK’s retail giant, have been wrestling with this very challenge. They’ve built a massive, distributed API gateway using Envoy and shared their journey from the complexities of quota-based rate limiting to a more dynamic, percentage-driven solution. Let’s dive into how they achieved this, making their API ecosystem robust and user-friendly! 👨‍💻 ...

Presenters Teju Nareddy Guy Daich Source EnvoyCon NA 2025 Unleash the Power: Customizing Envoy Gateway with the Extension Server 🚀 Ever felt that a powerful open-source tool was almost perfect, but just needed a little something extra to fit your unique needs? If you’re nodding along, then this deep dive into Envoy Gateway’s extensibility is for you! We’re going to explore how you can go beyond the out-of-the-box features and truly make Envoy Gateway your own, all thanks to a game-changing component: the extension server. ...

Presenters Tony Allen Source EnvoyCon NA 2025 Goodbye Sidecars, Hello Node-Level Envoy! Google Cloud’s Bold Leap in Service Networking 🚀 Are you tired of the overhead, the complexity, and the sheer bloat that comes with the traditional Envoy sidecar pattern in Kubernetes? Get ready for a breath of fresh air because Google Cloud is charting a new course, and it’s all about ditching those per-pod proxies for a more elegant, efficient, and glorious service networking future! 🌐 ...