Large Scale Distributed LLM Inference with LLM D and Kubernetes by Abdel Sghiouar

Presenters Abdel Sghiouar Source Devoxx Belgium 2025 Scaling LLMs: A Kubernetes Deep Dive 🚀💡👨‍💻 Deploying Large Language Models (LLMs) in production is no longer a simple matter of scaling web applications. It demands a fundamentally new approach, and Kubernetes is emerging as the central orchestration platform. Let’s dive into the latest techniques and innovations for mastering LLM deployments! 1. Deploying Small LLMs on Kubernetes: A Balancing Act 🛠️ Getting started with smaller LLMs (around 1 billion parameters) on Kubernetes can be surprisingly tricky. A recent presentation highlighted a practical approach using the VLM framework, demonstrating how to leverage Kubernetes for container orchestration and kubectl for management. ...

October 6, 2025 · 4 min

API Drift: A Hidden Crisis in MCP Servers By Naresh Jain.

Presenters Naresh Jain Source apidays London 2025 🚀 Taming the API Beast: How Specmatic Auto-Testing Can Save Your Sanity 🛠️ Let’s be honest: APIs are the backbone of modern software. But what happens when those APIs are… unreliable? The presenter at the recent tech conference shed light on a widespread problem – API inconsistencies – and presented a powerful solution: Specmatic Auto-Testing. Let’s dive in and see how you can avoid the API headache. ...

October 7, 2025 · 4 min

API Management for AI: Governing Ingress and Egress Traffic.

Presenters Pubudu Gunatilaka Source apidays London 2025 🚀 Governing AI Traffic: Securing Your Egress in the Age of AI 🤖 The rise of AI is transforming how we build and deploy applications. We’re no longer just adding AI; we’re embedding it from the ground up. But this exciting shift also brings new challenges – particularly when it comes to managing the outbound traffic, or egress, from your applications. A recent presentation highlighted a critical blind spot in many organizations: the neglect of egress API management. Let’s dive in! ...

October 7, 2025 · 4 min

Are APIs becoming obsolete? Think MCP, ACP, A2A, AGNTCY etc.

Presenters Shreshta Shyamsundar Source apidays London 2025 🚀 The API Landscape is Shifting: Are You Ready for the Age of AI Agents? 🤖 For years, APIs have been the backbone of the digital world, powering everything from online shopping to social media. But what happens when Artificial Intelligence enters the picture? Shreshta Shamsundar, a seasoned technologist with over two decades of experience, tackled this very question at API Days Global in London, arguing that APIs aren’t going anywhere – they’re evolving. Let’s dive into how AI agents are reshaping the API landscape and what this means for developers. ...

October 7, 2025 · 4 min

Future-Proofing Your APIs: A Holistic Approach to Security, Privacy, and ROI.

Presenters Ravinder Singh Source apidays London 2025 Future-Proofing Your APIs: Security, Privacy, and ROI 🚀 Hey everyone! Dr. Ravinder Singh here, from the Cabinet Office Government Commercial Function. Today, we’re diving into how to future-proof your APIs – ensuring they’re secure, private, and profitable. It’s no longer just a technical challenge; APIs are the lifeblood of modern business, and they’re a prime target for attackers. Let’s turn those risks into opportunities! ...

October 7, 2025 · 4 min