How to Use Apache Spark to Craft a Multi-Year Data Regression Testing and Simulations Framework

Presenters Vivek Yadav Source InfoQ podcast Stripe’s Secret Weapon: How Apache Spark Fuels Bulletproof Payment Systems 🚀 Ever wondered how companies like Stripe, which handle a mind-boggling amount of financial transactions every second, ensure their systems are absolutely rock-solid? It’s not just about clever coding; it’s about innovative testing strategies that go above and beyond. In a recent illuminating presentation, Vivek Yadav, an Engineering Manager at Stripe, pulled back the curtain on a rather unconventional yet incredibly effective use of Apache Spark – not for its usual analytical wizardry, but for something far more critical: large-scale regression testing and “what-if” scenario analysis for their core payment systems. Prepare to be amazed as we dive into how Stripe is leveraging this powerful tool to achieve unparalleled system integrity. ...

November 26, 2025 · 6 min