Back to Schedule

Sharing is Caring: How We Thought We Solved the GPU Investment Puzzle

Marc Herren

16:00 - 16:45

Pavillon

Lessons from a bank’s journey to eliminate GPU silos—without compromising data privacy or performance. GPUs are the lifeblood of AI/ML workloads, but equipping every Kubernetes cluster with these costly resources is unsustainable (hello, budgets!). Enter Liqo, the open-source Kubernetes orchestrator that lets us share GPUs across clusters. In this session, I’ll share how we built an HPC-like cluster with GPUs and explored sharing them across different k8s clusters while maintaining security and compliance—and what we learned when we hit a technical wall that forced us to pivot to another solution.