Scaled Kubernetes Platforms for Integrated AI
About this session
Every hardware has got his own advantages. Google is providing systems with GPUs and TPUs in their Google Cloud. AWS has got his own AI systems for building LLMs. IBM is providing Spyre Cards and Telum processors for running AI workloads in real-time. That all can be combined with Multi Cluster Management in Kubernetes. Firstly, you are receiving an overview, what will be provided by the different Providers and what is the benefit of the specific hardware. Then there is a small deep dive into how these AI hardware functionalities can be integrated into Kubernetes. Finally, there is an architecture overview about multi cluster management with the goal of a good understanding, how the LLM builds in Google Cloud (as an example) can be used on prem on other Kubernetes cluster hardware. All in all, you are creating a good understanding how you can integrate AI in Kubernetes with the benefit of different platforms.
Speaker
Key takeaways
- AI
- Kubernetes
- TPU/GPU integration