Running Ray on Kubernetes with KubeRay

Kubernetes Bytes

Content provided by Kubernetes Bytes, Ryan Wallner, and Bhavin Shah. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Kubernetes Bytes, Ryan Wallner, and Bhavin Shah or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ro.player.fm/legal.

1+ y ago 53:06

MP3•Pagina episodului

Fetch error

Hmmm there seems to be a problem fetching this series right now. Last successful fetch was on March 03, 2025 17:11 (9M ago)

What now? This series will be checked again in the next day. If you believe it should be working, please verify the publisher's feed link below is valid and includes actual episode links. You can contact support to request the feed be immediately fetched.

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand.

Check out our website at https://kubernetesbytes.com/

Cloud Native News:

https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito
https://orca.security/resources/blog/kubernetes-testing-environment/
https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available

Show links:

Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/
KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html
Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15)
KubeRay repository: https://github.com/ray-project/kuberay
Ray repository: https://github.com/ray-project/ray
Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform

Timestamps:

00:02:40 Cloud Native News
00:07:20 Interview with Kai
00:49:15 Key takeaways

88 episoade

#Tech #Bhavin Shah #Ryan Wallner #Kubernetes Bytes #Kuberentes #Cloud IT #CONTAIN #Cloud Native #Software