Treceți offline cu aplicația Player FM !
Podcasturi care merită ascultate
SPONSORIZAT
![All About Change podcast artwork](https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/32.jpg 32w, https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/64.jpg 64w, https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/128.jpg 128w, https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/256.jpg 256w, https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/512.jpg 512w)
![All About Change podcast artwork](/static/images/64pixel.png)
1 Joe Bates - Indigenous Resistance Against Big Oil 26:31
Inside Ford’s Data Transformation: Advanced Orchestration Strategies with Vasantha Kosuri-Marshall
Manage episode 461360304 series 2948506
Data engineering is entering a new era, where orchestration and automation are redefining how large-scale projects operate. This episode features Vasantha Kosuri-Marshall, Data and ML Ops Engineer at Ford Motor Company. Vasantha shares her expertise in managing complex data pipelines. She takes us through Ford's transition to cloud platforms, the adoption of Airflow and the intricate challenges of orchestrating data in a diverse environment.
Key Takeaways:
(03:10) Vasantha’s transition to the Advanced Driving Assist Systems team at Ford.
(05:42) Early adoption of Airflow to orchestrate complex data pipelines.
(09:29) Ford's move from on-premise data solutions to Google Cloud Platform.
(12:03) The importance of Airflow's scheduling capabilities for efficient data management.
(16:12) Using Kubernetes to scale Airflow for large-scale data processing.
(19:59) Vasantha’s experience in overcoming challenges with legacy orchestration tools.
(22:22) Integration of data engineering and data science pipelines at Ford.
(28:03) How deferrable operators in Airflow improve performance and save costs.
(32:12) Vasantha’s insights into tuning Airflow properties for thousands of DAGs.
(36:09) The significance of monitoring and observability in managing Airflow instances.
Resources Mentioned:
https://www.linkedin.com/in/vasantha-kosuri-marshall-0b0aab188/
https://airflow.apache.org/
https://cloud.google.com/
Ford Motor Company | LinkedIn -
https://www.linkedin.com/company/ford-motor-company/
Ford Motor Company | Website -
https://www.ford.com/
https://www.astronomer.io/
Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
42 episoade
Inside Ford’s Data Transformation: Advanced Orchestration Strategies with Vasantha Kosuri-Marshall
The Data Flowcast: Mastering Airflow for Data Engineering & AI
Manage episode 461360304 series 2948506
Data engineering is entering a new era, where orchestration and automation are redefining how large-scale projects operate. This episode features Vasantha Kosuri-Marshall, Data and ML Ops Engineer at Ford Motor Company. Vasantha shares her expertise in managing complex data pipelines. She takes us through Ford's transition to cloud platforms, the adoption of Airflow and the intricate challenges of orchestrating data in a diverse environment.
Key Takeaways:
(03:10) Vasantha’s transition to the Advanced Driving Assist Systems team at Ford.
(05:42) Early adoption of Airflow to orchestrate complex data pipelines.
(09:29) Ford's move from on-premise data solutions to Google Cloud Platform.
(12:03) The importance of Airflow's scheduling capabilities for efficient data management.
(16:12) Using Kubernetes to scale Airflow for large-scale data processing.
(19:59) Vasantha’s experience in overcoming challenges with legacy orchestration tools.
(22:22) Integration of data engineering and data science pipelines at Ford.
(28:03) How deferrable operators in Airflow improve performance and save costs.
(32:12) Vasantha’s insights into tuning Airflow properties for thousands of DAGs.
(36:09) The significance of monitoring and observability in managing Airflow instances.
Resources Mentioned:
https://www.linkedin.com/in/vasantha-kosuri-marshall-0b0aab188/
https://airflow.apache.org/
https://cloud.google.com/
Ford Motor Company | LinkedIn -
https://www.linkedin.com/company/ford-motor-company/
Ford Motor Company | Website -
https://www.ford.com/
https://www.astronomer.io/
Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
42 episoade
Toate episoadele
×![Artwork](/static/images/128pixel.png)
1 Overcoming Airflow Scaling Challenges at Monzo Bank with Jonathan Rainer 43:39
![Artwork](/static/images/128pixel.png)
1 Orchestrating Analytics and AI Workflows at Telia with Arjun Anandkumar 26:00
![Artwork](/static/images/128pixel.png)
1 The Role of Airflow in Finance Transformation at Etraveli Group with Mihir Samant 21:19
![Artwork](/static/images/128pixel.png)
1 Inside Ford’s Data Transformation: Advanced Orchestration Strategies with Vasantha Kosuri-Marshall 38:54
![Artwork](/static/images/128pixel.png)
1 Powering Finance With Advanced Data Solutions at Ramp with Ryan Delgado 24:35
![Artwork](/static/images/128pixel.png)
1 Exploring the Power of Airflow 3 at Astronomer with Amogh Desai 30:24
![Artwork](/static/images/128pixel.png)
1 Using Airflow To Power Machine Learning Pipelines at Optimove with Vasyl Vasyuta 24:11
![Artwork](/static/images/128pixel.png)
1 Maximizing Business Impact Through Data at GlossGenius with Katie Bauer 25:49
![Artwork](/static/images/128pixel.png)
1 Optimizing Large-Scale Deployments at LinkedIn with Rahul Gade 27:47
![Artwork](/static/images/128pixel.png)
1 How Uber Manages 1 Million Daily Tasks Using Airflow, with Shobhit Shah and Sumit Maheshwari 28:44
![Artwork](/static/images/128pixel.png)
1 Building Resilient Data Systems for Modern Enterprises at Astrafy with Andrea Bombino 28:29
![Artwork](/static/images/128pixel.png)
1 Inside Airflow 3: Redefining Data Engineering with Vikram Koka 30:08
![Artwork](/static/images/128pixel.png)
1 Building a Data-Driven HR Platform at 15Five with Guy Dassa 20:25
![Artwork](/static/images/128pixel.png)
1 The Intersection of AI and Data Management at Dosu with Devin Stein 20:18
![Artwork](/static/images/128pixel.png)
1 AI-Powered Vehicle Automation at Ford Motor Company with Serjesh Sharma 26:11
Bun venit la Player FM!
Player FM scanează web-ul pentru podcast-uri de înaltă calitate pentru a vă putea bucura acum. Este cea mai bună aplicație pentru podcast și funcționează pe Android, iPhone și pe web. Înscrieți-vă pentru a sincroniza abonamentele pe toate dispozitivele.