39 subscribers
Treceți offline cu aplicația Player FM !
Podcasturi care merită ascultate
SPONSORIZAT
![All About Change podcast artwork](https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/32.jpg 32w, https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/64.jpg 64w, https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/128.jpg 128w, https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/256.jpg 256w, https://cdn.player.fm/images/28620124/series/tZ0LeQMApl5prDPa/512.jpg 512w)
![All About Change podcast artwork](/static/images/64pixel.png)
1 Joe Bates - Indigenous Resistance Against Big Oil 26:31
The Intersection of AI and Data Management at Dosu with Devin Stein
Manage episode 443500435 series 2053958
Unlocking engineering productivity goes beyond coding — it’s about managing knowledge efficiently. In this episode, we explore the innovative ways in which Dosu leverages Airflow for data orchestration and supports the Airflow project.
Devin Stein, Founder of Dosu, shares his insights on how engineering teams can focus on value-added work by automating knowledge management. Devin dives into Dosu’s purpose, the significance of AI in their product, and why they chose Airflow as the backbone for scheduling and data management.
Key Takeaways:
(01:33) Dosu's mission to democratize engineering knowledge.
(05:00) AI is central to Dosu's product for structuring engineering knowledge.
(06:23) The importance of maintaining up-to-date data for AI effectiveness.
(07:55) How Airflow supports Dosu’s data ingestion and automation processes.
(08:45) The reasoning behind choosing Airflow over other orchestrators.
(11:00) Airflow enables Dosu to manage both traditional ETL and dynamic workflows.
(13:04) Dosu assists the Airflow project by auto-labeling issues and discussions.
(14:56) Thoughtful collaboration with the Airflow community to introduce AI tools.
(16:37) The potential of Airflow to handle more dynamic, scheduled workflows in the future.
(18:00) Challenges and custom solutions for implementing dynamic workflows in Airflow.
Resources Mentioned:
Apache Airflow - https://airflow.apache.org/
Dosu Website - https://dosu.dev/
Thanks for listening to The Data Flowcast: Mastering Airflow for Data Engineering & AI. If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
42 episoade
The Intersection of AI and Data Management at Dosu with Devin Stein
The Data Flowcast: Mastering Airflow for Data Engineering & AI
Manage episode 443500435 series 2053958
Unlocking engineering productivity goes beyond coding — it’s about managing knowledge efficiently. In this episode, we explore the innovative ways in which Dosu leverages Airflow for data orchestration and supports the Airflow project.
Devin Stein, Founder of Dosu, shares his insights on how engineering teams can focus on value-added work by automating knowledge management. Devin dives into Dosu’s purpose, the significance of AI in their product, and why they chose Airflow as the backbone for scheduling and data management.
Key Takeaways:
(01:33) Dosu's mission to democratize engineering knowledge.
(05:00) AI is central to Dosu's product for structuring engineering knowledge.
(06:23) The importance of maintaining up-to-date data for AI effectiveness.
(07:55) How Airflow supports Dosu’s data ingestion and automation processes.
(08:45) The reasoning behind choosing Airflow over other orchestrators.
(11:00) Airflow enables Dosu to manage both traditional ETL and dynamic workflows.
(13:04) Dosu assists the Airflow project by auto-labeling issues and discussions.
(14:56) Thoughtful collaboration with the Airflow community to introduce AI tools.
(16:37) The potential of Airflow to handle more dynamic, scheduled workflows in the future.
(18:00) Challenges and custom solutions for implementing dynamic workflows in Airflow.
Resources Mentioned:
Apache Airflow - https://airflow.apache.org/
Dosu Website - https://dosu.dev/
Thanks for listening to The Data Flowcast: Mastering Airflow for Data Engineering & AI. If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
42 episoade
Toate episoadele
×![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Overcoming Airflow Scaling Challenges at Apollo GraphQL with Jonathan Rainer 43:39
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Orchestrating Analytics and AI Workflows at Telia with Arjun Anandkumar 26:00
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 The Role of Airflow in Finance Transformation at Etraveli Group with Mihir Samant 21:19
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Inside Ford’s Data Transformation: Advanced Orchestration Strategies with Vasantha Kosuri-Marshall 38:54
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Powering Finance With Advanced Data Solutions at Ramp with Ryan Delgado 24:35
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Exploring the Power of Airflow 3 at Astronomer with Amogh Desai 30:24
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Using Airflow To Power Machine Learning Pipelines at Optimove with Vasyl Vasyuta 24:11
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Maximizing Business Impact Through Data at GlossGenius with Katie Bauer 25:49
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Optimizing Large-Scale Deployments at LinkedIn with Rahul Gade 27:47
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 How Uber Manages 1 Million Daily Tasks Using Airflow, with Shobhit Shah and Sumit Maheshwari 28:44
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Building Resilient Data Systems for Modern Enterprises at Astrafy with Andrea Bombino 28:29
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Inside Airflow 3: Redefining Data Engineering with Vikram Koka 30:08
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Building a Data-Driven HR Platform at 15Five with Guy Dassa 20:25
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 The Intersection of AI and Data Management at Dosu with Devin Stein 20:18
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 AI-Powered Vehicle Automation at Ford Motor Company with Serjesh Sharma 26:11
Bun venit la Player FM!
Player FM scanează web-ul pentru podcast-uri de înaltă calitate pentru a vă putea bucura acum. Este cea mai bună aplicație pentru podcast și funcționează pe Android, iPhone și pe web. Înscrieți-vă pentru a sincroniza abonamentele pe toate dispozitivele.