Artwork

Content provided by The Data Flowcast. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by The Data Flowcast or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ro.player.fm/legal.
Player FM - Aplicație Podcast
Treceți offline cu aplicația Player FM !
icon Daily Deals

The Intersection of AI and Data Management at Dosu with Devin Stein

20:18
 
Distribuie
 

Manage episode 443500435 series 2053958
Content provided by The Data Flowcast. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by The Data Flowcast or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ro.player.fm/legal.

Unlocking engineering productivity goes beyond coding — it’s about managing knowledge efficiently. In this episode, we explore the innovative ways in which Dosu leverages Airflow for data orchestration and supports the Airflow project.

Devin Stein, Founder of Dosu, shares his insights on how engineering teams can focus on value-added work by automating knowledge management. Devin dives into Dosu’s purpose, the significance of AI in their product, and why they chose Airflow as the backbone for scheduling and data management.

Key Takeaways:

(01:33) Dosu's mission to democratize engineering knowledge.

(05:00) AI is central to Dosu's product for structuring engineering knowledge.

(06:23) The importance of maintaining up-to-date data for AI effectiveness.

(07:55) How Airflow supports Dosu’s data ingestion and automation processes.

(08:45) The reasoning behind choosing Airflow over other orchestrators.

(11:00) Airflow enables Dosu to manage both traditional ETL and dynamic workflows.

(13:04) Dosu assists the Airflow project by auto-labeling issues and discussions.

(14:56) Thoughtful collaboration with the Airflow community to introduce AI tools.

(16:37) The potential of Airflow to handle more dynamic, scheduled workflows in the future.

(18:00) Challenges and custom solutions for implementing dynamic workflows in Airflow.

Resources Mentioned:

Apache Airflow - https://airflow.apache.org/

Dosu Website - https://dosu.dev/

Thanks for listening to The Data Flowcast: Mastering Airflow for Data Engineering & AI. If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.

#AI #Automation #Airflow #MachineLearning

  continue reading

42 episoade

Artwork
iconDistribuie
 
Manage episode 443500435 series 2053958
Content provided by The Data Flowcast. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by The Data Flowcast or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ro.player.fm/legal.

Unlocking engineering productivity goes beyond coding — it’s about managing knowledge efficiently. In this episode, we explore the innovative ways in which Dosu leverages Airflow for data orchestration and supports the Airflow project.

Devin Stein, Founder of Dosu, shares his insights on how engineering teams can focus on value-added work by automating knowledge management. Devin dives into Dosu’s purpose, the significance of AI in their product, and why they chose Airflow as the backbone for scheduling and data management.

Key Takeaways:

(01:33) Dosu's mission to democratize engineering knowledge.

(05:00) AI is central to Dosu's product for structuring engineering knowledge.

(06:23) The importance of maintaining up-to-date data for AI effectiveness.

(07:55) How Airflow supports Dosu’s data ingestion and automation processes.

(08:45) The reasoning behind choosing Airflow over other orchestrators.

(11:00) Airflow enables Dosu to manage both traditional ETL and dynamic workflows.

(13:04) Dosu assists the Airflow project by auto-labeling issues and discussions.

(14:56) Thoughtful collaboration with the Airflow community to introduce AI tools.

(16:37) The potential of Airflow to handle more dynamic, scheduled workflows in the future.

(18:00) Challenges and custom solutions for implementing dynamic workflows in Airflow.

Resources Mentioned:

Apache Airflow - https://airflow.apache.org/

Dosu Website - https://dosu.dev/

Thanks for listening to The Data Flowcast: Mastering Airflow for Data Engineering & AI. If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.

#AI #Automation #Airflow #MachineLearning

  continue reading

42 episoade

Toate episoadele

×
 
Loading …

Bun venit la Player FM!

Player FM scanează web-ul pentru podcast-uri de înaltă calitate pentru a vă putea bucura acum. Este cea mai bună aplicație pentru podcast și funcționează pe Android, iPhone și pe web. Înscrieți-vă pentru a sincroniza abonamentele pe toate dispozitivele.

 

icon Daily Deals

Ghid rapid de referință

Listen to this show while you explore
Play