Artwork

Content provided by The Data Flowcast. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by The Data Flowcast or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ro.player.fm/legal.
Player FM - Aplicație Podcast
Treceți offline cu aplicația Player FM !

Using Airflow To Power Machine Learning Pipelines at Optimove with Vasyl Vasyuta

24:11
 
Distribuie
 

Manage episode 455155998 series 2948506
Content provided by The Data Flowcast. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by The Data Flowcast or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ro.player.fm/legal.

Data orchestration and machine learning are shaping how organizations handle massive datasets and drive customer-focused strategies. Tools like Apache Airflow are central to this transformation. In this episode, Vasyl Vasyuta, R&D Team Leader at Optimove, joins us to discuss how his team leverages Airflow to optimize data processing, orchestrate machine learning models and create personalized customer experiences.

Key Takeaways:

(01:59) Optimove tailors marketing notifications with personalized customer journeys.

(04:25) Airflow orchestrates Snowflake procedures for massive datasets.

(05:11) DAGs manage workflows with branching and replay plugins.

(05:41) The "Joystick" plugin enables seamless data replays.

(09:33) Airflow supports MLOps for customer data grouping.

(11:15) Machine learning predicts customer behavior for better campaigns.

(13:20) Thousands of DAGs run every five minutes for data processing.

(15:36) Custom versioning allows rollbacks and gradual rollouts.

(18:00) Airflow logs enhance operational observability.

(23:00) DAG versioning in Airflow 3.0 could boost efficiency.

Resources Mentioned:

Vasyl Vasyuta -

https://www.linkedin.com/in/vasyl-vasyuta-3270b54a/

Optimove -

https://www.linkedin.com/company/optimove/

Apache Airflow -

https://airflow.apache.org/

Snowflake -

https://www.snowflake.com/

Datadog -

https://www.datadoghq.com/

Apache Airflow Survey -

https://astronomer.typeform.com/airflowsurvey24

Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.

#AI #Automation #Airflow #MachineLearning

  continue reading

42 episoade

Artwork
iconDistribuie
 
Manage episode 455155998 series 2948506
Content provided by The Data Flowcast. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by The Data Flowcast or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ro.player.fm/legal.

Data orchestration and machine learning are shaping how organizations handle massive datasets and drive customer-focused strategies. Tools like Apache Airflow are central to this transformation. In this episode, Vasyl Vasyuta, R&D Team Leader at Optimove, joins us to discuss how his team leverages Airflow to optimize data processing, orchestrate machine learning models and create personalized customer experiences.

Key Takeaways:

(01:59) Optimove tailors marketing notifications with personalized customer journeys.

(04:25) Airflow orchestrates Snowflake procedures for massive datasets.

(05:11) DAGs manage workflows with branching and replay plugins.

(05:41) The "Joystick" plugin enables seamless data replays.

(09:33) Airflow supports MLOps for customer data grouping.

(11:15) Machine learning predicts customer behavior for better campaigns.

(13:20) Thousands of DAGs run every five minutes for data processing.

(15:36) Custom versioning allows rollbacks and gradual rollouts.

(18:00) Airflow logs enhance operational observability.

(23:00) DAG versioning in Airflow 3.0 could boost efficiency.

Resources Mentioned:

Vasyl Vasyuta -

https://www.linkedin.com/in/vasyl-vasyuta-3270b54a/

Optimove -

https://www.linkedin.com/company/optimove/

Apache Airflow -

https://airflow.apache.org/

Snowflake -

https://www.snowflake.com/

Datadog -

https://www.datadoghq.com/

Apache Airflow Survey -

https://astronomer.typeform.com/airflowsurvey24

Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.

#AI #Automation #Airflow #MachineLearning

  continue reading

42 episoade

Toate episoadele

×
 
Loading …

Bun venit la Player FM!

Player FM scanează web-ul pentru podcast-uri de înaltă calitate pentru a vă putea bucura acum. Este cea mai bună aplicație pentru podcast și funcționează pe Android, iPhone și pe web. Înscrieți-vă pentru a sincroniza abonamentele pe toate dispozitivele.

 

Ghid rapid de referință

Listen to this show while you explore
Play