Treceți offline cu aplicația Player FM !
Using Airflow To Power Machine Learning Pipelines at Optimove with Vasyl Vasyuta
Manage episode 455155998 series 2948506
Data orchestration and machine learning are shaping how organizations handle massive datasets and drive customer-focused strategies. Tools like Apache Airflow are central to this transformation. In this episode, Vasyl Vasyuta, R&D Team Leader at Optimove, joins us to discuss how his team leverages Airflow to optimize data processing, orchestrate machine learning models and create personalized customer experiences.
Key Takeaways:
(01:59) Optimove tailors marketing notifications with personalized customer journeys.
(04:25) Airflow orchestrates Snowflake procedures for massive datasets.
(05:11) DAGs manage workflows with branching and replay plugins.
(05:41) The "Joystick" plugin enables seamless data replays.
(09:33) Airflow supports MLOps for customer data grouping.
(11:15) Machine learning predicts customer behavior for better campaigns.
(13:20) Thousands of DAGs run every five minutes for data processing.
(15:36) Custom versioning allows rollbacks and gradual rollouts.
(18:00) Airflow logs enhance operational observability.
(23:00) DAG versioning in Airflow 3.0 could boost efficiency.
Resources Mentioned:
https://www.linkedin.com/in/vasyl-vasyuta-3270b54a/
Optimove -
https://www.linkedin.com/company/optimove/
https://airflow.apache.org/
https://www.snowflake.com/
Datadog -
https://www.datadoghq.com/
https://astronomer.typeform.com/airflowsurvey24
Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
42 episoade
Using Airflow To Power Machine Learning Pipelines at Optimove with Vasyl Vasyuta
The Data Flowcast: Mastering Airflow for Data Engineering & AI
Manage episode 455155998 series 2948506
Data orchestration and machine learning are shaping how organizations handle massive datasets and drive customer-focused strategies. Tools like Apache Airflow are central to this transformation. In this episode, Vasyl Vasyuta, R&D Team Leader at Optimove, joins us to discuss how his team leverages Airflow to optimize data processing, orchestrate machine learning models and create personalized customer experiences.
Key Takeaways:
(01:59) Optimove tailors marketing notifications with personalized customer journeys.
(04:25) Airflow orchestrates Snowflake procedures for massive datasets.
(05:11) DAGs manage workflows with branching and replay plugins.
(05:41) The "Joystick" plugin enables seamless data replays.
(09:33) Airflow supports MLOps for customer data grouping.
(11:15) Machine learning predicts customer behavior for better campaigns.
(13:20) Thousands of DAGs run every five minutes for data processing.
(15:36) Custom versioning allows rollbacks and gradual rollouts.
(18:00) Airflow logs enhance operational observability.
(23:00) DAG versioning in Airflow 3.0 could boost efficiency.
Resources Mentioned:
https://www.linkedin.com/in/vasyl-vasyuta-3270b54a/
Optimove -
https://www.linkedin.com/company/optimove/
https://airflow.apache.org/
https://www.snowflake.com/
Datadog -
https://www.datadoghq.com/
https://astronomer.typeform.com/airflowsurvey24
Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
42 episoade
Toate episoadele
×![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Overcoming Airflow Scaling Challenges at Monzo Bank with Jonathan Rainer 43:39
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Orchestrating Analytics and AI Workflows at Telia with Arjun Anandkumar 26:00
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 The Role of Airflow in Finance Transformation at Etraveli Group with Mihir Samant 21:19
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Inside Ford’s Data Transformation: Advanced Orchestration Strategies with Vasantha Kosuri-Marshall 38:54
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Powering Finance With Advanced Data Solutions at Ramp with Ryan Delgado 24:35
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Exploring the Power of Airflow 3 at Astronomer with Amogh Desai 30:24
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Using Airflow To Power Machine Learning Pipelines at Optimove with Vasyl Vasyuta 24:11
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Maximizing Business Impact Through Data at GlossGenius with Katie Bauer 25:49
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Optimizing Large-Scale Deployments at LinkedIn with Rahul Gade 27:47
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 How Uber Manages 1 Million Daily Tasks Using Airflow, with Shobhit Shah and Sumit Maheshwari 28:44
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Building Resilient Data Systems for Modern Enterprises at Astrafy with Andrea Bombino 28:29
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Inside Airflow 3: Redefining Data Engineering with Vikram Koka 30:08
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 Building a Data-Driven HR Platform at 15Five with Guy Dassa 20:25
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 The Intersection of AI and Data Management at Dosu with Devin Stein 20:18
![The Data Flowcast: Mastering Airflow for Data Engineering & AI podcast artwork](/static/images/64pixel.png)
1 AI-Powered Vehicle Automation at Ford Motor Company with Serjesh Sharma 26:11
Bun venit la Player FM!
Player FM scanează web-ul pentru podcast-uri de înaltă calitate pentru a vă putea bucura acum. Este cea mai bună aplicație pentru podcast și funcționează pe Android, iPhone și pe web. Înscrieți-vă pentru a sincroniza abonamentele pe toate dispozitivele.