Loading…
PAPIs Latam 2019 has ended
Back To Schedule
Tuesday, June 25 • 14:30 - 14:50
Airflow on Kubernetes: a modern approach to ETL workflows.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
ETL workflows are no different from standard software. They should be implemented as code, with automated tests and continuous delivery. It should also be easy to understand, scale, debug, modify and monitor. Apache Airflow provides a framework for designing workflows as Python scripts, along with centralized logs, tasks status, metrics and a graph view. All these great features come at the price of a steep learning curve and a nasty mix of orchestration bugs and task bugs due to the variety of operators. I'll show how to use only one operator for any ETL workflow and solve that problem.
Speakers
avatar for Raphael Sampaio

Raphael Sampaio

Engineer, Konduto
Engineer at Konduto, a Brazilian company using Machine Learning for fraud detection. Our algorithm combines geographical, social and behavioral features to deliver an accurate risk measure, increasing customers profit margins while keeping fraud rates under control.

Tuesday June 25, 2019 14:30 - 14:50 GMT-03
Room 9 Av. Rebouças, 3970 - Pinheiros, São Paulo - SP, 05402-600, Brazil
  Engineering

Attendees (106)