Loading…
PAPIs Latam 2019 has ended
Back To Schedule
Tuesday, June 25 • 14:00 - 14:20
K8s-workqueue: Simplified Kubernetes ML Batch Jobs

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Managing batch ML jobs is a central competency for Data Science (DS) teams in the ad tech space. According to PWC research, digital ad spend has increased by 23% to $50 Billion in the first half of 2018. To deal with this growth, DS teams need flexible tools.
We present our k8s-workqueue system. A pluggable scheduling mechanism for ML Kubernetes workloads where tens of thousands of models are built every day on our platform. The focus on simplicity, led us to the design of this system that combines familiar features of traditional cron jobs and containers, with the power of the Kubernetes API.

Speakers
avatar for Chinmay Nerurkar

Chinmay Nerurkar

Senior Software Engineer II, Team Lead, Xandr Inc.


Tuesday June 25, 2019 14:00 - 14:20 -03
Room 9 Av. Rebouças, 3970 - Pinheiros, São Paulo - SP, 05402-600, Brazil