How Quantopian rearchitected brittle crontabs into resilient pipelines with Apache Airflow



How Quantopian rearchitected brittle crontabs into resilient pipelines with Apache Airflow

How Quantopian rearchitected brittle crontabs into resilient pipelines with Apache Airflow


Video description

Quantopian integrates financial data from vendors around the globe. As the scope of its operations outgrew cron, the company turned to Apache Airflow, a distributed scheduler and task executor. James Meickle explains how in less than six months, Quantopian was able to rearchitect brittle crontabs into resilient, recoverable pipelines defined in code to which anyone could contribute. …


Start your Free Trial

Self paced

Go to the Course
We have partnered with providers to bring you collection of courses, When you buy through links on our site, we may earn an affiliate commission from provider.