Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Discover insights about your collaboration patterns
We're continuously adding new repositories and metrics to build a more comprehensive picture of open source collaboration. Your contributions help the entire community learn and improve.