Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

😎 Awesome lists about all kinds of interesting topics

Project to track the distributed development stack (DDS).

The library for web and native user interfaces.