brainstate

spotify/luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

Python★ 18.8kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. apache/hadoop

    Apache Hadoop

    Java★ 15.7kApache-2.0GitHub ↗

    Why this match

    topics hadoop; language differs: Python → Java

  2. agronholm/apscheduler

    Task scheduling library for Python

    Python★ 7.7kMITGitHub ↗

    Why this match

    topics python, scheduling; license differs: Apache-2.0 → MIT

  3. linkedin/school-of-sre

    At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

    HTML★ 8.2kGitHub ↗

    Why this match

    topics hadoop, python; language differs: Python → HTML

  4. Tonejs/Tone.js

    A Web Audio framework for making interactive music in the browser.

    TypeScript★ 14.9kMITGitHub ↗

    Why this match

    topics scheduling; language differs: Python → TypeScript; license differs: Apache-2.0 → MIT

  5. pyenv/pyenv

    Simple Python version management

    Shell★ 45.2kMITGitHub ↗

    Why this match

    topics python; language differs: Python → Shell; license differs: Apache-2.0 → MIT

  6. deeplearning4j/deeplearning4j

    Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...

    Java★ 14.3kApache-2.0GitHub ↗

    Why this match

    topics hadoop, python; language differs: Python → Java

  7. prestodb/presto

    The official home of the Presto distributed SQL query engine for big data

    Java★ 16.8kApache-2.0GitHub ↗

    Why this match

    topics hadoop; language differs: Python → Java

  8. donnemartin/data-science-ipython-notebooks

    Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

    Python★ 29.4kGitHub ↗

    Why this match

    topics hadoop, python