Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and modular
#计算机科学#Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
A web frontend for scheduling Jupyter notebook reports
#计算机科学#Content for architecting a data science platform for products using Luigi, Spark & Flask.
#自然语言处理#An NLP framework for clinical phenotyping. Docker | Python | Solr | OMOP. http://claritynlp.readthedocs.io/en/latest/
A luigi powered analytics / warehouse stack
🐍 🐳 Luigi in Docker - alpine and ubuntu images available
Luigi pipeline to download VoxCeleb(2) audio from YouTube and extract speaker segments
Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.
#计算机科学#Migrated to: https://gitlab.com/Oslandia/osm-data-classification
#计算机科学#Automated ML pipeline with Python, Docker, Luigi, SciKit-Learn and Pandas to predict wine quality ratings
This is an editor for the new 3DS release of Mario and Luigi Superstar Saga.
A simple project to analyse Malaysian airports - an opportunity to play with tools like Luigi, Docker, and Metabase as part of an end-to-end analytics framework.
Материалы для курса Введение в Data Engineering: дата пайплайны