Linkis 在上层应用和底层引擎之间构建了一层计算中间件。通过使用Linkis 提供的REST/WebSocket/JDBC 等标准接口，上层应用可以方便地连接访问Spark, Presto, Flink 等底层引擎,同时实现跨引擎上下文共享、统一的计算任务和引擎治理与编排能力
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Jupyter magics and kernels for working with remote Spark clusters
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
Spark on Kubernetes infrastructure Helm charts repo
REST API for Apache Spark on K8S or YARN
A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
Spark on Kubernetes infrastructure Docker images repo
Loan Default Prediction using PySpark, with jobs scheduled by Apache Airflow and Integration with Spark using Apache Livy
Experiments produced during an end of studies project (ETS, H2018)
C# Livy client to submit Spark jobs to HDInsight and other Spark clusters
Experiment to get LIVY+ Apache Spark working on DC/OS + MESOS + Docker
An airflow DAG transformation framework
This is a web-based movie recommendation application written in Scala using Apache Spark and Livy.