azkaban · GitHub Topics

大数据入门指南 ⭐

hadoop hdfs Yarn mapreduce hive Apache Spark storm hbase Scala kafka zookeeper flume azkaban sqoop phoenix bigdata big-data

Java 16.49 k

1 年前

apache / dolphinscheduler

一个分布式易扩展的可视化DAG工作流任务调度系统。致力于解决数据处理流程中错综复杂的依赖关系，使调度系统在数据处理流程中开箱即用

workflow-schedule azkaban airflow task-scheduler job-scheduler cloud-native data-pipelines orchestration workflow workflow-orchestration powerful-data-pipelines

Java 13.58 k

3 天前

wangzhiwubigdata / God-Of-BigData

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

flink Apache Spark hadoop hdfs hive hbase kafka zookeeper bigdata flume azkaban

10.14 k

2 年前

azkaban / azkaban

Azkaban workflow manager.

workflow-engine azkaban scheduling Hacktoberfest

Java 4.5 k

1 年前

WeBankFinTech / DataSphereStudio

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualizati...

workflow governance azkaban davinci linkis Apache Spark hive hadoop visualis zeppelin hue tableau griffin kettle airflow flink dolphinscheduler atlas

Java 3.18 k

2 个月前

DTStack / Taier

Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

distributed-schedule-system dag scheduler job-scheduler workflow-scheduling-system task-schedule cronjob-scheduler flink Apache Spark hive hadoop azkaban

Java 1.25 k

10 个月前

WeBankFinTech / Schedulis

Schedulis is a high performance workflow task scheduling system that supports high availability and multi-tenant financial level features, Linkis computing middleware, and has been integrated into dat...

azkaban workflow linkis scheduler

Java 391

19 天前

233zzh / TitanDataOperationSystem

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkab...

hadoop Apache Spark hive kafka flume azkaban

JavaScript 130

4 年前

cocofree / azkaban_assistant

azkaban小助手,增加任务web配置、远程脚本调用、报警扩展、跨项目依赖等功能。

azkaban

Python 117

8 年前

tlhhup / litemall-dw

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

kafka hbase Vagrant openresty Lua Shell Spring Boot hive Scala flume azkaban Redis flink clickhouse atlas ranger Apache Spark

Java 113

3 年前

mtth / azkaban

Lightweight Azkaban client

azkaban Python

Python 77

5 年前

Wanfengyueluo / BookRecommenderSystem

4 年前

thestyleofme / common-datax

基于DataX的通用数据同步微服务，一个Restful接口搞定所有通用数据同步

datax springboot2 mybatis hive freemarker azkaban Redis dynamic-datasource mybatis-plus

Java 53

3 年前

apache / dolphinscheduler-operator

Apache DolphinScheduler Kubernetes Operator.

airflow azkaban cronjob-schedule distributed-schedule-system etl-dependency job-schedule job-scheduler schedule task-schedule task-scheduler workflow-platform workflow-schedule workflow-scheduling-system

Go 28

1 年前

leoChaoGlut / ambari-azkaban-service

Ambari service for Azkaban

ambari azkaban bigdata big-data

Shell 25

4 年前

Renien / ETL-Starter-Kit

📁 Extract, Transform, Load (ETL) 👷‍♂️ refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL rela...

bigdata datascience datamining etl-framework starter-project Scala pig hive azkaban Gradle

Scala 21

8 年前