flume · GitHub Topics

大数据入门指南 ⭐

hadoop hdfs Yarn mapreduce hive Apache Spark storm hbase Scala kafka zookeeper flume azkaban sqoop phoenix bigdata big-data

Java 16.49 k

1 年前

wangzhiwubigdata / God-Of-BigData

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

flink Apache Spark hadoop hdfs hive hbase kafka zookeeper bigdata flume azkaban

10.14 k

2 年前

MoRan1607 / BigDataGuide

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

hadoop zookeeper hive flume kafka hbase Apache Spark flink Scala bigdata Java

Java 2.97 k

10 天前

apache / logging-flume

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

flume Java apache API Library

Java 2.55 k

8 个月前

chrisjpatty / flume

Extract logic from your apps with a user-friendly node editor powered by React.

React flume Node.js JavaScript

TypeScript 1.54 k

3 个月前

OBenner / data-engineering-interview-questions

#面试#More than 2000+ Data engineer interview questions.

data-engineering 面试 hadoop hadoop-hdfs Apache Spark flink SQL kafka hive impala airflow Amazon Web Services Azure Apache Cassandra flume hbase avro nifi 数据结构

1.35 k

5 个月前

sunnyandgood / BigData

💎🔥大数据学习笔记

hadoop hive hbase hdfs zookeeper sqoop mapreduce flume MySQL Linux Shell

Java 682

6 年前

xander-wang / logvision

分布式实时日志分析与入侵检测系统

Apache Spark flume Redis

JavaScript 225

2 个月前

233zzh / TitanDataOperationSystem

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkab...

hadoop Apache Spark hive kafka flume azkaban

JavaScript 130

4 年前

aliyun / aliyun-maxcompute-data-collectors

flume kettle sqoop ogg bigdata

Java 128

1 个月前

wangj1106 / recommendMoteur

电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎

recommendation-engine recommender-system recommendation movies Apache Spark spark-streaming spark-sql flume kafka

Scala 117

7 年前

tlhhup / litemall-dw

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

kafka hbase Vagrant openresty Lua Shell Spring Boot hive Scala flume azkaban Redis flink clickhouse atlas ranger Apache Spark

Java 113

3 年前

soniclavier / bigdata-notebook

#计算机科学#

streaming flink Apache Spark storm bigdata kafka flume 机器学习 hadoop

Scala 105

6 年前

Pushkr / Apache-Spark-Hands-On

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

hive hadoop flume sqoop cloudera Apache Spark bigdata basics cheatsheet

Python 87

6 年前

zdkzdk / aaocp

一个对用户行为日志进行分析的大数据项目

Apache Spark hbase hive hadoop hdfs flume nginx zookeeper echarts

PLpgSQL 72

3 年前

leonlee / flume-ng-mongodb-sink

Flume NG MongoDB source.

flume sink MongoDB

Java 71

2 年前

mrugankray / Big-Data-Cluster

The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center ...

airflow Apache Cassandra flume hadoop hdfs hive hue kafka PostgreSQL pyspark Apache Spark sqoop zeppelin conda-environment Python schema-registry

Shell 64

2 年前