hudi · GitHub Topics

Doris 是百度开源的支持对海量大数据进行快速分析的MPP数据库。

olap 数据库 hadoop hive hudi iceberg real-time SQL BigQuery dbt delta-lake elt etl lakehouse query-engine redshift snowflake Apache Spark

Java 13.81 k

1 天前

StarRocks / starrocks

StarRocks 是新一代极速全场景 MPP (Massively Parallel Processing) 数据库。StarRocks 的愿景是能够让用户的数据分析变得更加简单和敏捷。用户无需经过复杂的预处理，就可以用 StarRocks 来支持多种数据分析场景的极速分析。

Java 10.13 k

1 天前

apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.

hudi apachehudi datalake bigdata apachespark incremental-processing stream-processing data-integration apacheflink

Java 5.84 k

2 天前

alldatacenter / alldata

🔥🔥 AllData可定义数据中台，以数据平台为底座，以数据中台为桥梁，以机器学习平台为工厂，以大模型应用为上游产品，提供全链路数字化解决方案。采购商业版、加入技术社区：https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo

griffin hudi iceberg paimon datart dinky streampark cube-studio datasophon cloudeon dolphinscheduler datahub datavines openmetadata alldata

Java 2.76 k

25 天前

collabH / bigdata-growth

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

flink kafka hive mapreduce Apache Spark olap hadoop hbase debezium hdfs bigdata hudi

Shell 1.63 k

1 个月前

Mrkuhuo / data-warehouse-learning

【2025最新版】大数据数据分析电商系统实时数仓离线数仓数据湖建设方案及实战代码，涉及组件 #flink #paimon #doris #seatunnel #dolphinscheduler #datart #dinky #hudi #iceberg。

datart dinky dolphinscheduler doris flink hudi iceberg paimon seatunnel

Java 864

8 天前

leesf / hudi-resources

汇总Apache Hudi相关资料

hudi apachehudi apache datalake bigdata stream-processing incremental-processing data-integration

553

7 天前

fancyChuan / bigdata-hub

数据建设与大数据技术知识体系，包含hadoop、hive、spark、flink主流框架和系列框架，数据中台、数据湖、数据治理、数仓建设、数据化转型等

bigdata hadoop Apache Spark flink hive hudi kafka clickhouse seatunnel

Java 401

3 个月前

apache / hudi-rs

The native Rust implementation for Apache Hudi, with C++ & Python API bindings.

apache hudi Python Rust C++

Rust 223

5 天前

izhangzhihao / Real-time-Data-Warehouse

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

flink data-warehouse data-warehousing flink-sql debezium kafka elasticsearch delta-lake cdc change-data-capture hudi iceberg SQL datalake delta deltalake Apache Spark spark-sql

Dockerfile 113

2 年前

WeBankFinTech / Streamis

Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.

flink linkis streaming hudi iceberg datalake kafka deltalake

Java 107

2 个月前

apache / doris-website

Apache Doris Website

doris analytics apache big-data data-warehousing 数据库 datalake dbms distributed-system hadoop hive hudi iceberg mpp olap ssb vectorized

TypeScript 99

4 天前

leesf / hudi-demos

汇总Apache Hudi中的一些Demo，便于快速上手Apache Hudi(Apache Hudi Demos to help beginners know about Hudi)

hudi apachehudi

Java 74

5 年前

1ambda / lakehouse

Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)

flink hudi iceberg Apache Spark trino dbt Docker airflow cdc debezium kafka

Kotlin 58

2 年前

Mrkuhuo / bigdata_learning

大数据组件学习代码

flink hadoop Java Python Apache Spark clickhouse datax dolphinscheduler doris elasticsearch hbase hive hudi iceberg sqoop

Java 57

1 年前

dacort / modern-data-lake-storage-layers

Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work

Amazon Web Services hudi iceberg apache-hudi apache-iceberg delta-lake

Jupyter Notebook 47

3 年前

apache / doris-thirdparty

Self-managed thirdparty dependencies for Apache Doris

analytics big-data data-warehousing 数据库 datalake dbms distributed-database hadoop hive hudi iceberg mpp olap real-time SQL ssb vectorized

18 天前

jaehyeon-kim / dbt-on-aws

dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats

athena dbt delta-lake emr glue hudi iceberg redshift

HCL 29

2 年前

apache / doris-streamloader

Stream Loader for Apache Doris

BigQuery 数据库 dbt delta-lake elt etl hadoop hive hudi iceberg lakehouse olap query-engine real-time redshift snowflake Apache Spark SQL

Go 24

2 个月前

shangyuantech / hudi-multistream

Consumption and writing to Hudi based on multiple topic

hudi

Java 8

5 年前