hudi · GitHub Topics

Doris 是百度开源的支持对海量大数据进行快速分析的MPP数据库。

olap 数据库 hudi iceberg real-time SQL BigQuery dbt delta-lake elt lakehouse query-engine redshift snowflake Apache Spark agent 人工智能 paimon

Java 14.27 k

1 小时前

StarRocks / starrocks

StarRocks 是新一代极速全场景 MPP (Massively Parallel Processing) 数据库。StarRocks 的愿景是能够让用户的数据分析变得更加简单和敏捷。用户无需经过复杂的预处理，就可以用 StarRocks 来支持多种数据分析场景的极速分析。

Java 10.66 k

6 小时前

apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.

hudi apachehudi datalake bigdata apachespark incremental-processing stream-processing data-integration apacheflink

Java 5.94 k

2 天前

collabH / bigdata-growth

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

flink kafka hive mapreduce Apache Spark olap hadoop hbase debezium hdfs bigdata hudi

Shell 1.67 k

1 个月前

apache / amoro

Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.

big-data data-lake flink hudi iceberg management-system paimon Apache Spark trino

Java 1.05 k

4 天前

Mrkuhuo / data-warehouse-learning

【2025最新版】大数据数据分析电商系统实时数仓离线数仓数据湖建设方案及实战代码，涉及组件 #flink #paimon #doris #seatunnel #dolphinscheduler #datart #dinky #hudi #iceberg。

datart dinky dolphinscheduler doris flink hudi iceberg paimon seatunnel

Java 955

9 天前

leesf / hudi-resources

汇总Apache Hudi相关资料

hudi apachehudi apache datalake bigdata stream-processing incremental-processing data-integration

558

22 天前

fancyChuan / bigdata-hub

数据建设与大数据技术知识体系，包含hadoop、hive、spark、flink主流框架和系列框架，数据中台、数据湖、数据治理、数仓建设、数据化转型等

bigdata hadoop Apache Spark flink hive hudi kafka clickhouse seatunnel

Java 423

1 个月前

apache / hudi-rs

The native Rust implementation for Apache Hudi, with C++ & Python API bindings.

apache hudi Python Rust C++

Rust 251

7 天前

izhangzhihao / Real-time-Data-Warehouse

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

flink data-warehouse data-warehousing flink-sql debezium kafka elasticsearch delta-lake cdc change-data-capture hudi iceberg SQL datalake delta deltalake Apache Spark spark-sql

Dockerfile 117

2 年前

WeBankFinTech / Streamis

Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.

flink linkis streaming hudi iceberg datalake kafka deltalake

Java 109

5 个月前

apache / doris-website

Apache Doris Website

doris analytics apache big-data data-warehousing 数据库 datalake dbms distributed-system hadoop hive hudi iceberg mpp olap ssb vectorized

MDX 105

15 小时前

leesf / hudi-demos

汇总Apache Hudi中的一些Demo，便于快速上手Apache Hudi(Apache Hudi Demos to help beginners know about Hudi)

hudi apachehudi

Java 75

5 年前

Mrkuhuo / bigdata_learning

大数据组件学习代码

flink hadoop Java Python Apache Spark clickhouse datax dolphinscheduler doris elasticsearch hbase hive hudi iceberg sqoop

Java 62

1 年前

1ambda / lakehouse

Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)

flink hudi iceberg Apache Spark trino dbt Docker airflow cdc debezium kafka

Kotlin 60

2 年前

dacort / modern-data-lake-storage-layers

Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work

Amazon Web Services hudi iceberg apache-hudi apache-iceberg delta-lake

Jupyter Notebook 47

3 年前

apache / doris-thirdparty

Self-managed thirdparty dependencies for Apache Doris

analytics big-data data-warehousing 数据库 datalake dbms distributed-database hadoop hive hudi iceberg mpp olap real-time SQL ssb vectorized

2 天前

jaehyeon-kim / dbt-on-aws

dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats

athena dbt delta-lake emr glue hudi iceberg redshift

HCL 30

2 年前

apache / doris-streamloader

Stream Loader for Apache Doris

BigQuery 数据库 dbt delta-lake elt etl hadoop hive hudi iceberg lakehouse olap query-engine real-time redshift snowflake Apache Spark SQL

Go 29

5 个月前

shangyuantech / hudi-multistream

Consumption and writing to Hudi based on multiple topic

hudi

Java 8

5 年前