#计算机科学#Apache Airflow 是一个workflow工作流调度、编排、监控平台
Airbyte 开源 EL(T) 平台，帮助用户将数据从应用程序，API 和数据库中同步到数据仓库
Doris 是百度开源的支持对海量大数据进行快速分析的MPP数据库。
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
SeaTunnel （原名为 waterdrop）是一个易用的支持海量数据实时同步的高性能分布式数据集成平台，每天可以稳定同步数百亿数据
#计算机科学#🧙 Build, run, and manage data pipelines for integrating and transforming data.
Flink CDC Connector 是ApacheFlink的一组数据源连接器
Privacy and Security focused Segment-alternative, in Golang and React
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
#计算机科学#Maestro: Netflix’s Workflow Orchestrator
Scalable and efficient data transformation framework - backwards compatible with dbt.
#大语言模型#A system for agentic LLM-powered data processing and ETL
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Dataform is a framework for managing SQL based data operations in BigQuery
Fastest open-source tool for replicating Databases to Data Lake in Open Table Formats like Apache Iceberg. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supporting Postgres,...
#网络爬虫#Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as ...
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift, Databricks) in real-time.