streaming-data-pipelines · GitHub Topics

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

cloud-native streaming Rust real-time Serverless stateful stream-processing WebAssembly data-integration data-flow distributed-systems event-driven-architecture stream-processing-engine data-pipelines streaming-data streaming-data-pipelines streaming-data-processing data-analytics streaming-analytics

Rust 4.94 k

6 天前

quixio / quix-streams

#计算机科学#Python Streaming DataFrames for Kafka

kafka Python stream-processing data-engineering 数据科学机器学习 streaming-data streaming-data-pipelines streaming-data-processing event-driven-architecture stream-processor

Python 1.39 k

3 天前

swimos / swim-rust

Self-contained distributed software platform for building stateful, massively real-time streaming applications in Rust.

actor-model async decentralized-applications distributed-systems real-time Rust stateful Web data-integration 框架 kafka stream-processing streaming streaming-data-pipelines Serverless

Rust 340

4 个月前

confluentinc / demo-change-data-capture

This demo shows how to capture data changes from relational databases (Oracle and PostgreSQL) and stream them to Confluent Cloud, use ksqlDB for real-time stream processing, send enriched data to clou...

Amazon Web Services connectors 数据库 ksqldb Oracle 数据库 PostgreSQL redshift snowflake streaming-data-pipelines cdc change-data-capture

HCL 15

5 个月前

confluentinc / demo-database-modernization

This demo shows how to stream data to cloud databases with Confluent. It includes fully-managed connectors (Oracle CDC, RabbitMQ, MongoDB Atlas), ksqlDB/Flink SQL as stream processing engine.

Amazon Web Services connect 数据库 ksqldb Terraform mongodb-atlas Oracle 数据库 rabbitmq streaming-data-pipelines flink-sql

HCL 10

5 个月前

confluentinc / demo-realtime-data-warehousing

Streaming data pipelines for real-time data warehousing. Includes fully managed connectors (PostgreSQL CDC, Snowflake).

connect data-warehousing ksqldb streaming-data-pipelines databricks PostgreSQL snowflake

HCL 6

5 个月前