streaming-data-pipelines · GitHub Topics

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

cloud-native streaming Rust real-time Serverless stateful stream-processing WebAssembly data-integration data-flow distributed-systems event-driven-architecture stream-processing-engine data-pipelines streaming-data streaming-data-pipelines streaming-data-processing data-analytics streaming-analytics

Rust 4.97 k

10 天前

quixio / quix-streams

#计算机科学#Python Streaming DataFrames for Kafka

kafka Python stream-processing data-engineering 数据科学机器学习 streaming-data streaming-data-pipelines streaming-data-processing event-driven-architecture stream-processor

Python 1.41 k

3 天前

graphform / swim-rust

Self-contained distributed software platform for building stateful, massively real-time streaming applications in Rust.

actor-model async decentralized-applications distributed-systems real-time Rust stateful Web data-integration 框架 kafka stream-processing streaming streaming-data-pipelines Serverless

Rust 347

1 个月前

confluentinc / demo-change-data-capture

This demo shows how to capture data changes from relational databases (Oracle and PostgreSQL) and stream them to Confluent Cloud, use ksqlDB for real-time stream processing, send enriched data to clou...

Amazon Web Services connectors 数据库 ksqldb Oracle 数据库 PostgreSQL redshift snowflake streaming-data-pipelines cdc change-data-capture

HCL 16

7 个月前

confluentinc / demo-database-modernization

This demo shows how to stream data to cloud databases with Confluent. It includes fully-managed connectors (Oracle CDC, RabbitMQ, MongoDB Atlas), ksqlDB/Flink SQL as stream processing engine.

Amazon Web Services connect 数据库 ksqldb Terraform mongodb-atlas Oracle 数据库 rabbitmq streaming-data-pipelines flink-sql

HCL 10

7 个月前

confluentinc / demo-realtime-data-warehousing

Streaming data pipelines for real-time data warehousing. Includes fully managed connectors (PostgreSQL CDC, Snowflake).

connect data-warehousing ksqldb streaming-data-pipelines databricks PostgreSQL snowflake

HCL 7

7 个月前

fgrzl / streams

A basic streaming data store

event-store event-stream streaming streaming-data-pipelines

Go 0

10 天前

rajesh1804 / RideCastAI2.0

Built a production-grade machine learning system for real-time ride fare and ETA prediction, inspired by Uber and Lyft infrastructure. https://rajesh1804.medium.com/%EF%B8%8F-ridecastai-2-0-c68dfac54d...

ml-engineering mlops online-learning onnx streaming-data-pipelines

Python 0

8 天前