Prefect 是一个现代化工作流编排工具，使开发人员能够构建、观察数据管道并对其做出反应
Turns Data and AI algorithms into production-ready web applications in no time.
#数据仓库#The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Fancy stream processing made operationally mundane
#大语言模型#Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
#计算机科学#Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckD...
Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing...
#计算机科学#Maestro: Netflix’s Workflow Orchestrator
#计算机科学#An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collect...
Scalable and efficient data transformation framework - backwards compatible with dbt.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, , 20+ connectors
Collect, aggregate, and visualize a data ecosystem's metadata
Cloud Native DataOps & AIOps Platform | 云原生数智运维平台
Polyglot workflows without leaving the comfort of your technology stack.
#数据仓库#📙 Awesome Data Catalogs and Observability Platforms.
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Tenzir is the data pipeline engine for security teams.