DuckDB-powered data lake analytics from Postgres
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POC...
A highly efficient daemon for streaming data from Kafka into Delta Lake
The Internals of Delta Lake
Smart Automation Tool for building modern Data Lakes and Data Pipelines
#计算机科学#One-click ML infrastructure for teams that just want to get sh*t done.
a lightweight, comprehensive solution for managing delta tables built on polars and deltalake
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
This repository exemplifies a simple ELT process using delta to perform upsert and remove data files that aren't in the latest state of the transaction log for the table.
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We wil...
Command-line interface to quickly generate fake CSV and JSON data
Databricks Platform - Architecture, Security, Automation and much more!!
Spark-free Python utilities for Microsoft Fabric focused on Data Engineering using Polars and delta-rs
Don't Panic. This guide will help you when it feels like the end of the world.