datafusion 开源项目推荐（238 个）

apache /datafusion

Apache DataFusion SQL 查询引擎

ibis-project /ibis

the portable Python dataframe library

lakehq /sail

这是一个用Rust语言编写的、用于替代Apache Spark的替代品，能够统一处理批处理任务、流处理任务以及需要大量计算资源的AI相关工作负载。

roapi /roapi

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

lakesoul-io /LakeSoul

LakeSoul是一个端到端、实时云原生Lakehouse框架，用于快速数据摄入、并发更新、增量分析、多模式数据处理和载体搜索，为下一代BI和AI工作负载提供支持。

nisshi-io /solace-nisshi

Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake

ModernRelay /omnigraph

Object-storage native graph database with branching and typed ontology

apache /auron

用于分布式计算框架的Aaron加速器（例如，Spark）利用原生载体化执行来加速查询处理

apache /datafusion-comet

阿帕奇数据融合彗星火花加速器

arkflow-rs /arkflow

High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.

ClickHouse /ClickBench

ClickBench：分析数据库的基准

skyzh /vector-db-from-scratch

Learn vector search with Rust and DataFusion; the C++/BusTub track is deprecated.

paradedb /pg_analytics

DuckDB-powered data lake analytics from Postgres

splitgraph /seafowl

Analytical database for data-driven Web applications 🪶

datafusion-contrib /liquid-cache

Pushdown cache for DataFusion

kamu-data /kamu-cli

新一代去中心化数据湖仓和多方流处理网络

JanKaul /iceberg-rust

Unofficial rust implementation of Apache Iceberg with integration for Datafusion

datafusion-contrib /datafusion-ducklake

A Rust-native DuckLake engine built on Apache DataFusion

biodatageeks /polars-bio

Blazing-Fast Bioinformatic Operations on Python DataFrames

datafusion-contrib /datafusion-dft

Batteries included CLI, TUI, and server implementations for DataFusion.