Apache DataFusion
Fewer than 5 people recommend it so far, so there's no written verdict. Here is what commenters said.
Why people recommend it
“I remain excited about the broader ecosystem (especially datafusion).”
“I thought of datafusion work and the rust implementation as a way to address the delta seen vs the Spark/JVM GraphFrames implementation”
Show 1 more
“You might find https://github.com/apache/datafusion and https://github.com/datafusion-contrib/datafusion-federation of interest”
Caveats and dissent
“I spent a very frustrating day tracking down this one in particular”
Often compared with
Who recommends it in their own words
From the makers not counted in the ranking
“queried with DataFusion”
“integrate some of our data post-processing pipeline with our custom DataFusion UDF library”
Threads where it came up
- Algorithms on billion-scale graph using 10GB RAM: I love DataFusion 3 mentions
- AWS Acquires DuckLabs 2 mentions
- Ask HN: What Are You Working On? (May 2026) 2 mentions
- Shredding JSON columns gave Logfire up to 1000x faster queries 1 mention
- DuckDB Ducklake 1 mention
- Ask HN: What are you working on? (September 2026) 1 mention
Also written as DataFusion. Data: apache-datafusion.json. Quotes are verbatim; the verdict and theme labels are written by a model from these comments, and every clause links to its sources.
All comments 15
“bringing-ducklake-to-datafusion”
“the rest uses Apache Data Fusion Parser”
“I remain excited about the broader ecosystem (especially datafusion).”
“You can even use DuckLake with Datafusion”
“Co-partitioning of range-partitioned data is now supported on `main` too”
“I thought of datafusion work and the rust implementation as a way to address the delta seen vs the Spark/JVM GraphFrames implementation”
“datafusion allows you to do fine grained storage integration”
“Apache DataFusion for SQL engine”
“The SQL engine is Apache DataFusion[1]”
“spelunk in the Data Fusion codebase”
“You might find https://github.com/apache/datafusion and https://github.com/datafusion-contrib/datafusion-federation of interest”
“DataFusion as the more complete option”
“Stack is Iggy, Polars, Datafusion, RisingWave, R2, CF Workers, Civo”
“I spent a very frustrating day tracking down this one in particular”
“I also tried Datafusion and polars but clickhouse ended up being faster.”