Release DataFusion 48.0.0 (June 2025)

[alamb]

Is your feature request related to a problem or challenge?

Tracking ticket for next release, also a place to track desired inclusions

Previous release will be https://crates.io/crates/datafusion/47.0.0 (April, 2025) so next major release would be late May or Early June 2025

Steps:

• Update version and changelog:
• Test with DataFusion Python:
• Test with DataFusion Comet
• Test with delta.rs:
• Test with SailHQ:
• Write upgrade guide:
• Test with parquet viewer
• Test with datafusion-materialized-views
• Voting Thread:
• Create ticket for next release:

Prior release tickets:

• 47.0.0: Release DataFusion 47.0.0 (April 2025) #15072

Changes to add to upgrade guide

These PRs made changes that deserve a mention in the upgrade guide

• Feat: introduce ExecutionPlan::partition_statistics API #15852

Features to mention in the blog (if they make it)

• feat: Add datafusion-spark crate #15168
• feat: ORDER BY ALL #15772
• [EPIC] A collection of tickets for improving sorting larger than memory datasets / spilling sorts #15271
• Change mapping of SQL VARCHAR from Utf8 to Utf8View #15096

Bugs that would be good to fix

• Fix: after repartitioning, the PartitionedFile and FileGroup statistics should be inexact/recomputed #15539
• Fix: fetch is missing in replace_order_preserving_variants method during EnforceDistribution optimizer #15808

Community Wishlist

• Format Date32 to string given timestamp specifiers #15361
• Add statistics_by_partition API to ExecutionPlan #15495

[xudong963]

I'll help to test DF48 by upgrading df in https://github.com/datafusion-contrib/datafusion-materialized-views