Skip to content

Commit

Permalink
Editing pass over entire doc
Browse files Browse the repository at this point in the history
  • Loading branch information
amoeba committed Jan 22, 2025
1 parent dd3486d commit ab36859
Showing 1 changed file with 64 additions and 52 deletions.
116 changes: 64 additions & 52 deletions _posts/2025-01-16-19.0.0-release.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,58 +42,68 @@ Committee (PMC).

Thanks for your contributions and participation in the project!

## Columnar format
## Columnar Format

We've added a new experimental specification for statistics schema. It's useful
to exchange statistics. See [the statistics schema
We've added a new experimental specification for representing statistics on
Arrow Arrays as Arrow Arrays. This is useful for preserving and exchanging
statistics between systems such as when converting Parquet data to Arrow. See
[the statistics schema
documentation](https://arrow.apache.org/docs/format/StatisticsSchema.html) for
details.

There's also an expansion of the C Device ABI to include an experimental Async
Device Stream Interface. While the existing C Device Interface is a
pull-oriented API, the Async interface provides a push-oriented design for other
workflows. See the
We've expanded the Arrow C Device Data Interface to include an experimental
Async Device Stream Interface. While the existing Arrow C Device Data Interface
is a pull-oriented API, the Async interface provides a push-oriented design for
other workflows. See the
[documentation](https://arrow.apache.org/docs/format/CDeviceDataInterface.html#async-device-stream-interface)
for more information. It currently has implementations in the C++ and Go
libraries.

## Arrow Flight RPC notes
## Arrow Flight RPC Notes

- The precision of a Timestamp (used for timeouts) is now nanoseconds on all platforms; previously it was platform-dependent. ([#44679](https://github.com/apache/arrow/issues/44679))
- The Python bindings now support various new fields that were added to FlightEndpoint/FlightInfo (like `expiration_time`). ([#36954](https://github.com/apache/arrow/issues/36954))
The precision of a Timestamp (used for timeouts) is now nanoseconds on all
platforms; previously it was platform-dependent.
([#44679](https://github.com/apache/arrow/issues/44679))

## C++ notes
The Python bindings now support various new fields that were added to
FlightEndpoint/FlightInfo (like `expiration_time`).
([#36954](https://github.com/apache/arrow/issues/36954))

### Compute

It is now possible to cast from a struct type to another struct type with
additional columns, provided the additional columns are nullable (GH-44555).
## C++ Notes

The compute function `expm1` has been added to compute `exp(x) - 1` with better
accuracy when the input value is close to 0 (GH-44903).
### Compute

Hyperbolic trigonometric functions and their reciprocals have also been added
(GH-44952).
- It is now possible to cast from a struct type to another struct type with
additional columns, provided the additional columns are nullable
([#44555)](https://github.com/apache/arrow/issues/44555).

The new Decimal32 and Decimal64 types have been further supported by allowing
- The compute function `expm1` has been added to compute `exp(x) - 1` with better
accuracy when the input value is close to 0
([#44903](https://github.com/apache/arrow/issues/44903)).
- Hyperbolic trigonometric functions and their reciprocals have also been added
([#44952](https://github.com/apache/arrow/issues/44952)).
- The new Decimal32 and Decimal64 types have been further supported by allowing
casting between numeric, string, and other decimal types
([GH-43956](https://github.com/apache/arrow/issues/43956)).
([#43956](https://github.com/apache/arrow/issues/43956)).

### Acero

Added AVX2 support for decoding row tables in the Swiss join specialization of
- Added AVX2 support for decoding row tables in the Swiss join specialization of
hash joins, enabling up to 40% performance improvement for build-heavy workloads
([GH-43693](https://github.com/apache/arrow/issues/43693)).
([#43693](https://github.com/apache/arrow/issues/43693)).

### Filesystems

The S3 filesystem has gained support for server-side encryption with customer
provided keys, aka SSE-C (GH-43535).
- The S3 filesystem has gained support for server-side encryption with customer
provided keys, aka SSE-C
([#43535](https://github.com/apache/arrow/issues/43535)).

The S3 filesystem also gained an option to disable the SIGPIPE signals that may
be emitted on some network events (GH-44695).
- The S3 filesystem also gained an option to disable the SIGPIPE signals that may
be emitted on some network events
([#44695](https://github.com/apache/arrow/issues/44695)).

The Azure filesystem now supports SAS token authentication (GH-44308).
- The Azure filesystem now supports SAS token authentication
([#44308](https://github.com/apache/arrow/issues/44308)).

### Flight RPC

Expand All @@ -104,28 +114,30 @@ The Azure filesystem now supports SAS token authentication (GH-44308).
FlightEndpoint/FlightInfo (like `expiration_time`).
([#36954](https://github.com/apache/arrow/issues/36954))
- The UCX backend has been deprecated and is scheduled for removal.
([GH-45079](https://github.com/apache/arrow/issues/)).

([#45079](https://github.com/apache/arrow/issues/45079)).

### Parquet

The initial footer read size can now be configured to reduce the number of
potential roundtrips on high-latency filesystems such as S3 (GH-45015).

The new SizeStatistics format feature has been implemented, though it is
disabled by default when writing (GH-40592).

We've added a new method to the ParquetFileReader class,
- The initial footer read size can now be configured to reduce the number of
potential round-trips on hi-latency filesystems such as S3. ([#45015](https://github.com/apache/arrow/issues/45015)).
- The new `SizeStatistics` format feature has been implemented, though it is
disabled by default when writing. ([#40592](https://github.com/apache/arrow/issues/40592)).
- We've added a new method to the ParquetFileReader class,
[GetReadRanges](https://arrow.apache.org/docs/cpp/api/formats.html#_CPPv4N7parquet17ParquetFileReader13GetReadRangesERKNSt6vectorIiEERKNSt6vectorIiEE7int64_t7int64_t),
which can calculate the byte ranges necessary to read a given set of columns and
row groups. This may be useful to pre-buffer file data via caching mechanisms. ([GH-45092](https://github.com/apache/arrow/issues/45092))

We've added `arrow::Result`-returning variants for `parquet::arrow::OpenFile()` and `parquet::arrow::FileReader::GetRecordBatchReader()` ([GH-44784](https://github.com/apache/arrow/issues/44784), [GH-44808](https://github.com/apache/arrow/issues/44808))
row groups. This may be useful to pre-buffer file data via caching mechanisms.
([#45092](https://github.com/apache/arrow/issues/45092))
- We've added `arrow::Result`-returning variants for `parquet::arrow::OpenFile()`
and `parquet::arrow::FileReader::GetRecordBatchReader()`.
([#44784](https://github.com/apache/arrow/issues/44784),
[#44808](https://github.com/apache/arrow/issues/44808))

## C# notes

* The `PrimitiveArrayBuilder` constructor has been made public to allow writing custom builders ([#23995](https://github.com/apache/arrow/issues/23995))
* Improved the performance of looking up schema fields by name ([#44575](https://github.com/apache/arrow/issues/44575))
- The `PrimitiveArrayBuilder` constructor has been made public to allow writing
custom builders. ([#23995](https://github.com/apache/arrow/issues/23995))
- Improved the performance of looking up schema fields by name.
([#44575](https://github.com/apache/arrow/issues/44575))

## Java notes

Expand All @@ -142,24 +154,24 @@ TODO
### Ruby

- Added basic support for JRuby with an implementation based on Arrow Java
([GH-44346](https://github.com/apache/arrow/pull/44346)). The plan is to release
([#44346](https://github.com/apache/arrow/pull/44346)). The plan is to release
this as a gem once it covers a base set of features. See
[GH-45324](https://github.com/apache/arrow/issues/45324) for more information.
[#45324](https://github.com/apache/arrow/issues/45324) for more information.
- Added support for 32bit and 64bit decimal, binary view, and string view. See
[issues
listed](https://github.com/apache/arrow/issues?q=is%3Aclosed%20milestone%3A19.0.0%20label%3A%22Component%3A%20GLib%22)
in the 19.0.0 milestone.
- Fixed a bug that empty struct list can't be built
([GH-44742](https://github.com/apache/arrow/issues/44742))
- Fixed a bug that `record_batch[:colun].size` raises an exception
([GH-45119](https://github.com/apache/arrow/issues/45119))
in the 19.0.0 milestone for more details.
- Fixed a bug that empty struct list can't be built.
([#44742](https://github.com/apache/arrow/issues/44742))
- Fixed a bug that `record_batch[:column].size` raises an exception.
([#45119](https://github.com/apache/arrow/issues/45119))

### C GLib

- Added support for 32bit and 64bit decimal, binary view, and string view. See
[issues
listed](https://github.com/apache/arrow/issues?q=is%3Aclosed%20milestone%3A19.0.0%20label%3A%22Component%3A%20GLib%22)
in the 19.0.0 milestone.
listed in the 19.0.0 milestone](https://github.com/apache/arrow/issues?q=is%3Aclosed%20milestone%3A19.0.0%20label%3A%22Component%3A%20GLib%22)
for more details.

## Rust notes and Go notes

Expand All @@ -171,7 +183,7 @@ implementation, see the latest [Arrow Go changelog][6]
## Linux packages notes

- Debian: Fixed keyring format to support newer libapt (e.g., that used by
Trixie) ([GH-45118](https://github.com/apache/arrow/issues/45118))
Trixie). ([#45118](https://github.com/apache/arrow/issues/45118))

[1]: https://github.com/apache/arrow/milestone/66?closed=1
[2]: {{ site.baseurl }}/release/19.0.0.html#contributors
Expand Down

0 comments on commit ab36859

Please sign in to comment.