Skip to content

ArrowJsonBatch::from_batch is incomplete #8684

@phil-opp

Description

@phil-opp

Describe the bug

The arrow_integration_test::ArrowJsonBatch::from_batch only supports DataType::Int8. All other data is translated to a column with no data.

This limitation is not mentioned anywhere in the docs.

To Reproduce

See https://docs.rs/arrow-integration-test/latest/src/arrow_integration_test/lib.rs.html#1054

Expected behavior

Either an error or support for all data types.

Additional context

We want to use this function to store a human-readable representation of some arrow arrays. We need to support fields containing binary data, so the arrow_json crate is not suitable for our use case.

Metadata

Metadata

Assignees

No one assigned

    Labels

    arrowChanges to the arrow cratedocumentationImprovements or additions to documentationenhancementAny new improvement worthy of a entry in the changelog

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions