Skip to content

Revise the arguments for to_parquet method calls #37

@nrs23

Description

@nrs23

we use this pattern when writing to parquet in our our different pipeline stages:

    future: dd.Scalar = ddf.to_parquet(
        Path(outfile),
        version='2.6',
        allow_truncated_timestamps=True,
        write_index=False,
        compute=False,
    )

Do we need to be using version with a static version number? Do we need truncated timestamps?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions