Skip to content

[TASK] Clarify purpose of various filtering functions in prefilter.py #28

@nrs23

Description

@nrs23

It's not clear what the following line of code is for:

ddf = ddf.drop(columns=['date', '0', '1', '2', '717', '718', '719']).persist().repartition(partition_size="20MB")

It's also not clear why we use days_with_too_few_points twice, using date as agg_columns argument in the first instance and recorders in the second.

We need to ask @dkadish, but should probably collect other questions first.

Metadata

Metadata

Assignees

No one assigned

    Labels

    dac-paperRelevant to the DAC paper onlyquestionFurther information is requested

    Type

    No fields configured for Task.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions