After file indexing, solar.parquet needs to over-write the files table.
However, because dask cannot know whether to overwrite or not, it just adds new records.
This results in the entire files table being duplicated, half of which has all nan solar fields.
After file indexing, solar.parquet needs to over-write the files table.
However, because dask cannot know whether to overwrite or not, it just adds new records.
This results in the entire files table being duplicated, half of which has all nan solar fields.