'[Errno 9] Bad file descriptor' thrown while requesting GET https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu/resolve/87f09149ef4734204d70ed1d046ddc9ca3f2b8f9/sample/10BT/010_00000.parquet

[DennisFaucher]

Keep getting that error when I run 3d_fine_web_edu.py

uv run 3d_fine_web_edu.py
warning: No requires-python value found in the workspace. Defaulting to >=3.13.
2026-05-08 15:15:06.843 | INFO | main:main:358 - GPUs: 0 | World size: 1 | Device: cpu
2026-05-08 15:15:08.374 | INFO | main:main:369 - Tokenizer: gpt-oss-20b | Vocab size: 199,998
2026-05-08 15:15:08.374 | INFO | main:main:389 - seq_len=2048 | micro_batch=4 | grad_accum=64 | global_batch_tokens=524,288 | total_steps=57,220
2026-05-08 15:15:48.629 | INFO | main:main:433 - Parameters: 3,557,815,042 | AMP dtype: torch.float16
/Users/faucherd/Downloads/OpenMythos/.venv/lib/python3.13/site-packages/torch/utils/data/dataloader.py:1118: UserWarning: 'pin_memory' argument is set as true but not supported on MPS now, device pinned memory won't be used.
super().init(loader)
Resolving data files: 100%|█████████████| 2410/2410 [00:00<00:00, 100291.43it/s]
Resolving data files: 100%|████████████| 2410/2410 [00:00<00:00, 106265.28it/s]
Resolving data files: 100%|█████████████| 2410/2410 [00:00<00:00, 108406.68it/s]
Resolving data files: 100%|██████████████| 2410/2410 [00:00<00:00, 104410.28it/s]

─❮ '[Errno 9] Bad file descriptor' thrown while requesting GET https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu/resolve/87f09149ef4734204d70ed1d046dd

[mihara-bot]

Hi @DennisFaucher , This is probably a network issue. You can pre-download fineweb-edu/sample/10BT on your local disk. This subset is only about 28.5GB.