FSDP-and native DDP-examples fail to run on Windows

[Meganton]

Both with and without lightning the FSDP-examples fail to run, the one with lightning gives a UnicodeEncodeError: 'charmap' codec can't encode character '\u014d' in position 42: character maps to <undefined> and the one without a RuntimeError: use_libuv was requested but PyTorch was build without libuv support, just like the native DDP-example.

@gopaljigaur

[gopaljigaur]

Hi @Meganton, I believe the UnicodeEncodeError is caused due to an issue with how text dataset is loaded by WikiText2 class from lightning.pytorch.demos in the example. The dataset text file is not loaded as UTF-8. I had encountered this issue earlier but it resolved on its own, might have been a library version-specific issue, I am not sure.

On the other hand, Runtime Error: use_libuv... may be an issue with a newer version of PyTorch and may be resolved by downgrading the library.

[Meganton]

Hi @Meganton, I believe the UnicodeEncodeError is caused due to an issue with how text dataset is loaded by WikiText2 class from lightning.pytorch.demos in the example. The dataset text file is not loaded as UTF-8. I had encountered this issue earlier but it resolved on its own, might have been a library version-specific issue, I am not sure.

On the other hand, Runtime Error: use_libuv... may be an issue with a newer version of PyTorch and may be resolved by downgrading the library.

So for you, alle three examples run fine?
Do you use Linux?

[gopaljigaur]

Yes, I had tested all these examples before pushing and they worked fine. And yes, I used Linux.