-
Notifications
You must be signed in to change notification settings - Fork 31
Open
Description
Hello, when using DDP with the sampler , due to the dynamic batch size, the number of batches allocated by different ranks is inconsistent. This is what makes different ranks unable to communicate in DDP. Are there other solutions?
wangleiofficialwangleiofficial
Metadata
Metadata
Assignees
Labels
No labels