Skip to content

Fix FSDP double-buffer overflow in lazy main_grad_getter during backward#146

Open
sudhu2k wants to merge 1 commit into
rocm_devfrom
sudhu/megatron_fsdp_dbuf_fix
Open

Fix FSDP double-buffer overflow in lazy main_grad_getter during backward#146
sudhu2k wants to merge 1 commit into
rocm_devfrom
sudhu/megatron_fsdp_dbuf_fix

Enhance grad buffer management in MegatronFSDP and ParamAndGradBuffer

debab8f
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar