Skip to content

[Feature] Hide 75% of the communication in tensor parallelism using DoMiNo#292

Open
xrsrke wants to merge 38 commits intomainfrom xrsrke/exp7a13b0_domino_revert_from_fix_stream_not_sync_exp2a1c7_and_commit_23f2_and_75_percent_bwd_overlapping_with_cuda_stream_sync_bwd_but_remove_stream_manager_ctx

Commits

Commits on Jan 29, 2025

Commits on Jan 30, 2025

Commits on Jan 31, 2025

Commits on Feb 3, 2025

Commits on Feb 4, 2025

Commits on Feb 5, 2025

Commits on Feb 10, 2025

Commits on Feb 24, 2025

Commits on Feb 25, 2025

Commits on Feb 28, 2025

Commits on Mar 8, 2025

Commits on Mar 10, 2025

Commits on Mar 13, 2025