Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MoE] fix run err in mixtral22B recipe and update its perf config #12036

Merged
merged 4 commits into from
Feb 4, 2025

Conversation

gdengk
Copy link
Contributor

@gdengk gdengk commented Feb 3, 2025

What does this PR do ?

  • fix the run err when fetching callbacks in mixtral-22B recipe.
  • update the mixtral-22B perf config

Collection: [Note which collection this PR will affect]

Changelog

  • Add specific line by line info of high level changes in this PR.

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this 

GitHub Actions CI

The Jenkins CI system has been replaced by GitHub Actions self-hosted runners.

The GitHub Actions CI will run automatically when the "Run CICD" label is added to the PR.
To re-run CI remove and add the label again.
To run CI on an untrusted fork, a NeMo user with write access must first click "Approve and run".

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you add or update any necessary documentation?
  • Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
    • Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

  • New Feature
  • Bugfix
  • Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

  • Related to # (issue)

@gdengk gdengk force-pushed the gaod/moe/update_mixtral22b_perf_config branch from 8c5896f to 016e20e Compare February 3, 2025 20:55
Copy link
Collaborator

@erhoo82 erhoo82 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@akoumpa akoumpa added Run CICD and removed Run CICD labels Feb 3, 2025
@akoumpa akoumpa enabled auto-merge (squash) February 3, 2025 23:03
@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 30.30%. Comparing base (09186c3) to head (e2635e4).

Additional details and impacted files
@@           Coverage Diff           @@
##             main   #12036   +/-   ##
=======================================
  Coverage   30.30%   30.30%           
=======================================
  Files        1387     1387           
  Lines      176283   176283           
  Branches    27091    27091           
=======================================
+ Hits        53423    53427    +4     
+ Misses     118776   118772    -4     
  Partials     4084     4084           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@akoumpa
Copy link
Member

akoumpa commented Feb 4, 2025

@ko3n1g @pablo-garay can we force-merge this one? it's config change.

@ko3n1g ko3n1g disabled auto-merge February 4, 2025 07:47
@ko3n1g ko3n1g merged commit 8ac1dbc into NVIDIA:main Feb 4, 2025
164 of 410 checks passed
@gdengk gdengk deleted the gaod/moe/update_mixtral22b_perf_config branch February 4, 2025 17:57
BoxiangW pushed a commit that referenced this pull request Feb 7, 2025
…2036)

* update mixtral-22B performance config

Signed-off-by: gdeng <[email protected]>

* fix run err in mixtral22B recipe

Signed-off-by: gdeng <[email protected]>

* Apply isort and black reformatting

Signed-off-by: gdengk <[email protected]>

---------

Signed-off-by: gdeng <[email protected]>
Signed-off-by: gdengk <[email protected]>
Co-authored-by: gdengk <[email protected]>
youngeunkwon0405 pushed a commit to youngeunkwon0405/NeMo that referenced this pull request Feb 10, 2025
…IDIA#12036)

* update mixtral-22B performance config

Signed-off-by: gdeng <[email protected]>

* fix run err in mixtral22B recipe

Signed-off-by: gdeng <[email protected]>

* Apply isort and black reformatting

Signed-off-by: gdengk <[email protected]>

---------

Signed-off-by: gdeng <[email protected]>
Signed-off-by: gdengk <[email protected]>
Co-authored-by: gdengk <[email protected]>
Signed-off-by: Youngeun Kwon <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants