Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ModernBERT support #779

Open
3 tasks
FahadEbrahim opened this issue Jan 10, 2025 · 2 comments
Open
3 tasks

ModernBERT support #779

FahadEbrahim opened this issue Jan 10, 2025 · 2 comments
Assignees
@TimoImhof
Labels
enhancement New feature or request

Comments

@FahadEbrahim
Copy link
Contributor

FahadEbrahim commented Jan 10, 2025 •
edited
Loading

🌟 New Model setup

Model description:

A newer, better and lighter BERT Model showing promising results. It has a new architecture.

Open source status
@FahadEbrahim FahadEbrahim added the enhancement New feature or request label Jan 10, 2025
@TimoImhof TimoImhof self-assigned this Jan 11, 2025
@TimoImhof
Copy link
Contributor

Hi @FahadEbrahim
Thanks for opening this issue!
ModernBert was released with the transformers version 4.48.0.
Adapters work with version 4.47.1, so once the sync pull request #782 is merged, we can start integrating ModernBert.

@PrithivirajDamodaran
Copy link

Thank you - Looking forward to merge soon and integration of ModernBert to use 'adapters.models.modernbert' :-)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@TimoImhof TimoImhof

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@PrithivirajDamodaran @TimoImhof @FahadEbrahim