Skip to content

Plans to support Gemma 3? #3697

Open
@deep1401

Description

@deep1401

Are there any plans or is anyone working on integrating support for the Gemma 3 models within Fastchat? Natively loading a Gemma 3 model doesn't directly work and opens up loading as well as inference issues.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions