Skip to content

Offload compute by allowing users to sign in with their LLM tokens #21

@rockett-m

Description

@rockett-m

This will allow for distributed compute and no rate limiting (versus using a single API key).
If we can allow for "sign in with OpenAI/LLaMa/Cerebras/HuggingFace/Grok/others" then users can draw upon their own purchased compute plans and no bottleneck on our end calling our backend functions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No fields configured for Task.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions