Skip to content

feat: add Novita AI as LLM provider#2230

Open
Alex-wuhu wants to merge 2 commits intokoala73:mainfrom
Alex-wuhu:novita-integration
Open

feat: add Novita AI as LLM provider#2230
Alex-wuhu wants to merge 2 commits intokoala73:mainfrom
Alex-wuhu:novita-integration

Conversation

@Alex-wuhu
Copy link
Copy Markdown

Summary

Add Novita AI as a new LLM provider. Novita offers an OpenAI-compatible API with competitive pricing and a wide selection of open-source models.

Changes

  • New Novita provider following existing provider patterns
  • API key configuration via NOVITA_API_KEY environment variable
  • Support for chat, completion, and embedding models

Configuration

NOVITA_API_KEY=your_key_here

Endpoint: https://api.novita.ai/openai

@vercel
Copy link
Copy Markdown

vercel bot commented Mar 25, 2026

@Alex-wuhu is attempting to deploy a commit to the Elie Team on Vercel.

A member of the Team first needs to authorize it.

@koala73 koala73 added High Value Meaningful contribution to the project Ready to Merge PR is mergeable, passes checks, and adds value labels Mar 26, 2026
@SebastienMelki
Copy link
Copy Markdown
Collaborator

@Alex-wuhu — implementation follows the existing provider pattern cleanly. A few questions:

  1. Branch has merge conflicts — please rebase on main
  2. Are there Novita free-tier rate limits we should document in .env.example?
  3. Is https://api.novita.ai/openai the stable production endpoint or might it change?
  4. Does Novita support streaming responses? Matters for the AI Brief path.

@SebastienMelki
Copy link
Copy Markdown
Collaborator

Note: merge conflicts with main. Fork PR — can't rebase from maintainer side. @Alex-wuhu — please rebase on current main when addressing the review questions.

Add Novita AI (https://novita.ai) as a new LLM provider option.
Novita offers OpenAI-compatible API endpoints with competitive pricing.
@Alex-wuhu Alex-wuhu force-pushed the novita-integration branch from e6687b9 to 8049572 Compare March 31, 2026 04:25
…ion style

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@Alex-wuhu
Copy link
Copy Markdown
Author

Hi @SebastienMelki, thanks for the review! Here are the answers:

1. Rebase on main — Done. Conflicts resolved and pushed.

2. Novita free-tier rate limits for .env.example?
Novita AI is purely pay-per-use with no free tier. Neither the pricing page nor the API docs mention request rate limits. So there's nothing to document like Groq's "14,400 req/day" or OpenRouter's "50 req/day" — the current .env.example comment is sufficient.

3. Is https://api.novita.ai/openai the stable production endpoint?
Yes. The official docs explicitly list https://api.novita.ai/openai as the production base URL. The full chat completions path used in the PR (https://api.novita.ai/openai/v1/chat/completions) is correct and stable.

4. Does Novita support streaming?
Yes — the docs state it "supports both streaming and non-streaming modes" via the standard stream: true parameter (SSE). Since callLlmReasoningStream handles streaming generically for all OpenAI-compatible providers, Novita works on the AI Brief path without any additional code.


Also — would you be interested in doing a co-post on X with Novita AI about this integration? Let us know!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

High Value Meaningful contribution to the project Ready to Merge PR is mergeable, passes checks, and adds value

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants