Rework the /status provider matrix and update tracked models#474
Merged
Conversation
xAI removed unauthenticated access to Grok, so the BrightData and Olostep scrapers can no longer reach it. Remove Grok from those scraper registries, the CLI setup lists, the scraper docs, and the /status + provider-test targets. Grok stays trackable via OpenRouter (authenticated), so its OpenRouter target, model metadata, trackable-model docs, and a docs example remain. The /status matrix rendered every empty cell as the same grey dot. Split empty cells into "not available" (SERP-only surfaces like Google AI Mode/Overview and Copilot via Direct API or OpenRouter, which can't exist) shown as a hatched N/A, versus "not tracked yet" shown as the neutral dot, with legend entries and tooltips.
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Replace the coarse scrape-only rule with a full capability model: pure LLMs (Claude, Grok, Mistral, DeepSeek) are N/A on every scraper, the SERP/consumer surfaces (Google AI Mode/Overview, Copilot) are N/A on the Model APIs, and each scraper's capability set marks its own gaps (Oxylabs can't reach Gemini/Copilot, DataForSEO can't reach Copilot). Group the matrix columns into Model APIs and AI Search Scrapers with a gap and group headers. Add Google AI Overview scraping to the Oxylabs provider (google_search source, render html) with text + citation extraction and unit tests, plus the google-ai-overview:oxylabs:online target and CLI/docs entries. The scheduled provider-test workflow exercises it live.
Track Moonshot's Kimi through OpenRouter as an additional model — N/A on every scraper, like the other API-only models. Register its label and Moonshot AI icon (SiMoonshotai), add the status/test target, and document it.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Reworks the public
/statusprovider matrix to be capability-accurate and adjusts which models Elmo tracks.Tracked-model changes
STATUS_TARGETS. Grok stays trackable via OpenRouter (authenticated) — its OpenRouter target, model metadata, and docs remain.google-ai-overviewscraping to the Oxylabs provider (google_searchsource,render: html), with text + citation extraction from the parsedai_overviewsblock and unit tests. Adds thegoogle-ai-overview:oxylabs:onlinetarget plus CLI/docs entries. The scheduled provider-test workflow exercises it live.moonshotai/kimi-k3) via OpenRouter. New tracked model with its label and Moonshot AI icon (SiMoonshotai), status/test target, and docs./statusmatrix presentationResulting classification:
Notes
status-helpers.ts(the registries in@workspace/libremain the runtime source of truth).patchchangesets cover the tracked-model changes.Verification
@workspace/www,@workspace/web,@elmohq/cli).@workspace/config,@workspace/libprovider + text-extraction — including new Oxylabs AI Overview extraction tests,@workspace/webmodel-filter).pnpm --filter @workspace/www buildsucceeds.test-provider.tsagainst real provider APIs:google-ai-overview:oxylabs:onlineandkimi:openrouter:moonshotai/kimi-k3both PASS. The Oxylabs AI Overview run returned real overview text with 3 citations — all extracted from theai_overviewsblock, confirming the parser against a production response (none of the pre-existing citation paths were present) — and Kimi returned a valid OpenRouter response.