Skip to content

feat(openrouter/meta/muse-glimmer-30b): add new models [bot] - #2111

Merged
Archit-Kumar-16 merged 5 commits into
mainfrom
bot/add-openrouter-meta-muse-glimmer-30b-20260811-000751
Aug 11, 2026
Merged

feat(openrouter/meta/muse-glimmer-30b): add new models [bot]#2111
Archit-Kumar-16 merged 5 commits into
mainfrom
bot/add-openrouter-meta-muse-glimmer-30b-20260811-000751

Conversation

@models-bot

@models-bot models-bot Bot commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

Auto-generated by model-addition-agent for openrouter/meta/muse-glimmer-30b.


Note

Low Risk
Declarative model metadata only; no runtime or routing logic changes.

Overview
Adds a new OpenRouter provider catalog entry for meta/muse-glimmer-30b, registering it as an active serverless chat model with thinking enabled.

The YAML defines token pricing (including prompt-cache read cost), a 131k context window, text/image input, and capabilities such as function calling, JSON/structured output, prompt caching, and tool choice, plus default sampling params (temperature, top_p, top_k).

Reviewed by Cursor Bugbot for commit f969cd1. Bugbot is set up for automated code reviews on this repo. Configure here.

Comment thread providers/openrouter/meta/muse-glimmer-30b.yaml
@github-actions

Copy link
Copy Markdown
Contributor

/test-models

@harshiv-26

Copy link
Copy Markdown
Collaborator

Gateway test results

  • Total: 10
  • Passed: 10
  • Failed: 0
  • Validation failed: 0
  • Errored: 0
  • Skipped: 0
  • Success rate: 100.0%
Provider Model Scenarios
openrouter meta/muse-glimmer-30b success: params:text-text:stream, tool-call:text-text:stream, params:text-text, tool-call:text-text, json-output:text-text:stream, json-output:text-text, structured-output:text-text, structured-output:text-text:stream, reasoning:text-text, reasoning:text-text:stream
Successes (10)

openrouter/meta/muse-glimmer-30b — params:text-text:stream (success)

Output
The capital of France is **Paris**.

openrouter/meta/muse-glimmer-30b — tool-call:text-text:stream (success)

Output
{"location": "London"}
VALIDATION: tool-call stream SUCCESS

openrouter/meta/muse-glimmer-30b — params:text-text (success)

Output
Paris is the capital of France.

openrouter/meta/muse-glimmer-30b — tool-call:text-text (success)

Output
Function: get_weather
Arguments: {"location": "London"}
VALIDATION: tool-call SUCCESS

openrouter/meta/muse-glimmer-30b — json-output:text-text:stream (success)

Output
{
  "colors": [
    {"name": "red", "hex": "#FF0000"},
    {"name": "green", "hex": "#00FF00"},
    {"name": "blue", "hex": "#0000FF"}
  ]
}
VALIDATIO
... (truncated, 30 chars omitted)

openrouter/meta/muse-glimmer-30b — json-output:text-text (success)

Output
{
  "colors": [
    {"name": "Red", "hex": "#FF0000"},
    {"name": "Green", "hex": "#00FF00"},
    {"name": "Blue", "hex": "#0000FF"}
  ]
}
VALIDATIO
... (truncated, 23 chars omitted)

openrouter/meta/muse-glimmer-30b — structured-output:text-text (success)

Output
{
  "name": "science fair",
  "date": "Friday",
  "participants": ["Alice", "Bob"]
}
VALIDATION: structured-output SUCCESS

openrouter/meta/muse-glimmer-30b — structured-output:text-text:stream (success)

Output
{
  "name": "science fair",
  "date": "Friday",
  "participants": ["Alice", "Bob"]
}
VALIDATION: structured-output stream SUCCESS

openrouter/meta/muse-glimmer-30b — reasoning:text-text (success)

Output
Power towers are evaluated from the top down.  In ordinary
mathematical notation

a^b^c^d = a^( b^( c^d) )


the exponentiation is right associ
... (truncated, 978 chars omitted)

openrouter/meta/muse-glimmer-30b — reasoning:text-text:stream (success)

Output
In ordinary arithmetic an exponential tower is taken to be right
associative

$$a^{b^{c}}=a^{\left(b^{c}\right)}\qquad {\rm not}\qquad \left(a^{b}\rig
... (truncated, 1353 chars omitted)

@github-actions

Copy link
Copy Markdown
Contributor

/test-models

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

There are 2 total unresolved issues (including 1 from previous review).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 23c6d70. Configure here.

Comment thread providers/openrouter/meta/muse-glimmer-30b.yaml Outdated
@harshiv-26

Copy link
Copy Markdown
Collaborator

Gateway test results

  • Total: 10
  • Passed: 0
  • Failed: 10
  • Validation failed: 0
  • Errored: 0
  • Skipped: 0
  • Success rate: 0.0%
Provider Model Scenarios
openrouter meta/muse-glimmer-30b failure: structured-output:text-text, params:text-text:stream, params:text-text, structured-output:text-text:stream, tool-call:text-text:stream, reasoning:text-text:stream, json-output:text-text, tool-call:text-text, reasoning:text-text, json-output:text-text:stream
Failures (10)

openrouter/meta/muse-glimmer-30b — structured-output:text-text (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmp5126v92d/snippet.py", line 21, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI
import json

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response_schema = json.loads('''{
  "title": "CalendarEvent",
  "type": "object",
  "properties": {
    "name": { "type": "string" },
    "date": { "type": "string" },
    "participants": {
      "type": "array",
      "items": { "type": "string" }
    }
  },
  "required": ["name", "date", "participants"],
  "additionalProperties": false
}''')

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "Alice and Bob are going to a science fair on Friday. Extract the event details as JSON."},
    ],
    response_format={"type": "json_schema", "json_schema": {"name": "CalendarEvent", "schema": response_schema}},
    stream=False,
)
import json as _json

_content = response.choices[0].message.content
print(_content)

if not _content:
    raise Exception("VALIDATION FAILED: structured-output - response content is empty")

_parsed = _json.loads(_content)

if "name" not in _parsed or "date" not in _parsed or "participants" not in _parsed:
    raise Exception("VALIDATION FAILED: structured-output - missing expected fields (name, date, participants)")

if not isinstance(_parsed.get("participants"), list):
    raise Exception("VALIDATION FAILED: structured-output - 'participants' is not a list, schema not enforced")

if set(_parsed.keys()) != {"name", "date", "participants"}:
    raise Exception(
        f"VALIDATION FAILED: structured-output - unexpected keys present: {set(_parsed.keys())}"
    )

print("VALIDATION: structured-output SUCCESS")

openrouter/meta/muse-glimmer-30b — params:text-text:stream (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmpovz51wnx/snippet.py", line 5, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "What is the capital of France?"},
    ],
    max_tokens=128,
    temperature=1,
    stream=True,
)

for chunk in response:
    if chunk.choices and len(chunk.choices) > 0:
        delta = chunk.choices[0].delta
        if delta.content is not None:
            print(delta.content, end="", flush=True)

openrouter/meta/muse-glimmer-30b — params:text-text (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmpkqosx5uh/snippet.py", line 5, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "What is the capital of France?"},
    ],
    max_tokens=128,
    temperature=1,
    stream=False,
)

print(response.choices[0].message.content)

openrouter/meta/muse-glimmer-30b — structured-output:text-text:stream (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmpg2x63in0/snippet.py", line 21, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI
import json

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response_schema = json.loads('''{
  "title": "CalendarEvent",
  "type": "object",
  "properties": {
    "name": { "type": "string" },
    "date": { "type": "string" },
    "participants": {
      "type": "array",
      "items": { "type": "string" }
    }
  },
  "required": ["name", "date", "participants"],
  "additionalProperties": false
}''')

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "Alice and Bob are going to a science fair on Friday. Extract the event details as JSON."},
    ],
    response_format={"type": "json_schema", "json_schema": {"name": "CalendarEvent", "schema": response_schema}},
    stream=True,
)
import json as _json

_accumulated = ""
for chunk in response:
    if chunk.choices and len(chunk.choices) > 0:
        delta = chunk.choices[0].delta
        if delta.content is not None:
            _accumulated += delta.content
            print(delta.content, end="", flush=True)

if not _accumulated:
    raise Exception("VALIDATION FAILED: structured-output stream - no content received")

_parsed = _json.loads(_accumulated)

if "name" not in _parsed or "date" not in _parsed or "participants" not in _parsed:
    raise Exception("VALIDATION FAILED: structured-output stream - missing expected fields (name, date, participants)")

if not isinstance(_parsed.get("participants"), list):
    raise Exception("VALIDATION FAILED: structured-output stream - 'participants' is not a list, schema not enforced")

if set(_parsed.keys()) != {"name", "date", "participants"}:
    raise Exception(
        f"VALIDATION FAILED: structured-output stream - unexpected keys present: {set(_parsed.keys())}"
    )

print("\nVALIDATION: structured-output stream SUCCESS")

openrouter/meta/muse-glimmer-30b — tool-call:text-text:stream (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmpeemvlxrr/snippet.py", line 27, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

tools = [
    {
        "type": "function",
        "function": {
            "name": "get_weather",
            "description": "Get the current weather for a location.",
            "parameters": {
                "type": "object",
                "properties": {
                    "location": {
                        "type": "string",
                        "description": "The city name, e.g. London",
                    },
                },
                "required": ["location"],
                "additionalProperties": False,
            },
            "strict": True,
        },
    },
]

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "Use the get_weather tool to check the weather in London. You must call the tool, do not respond with plain text."},
    ],
    tools=tools,
    tool_choice="auto",
    stream=True,
)
_tool_calls_made = False
for chunk in response:
    if chunk.choices and len(chunk.choices) > 0:
        delta = chunk.choices[0].delta
        if delta.content is not None:
            print(delta.content, end="", flush=True)
        if delta.tool_calls:
            _tool_calls_made = True
            for _tc in delta.tool_calls:
                if _tc.function:
                    print(_tc.function.arguments or "", end="", flush=True)

if not _tool_calls_made:
    raise Exception("VALIDATION FAILED: tool-call stream - no tool calls received")
print("\nVALIDATION: tool-call stream SUCCESS")

openrouter/meta/muse-glimmer-30b — reasoning:text-text:stream (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmpn709lcae/snippet.py", line 5, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "How to calculate 3^3^3^3? Think step by step and show all reasoning."},
    ],
    reasoning_effort="medium",
    stream=True,
)
_reasoning_detected = False
for chunk in response:
    if chunk.choices and len(chunk.choices) > 0:
        delta = chunk.choices[0].delta
        if delta.content is not None:
            print(delta.content, end="", flush=True)
        if getattr(delta, "reasoning_content", None) is not None:
            _reasoning_detected = True
        if getattr(delta, "reasoning", None) is not None:
            _reasoning_detected = True

    _usage = getattr(chunk, "usage", None)
    if _usage is not None:
        _details = getattr(_usage, "completion_tokens_details", None)
        if _details and getattr(_details, "reasoning_tokens", 0) > 0:
            _reasoning_detected = True

if not _reasoning_detected:
    raise Exception("VALIDATION FAILED: reasoning stream - no reasoning information in stream")
print("\nVALIDATION: reasoning stream SUCCESS")

openrouter/meta/muse-glimmer-30b — json-output:text-text (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmp1l7fmrap/snippet.py", line 5, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "List 3 colors with their hex codes in JSON."},
    ],
    response_format={"type": "json_object"},
    stream=False,
)
import json as _json

_content = response.choices[0].message.content
print(_content)

if not _content:
    raise Exception("VALIDATION FAILED: json-output - response content is empty")

_json.loads(_content)
print("VALIDATION: json-output SUCCESS")

openrouter/meta/muse-glimmer-30b — tool-call:text-text (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmp3m__fizf/snippet.py", line 27, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

tools = [
    {
        "type": "function",
        "function": {
            "name": "get_weather",
            "description": "Get the current weather for a location.",
            "parameters": {
                "type": "object",
                "properties": {
                    "location": {
                        "type": "string",
                        "description": "The city name, e.g. London",
                    },
                },
                "required": ["location"],
                "additionalProperties": False,
            },
            "strict": True,
        },
    },
]

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "Use the get_weather tool to check the weather in London. You must call the tool, do not respond with plain text."},
    ],
    tools=tools,
    tool_choice="auto",
    stream=False,
)
_message = response.choices[0].message
if _message.tool_calls:
    for _tc in _message.tool_calls:
        print(f"Function: {_tc.function.name}")
        print(f"Arguments: {_tc.function.arguments}")
else:
    print(_message.content)

if not _message.tool_calls or len(_message.tool_calls) == 0:
    raise Exception("VALIDATION FAILED: tool-call - no tool calls in response")
print("VALIDATION: tool-call SUCCESS")

openrouter/meta/muse-glimmer-30b — reasoning:text-text (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmp2p083kuy/snippet.py", line 5, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "How to calculate 3^3^3^3? Think step by step and show all reasoning."},
    ],
    reasoning_effort="medium",
    stream=False,
)
_usage = getattr(response, "usage", None)
_reasoning_detected = False

_choices = getattr(response, "choices", None)
if _choices and len(_choices) > 0:
    _message = getattr(_choices[0], "message", None)
else:
    _message = None

if _message and getattr(_message, "content", None) is not None:
    print(_message.content)

if _usage is not None:
    _output_token_details = getattr(_usage, "completion_tokens_details", None)
    if _output_token_details and getattr(_output_token_details, "reasoning_tokens", 0) > 0:
        _reasoning_detected = True
    elif getattr(_usage, "reasoning", None) is not None:
        _reasoning_detected = True

if getattr(_message, "reasoning_content", None) is not None:
    _reasoning_detected = True
elif getattr(_message, "reasoning", None) is not None:
    _reasoning_detected = True

if not _reasoning_detected:
    print("Response: ", response)
    raise Exception("VALIDATION FAILED: reasoning - no reasoning information in response")
print("VALIDATION: reasoning SUCCESS")

openrouter/meta/muse-glimmer-30b — json-output:text-text:stream (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmpl0tcw4ih/snippet.py", line 5, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-743f04e7-e is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "List 3 colors with their hex codes in JSON."},
    ],
    response_format={"type": "json_object"},
    stream=True,
)
import json as _json

_accumulated = ""
for chunk in response:
    if chunk.choices and len(chunk.choices) > 0:
        delta = chunk.choices[0].delta
        if delta.content is not None:
            _accumulated += delta.content
            print(delta.content, end="", flush=True)

if not _accumulated:
    raise Exception("VALIDATION FAILED: json-output stream - no content received")

_json.loads(_accumulated)
print("\nVALIDATION: json-output stream SUCCESS")

@github-actions

Copy link
Copy Markdown
Contributor

/test-models

@github-actions

Copy link
Copy Markdown
Contributor

/test-models

@harshiv-26

Copy link
Copy Markdown
Collaborator

Gateway test results

  • Total: 10
  • Passed: 10
  • Failed: 0
  • Validation failed: 0
  • Errored: 0
  • Skipped: 0
  • Success rate: 100.0%
Provider Model Scenarios
openrouter meta/muse-glimmer-30b success: tool-call:text-text:stream, tool-call:text-text, params:text-text, params:text-text:stream, json-output:text-text, json-output:text-text:stream, structured-output:text-text, structured-output:text-text:stream, reasoning:text-text:stream, reasoning:text-text
Successes (10)

openrouter/meta/muse-glimmer-30b — tool-call:text-text:stream (success)

Output
{"location": "London"}
VALIDATION: tool-call stream SUCCESS

openrouter/meta/muse-glimmer-30b — tool-call:text-text (success)

Output
Function: get_weather
Arguments: {"location": "London"}
VALIDATION: tool-call SUCCESS

openrouter/meta/muse-glimmer-30b — params:text-text (success)

Output
The capital of France is Paris.

openrouter/meta/muse-glimmer-30b — params:text-text:stream (success)

Output
The capital of France is Paris.

openrouter/meta/muse-glimmer-30b — json-output:text-text (success)

Output
{
  "colors": [
    { "name": "red", "hex": "#FF0000" },
    { "name": "green", "hex": "#00FF00" },
    { "name": "blue", "hex": "#0000FF" }
  ]
}
VAL
... (truncated, 29 chars omitted)

openrouter/meta/muse-glimmer-30b — json-output:text-text:stream (success)

Output
{
  "colors": [
    {"name": "red", "hex": "#FF0000"},
    {"name": "green", "hex": "#00FF00"},
    {"name": "blue", "hex": "#0000FF"}
  ]
}
VALIDATIO
... (truncated, 30 chars omitted)

openrouter/meta/muse-glimmer-30b — structured-output:text-text (success)

Output
{
  "name": "science fair",
  "date": "Friday",
  "participants": ["Alice", "Bob"]
}
VALIDATION: structured-output SUCCESS

openrouter/meta/muse-glimmer-30b — structured-output:text-text:stream (success)

Output
{
  "name": "science fair",
  "date": "Friday",
  "participants": ["Alice", "Bob"]
}
VALIDATION: structured-output stream SUCCESS

openrouter/meta/muse-glimmer-30b — reasoning:text-text:stream (success)

Output
In an exponent tower the power is taken from the top down.

In ordinary mathematics

$$a^{b^{c}}=a^{\left(b^{c}\right)}$$

is right associative, i.e. 
... (truncated, 1459 chars omitted)

openrouter/meta/muse-glimmer-30b — reasoning:text-text (success)

Output
In ordinary arithmetic the power sign is not associative so you have to
decide what you mean by a tower of powers

3^3^3^3


The convention tha
... (truncated, 1554 chars omitted)

@Archit-Kumar-16
Archit-Kumar-16 merged commit 0e2d2be into main Aug 11, 2026
8 checks passed
@Archit-Kumar-16
Archit-Kumar-16 deleted the bot/add-openrouter-meta-muse-glimmer-30b-20260811-000751 branch August 11, 2026 05:51
@harshiv-26

Copy link
Copy Markdown
Collaborator

Gateway test results

  • Total: 10
  • Passed: 9
  • Failed: 1
  • Validation failed: 0
  • Errored: 0
  • Skipped: 0
  • Success rate: 90.0%
Provider Model Scenarios
openrouter meta/muse-glimmer-30b success: params:text-text, tool-call:text-text:stream, params:text-text:stream, tool-call:text-text, json-output:text-text:stream, json-output:text-text, structured-output:text-text:stream, reasoning:text-text, reasoning:text-text:stream

failure: structured-output:text-text
Failures (1)

openrouter/meta/muse-glimmer-30b — structured-output:text-text (failure)

Error
Traceback (most recent call last):
  File "/tmp/tmphky6bfu6/snippet.py", line 21, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_utils/_utils.py", line 286, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/resources/chat/completions/completions.py", line 1147, in create
    return self._post(
           ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1259, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/openai/_base_client.py", line 1047, in request
    raise self._make_status_error_from_response(err.response) from None
openai.PermissionDeniedError: Error code: 403 - {'status': 'failure', 'message': 'User gateway-tester-v2-37f57406-9 is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'error': {'message': 'User gateway-tester-v2-37f57406-9 is not authorized to access model test-v2-openrouter/meta-muse-glimmer-30b or model does not exist', 'type': 'AuthorizationError', 'code': '403'}, 'error_origin_level': 'authorization'}
Code snippet
from openai import OpenAI
import json

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response_schema = json.loads('''{
  "title": "CalendarEvent",
  "type": "object",
  "properties": {
    "name": { "type": "string" },
    "date": { "type": "string" },
    "participants": {
      "type": "array",
      "items": { "type": "string" }
    }
  },
  "required": ["name", "date", "participants"],
  "additionalProperties": false
}''')

response = client.chat.completions.create(
    model="test-v2-openrouter/meta-muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "Alice and Bob are going to a science fair on Friday. Extract the event details as JSON."},
    ],
    response_format={"type": "json_schema", "json_schema": {"name": "CalendarEvent", "schema": response_schema}},
    stream=False,
)
import json as _json

_content = response.choices[0].message.content
print(_content)

if not _content:
    raise Exception("VALIDATION FAILED: structured-output - response content is empty")

_parsed = _json.loads(_content)

if "name" not in _parsed or "date" not in _parsed or "participants" not in _parsed:
    raise Exception("VALIDATION FAILED: structured-output - missing expected fields (name, date, participants)")

if not isinstance(_parsed.get("participants"), list):
    raise Exception("VALIDATION FAILED: structured-output - 'participants' is not a list, schema not enforced")

if set(_parsed.keys()) != {"name", "date", "participants"}:
    raise Exception(
        f"VALIDATION FAILED: structured-output - unexpected keys present: {set(_parsed.keys())}"
    )

print("VALIDATION: structured-output SUCCESS")
Successes (9)

openrouter/meta/muse-glimmer-30b — params:text-text (success)

Output
The capital of France is Paris.

openrouter/meta/muse-glimmer-30b — tool-call:text-text:stream (success)

Output
{"location": "London"}
VALIDATION: tool-call stream SUCCESS

openrouter/meta/muse-glimmer-30b — params:text-text:stream (success)

Output
The capital of France is Paris.

openrouter/meta/muse-glimmer-30b — tool-call:text-text (success)

Output
Function: get_weather
Arguments: {"location": "London"}
VALIDATION: tool-call SUCCESS

openrouter/meta/muse-glimmer-30b — json-output:text-text:stream (success)

Output
{
  "colors": [
    {"name": "red", "hex": "#FF0000"},
    {"name": "green", "hex": "#00FF00"},
    {"name": "blue", "hex": "#0000FF"}
  ]
}
VALIDATIO
... (truncated, 30 chars omitted)

openrouter/meta/muse-glimmer-30b — json-output:text-text (success)

Output
{
  "colors": [
    { "name": "Red", "hex": "#FF0000" },
    { "name": "Green", "hex": "#00FF00" },
    { "name": "Blue", "hex": "#0000FF" }
  ]
}
VAL
... (truncated, 29 chars omitted)

openrouter/meta/muse-glimmer-30b — structured-output:text-text:stream (success)

Output
{
  "name": "science fair",
  "date": "Friday",
  "participants": ["Alice", "Bob"]
}
VALIDATION: structured-output stream SUCCESS

openrouter/meta/muse-glimmer-30b — reasoning:text-text (success)

Output
In an exponent tower the power is taken from the top down, i.e.

$$a^{b^{c}} = a^{\left(b^{c}\right)}\qquad\text{not}\qquad \left(a^{b}\right)^{c}$$


... (truncated, 1378 chars omitted)

openrouter/meta/muse-glimmer-30b — reasoning:text-text:stream (success)

Output
Exponentiation is not associative so a power tower has to be defined.

In ordinary arithmetic a tower is taken to be **right associative**

a^b^c^
... (truncated, 1308 chars omitted)


</details>

</details>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants