Skip to content

feat(sambanova): update model YAMLs [bot] - #2102

Closed
models-bot[bot] wants to merge 1 commit into
mainfrom
bot/update-sambanova-20260810-125401
Closed

feat(sambanova): update model YAMLs [bot]#2102
models-bot[bot] wants to merge 1 commit into
mainfrom
bot/update-sambanova-20260810-125401

Conversation

@models-bot

@models-bot models-bot Bot commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

Auto-generated by poc-agent for provider sambanova.


Note

Low Risk
Metadata-only pricing and documentation link updates with no runtime or auth changes.

Overview
Updates SambaNova catalog metadata for gemma-4-31B-it.

Pricing per-token costs are raised: input 2.2e-7 → 3.8e-7, output 5.9e-7 → 1.15e-6 (region * unchanged).

Sources now cite SambaNova docs for the models list plus vision, video, and prompt-caching (in addition to existing function-calling). No changes to modalities, limits, or other model flags in this diff.

Reviewed by Cursor Bugbot for commit 5e05eff. Bugbot is set up for automated code reviews on this repo. Configure here.

@github-actions

Copy link
Copy Markdown
Contributor

/test-models

@harshiv-26

Copy link
Copy Markdown
Collaborator

Gateway test results

  • Total: 4
  • Passed: 2
  • Failed: 0
  • Validation failed: 2
  • Errored: 0
  • Skipped: 0
  • Success rate: 50.0%
Provider Model Scenarios
sambanova gemma-4-31B-it success: params:stream, params

validation_failure: reasoning, reasoning:stream
Failures (2)

sambanova/gemma-4-31B-it — reasoning (validation_failure)

Error
Traceback (most recent call last):
  File "/tmp/tmp6kdgv5r5/snippet.py", line 39, in <module>
    raise Exception("VALIDATION FAILED: reasoning - no reasoning information in response")
Exception: VALIDATION FAILED: reasoning - no reasoning information in response
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response = client.chat.completions.create(
    model="test-v2-sambanova/gemma-4-31B-it",
    messages=[
        {"role": "user", "content": "How to calculate 3^3^3^3? Think step by step and show all reasoning."},
    ],
    reasoning_effort="medium",
    stream=False,
)
_usage = getattr(response, "usage", None)
_reasoning_detected = False

_choices = getattr(response, "choices", None)
if _choices and len(_choices) > 0:
    _message = getattr(_choices[0], "message", None)
else:
    _message = None

if _message and getattr(_message, "content", None) is not None:
    print(_message.content)

if _usage is not None:
    _output_token_details = getattr(_usage, "completion_tokens_details", None)
    if _output_token_details and getattr(_output_token_details, "reasoning_tokens", 0) > 0:
        _reasoning_detected = True
    elif getattr(_usage, "reasoning", None) is not None:
        _reasoning_detected = True

if getattr(_message, "reasoning_content", None) is not None:
    _reasoning_detected = True
elif getattr(_message, "reasoning", None) is not None:
    _reasoning_detected = True

if not _reasoning_detected:
    print("Response: ", response)
    raise Exception("VALIDATION FAILED: reasoning - no reasoning information in response")
print("VALIDATION: reasoning SUCCESS")
Output
To calculate an expression like $3^{3^{3^3}}$, we must follow the mathematical convention for **tetration** (repeated exponentiation). 

### Step 1: Determine the Order of Operations
In mathematics, when exponents are stacked without parentheses, they are evaluated from **top to bottom** (right-associative). 

The expression is interpreted as:
$$3^{(3^{(3^3)})}$$

If we calculated from the bottom up, the number would be significantly smaller. By calculating from the top down, the number grows at an astronomical rate.

---

### Step 2: Solve the First Level (The Top)
We start with the highest exponent:
$$3^3 = 3 \times 3 \times 3 = 27$$

Now, we substitute this back into the expression:
$$3^{3^{27}}$$

---

### Step 3: Solve the Second Level
Now we must calculate $3^{27}$. This is a large number, but manageable with a calculator:
$$3^{27} = 7,625,597,484,987$$

Now, we substitute this result back into the base:
$$3^{7,625,597,484,987}$$

---

### Step 4: Analyze the Final Result
The final step is to calculate $3$ raised to the power of $7.6$ trillion. 

**Can we write this as a standard number?**
No. To understand why, let's look at the number of digits this number would have. The number of digits in $x$ is roughly $\log_{10}(x)$.

$$\text{Number of digits} \approx \log_{10}(3^{7,625,597,484,987})$$
$$\text{Number of digits} \approx 7,625,597,484,987 \times \log_{10}(3)$$
$$\text{Number of digits} \approx 7,625,597,484,987 \times 0.4771$$
$$\text{Number of digits} \approx 3,638,334,640,024$$

The resulting number has approximately **3.6 trillion digits**. 

To put this in perspective:
*   If you printed this number in standard font on A4 paper, the paper trail would stretch for millions of miles.
*   There is not enough digital storage on a standard consumer hard drive to save this number as a text file.

### Final Answer:
The expression $3^{3^{3^3}}$ is equal to **$3^{7,625,597,484,987}$**. 

It is a number so large that it cannot be written in decimal form, but it is represented in tetration notation as $^4 3$.
Response:  ChatCompletion(id='8c31d055-fda6-4620-84c6-d8053a74323d', choices=[Choice(finish_reason='stop', index=0, logprobs=None, message=ChatCompletionMessage(content="To calculate an expression like $3^{3^{3^3}}$, we must follow the mathematical convention for **tetration** (repeated exponentiation). \n\n### Step 1: Determine the Order of Operations\nIn mathematics, when exponents are stacked without parentheses, they are evaluated from **top to bottom** (right-associative). \n\nThe expression is interpreted as:\n$$3^{(3^{(3^3)})}$$\n\nIf we calculated from the bottom up, the number would be significantly smaller. By calculating from the top down, the number grows at an astronomical rate.\n\n---\n\n### Step 2: Solve the First Level (The Top)\nWe start with the highest exponent:\n$$3^3 = 3 \\times 3 \\times 3 = 27$$\n\nNow, we substitute this back into the expression:\n$$3^{3^{27}}$$\n\n---\n\n### Step 3: Solve the Second Level\nNow we must calculate $3^{27}$. This is a large number, but manageable with a calculator:\n$$3^{27} = 7,625,597,484,987$$\n\nNow, we substitute this result back into the base:\n$$3^{7,625,597,484,987}$$\n\n---\n\n### Step 4: Analyze the Final Result\nThe final step is to calculate $3$ raised to the power of $7.6$ trillion. \n\n**Can we write this as a standard number?**\nNo. To understand why, let's look at the number of digits this number would have. The number of digits in $x$ is roughly $\\log_{10}(x)$.\n\n$$\\text{Number of digits} \\approx \\log_{10}(3^{7,625,597,484,987})$$\n$$\\text{Number of digits} \\approx 7,625,597,484,987 \\times \\log_{10}(3)$$\n$$\\text{Number of digits} \\approx 7,625,597,484,987 \\times 0.4771$$\n$$\\text{Number of digits} \\approx 3,638,334,640,024$$\n\nThe resulting number has approximately **3.6 trillion digits**. \n\nTo put this in perspective:\n*   If you printed this number in standard font on A4 paper, the paper trail would stretch for millions of miles.\n*   There is not enough digital storage on a standard consumer hard drive to save this number as a text file.\n\n### Final Answer:\nThe expression $3^{3^{3^3}}$ is equal to **$3^{7,625,597,484,987}$**. \n\nIt is a number so large that it cannot be written in decimal form, but it is represented in tetration notation as $^4 3$.", refusal=None, role='assistant', annotations=None, audio=None, function_call=None, tool_calls=None))], created=1786366537, model='gemma-4-31B-it', object='chat.completion', service_tier=None, system_fingerprint='fastcoe', usage=CompletionUsage(completion_tokens=653, prompt_tokens=35, total_tokens=688, completion_tokens_details=None, prompt_tokens_details=None), provider='sambanova')

sambanova/gemma-4-31B-it — reasoning:stream (validation_failure)

Error
Traceback (most recent call last):
  File "/tmp/tmpi6ty7wqu/snippet.py", line 31, in <module>
    raise Exception("VALIDATION FAILED: reasoning stream - no reasoning information in stream")
Exception: VALIDATION FAILED: reasoning stream - no reasoning information in stream
Code snippet
from openai import OpenAI

client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")

response = client.chat.completions.create(
    model="test-v2-sambanova/gemma-4-31B-it",
    messages=[
        {"role": "user", "content": "How to calculate 3^3^3^3? Think step by step and show all reasoning."},
    ],
    reasoning_effort="medium",
    stream=True,
)
_reasoning_detected = False
for chunk in response:
    if chunk.choices and len(chunk.choices) > 0:
        delta = chunk.choices[0].delta
        if delta.content is not None:
            print(delta.content, end="", flush=True)
        if getattr(delta, "reasoning_content", None) is not None:
            _reasoning_detected = True
        if getattr(delta, "reasoning", None) is not None:
            _reasoning_detected = True

    _usage = getattr(chunk, "usage", None)
    if _usage is not None:
        _details = getattr(_usage, "completion_tokens_details", None)
        if _details and getattr(_details, "reasoning_tokens", 0) > 0:
            _reasoning_detected = True

if not _reasoning_detected:
    raise Exception("VALIDATION FAILED: reasoning stream - no reasoning information in stream")
print("\nVALIDATION: reasoning stream SUCCESS")
Output
To calculate an expression like $3^{3^{3^3}}$, we must follow the mathematical convention for **tetration** (repeated exponentiation). 

### Step 1: Determine the Order of Operations
In mathematics, when exponents are stacked without parentheses, they are evaluated from **top to bottom** (right-associative). 

The expression is interpreted as:
$$3^{(3^{(3^3)})}$$

If we calculated from the bottom up, the number would be significantly smaller. By calculating from the top down, the number grows at an astronomical rate.

---

### Step 2: Solve the First Level (The Top)
We start with the highest exponent:
$$3^3 = 3 \times 3 \times 3 = 27$$

Now, we substitute this back into the expression:
$$3^{3^{27}}$$

---

### Step 3: Solve the Second Level
Now we must calculate $3^{27}$. This is a large number, but manageable with a calculator:
$$3^{27} = 7,625,597,484,987$$

Now, we substitute this result back into the base:
$$3^{7,625,597,484,987}$$

---

### Step 4: Analyze the Final Result
The final step is to calculate $3$ raised to the power of $7.6$ trillion. 

**Can we write this as a standard number?**
No. To understand why, let's look at the number of digits this number would have. The number of digits in $x$ is roughly $\log_{10}(x)$.

$$\text{Number of digits} \approx \log_{10}(3^{7,625,597,484,987})$$
$$\text{Number of digits} \approx 7,625,597,484,987 \times \log_{10}(3)$$
$$\text{Number of digits} \approx 7,625,597,484,987 \times 0.4771$$
$$\text{Number of digits} \approx 3,638,334,640,024$$

The resulting number has approximately **3.6 trillion digits**. 

To put this in perspective:
*   If you printed this number in standard font on A4 paper, the paper trail would stretch for millions of miles.
*   There is not enough digital storage on a standard consumer hard drive to save this number as a text file.

### Final Answer:
The expression $3^{3^{3^3}}$ is equal to **$3^{7,625,597,484,987}$**. 

It is a number so large that it cannot be written in decimal form, but it is represented in tetration notation as $^4 3$.
Successes (2)

sambanova/gemma-4-31B-it — params:stream (success)

Output
The capital of France is Paris.

sambanova/gemma-4-31B-it — params (success)

Output
The capital of France is Paris.

@LordGameleo

Copy link
Copy Markdown
Collaborator

~73-95% price increase on gemma-4-31B-it — please verify against SambaNova's published pricing page.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants