Skip to content

Pass through azure open ai params to cachedChatCompletion#117

Merged
ibolmo merged 3 commits intomainfrom
azure-fix
Feb 25, 2025
Merged

Pass through azure open ai params to cachedChatCompletion#117
ibolmo merged 3 commits intomainfrom
azure-fix

Conversation

@ibolmo
Copy link
Collaborator

@ibolmo ibolmo commented Feb 25, 2025

No description provided.

@github-actions
Copy link

github-actions bot commented Feb 25, 2025

Braintrust eval report

Autoevals (azure-fix-1740788643)

Score Average Improvements Regressions
NumericDiff 72.9% (+9pp) 22 🟢 -
Start 1740788642.74s - -
End 1740788644.3s - -
Duration 1.53s (-2.22s) 100 🟢 16 🔴
Llm_duration 1.56s (-0.77s) 9 🟢 7 🔴
Prompt_tokens 278.99tok (+0.82tok) - 35 🔴
Completion_tokens 20.63tok (+0tok) - -
Total_tokens 299.62tok (+0.82tok) - 35 🔴
Estimated_cost 0$ (+0$) - -

@github-actions
Copy link

Braintrust eval report

Autoevals (azure-fix-1740509304)

Score Average Improvements Regressions
NumericDiff 74.8% (0pp) - -
Start 1740509304s - -
End 1740509305.6s - -
Duration 1.5s (-0.01s) 51 🟢 48 🔴
Prompt_tokens 279.25tok (+0tok) - -
Completion_tokens 18.36tok (+0tok) - -
Total_tokens 297.6tok (+0tok) - -

@ibolmo ibolmo merged commit c7ede06 into main Feb 25, 2025
8 checks passed
@ibolmo ibolmo deleted the azure-fix branch February 25, 2025 18:50
@github-actions
Copy link

github-actions bot commented Feb 25, 2025

Braintrust eval report

Autoevals (main-1740509478)

Score Average Improvements Regressions
NumericDiff 74.8% (+0pp) - -
Start 1740509478.28s - -
End 1740509479.92s - -
Duration 1.61s (+0.11s) - 100 🔴
Prompt_tokens 279.25tok (+0tok) - -
Completion_tokens 18.36tok (+0tok) - -
Total_tokens 297.6tok (+0tok) - -

@ibolmo
Copy link
Collaborator Author

ibolmo commented Feb 25, 2025

@da1z 0.120 is now available https://www.npmjs.com/package/autoevals if you don't mind checking that things are looking good

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants