Add benchmark results for openai/gpt-5.1

[github-actions]

This PR adds benchmark results for the openai/gpt-5.1 model.

The following files have been updated:

• src/benchmark/results.json - Raw benchmark results
• src/benchmark/validation-results.json - Validation results against human baseline

This PR was automatically generated by the benchmark workflow.

Note: If you don't want to merge this PR, close it and the model will be added to the untested list to prevent re-processing.

@alrocar

---

Note

Adds openai/gpt-5.1 to the benchmark suite, including raw run outputs and validation comparisons against the human baseline.

• Config:
  • Add openai model gpt-5.1 to src/benchmark-config.json.
• Benchmarks:
  • Append extensive gpt-5.1 run data to src/benchmark/results.json (SQL, outputs, metrics, attempts for many pipe_XX queries).
• Validation:
  • Update src/benchmark/validation-results.json with per-query results for openai/gpt-5.1, including match statuses, distances, and aggregate summary metrics.

^{Written by Cursor Bugbot for commit 206a345. This will update automatically on new commits. Configure here.}

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Preview	Comments	Updated (UTC)
llm-benchmark	Ready	Preview	Comment	Nov 14, 2025 0:21am