Add autoloop perf-comparison program for tsb vs pandas benchmarking - #87
Conversation
…d playground page - Create .autoloop/programs/perf-comparison/program.md autoloop program definition - Add benchmarks/tsb/ and benchmarks/pandas/ with seed Series creation benchmarks - Add benchmarks/run_benchmarks.sh to orchestrate both TS and Python benchmarks - Add playground/benchmarks.html for displaying performance comparison metrics - Update playground/index.html with Performance section linking to benchmarks - Update pages.yml to copy benchmark results into deployed playground site Agent-Logs-Url: https://github.com/githubnext/tsessebe/sessions/4b3aa7c2-4060-4c79-b63c-1717b2502bb1 Co-authored-by: mrjf <180956+mrjf@users.noreply.github.com>
- Add error handling for malformed JSON in benchmark output parsing - Fix division-by-zero edge case in ratio calculation - Use string-quoted type hints in Python for broader compatibility Agent-Logs-Url: https://github.com/githubnext/tsessebe/sessions/4b3aa7c2-4060-4c79-b63c-1717b2502bb1 Co-authored-by: mrjf <180956+mrjf@users.noreply.github.com>
|
@copilot fix ci |
- Remove unused `Label` import in tests/stats/rank.test.ts (lint error: noUnusedImports) - Fix benchmarks/results.json formatting to satisfy biome formatter Agent-Logs-Url: https://github.com/githubnext/tsessebe/sessions/d1b6f11d-7523-4655-b5fe-d8a5cb191ffe Co-authored-by: mrjf <180956+mrjf@users.noreply.github.com>
|
Warning The Evergreen Fix: Merge Conflict ResolvedI resolved the merge conflict in Conflict: Both this PR and Resolution: Both step groups are included in sequence:
|
|
@copilot resolve the merge conflicts in this pull request |
…performance-test # Conflicts: # .github/workflows/pages.yml Co-authored-by: mrjf <180956+mrjf@users.noreply.github.com>
Resolved in 6ad6a7a. The only conflict was in |
New autoloop program that iteratively benchmarks
tsb(TypeScript/Bun) againstpandas(Python), one function per iteration, with results displayed on the playground doc site.Autoloop program
.autoloop/programs/perf-comparison/program.md— runs every 6h, metric isbenchmarked_functions(higher is better). Each iteration picks an unbenchmarked function, writes matching TS + Python benchmarks, runs both, records results.Benchmark infrastructure
benchmarks/tsb/andbenchmarks/pandas/— paired benchmark scripts with identical datasets (100K elements, 5 warm-up + 50 measured iterations)benchmarks/run_benchmarks.sh— orchestrator that discovers pairs, runs both, computes ratios, writesresults.jsonbench_series_creationfor both runtimesPlayground page
playground/benchmarks.html— bar chart + detail table, dynamically loadsresults.jsonplayground/index.html— added Performance section linking to benchmarks.github/workflows/pages.yml— copies benchmark results into deployed site