All issues

Search results

Under-specified ADT problems are graded inconsistently across languages

Status: Open.

#121 In aallan/vera-bench;

· aallan opened on Jul 28, 2026

A nullary Python class is read as unverifiable, so the shape guard renders a call it cannot honour

Status: Open.

#119 In aallan/vera-bench;

· aallan opened on Jul 28, 2026

baselines destroys its output before it has a replacement

Status: Open.

#118 In aallan/vera-bench;

· aallan opened on Jul 28, 2026

TypeScript declaration scanning is not literal-aware

Status: Open.

#115 In aallan/vera-bench;

· aallan opened on Jul 27, 2026

Deduplicate the Python and TypeScript wrapper builders across runner and baseline_runner

Status: Open.

#111 In aallan/vera-bench;

· aallan opened on Jul 26, 2026

Expose the LLM client timeout as a --timeout flag

Status: Open.

#105 In aallan/vera-bench;

· aallan opened on Jul 25, 2026

Tier the test suite (unit vs integration) so the merge gate is fast and hermetic

Status: Open.

#102 In aallan/vera-bench;

· aallan opened on Jul 24, 2026

run_sweep.sh re-runs whole targets to clear a few transient failures — retry per-problem instead

Status: Open.

#101 In aallan/vera-bench;

· aallan opened on Jul 24, 2026

Track Harness/Codecov acquisition impact on vera-bench CI

infrastructureBuild, CI, tooling, storageBuild, CI, tooling, storage

qualityCode quality, testing, coverageCode quality, testing, coverage

Status: Open.

#80 In aallan/vera-bench;

· aallan opened on Jun 3, 2026

Add MoonBit as a comparison language

languagesLanguage support (Python, TypeScript, Go, etc.)Language support (Python, TypeScript, Go, etc.)

Status: Open.

#49 In aallan/vera-bench;

· aallan opened on Apr 13, 2026

Refactor models.py to a provider registry

enhancementNew feature or requestNew feature or request

Status: Open.

#45 In aallan/vera-bench;

· aallan opened on Apr 9, 2026

Automated scheduled benchmark runs with structured storage

infrastructureBuild, CI, tooling, storageBuild, CI, tooling, storage

Status: Open.

#31 In aallan/vera-bench;

· aallan opened on Mar 30, 2026