feat(multi-agent): native concurrent floor (bench eval run --agents) + bf.* trajectory tree + hosted medical benchmark - #846

Draft

Yiminnn wants to merge 58 commits into

mainfrom

feat/arena-concurrent-scaffold

Commits on Jun 28, 2026

feat(arena): opt-in inter-agent concurrent runtime scaffold
symphony-bot
committed
feat(arena): route seats through the LiteLLM proxy + capture per-seat trajectories
symphony-bot
committed
feat(arena): persist proxy raw-LLM trajectory in BenchFlow canonical format
symphony-bot
committed
feat(arena): add a LangGraph medical-assistant agent hosted via the proxy
symphony-bot
committed
chore(arena): sample run-result bundle + callback-flush delay
symphony-bot
committed

Commits on Jun 29, 2026

feat(medical): per-specialist proxies → separate per-agent trajectories + native-vs-hosted runner
symphony-bot
committed
feat(medical): host Multi-Agent-Medical-Assistant as a BenchFlow benchmark
symphony-bot
committed

Commits on Jun 30, 2026

feat(trajectories): multi-agent bf.* attribution + agent tree

symphony-bot
and
claude
committed
feat(casino): real concurrent multi-agent ACP floor + live town viewer

symphony-bot
and
claude
committed
feat(arena): native concurrent multi-agent runner (--agents agents.yaml)

symphony-bot
and
claude
committed
fix(arena): unique per-process env-file path + per-seat id env for the shared floor

symphony-bot
and
claude
committed
fix(arena): reap host-service process group on teardown; use openhands proxy seat

symphony-bot
and
claude
committed
feat(arena): snapshot the service event log to events.jsonl for the town viewer

symphony-bot
and
claude
committed
feat(arena): decoupled Roster — `--agents` is a pure agents list

symphony-bot
and
claude
committed
feat(casinobench): benchmarks/casinobench env-0 task package + in-sandbox image

symphony-bot
and
claude
committed
refactor(arena): floor consumes a Roster + FloorConfig (decoupled from the task)

symphony-bot
and
claude
committed
feat(arena): in-sandbox service bootstrap + `bench eval run --agents` (drop host subprocess)

symphony-bot
and
claude
committed
fix(arena): inject floor service env via sandbox persistent env (not a no-op export)

symphony-bot
and
claude
committed

Commits on Jul 1, 2026

fix(arena): run Dockerfile + manifest task_selection/forward_env in bootstrap

symphony-bot
and
claude
committed
feat(cli): fold the multi-agent floor flags onto `bench eval run`

symphony-bot
and
claude
committed
feat(arena): snapshot events.jsonl in-sandbox for the animated town board

symphony-bot
and
claude
committed
fix(casinobench): cwd-based seat id + guard the viewer reseat reload

symphony-bot
and
claude
committed
docs(casino): add native-floor viewer screenshots (animated board + dossiers)

symphony-bot
and
claude
committed
feat(arena): player/seat id defaults to <agent>-<model>

symphony-bot
and
claude
committed
fix(casino): dossier tool-call rows show the command (title), not just kind
symphony-bot
committed
fix(casinobench): stop forwarding BENCHFLOW_SEED to the agent

symphony-bot
and
claude
committed
chore(casino): drop hardcoded /home paths + add all-games (seed-fixed) screenshot

symphony-bot
and
claude
committed
fix(arena): decouple the concurrent floor from casino specifics

symphony-bot
and
claude
committed

Commits on Jul 2, 2026

feat(casino): coordinated all-18-games coverage prompt
symphony-bot
committed
revert(arena): drop the barrier drive + forced-coverage prompt — casino stays free-play
symphony-bot
committed
feat(arena): floor bootstrap supports --sandbox daytona (not just docker)
symphony-bot
committed
feat(casinobench): reference the published versioned base image (daytona-pullable)
symphony-bot
committed
feat(casinobench): manifest → ACR tag (the registry Daytona pulls from)
symphony-bot
committed

Commits on Jul 3, 2026

fix(daytona): floor service-start detaches cleanly (setsid + tolerate start-exec timeout)
symphony-bot
committed
fix(daytona): proxy seats run their LiteLLM proxy in-sandbox on daytona
symphony-bot
committed
fix(daytona): keep the floor sandbox alive for the whole run (24h auto-stop)
symphony-bot
committed
fix(arena): proxy-stop in the seat finally is best-effort (don't crash the floor)
symphony-bot
committed
fix(daytona): size the shared floor sandbox (8cpu/16GB) so agents don't OOM
symphony-bot
committed
fix(daytona): floor sandbox 4cpu/8GB (daytona per-sandbox cap is 4 cpu)
symphony-bot
committed
fix(arena): scope the floor sandbox resource cap to daytona (docker uses host mem)
symphony-bot
committed
fix(daytona): SSH keepalive so the ACP agent stream survives think-gaps
symphony-bot
committed
fix(daytona): harden the ACP SSH connect (ConnectTimeout + ConnectionAttempts)
symphony-bot
committed

Commits on Jul 4, 2026

fix(arena): unique per-run floor session id
symphony-bot
committed
feat(arena): install seat agents + subscription marker in the floor
symphony-bot
committed
feat(acp): match model against adapter-advertised values; best-effort path resolve
symphony-bot
committed
feat(agents): claude adapter 0.55.0 + upload ~/.claude.json entitlements
symphony-bot
committed
chore(casinobench): bump base image to 2.0.4 (viewer dossier + thinking join)
symphony-bot
committed
feat(examples): casino floor viewers + mixed-agent rosters
symphony-bot
committed
chore(casinobench): bump base image to 2.0.5 (busted-seat join gate)
symphony-bot
committed
feat(arena): --deadline flag for the multi-agent floor (0 = no deadline, 24h cap)
symphony-bot
committed
feat(arena): nudge-on-event, ACP arrival timestamps, honest floor metrics
symphony-bot
committed
chore(casinobench): image 2.0.6 + house-etiquette prompt + roster-10
symphony-bot
committed

Commits on Jul 15, 2026

fix(arena): wire floor run controls
bingran-you
committed

Commits on Jul 17, 2026

fix(arena): close floor CLI drift
bingran-you
committed