Tests for Inspect adapter edge cases (empty choices, local paths, misleading dataset names)#105

Open

MattFisher wants to merge 9 commits intoevaleval:mainfrom

MattFisher:inspect-edge-case-tests

Commits on Apr 14, 2026

Add xfail tests for Inspect adapter edge cases
MattFisher
committed

Commits on Apr 23, 2026

Trim fixture sample_ids to match retained samples
MattFisher
committed
Merge caller-provided metadata_args with defaults in test helper
MattFisher
committed
Fix IndexError on empty output.choices in Inspect instance-level adapter
MattFisher
committed
Detect local dataset paths and emit SourceDataPrivate
MattFisher
committed
Use task name as dataset_name; preserve dataset.name in additional_details
MattFisher
committed
Align instance-level evaluation_id with aggregate log
MattFisher
committed
Merge remote-tracking branch 'origin/main' into inspect-edge-case-tests
MattFisher
committed
Refine dataset_name heuristic based on dataset.location
MattFisher
committed