Skip to content

Missing agent credentials should be clean non-retryable rollout errors #917

Description

@bingran-you

Mirrors Linear ENG-257: https://linear.app/benchflow/issue/ENG-257/missing-credential-surfaces-as-an-in-rollout-traceback-instead-of-a

Problem

A missing required model credential currently surfaces through a generic exception path in rollout setup. That can produce noisy traceback-style logs and an ambiguous retryable/error classification even though the operator action is clear: provide the missing key.

Expected

Missing agent/model credentials should become a clean rollout error, classify as provider_auth, and avoid the generic Run failed traceback logger. This should stay focused on missing credential classification, not broad upfront preflight that could false-block injected runtime envs.

Current fix path

Daily scan 2026-07-11 confirmed this is BenchFlow repo-owned and narrow enough for a focused PR.

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1Important debt — must fix soon, but does not block the current release.area:diagnosticsIssue / PR lives primarily in the "diagnostics" subsystem.area:rolloutIssue / PR lives primarily in the "rollout" subsystem.bugSomething isn't workingreviewingFix PR open and awaiting reviewstatus:in-progressHas assignee or linked draft PR.

    Type

    No type

    Projects

    Status
    In Progress

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions