Skip to content

[Release acceptance] Prove music quality Gate on the real provider #201

Description

@Jah-yee

Current scope

The RunPod deployment gap from the original issue is obsolete: scripts/deploy-music-serverless.ts, bun run deploy:music-serverless, the GPU image workflow, worker tests, and deployment documentation now exist. Do not reactivate the recovered 623-line deploy script.

The remaining valuable work is a current music-quality evaluation gate against today's music-engine contract.

Deliverable

  • A compact, versioned fixture corpus that exercises melody preservation, contour, timing, style conditioning, output validity, and deterministic/mock behavior.
  • Objective checks where possible, perceptual rubric and sampled artifacts where objective scores are insufficient.
  • One local command and one scheduled/explicit CI job with retained reports.
  • Model/version/seed recorded in every report.
  • Threshold changes reviewed as product/music decisions, not silently updated to make CI green.

Non-goals

  • Restoring deleted scripts verbatim.
  • Treating BPM/key estimates alone as proof of musical quality.
  • Running paid GPU evaluation on every ordinary PR.

Acceptance

A known-good release and a deliberately degraded fixture produce meaningfully different scores, reports are reproducible, and the operator can identify which musical dimension regressed.

rc.2 status

Merged integrated PR #440 and final release-tail PR #454 now supply the online technical Gate, versioned receipts, bounded retries, frozen golden cases, provider evidence artifact, and operator runbook. Keep this issue open only for real-provider product-level acceptance in #455/#450 and independent review in #456. Close it once the frozen known-good/degraded checks discriminate correctly, all three canary profiles pass, and the human melody/musicality decision is recorded; further model tuning belongs in a new post-release issue.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestowner-requiredRequires a human identity, approval, or external owner permissionpost-releaseNot a blocker for the current release; schedule after publicationslice/infratype/governance

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions