LCORE-2802: Add OKP RAG quality regression benchmarks and baseline comparison#265

Open

alessandralanz wants to merge 15 commits into

lightspeed-core:mainfrom

alessandralanz:lcore-regression

Commits on Jun 26, 2026

Add OKP RAG quality benchmarks and system config for LCORE regression. Checked against a live OKP image with 85% pass rate
alessandralanz
committed
Add baseline comparison script for regression gating
alessandralanz
committed
Revised benchmarks to adhere to Evaluation Data Collection Standard + Guide's dataset sizing and distribution recommendations
alessandralanz
committed
Add version-controlled baseline for regression gating
alessandralanz
committed
Add three run A/B/C comparison script and regression tests. Attributes quality regression to PR code changes vs OKP data changes using pairwise A/B/C comparisons and shared test helpers have been m…
alessandralanz
committed

Commits on Jun 29, 2026

LCORE-2802: Update baseline from 102 to 506 evaluations
alessandralanz
committed

Commits on Jun 30, 2026

Commits on Jul 1, 2026

Commits on Jul 2, 2026

Remove A/B/C comparison script since weekly/PR gate jobs isolate variables independently
alessandralanz
committed