Code of Conduct
Existing issues
What happened?
A user who has customized profile.yml gets evaluations that silently ignore those customizations when running via Gemini
gemini-eval.mjs is documented as the free-tier alternative to the Claude/agent path, but it does not load all the context files the agent path is required to load. Specifically, it skips config/profile.yml and modes/_profile.md, so offers are evaluated without the user's archetypes, North Star, comp targets, location policy, narrative, or proof-point metrics. This skews report accuracy
This contradicts the explicit "Sources of Truth" contract in modes/_shared.md, which lists those files as always loaded.
Steps to reproduce
.
Expected behavior
No response
CLI tool
No response
OS and Node.js version
No response
Output of npm run doctor
Code of Conduct
Existing issues
What happened?
A user who has customized
profile.ymlgets evaluations that silently ignore those customizations when running via Geminigemini-eval.mjsis documented as the free-tier alternative to the Claude/agent path, but it does not load all the context files the agent path is required to load. Specifically, it skipsconfig/profile.ymlandmodes/_profile.md, so offers are evaluated without the user's archetypes, North Star, comp targets, location policy, narrative, or proof-point metrics. This skews report accuracyThis contradicts the explicit "Sources of Truth" contract in modes/_shared.md, which lists those files as always loaded.
Steps to reproduce
.
Expected behavior
No response
CLI tool
No response
OS and Node.js version
No response
Output of npm run doctor