-
Notifications
You must be signed in to change notification settings - Fork 21
Open
Description
Describe the issue:
When executing python ./src/evaluate.py --evaluation-name assistant-dev --evaluation-data-path ./src/data/ground_truth_sample.jsonl --metrics similarity according to README.md, the error is as follows:


Repro Steps:
- Run
git clone https://github.com/Azure-Samples/assistant-data-openai-python-promptflow
andcd assistant-data-openai-python-promptflow - Run
python -m venv .venvand.venv\scripts\activate - Run
pip install -r ./src/requirements.txt - Run
azd auth login - Run
azd provision - Run
azd deploy - Run
pf flow test --flow ./src/copilot_sdk_flow/flow.flex.yaml --inputs chat_input="which month has peak sales in 2023" - Run
python ./src/evaluate.py --evaluation-name assistant-dev --evaluation-data-path ./src/data/ground_truth_sample.jsonl --metrics similarity
Environment:
- Azd version: azd version 1.9.5 (commit cd2b7af9995d358aab33c782614f801ac1997dde)
- OS: Windows desktop
Expected behavior:
Run python ./src/evaluate.py --evaluation-name assistant-dev --evaluation-data-path ./src/data/ground_truth_sample.jsonl --metrics similarity can pass.
@jongio and @jfomhover for notification.
Metadata
Metadata
Assignees
Labels
No labels