[Bug] web_retrievers manual test fail due to HF token.

[ZePan110]

Priority

P2-High

OS type

Ubuntu

Hardware type

Xeon-GNR

Installation method

• Pull docker images from hub.docker.com
• Build docker images from source
• Other

Deploy method

• Docker
• Docker Compose
• Kubernetes Helm Charts
• Other

Running nodes

Single Node

What's the version?

8beb8ed

Description

web_retrievers manual test fail
test link: https://github.com/opea-project/GenAIComps/actions/runs/13171452809/job/36764974639#step:8:497

Reproduce steps

manual test https://github.com/opea-project/GenAIComps/actions/runs/13171452809/job/36764974639

Raw log

Attachments

No response

[yongfengdu]

After enabled HF_TOKEN, another issue occurs and it seems like an issue of the latest image.
I've tried image opea/web-retriever:1.2 succeeded.
The error message with latest image is:

INFO: 192.168.103.192:39752 - "POST /v1/web_retrieval HTTP/1.1" 500 Internal Server Error
ERROR: Exception in ASGI application
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/chromadb/api/models/CollectionCommon.py", line 90, in wrapper
return func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/chromadb/api/models/CollectionCommon.py", line 389, in _validate_and_prepare_upsert_request
upsert_records = normalize_insert_record_set(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/chromadb/api/types.py", line 187, in normalize_insert_record_set
base_record_set = normalize_base_record_set(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/chromadb/api/types.py", line 164, in normalize_base_record_set
embeddings=normalize_embeddings(embeddings),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/chromadb/api/types.py", line 88, in normalize_embeddings
raise ValueError(
ValueError: Expected embeddings to be a list of floats or ints, a list of lists, a numpy array, or a list of numpy arrays, got [[[[2.7395002841949463, 3.2552080154418945, 1.2531545162200928, 8.331116676330566, 1.4570555686950684, 2.380880117416382, -0.5619943141937256, -1.3199527263641357, -0.033070024102926254, 0.1076865866780281, 1.6511542797088623, 1.504760503768921, 0.8926490545272827, 1.0040695667266846, -0.3639872670173645, -1.6770744323730469, -0.31314

[yongfengdu]

Created #1268 to track

[yongfengdu]

Web retriever shouldn't depends on the HF_TOKEN, and I've tried latest image without HF_TOKEN works fine.