Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

It fails to work due to krisp filter authentication on self-hosted livekit #7

Open
mpisat opened this issue Feb 4, 2025 · 2 comments
Open

It fails to work due to krisp filter authentication on self-hosted livekit #7

mpisat opened this issue Feb 4, 2025 · 2 comments

Comments

@mpisat
Copy link

mpisat commented Feb 4, 2025

I'm getting:

both agent and pnpm is running. I hear greeting voice from agent. After that, when I say something, nothing happens.

a1d8b1db.57c15ca04d856851.js:64  Uncaught (in promise) Error: Authentication Error. Code 25683
    at n.N (a1d8b1db.57c15ca04d856851.js:64:5032)
    at n.setEnabled (a1d8b1db.57c15ca04d856851.js:64:3907)
    at D.<anonymous> (a1d8b1db.57c15ca04d856851.js:64:3297)
    at D._onWasmWorkerMessage (a1d8b1db.57c15ca04d856851.js:2:6457)
N @ a1d8b1db.57c15ca04d856851.js:64
setEnabled @ a1d8b1db.57c15ca04d856851.js:64
(anonymous) @ a1d8b1db.57c15ca04d856851.js:64
_onWasmWorkerMessage @ a1d8b1db.57c15ca04d856851.js:2
851-0b670061de27ff6d.js:1  Error: Authentication Error. Code 25683
    at n.N (a1d8b1db.57c15ca04d856851.js:64:5032)
    at n.setEnabled (a1d8b1db.57c15ca04d856851.js:64:3907)
    at async H.setEnabled (a1d8b1db.57c15ca04d856851.js:64:6910)
window.console.error @ 851-0b670061de27ff6d.js:1
console.error @ 290-0745e31b206d45e3.js:114
(anonymous) @ 290-0745e31b206d45e3.js:233
Promise.catch
(anonymous) @ 290-0745e31b206d45e3.js:233
aW @ de0c560c-4f05a088fce5a825.js:1
oe @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
or @ de0c560c-4f05a088fce5a825.js:1
ol @ de0c560c-4f05a088fce5a825.js:1
id @ de0c560c-4f05a088fce5a825.js:1
o @ de0c560c-4f05a088fce5a825.js:1
T @ 851-0b670061de27ff6d.js:1
a1d8b1db.57c15ca04d856851.js:64  Uncaught (in promise) Error: Authentication Error. Code 25683
    at n.N (a1d8b1db.57c15ca04d856851.js:64:5032)
    at n.setEnabled (a1d8b1db.57c15ca04d856851.js:64:3907)
    at async H.setEnabled (a1d8b1db.57c15ca04d856851.js:64:6910)

and agent logs:

{"message": "agent started", "level": "INFO", "name": "gemini-playground", "pid": 900813, "job_id": "AJ_zNXHQXqFcABt", "timestamp": "2025-02-04T11:20:32.888052+00:00"}
{"message": "Session initialized with chat context", "level": "INFO", "name": "livekit.agents", "pid": 900813, "job_id": "AJ_zNXHQXqFcABt", "timestamp": "2025-02-04T11:20:32.889073+00:00"}
{"message": "b'{\\n  \"setupComplete\": {}\\n}\\n'", "level": "INFO", "name": "root", "pid": 900813, "job_id": "AJ_zNXHQXqFcABt", "timestamp": "2025-02-04T11:20:32.968578+00:00"}
{"message": "initializing job process", "level": "INFO", "name": "livekit.agents", "pid": 901084, "timestamp": "2025-02-04T11:20:33.398826+00:00"}
{"message": "job process initialized", "level": "INFO", "name": "livekit.agents", "pid": 901084, "timestamp": "2025-02-04T11:20:33.398978+00:00"}
{"message": "process exiting", "level": "INFO", "name": "livekit.agents", "reason": "room disconnected", "pid": 900808, "job_id": "AJ_ydKJyz9HPjzA", "timestamp": "2025-02-04T11:20:40.701989+00:00"}
{"message": "livekit::room:1142:livekit::room - disconnected from room with reason: UnknownReason", "level": "INFO", "name": "livekit", "pid": 900808, "job_id": "AJ_ydKJyz9HPjzA", "timestamp": "2025-02-04T11:20:40.700460+00:00"}
{"message": "received job request", "level": "INFO", "name": "livekit.agents", "job_id": "AJ_xt4QYcBisE4v", "dispatch_id": "", "room_name": "c0wker", "agent_name": "", "resuming": false, "timestamp": "2025-02-04T11:21:34.477729+00:00"}
{"message": "connecting to room c0wker", "level": "INFO", "name": "gemini-playground", "pid": 900817, "job_id": "AJ_xt4QYcBisE4v", "timestamp": "2025-02-04T11:21:34.480980+00:00"}
{"message": "livekit_ffi::server:133:livekit_ffi::server - initializing ffi server v0.12.5", "level": "INFO", "name": "livekit", "pid": 900817, "job_id": "AJ_xt4QYcBisE4v", "timestamp": "2025-02-04T11:21:34.484603+00:00"}
{"message": "livekit_ffi::cabi:36:livekit_ffi::cabi - initializing ffi server v0.12.5", "level": "INFO", "name": "livekit", "pid": 900817, "job_id": "AJ_xt4QYcBisE4v", "timestamp": "2025-02-04T11:21:34.485301+00:00"}
{"message": "livekit_api::signal_client::signal_stream:96:livekit_api::signal_client::signal_stream - connecting to wss://de.karsiyaka.com:7883/rtc?sdk=python&protocol=15&auto_subscribe=0&adaptive_stream=0&version=0.19.1&access_token=...", "level": "INFO", "name": "livekit", "pid": 900817, "job_id": "AJ_xt4QYcBisE4v", "timestamp": "2025-02-04T11:21:34.488359+00:00"}
{"message": "starting multimodal agent", "level": "INFO", "name": "gemini-playground", "pid": 900817, "job_id": "AJ_xt4QYcBisE4v", "timestamp": "2025-02-04T11:21:34.573370+00:00"}
{"message": "agent started", "level": "INFO", "name": "gemini-playground", "pid": 900817, "job_id": "AJ_xt4QYcBisE4v", "timestamp": "2025-02-04T11:21:34.574019+00:00"}
{"message": "Session initialized with chat context", "level": "INFO", "name": "livekit.agents", "pid": 900817, "job_id": "AJ_xt4QYcBisE4v", "timestamp": "2025-02-04T11:21:34.574900+00:00"}
{"message": "b'{\\n  \"setupComplete\": {}\\n}\\n'", "level": "INFO", "name": "root", "pid": 900817, "job_id": "AJ_xt4QYcBisE4v", "timestamp": "2025-02-04T11:21:34.655062+00:00"}
{"message": "initializing job process", "level": "INFO", "name": "livekit.agents", "pid": 901156, "timestamp": "2025-02-04T11:21:35.109220+00:00"}
{"message": "job process initialized", "level": "INFO", "name": "livekit.agents", "pid": 901156, "timestamp": "2025-02-04T11:21:35.109369+00:00"}
{"message": "livekit::room:1142:livekit::room - disconnected from room with reason: UnknownReason", "level": "INFO", "name": "livekit", "pid": 900813, "job_id": "AJ_zNXHQXqFcABt", "timestamp": "2025-02-04T11:21:51.739891+00:00"}
{"message": "process exiting", "level": "INFO", "name": "livekit.agents", "reason": "room disconnected", "pid": 900813, "job_id": "AJ_zNXHQXqFcABt", "timestamp": "2025-02-04T11:21:51.741840+00:00"}

no errors on react side.
@mpisat
Copy link
Author

mpisat commented Feb 4, 2025

Versions:

node -v
v18.19.1

python3
Python 3.12.3 (main, Jan 17 2025, 18:03:48) [GCC 13.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> 
(.venv) root@de ~/python/gemini-playground/agent # pip list
Package                   Version
------------------------- ---------------
aiohappyeyeballs          2.4.4
aiohttp                   3.11.11
aiosignal                 1.3.2
annotated-types           0.7.0
anyio                     4.8.0
attrs                     25.1.0
cachetools                5.5.1
certifi                   2025.1.31
charset-normalizer        3.4.1
click                     8.1.8
frozenlist                1.5.0
google-api-core           2.24.1
google-auth               2.38.0
google-cloud-speech       2.30.0
google-cloud-texttospeech 2.24.0
google-genai              0.5.0
googleapis-common-protos  1.66.0
grpcio                    1.70.0
grpcio-status             1.70.0
idna                      3.10
livekit                   0.19.1
livekit-agents            0.12.11
livekit-api               0.8.1
livekit-plugins-google    0.10.2
livekit-protocol          0.8.0
multidict                 6.1.0
pillow                    11.1.0
pip                       24.0
propcache                 0.2.1
proto-plus                1.26.0
protobuf                  5.29.3
psutil                    5.9.8
pyasn1                    0.6.1
pyasn1_modules            0.4.1
pydantic                  2.10.6
pydantic_core             2.27.2
PyJWT                     2.10.1
python-dotenv             1.0.1
requests                  2.32.3
rsa                       4.9
sniffio                   1.3.1
types-protobuf            4.25.0.20240417
typing_extensions         4.12.2
urllib3                   2.3.0
watchfiles                0.24.0
websockets                14.2
yarl                      1.18.3

@mpisat
Copy link
Author

mpisat commented Feb 4, 2025

I was using pnpm run start -p 3011
when I test it with pnpm run dev -p 3011 (because my port 3000 is in use ofc)

Unhandled Runtime Error
Error: Authentication Error. Code 25683

Call Stack
CA.oA
node_modules/.pnpm/@[email protected][email protected]/node_modules/@livekit/krisp-noise-filter/dist/index.js (921:1)
CA.setEnabled
node_modules/.pnpm/@[email protected][email protected]/node_modules/@livekit/krisp-noise-filter/dist/index.js (895:1)
D.c
node_modules/.pnpm/@[email protected][email protected]/node_modules/@livekit/krisp-noise-filter/dist/index.js (874:1)
D._onWasmWorkerMessage
node_modules/.pnpm/@[email protected][email protected]/node_modules/@livekit/krisp-noise-filter/dist/index.js (203:1)

I'm using self hosted livekit and I definitely don't have krisp noise filter, I guess we need to disable it somehow?

@mpisat mpisat changed the title It fails to work. It fails to work due to krisp filter authentication on self-hosted livekit Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mpisat