Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/voice2 #31

Open
wants to merge 2,643 commits into
base: main
Choose a base branch
from
Open

Feature/voice2 #31

wants to merge 2,643 commits into from

Conversation

jmikedupont2
Copy link
Member

Relates to

Risks

Background

What does this PR do?

What kind of change is this?

Documentation changes needed?

Testing

Where should a reviewer start?

Detailed testing steps

lalalune and others added 30 commits February 5, 2025 06:39
docs: fix typos and update broken link in docs
…message-add

fix: twitter - add actions suppress action ability.
fix: rag optimizations/fixes for context.
…tel-plugin

fix: quick-intel plugin: optimize template/add suppress init msg
…message-add

fix: discord - add actions suppress action ability.
@jmikedupont2
Copy link
Member Author

jmikedupont2 commented Mar 3, 2025

80
0s ago
Space] Speaker approved => 1qLQGblNxGYEJ [JanusClient] subscribeSpeaker => userId= 1qLQGblNxGYEJ [JanusClient] subscriber handle => 5683229071807695 [JanusClient] found feedId => 408853090709551 [Space] updated speaker info => userId=1qLQGblNxGYEJ, feedId=408853090709551 [JanusClient] subscriber => "attached" with offer [JanusClient] subscriber track => audio [JanusClient] subscriber => done (user= 1qLQGblNxGYEJ ) [JanusClient] webrtcup => 5683229071807695 [2025-03-03 13:57:07] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:11] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:17] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:25] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:31] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:38] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:42] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:45] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:48] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:51] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:53] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:55] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:57:59] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:58:02] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:58:04] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:58:07] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:58:12] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:58:15] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:58:32] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:58:36] ERROR: [SttTtsPlugin] processAudio error => [2025-03-03 13:58:43] ERROR: [SttTtsPlugin] processAudio error => node:events:485 throw er; // Unhandled 'error' event ^ Error: ICE connection failed at RTCPeerConnection.<anonymous> (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/agent-twitter-client/dist/node/esm/index.mjs:4476:28) at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:37:18 at Set.forEach (<anonymous>) at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:33:15 at process.processTicksAndRejections (node:internal/process/task_queues:85:11) Emitted 'error' event on JanusClient instance at: at RTCPeerConnection.<anonymous> (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/agent-twitter-client/dist/node/esm/index.mjs:4476:14) at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:37:18 [... lines matching original stack trace ...] at process.processTicksAndRejections (node:internal/process/task_queues:85:11) Node.js v23.9.0 /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/agent:  ERR_PNPM_RECURSIVE_RUN_FIRST_FAIL  @elizaos/agent@0.25.6-alpha.1 start: `node --loader ts-node/esm src/index.ts "--isRoot" "--characters=./characters/zos.character.json"` Exit status 1  ELIFECYCLE  Command failed with exit code 1
Space] Speaker approved => 1qLQGblNxGYEJ
[JanusClient] subscribeSpeaker => userId= 1qLQGblNxGYEJ
[JanusClient] subscriber handle => 5683229071807695
[JanusClient] found feedId => 408853090709551
[Space] updated speaker info => userId=1qLQGblNxGYEJ, feedId=408853090709551
[JanusClient] subscriber => "attached" with offer
[JanusClient] subscriber track => audio
[JanusClient] subscriber => done (user= 1qLQGblNxGYEJ )
[JanusClient] webrtcup => 5683229071807695
[2025-03-03 13:57:07] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:11] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:17] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:25] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:31] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:38] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:42] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:45] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:48] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:51] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:53] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:55] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:57:59] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:58:02] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:58:04] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:58:07] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:58:12] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:58:15] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:58:32] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:58:36] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 13:58:43] ERROR: [SttTtsPlugin] processAudio error =>
node:events:485
throw er; // Unhandled 'error' event
^

Error: ICE connection failed
at RTCPeerConnection.<anonymous> (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/agent-twitter-client/dist/node/esm/index.mjs:4476:28)
at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:37:18
at Set.forEach (<anonymous>)
at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:33:15
at process.processTicksAndRejections (node:internal/process/task_queues:85:11)
Emitted 'error' event on JanusClient instance at:
at RTCPeerConnection.<anonymous> (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/agent-twitter-client/dist/node/esm/index.mjs:4476:14)
at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:37:18
[... lines matching original stack trace ...]
at process.processTicksAndRejections (node:internal/process/task_queues:85:11)

Node.js v23.9.0
/mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/agent:
 ERR_PNPM_RECURSIVE_RUN_FIRST_FAIL  @elizaos/agent@0.25.6-alpha.1 start: `node --loader ts-node/esm src/index.ts "--isRoot" "--characters=./characters/zos.character.json"`
Exit status 1
 ELIFECYCLE  Command failed with exit code 1.
Show less

The error logs indicate that there are multiple issues occurring in the application:

  1. Repeated SttTtsPlugin errors:
    There are numerous errors from the SttTtsPlugin, specifically with processing audio. These errors occur consistently from 13:57:07 to 13:58:43[1].

  2. ICE connection failure:
    The application encountered an ICE (Interactive Connectivity Establishment) connection failure, which is a critical error in WebRTC connections. This error caused the Node.js process to terminate[1].

  3. Janus session timeout:
    Although not explicitly shown in the logs, the ICE connection failure might be related to a Janus session timeout. Janus requires a keepalive message every 60 seconds to maintain the WebSocket connection[3][4].

To address these issues:

  1. SttTtsPlugin errors:
    Investigate the audio processing pipeline in the SttTtsPlugin. There might be issues with audio format, encoding, or the processing algorithm itself.

  2. ICE connection failure:

  • Ensure that STUN/TURN servers are correctly configured.
  • Check for any network issues or firewalls that might be blocking WebRTC traffic.
  • Verify that the ICE candidates are being properly exchanged between peers.
  1. Janus session maintenance:
    Implement a keepalive mechanism to prevent session timeouts:
  • Send a 'keepalive' message with the same 'session_id' every 30 seconds.
  • Use a runnable handler to manage this periodic task[4].

Example of implementing the keepalive:

function startKeepAlive(websocket, sessionId) {
  setInterval(() => {
    const keepaliveMessage = {
      janus: "keepalive",
      session_id: sessionId
    };
    websocket.send(JSON.stringify(keepaliveMessage));
  }, 30000); // Send keepalive every 30 seconds
}

Call this function when the WebSocket connection opens, and ensure to clear the interval when destroying the connection.

By addressing these issues, particularly the Janus session maintenance, you should be able to maintain a stable connection and prevent the ICE connection failures.

Citations:
[1] https://janus.discourse.group/t/error-creating-audio-sockets/65
[2] https://webrtc.googlesource.com/src/+/refs/heads/main/modules/audio_processing/audio_processing_impl.cc
[3] https://janus.conf.meetecho.com/docs/videoroom
[4] https://stackoverflow.com/questions/61883220/janus-gateway-videoroom-cancels-connection-after-60-seconds
[5] tonarino/webrtc-audio-processing#18
[6] https://pub.dev/documentation/janus_client/latest/
[7] https://gist.github.com/648540858/44135642522fe4fdb6f15865581c4c9a
[8] https://stackoverflow.com/questions/77798405/what-can-cause-audio-to-fail-one-way-in-a-webrtc-connection

@jmikedupont2
Copy link
Member Author

elizaOS#2206

@jmikedupont2
Copy link
Member Author

jmikedupont2 commented Mar 3, 2025

 [Space] Initializing...
[2025-03-03 19:45:47] INFO: Run `pnpm start:client` to start the client and visit the outputted URL (http://localhost:5173) to chat with your agents. When running multiple agents, use client with different port `SERVER_PORT=3001 pnpm start:client`
Downloading fast-bge-small-en-v1.5 [============--------] 58% 0.8s[Space] Got region => us-east-1
[Space] Creating broadcast...
Downloading fast-bge-small-en-v1.5 [====================] 100% 0.0s
[Space] Authorizing token...
[Space] Getting turn servers...
[2025-03-03 19:45:49] INFO: Generating text with options:
    modelProvider: "groq"
    model: "medium"
[2025-03-03 19:45:49] INFO: Selected model: llama-3.3-70b-versatile
[2025-03-03 19:45:49] INFO: Generating text with options:
    modelProvider: "groq"
    model: "small"
[2025-03-03 19:45:49] INFO: Selected model: llama-3.1-8b-instant
[JanusClient] Starting polling...
[JanusClient] createRoom => {"janus":"success","session_id":6082224249469452,"transaction":"vdu0hz41","sender":8591367340069483,"plugindata":{"plugin":"janus.plugin.videoroom","data":{"videoroom":"created","room":"1eaKbWMzOwBGX","permanent":false}}}
[JanusClient] Room '1eaKbWMzOwBGX' created successfully
[JanusClient] joined room => publisherId= 5089795037982126
[JanusClient] createOffer...
[JanusClient] sending configure with JSEP...
[JanusClient] waiting for answer...
[JanusClient] Initialization complete
[Space] Publishing broadcast...
[Space] Connecting chat...
[ChatClient] Connecting => wss://prod-chatman-ancillary-us-east-1.pscp.tv/chatapi/v1/chatnow
[ChatClient] Connected
[Space] Initialized => https://x.com/i/broadcasts/1eaKbWMzOwBGX
[Space] All plugins initialized
[Space] Plugin added => RecordToDiskPlugin
[2025-03-03 19:45:50] ERROR: Service transcription not found
[Space] Plugin added => SttTtsPlugin
[Space] Plugin added => IdleMonitorPlugin
[IdleMonitorPlugin] onAttach => plugin attached
[IdleMonitorPlugin] init => setting up idle checks
[JanusClient] got answer => setRemoteDescription
[2025-03-03 19:45:50] INFO: Generating text with options:
    modelProvider: "groq"
    model: "small"
[2025-03-03 19:45:50] INFO: Selected model: llama-3.1-8b-instant
[JanusClient] webrtcup => 8591367340069483
[2025-03-03 19:45:51] INFO: Generating text with options:
    modelProvider: "groq"
    model: "medium"
[2025-03-03 19:45:51] INFO: Selected model: llama-3.3-70b-versatile
[2025-03-03 19:45:51] ERROR: [SttTtsPlugin] TTS streaming error =>
[2025-03-03 19:45:52] INFO: Generating text with options:
    modelProvider: "groq"
    model: "large"
[2025-03-03 19:45:52] INFO: Selected model: llama-3.2-90b-vision-preview
Error parsing JSON: SyntaxError: Unexpected non-whitespace character after JSON at position 181 (line 1 column 182)
    at JSON.parse (<anonymous>)
    at parseJSONObjectFromText (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/packages/core/dist/index.js:220:29)
    at generateMessageResponse (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/packages/core/dist/index.js:8783:35)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async TwitterInteractionClient.handleTweet (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/vendor/elizaos/client-twitter/dist/index.js:5290:26)
    at async TwitterInteractionClient.handleTwitterInteractions (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/vendor/elizaos/client-twitter/dist/index.js:5186:21)
Text is not JSON { "user": "ZOS-MycorrhizalMind", "text": "verifying vibes, @introsp3ctor 👍✨, just making sure the mycorrhizal pulse is strong 🌱 #mycorrhizalpulse #zosmind", "action": "POST_TWEET" }This response acknowledges Mike Dupont's request to verify the authenticity of 'Officialcryptojebb' on telegram, while also maintaining ZOS-MycorrhizalMind's unique voice and style. The action is set to POST_TWEET, as the response is meant to be shared publicly on Twitter.
[2025-03-03 19:45:55] INFO: Executing handler for action: POST_TWEET
[2025-03-03 19:45:57] ERROR: Failed to login to Twitter
[Space] Speaker request => {
  userId: '1qLQGblNxGYEJ',
  username: 'introsp3ctor',
  displayName: 'Mike Dupont',
  sessionUUID: '58abd8ca-4b1a-4760-9225-8aeef59b7587'
}
[2025-03-03 19:47:09] INFO: Generating text with options:
    modelProvider: "groq"
    model: "small"
[2025-03-03 19:47:09] INFO: Selected model: llama-3.1-8b-instant
[2025-03-03 19:47:09] ERROR: [SttTtsPlugin] TTS streaming error =>
[Space] Approving speaker => https://guest.pscp.tv/api/v1/audiospace/request/approve {
  ntpForBroadcasterFrame: '2208988800024000300',
  ntpForLiveFrame: '2208988800024000300',
  chat_token: 'XXXX',
  session_uuid: '5dddd87'
}
[Space] Speaker approved => 1qLQGblNxGYEJ
[JanusClient] subscribeSpeaker => userId= 1qLQGblNxGYEJ
[JanusClient] subscriber handle => 8848106390472073
[JanusClient] found feedId => 7543580171886557
[Space] updated speaker info => userId=dddd, feedId=7543580171886557
[JanusClient] subscriber => "attached" with offer
[JanusClient] subscriber track => audio
[JanusClient] subscriber => done (user= 1qLQGblNxGYEJ )
[JanusClient] webrtcup => 8848106390472073
[2025-03-03 19:47:22] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:47:26] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:47:28] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:47:32] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:47:33] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:47:39] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:47:45] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:47:54] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:47:56] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:47:58] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:48:02] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:48:10] ERROR: [SttTtsPlugin] processAudio error =>
[2025-03-03 19:48:15] ERROR: [SttTtsPlugin] processAudio error =>
node:events:485
      throw er; // Unhandled 'error' event
      ^

Error: ICE connection failed
    at RTCPeerConnection.<anonymous> (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/agent-twitter-client/dist/node/esm/index.mjs:4476:28)
    at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:37:18
    at Set.forEach (<anonymous>)
    at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:33:15
    at process.processTicksAndRejections (node:internal/process/task_queues:85:11)
Emitted 'error' event on JanusClient instance at:
    at RTCPeerConnection.<anonymous> (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/agent-twitter-client/dist/node/esm/index.mjs:4476:14)
    at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:37:18
    [... lines matching original stack trace ...]
    at process.processTicksAndRejections (node:internal/process/task_queues:85:11)

Node.js v23.9.0
/mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/agent:
 ERR_PNPM_RECURSIVE_RUN_FIRST_FAIL  @elizaos/agent@0.25.6-alpha.1 start: `node --loader ts-node/esm src/index.ts "--isRoot" "--characters=./characters/zos.character.json"`
Exit status 1
 ELIFECYCLE  Command failed with exit code 1.
mdupont@mdupont-G470:~/cloud-deployment-eliza-2$ 

@jmikedupont2
Copy link
Member Author

Better

[Space] Speaker approved => 1qLQGblNxGYEJ
[JanusClient] subscribeSpeaker => userId= 1qLQGblNxGYEJ
[JanusClient] subscriber handle => 1917953999484346
[JanusClient] found feedId => 7015435374438017
[Space] updated speaker info => userId=1qLQGblNxGYEJ, feedId=7015435374438017
[JanusClient] subscriber => "attached" with offer
[JanusClient] subscriber track => audio
[JanusClient] subscriber => done (user= 1qLQGblNxGYEJ )
[JanusClient] webrtcup => 1917953999484346
[2025-03-03 20:41:53] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:41:57] WARN: Invalid embedding input:
    input: ""
    type: "string"
    length: 0
[2025-03-03 20:41:57] INFO: Generating text with options:
    modelProvider: "groq"
    model: "small"
[2025-03-03 20:41:57] INFO: Selected model: llama-3.1-8b-instant
[2025-03-03 20:41:57] WARN: [SttTtsPlugin] No replyText for user => 1qLQGblNxGYEJ
[2025-03-03 20:42:00] INFO: Generating text with options:
    modelProvider: "groq"
    model: "small"
[2025-03-03 20:42:00] INFO: Selected model: llama-3.1-8b-instant
[2025-03-03 20:42:01] WARN: [SttTtsPlugin] No replyText for user => 1qLQGblNxGYEJ
[2025-03-03 20:42:11] INFO: Generating text with options:
    modelProvider: "groq"
    model: "small"
[2025-03-03 20:42:11] INFO: Selected model: llama-3.1-8b-instant
[2025-03-03 20:42:12] WARN: [SttTtsPlugin] No replyText for user => 1qLQGblNxGYEJ
[2025-03-03 20:42:17] INFO: Generating text with options:
    modelProvider: "groq"
    model: "small"
[2025-03-03 20:42:17] INFO: Selected model: llama-3.1-8b-instant
[2025-03-03 20:42:18] WARN: [SttTtsPlugin] No replyText for user => 1qLQGblNxGYEJ
[2025-03-03 20:42:22] INFO: Generating text with options:
    modelProvider: "groq"
    model: "small"
[2025-03-03 20:42:22] INFO: Selected model: llama-3.1-8b-instant
[2025-03-03 20:42:34] WARN: [SttTtsPlugin] No replyText for user => 1qLQGblNxGYEJ
[2025-03-03 20:42:38] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:42:55] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:42:58] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:00] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:06] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:10] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:13] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:21] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:22] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:26] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:27] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:35] INFO: Generating text with options:
    modelProvider: "groq"
    model: "small"
[2025-03-03 20:43:35] INFO: Selected model: llama-3.1-8b-instant
[2025-03-03 20:43:39] WARN: [SttTtsPlugin] No replyText for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:42] WARN: [SttTtsPlugin] No replyText for user => 1qLQGblNxGYEJ
[2025-03-03 20:43:45] WARN: [SttTtsPlugin] No speech recognized for user => 1qLQGblNxGYEJ
[ChatClient] Closed
node:events:485
      throw er; // Unhandled 'error' event
      ^

Error: ICE connection failed
    at RTCPeerConnection.<anonymous> (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/agent-twitter-client/dist/node/esm/index.mjs:4476:28)
    at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:37:18
    at Set.forEach (<anonymous>)
    at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:33:15
    at process.processTicksAndRejections (node:internal/process/task_queues:85:11)
Emitted 'error' event on JanusClient instance at:
    at RTCPeerConnection.<anonymous> (file:///mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/agent-twitter-client/dist/node/esm/index.mjs:4476:14)
    at /mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/node_modules/@roamhq/wrtc/lib/eventtarget.js:37:18
    [... lines matching original stack trace ...]
    at process.processTicksAndRejections (node:internal/process/task_queues:85:11)

Node.js v23.9.0
/mnt/data1/nix/time/2025/01/13/cloud-deployment-eliza/agent:
 ERR_PNPM_RECURSIVE_RUN_FIRST_FAIL  @elizaos/agent@0.25.6-alpha.1 start: `node --loader ts-node/esm src/index.ts "--isRoot" "--characters=./characters/zos.character.json"`
Exit status 1
 ELIFECYCLE  Command failed with exit code 1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.