Skip to content

ESP32-S3-KORVO-2运行ai_agent/volc_rtc加入房间后没声音 (AUD-6087) #1377

@HaoWenT

Description

@HaoWenT

(27) boot: ESP-IDF v5.3.1-dirty 2nd stage bootloader
I (27) boot: compile time Feb 17 2025 21:11:32
I (27) boot: Multicore bootloader
I (30) boot: chip revision: v0.2
I (34) qio_mode: Enabling default flash chip QIO
I (39) boot.esp32s3: Boot SPI Speed : 80MHz
I (44) boot.esp32s3: SPI Mode : QIO
I (49) boot.esp32s3: SPI Flash Size : 16MB
I (54) boot: Enabling RNG early entropy source...
I (59) boot: Partition Table:
I (63) boot: ## Label Usage Type ST Offset Length
I (70) boot: 0 nvs WiFi data 01 02 00009000 00004000
I (78) boot: 1 phy_init RF data 01 01 0000d000 00001000
I (85) boot: 2 factory factory app 00 00 00010000 00300000
I (92) boot: 3 model Unknown data 01 82 00310000 0040e000
I (100) boot: 4 spiffs_data Unknown data 01 82 0071e000 00010000
I (108) boot: End of partition table
I (112) esp_image: segment 0: paddr=00010020 vaddr=3c180020 size=5243ch (336956) map
I (171) esp_image: segment 1: paddr=00062464 vaddr=3fc9f900 size=07edch ( 32476) load
I (177) esp_image: segment 2: paddr=0006a348 vaddr=40378000 size=05cd0h ( 23760) load
I (182) esp_image: segment 3: paddr=00070020 vaddr=42000020 size=179d74h (1547636) map
I (420) esp_image: segment 4: paddr=001e9d9c vaddr=4037dcd0 size=11bb4h ( 72628) load
I (445) boot: Loaded app from partition at offset 0x10000
I (445) boot: Disabling RNG early entropy source...
I (457) octal_psram: vendor id : 0x0d (AP)
I (457) octal_psram: dev id : 0x02 (generation 3)
I (457) octal_psram: density : 0x03 (64 Mbit)
I (462) octal_psram: good-die : 0x01 (Pass)
I (467) octal_psram: Latency : 0x01 (Fixed)
I (473) octal_psram: VCC : 0x01 (3V)
I (478) octal_psram: SRF : 0x01 (Fast Refresh)
I (483) octal_psram: BurstType : 0x01 (Hybrid Wrap)
I (489) octal_psram: BurstLen : 0x01 (32 Byte)
I (495) octal_psram: Readlatency : 0x02 (10 cycles@Fixed)
I (501) octal_psram: DriveStrength: 0x00 (1/1)
I (507) MSPI Timing: PSRAM timing tuning index: 5
I (511) esp_psram: Found 8MB PSRAM device
I (516) esp_psram: Speed: 80MHz
I (520) cpu_start: Multicore app
I (809) esp_psram: SPI SRAM memory test OK
I (818) cpu_start: Pro cpu start user code
I (818) cpu_start: cpu freq: 240000000 Hz
I (818) app_init: Application information:
I (821) app_init: Project name: volc_rtc
I (826) app_init: App version: 1
I (830) app_init: Compile time: Feb 18 2025 19:39:37
I (836) app_init: ELF file SHA256: 5d477f077...
I (841) app_init: ESP-IDF: v5.3.1-dirty
I (847) efuse_init: Min chip rev: v0.0
I (851) efuse_init: Max chip rev: v0.99
I (856) efuse_init: Chip rev: v0.2
I (861) heap_init: Initializing. RAM available for dynamic allocation:
I (868) heap_init: At 3FCAED48 len 0003A9C8 (234 KiB): RAM
I (874) heap_init: At 3FCE9710 len 00005724 (21 KiB): RAM
I (881) heap_init: At 600FE100 len 00001EE8 (7 KiB): RTCRAM
I (887) esp_psram: Adding pool of 8192K of PSRAM memory to heap allocator
I (895) spi_flash: detected chip: gd
I (898) spi_flash: flash io: qio
W (903) ADC: legacy driver is deprecated, please migrate to esp_adc/adc_oneshot.h
I (911) sleep: Configure to isolate all GPIO pins in sleep state
I (918) sleep: Enable automatic switching of GPIO sleep configuration
I (925) main_task: Started on CPU0
I (937) esp_psram: Reserving pool of 32K of internal memory for DMA/internal allocations
I (938) main_task: Calling app_main()
I (946) main: Initialize board peripherals
I (950) PERIPH_SPIFFS: Partition size: total: 52961, used: 12299
I (954) AUDIO_THREAD: The esp_periph task allocate stack on internal memory
W (961) i2c_bus_v2: I2C master handle is NULL, will create new one
I (968) gpio: GPIO[17]| InputEn: 1| OutputEn: 1| OpenDrain: 1| Pullup: 1| Pulldown: 0| Intr:0
I (977) gpio: GPIO[18]| InputEn: 1| OutputEn: 1| OpenDrain: 1| Pullup: 1| Pulldown: 0| Intr:0
I (991) DRV8311: ES8311 in Slave mode
I (1001) gpio: GPIO[48]| InputEn: 0| OutputEn: 1| OpenDrain: 0| Pullup: 0| Pulldown: 0| Intr:0
I (1008) ES7210: ES7210 in Slave mode
I (1016) ES7210: Enable ES7210_INPUT_MIC1
I (1019) ES7210: Enable ES7210_INPUT_MIC2
I (1022) ES7210: Enable ES7210_INPUT_MIC3
W (1025) ES7210: Enable TDM mode. ES7210_SDP_INTERFACE2_REG12: 2
I (1030) ES7210: config fmt 60
I (1032) AUDIO_HAL: Codec mode is 3, Ctrl:1
I (1044) pp: pp rom version: e7ae62f
I (1044) net80211: net80211 rom version: e7ae62f
I (1046) wifi:wifi driver task: 3fcc3c60, prio:23, stack:6656, core=0
I (1052) wifi:wifi firmware version: ccaebfa
I (1054) wifi:wifi certification version: v7.0
I (1059) wifi:config NVS flash: enabled
I (1062) wifi:config nano formating: disabled
I (1066) wifi:Init data frame dynamic rx buffer num: 32
I (1071) wifi:Init static rx mgmt buffer num: 5
I (1075) wifi:Init management short buffer num: 32
I (1080) wifi:Init static tx buffer num: 16
I (1084) wifi:Init tx cache buffer num: 32
I (1088) wifi:Init static tx FG buffer num: 2
I (1092) wifi:Init static rx buffer size: 1600
I (1096) wifi:Init static rx buffer num: 16
I (1100) wifi:Init dynamic rx buffer num: 32
I (1104) wifi_init: rx ba win: 16
I (1108) wifi_init: accept mbox: 6
I (1112) wifi_init: tcpip mbox: 32
I (1116) wifi_init: udp mbox: 6
I (1120) wifi_init: tcp mbox: 6
I (1124) wifi_init: tcp tx win: 5760
I (1128) wifi_init: tcp rx win: 5760
I (1132) wifi_init: tcp mss: 1440
I (1136) wifi_init: WiFi/LWIP prefer SPIRAM
I (1141) wifi_init: WiFi IRAM OP enabled
I (1146) wifi_init: WiFi RX IRAM OP enabled
W (1151) wifi:Password length matches WPA2 standards, authmode threshold changes from OPEN to WPA2
I (1159) wifi:Set ps type: 1, coexist: 0

I (1163) phy_init: phy_version 680,a6008b2,Jun 4 2024,16:41:10
I (1201) wifi:mode : sta (8c:bf:ea:1c:db:60)
I (1201) wifi:enable tsf
W (1202) PERIPH_WIFI: WiFi Event cb, Unhandle event_base:WIFI_EVENT, event_id:43
I (1772) wifi:new:<3,1>, old:<1,0>, ap:<255,255>, sta:<3,1>, prof:1, snd_ch_cfg:0x0
I (1773) wifi:state: init -> auth (0xb0)
W (1773) PERIPH_WIFI: WiFi Event cb, Unhandle event_base:WIFI_EVENT, event_id:43
I (1774) wifi:state: auth -> assoc (0x0)
I (1789) wifi:state: assoc -> run (0x10)
I (1808) wifi:[ADDBA]RX DELBA, reason:39, delete tid:0, initiator:1(originator)
I (1890) wifi:connected with WT2003, aid = 8, channel 3, 40U, bssid = bc:5f:f6:8f:30:8c
I (1891) wifi:security: WPA2-PSK, phy: bgn, rssi: -47
I (1892) wifi:pm start, type: 1

I (1895) wifi:dp: 1, bi: 102400, li: 3, scale listen interval from 307200 us to 307200 us
I (1903) wifi:set rx beacon pti, rx_bcn_pti: 0, bcn_timeout: 25000, mt_pti: 0, mt_time: 10000
W (1912) PERIPH_WIFI: WiFi Event cb, Unhandle event_base:WIFI_EVENT, event_id:4
I (1913) wifi:AP's beacon interval = 102400 us, DTIM period = 1
I (1927) wifi:idx:0 (ifx:0, bc:5f:f6:8f:30:8c), tid:0, ssn:356, winSize:64
I (2912) esp_netif_handlers: sta ip: 192.168.1.110, mask: 255.255.255.0, gw: 192.168.1.1
I (2912) PERIPH_WIFI: Got ip:192.168.1.110
I (2915) main: volc_rtc_init
I (2918) audio processor: Create audio pipeline for audio player
I (2925) audio processor: Create audio player audio stream
I (2932) audio processor: Register all elements to playback pipeline
I (2938) audio processor: Link playback element together raw-->audio_decoder-->i2s_stream-->[codec_chip]
E (2949) gpio: gpio_install_isr_service(502): GPIO isr service already installed
E (2957) DISPATCHER: exe first list: 0x0
I (2961) DISPATCHER: dispatcher_event_task is running...
1970-01-01 00:00:02.151 [E] VolcEngineRTCLite.c:105 ****************** HELLO BOOKA (67b4a36b8c5bd801d861e0c8)(1.56.001.58)(6059fcf26792a8820bc81f13662979d531e5504d) ********************
1970-01-01 00:00:02.167 [E] Cache.c:270 operation returned status code: 0x00000009
1970-01-01 00:00:02.181 [E] ThreadPool.c:92 coreid 1 set 1 stack_size 8192 priority 5
I (3000) audio processor: recorder_pipeline_open
I (3004) audio processor: Create audio pipeline for recording
I (3010) audio processor: Create player audio stream
I (3017) audio processor: Register all player elements to audio pipeline
I (3023) audio processor: Link all player elements to audio pipeline
I (3031) audio processor: player_pipeline_open
I (3035) audio processor: Create audio pipeline for playback
I (3042) audio processor: Create playback audio stream
I (3048) audio_stream_7210: Create opus decoder
I (3053) audio processor: Register all elements to playback pipeline
I (3060) audio processor: ENBALE_AUDIO_STREAM_DUAL_MIC
I (3066) audio processor: Link playback element together raw-->audio_decoder-->rsp-->i2s_stream-->[codec_chip]
I (3079) audio processor: player pipe start running
I (3082) volc_rtc: start join room

1970-01-01 00:00:02.269 [E] RoomImplX.c:167 operation returned status code: 0x52000057
1970-01-01 00:00:02.886 [E] Cache.c:309 operation returned status code: 0x00000009
1970-01-01 00:00:02.891 [E] RoomImplX.c:167 operation returned status code: 0x52000057
1970-01-01 00:00:02.892 [E] LiteHttp.c:641 ID 1920100004 E_LOGIC : NO need keepAlive
1970-01-01 00:00:02.901 [E] RoomImplX.c:167 operation returned status code: 0x52000057
1970-01-01 00:00:03.011 [E] RoomImplX.c:167 operation returned status code: 0x52000057
I (4058) volc_rtc: join channel success 1234567 elapsed 209 ms now 209 ms

I (4059) volc_rtc: join room success

I (4060) RAW_OPUS_ENC: Raw Opus encoder init
I (4065) MODEL_LOADER: The storage free size is 22656 KB
I (4070) MODEL_LOADER: The partition size is 4152 KB
I (4076) MODEL_LOADER: Successfully load srmodels
I (4082) RECORDER_SR: The first wakenet model: wn9_hilexin

I (4088) AFE_SR: afe interface for speech recognition

I (4094) AFE_SR: AFE version: SR_V220727

I (4098) AFE_SR: Initial auido front-end, total channel: 3, mic num: 2, ref num: 1

I (4107) AFE_SR: aec_init: 1, se_init: 0, vad_init: 0

I (4113) AFE_SR: wakenet_init: 0

I (4179) AFE_SR: wake num: 2, mode: 0, (Sep 4 2024 11:49:31)

I (4180) AUDIO_RECORDER: RECORDER_CMD_TRIGGER_START
I (4181) main: volc_rtc_init_done
I (4184) main_task: Returned from app_main()
I (25781) volc_rtc: remote user joined 1234567:ai
1970-01-01 00:00:24.977 [E] rx_net_delay_manager.c:1130
I (25803) volc_rtc: remote user mute audio 1234567:ai 0
I (25803) volc_rtc: remote user mute video 1234567:ai 1
I (25815) volc_rtc: remote user mute audio 1234567:ai 0
I (25816) volc_rtc: remote user mute video 1234567:ai 1
1970-01-01 00:00:25.168 [E] rx_net_audio_jitterbuffer.c:1266
1970-01-01 00:00:25.174 [E] rx_net_audio_jitterbuffer.c:1190
1970-01-01 00:00:25.174 [E] rx_net_delay_manager.c:1130
1970-01-01 00:00:25.174 [E] rx_net_delay_manager.c:1130
1970-01-01 00:00:25.179 [E] Counter.c:90 AudioRecevied fps 0
1970-01-01 00:00:26.004 [E] Counter.c:90 AudioRecevied fps 42
1970-01-01 00:00:27.019 [E] Counter.c:90 AudioRecevied fps 51
1970-01-01 00:00:28.004 [E] Counter.c:90 AudioRecevied fps 49
1970-01-01 00:00:29.021 [E] Counter.c:90 AudioRecevied fps 51
1970-01-01 00:00:30.005 [E] Counter.c:90 AudioRecevied fps 49
1970-01-01 00:00:31.003 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:32.027 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:33.000 [E] Counter.c:90 AudioRecevied fps 50
I (34604) wifi:idx:1 (ifx:0, bc:5f:f6:8f:30:8c), tid:6, ssn:5, winSize:64
1970-01-01 00:00:34.004 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:35.007 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:36.003 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:37.004 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:38.009 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:39.004 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:40.006 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:41.001 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:42.033 [E] Counter.c:90 AudioRecevied fps 51
1970-01-01 00:00:43.002 [E] Counter.c:90 AudioRecevied fps 49
1970-01-01 00:00:44.008 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:45.003 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:46.002 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:47.015 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:48.011 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:49.008 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:50.010 [E] Counter.c:90 AudioRecevied fps 49
1970-01-01 00:00:51.005 [E] Counter.c:90 AudioRecevied fps 50
1970-01-01 00:00:52.022 [E] Counter.c:90 AudioRecevied fps 51
1970-01-01 00:00:53.001 [E] Counter.c:90 AudioRecevied fps 49
1970-01-01 00:00:54.022 [E] Counter.c:90 AudioRecevied fps 51
1970-01-01 00:00:55.004 [E] Counter.c:90 AudioRecevied fps 49
1970-01-01 00:00:56.001 [E] Counter.c:90 AudioRecevied fps 50
请问一下:用GetRoomOnlineUsers这个API看到设备和智能体都进入了同一个房间,但是没有听到欢迎词,提问也没有回复,是什么问题?需要怎么排查?调试web端交互式AIGC场景 AIGC Demo这个是调试成功的,用网页端连接是可以问答对话的,只是ESP设备进入房间后听不到声音

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions