[Camera Support]: audio and video out of sync

[runningman84]

Checklist

• I have updated to the latest available Frigate version.
• I have cleared the cache of my browser.
• I have tried a different browser to see if it is related to my browser.
• I have tried reproducing the issue in incognito mode to rule out problems with any third party extensions or plugins I have installed.

Describe the problem you are having

Recordings in 0.16.0-beta3 are out of sync. The video and audio does not match. This used to be fine in 0.15.x without any other changes.

A side note, I have 3 cameras configured but only one is online right now due to privacy reasons. That cause error messages in frigate and go2rtc but that hasn't been an issue in older versions.

Steps to reproduce

1. install frigate beta
2. record something
3. view video afterwards
   ...

Version

0.16.0-beta3

In which browser(s) are you experiencing the issue with?

Brave: v1.80.115

Frigate config file

root@frigate-7bfccfb756-svrrr:/config# cat config.yaml
# Optional: logger verbosity settings
logger:
  # Optional: Default log verbosity (default: shown below)
  default: info
mqtt:
  host: mosquitto
  topic_prefix: frigate
  # user: ${SECRET_MQTT_USERNAME}
  # password: ${SECRET_MQTT_PASSWORD}
database:
  path: /config/frigate.db
detectors:
  coral:
    type: edgetpu
    device: pci:0
record:
  enabled: true
  retain:
    days: 0
    mode: all
  alerts:
    retain:
      days: 7
  detections:
    retain:
      days: 7
objects:
  track:
    - person
    - face
  filters:
    person:
      min_area: 2500
      max_area: 100000
      threshold: 0.7
# Global ffmpeg configuration
ffmpeg:
  hwaccel_args: preset-vaapi
# Birdseye
birdseye:
  enabled: false
# Specify camera's
cameras:
  living_room:
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://go2rtc:8554/living_room
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://go2rtc:8554/living_room_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    live:
      streams:
        living_room_sub: living_room_sub
    detect:
      width: 1280
      height: 720
      fps: 5
    motion:
      mask:
        - 0,0.062,0.399,0.062,0.399,0,0,0
        - 0,1,0.264,0.331,0.242,0.077,0,0.073
        - 0.672,0.473,0.704,0.288,0.903,0.384,0.841,0.635
        - 0.564,1,1,0.667,0.999,0.997
    snapshots:
      enabled: true # <----- Enable snapshots
    objects:
      mask:
        - 0.699,0.285,0.672,0.468,0.79,0.588,0.84,0.629,0.907,0.385
        - 0,0.958,0.257,0.329,0.241,0.073,0.002,0.072
  master_bedroom:
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://go2rtc:8554/master_bedroom
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://go2rtc:8554/master_bedroom_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    live:
      streams:
        master_bedroom_sub: master_bedroom_sub
    detect:
      width: 640
      height: 360
      fps: 5
    motion:
      mask:
        - 0,25,230,25,230,0,0,0
    snapshots:
      enabled: true # <----- Enable snapshots
  corridor_downstairs:
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://go2rtc:8554/corridor_downstairs
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://go2rtc:8554/corridor_downstairs_sub1
          input_args: preset-rtsp-restream
          roles:
            - detect
        # - path: rtsp://go2rtc:8554/corridor_downstairs_sub2
        #   input_args: preset-rtsp-restream
    live:
      streams:
        corridor_downstairs_sub1: corridor_downstairs_sub1
    detect:
      width: 640
      height: 360
      fps: 5
    motion:
      mask:
        - 0.773,0.879,0.827,0.395,0.848,0.194,0.749,0.186,0.59,0.223,0.593,0.396,0.587,0.654,0.68,0.656
        - 0.156,0.517,0.194,0.4,0.252,0.336,0.297,0.356,0.32,0.633,0.27,0.867,0.205,0.872
        - 0,1,0.133,1,0.064,0.194,0,0.244
        - 0,0.069,0.188,0.069,0.188,0,0,0
        - 0.297,0,0.331,0,0.331,0.137,0.303,0.154
    objects:
      filters:
        object_0:
          mask: 
            0.77,0.87,0.814,0.459,0.849,0.204,0.752,0.196,0.594,0.232,0.597,0.397,0.584,0.654,0.68,0.656
        object_1:
          mask:
            - 100,186,124,144,161,121,190,128,205,228,173,312,131,314
        object_2:
          mask:
            - 0,360,85,360,41,70,0,88
version: 0.16-0
detect:
  enabled: true

docker-compose file or Docker CLI command

na it is running in a k8s pod

Relevant Frigate log output

│ s6-rc: info: service certsync-log: starting                                                                                                                                                                                                              │
│ s6-rc: info: service frigate-log successfully started                                                                                                                                                                                                    │
│ s6-rc: info: service nginx-log successfully started                                                                                                                                                                                                      │
│ s6-rc: info: service certsync-log successfully started                                                                                                                                                                                                   │
│ s6-rc: info: service go2rtc-log successfully started                                                                                                                                                                                                     │
│ s6-rc: info: service prepare successfully started                                                                                                                                                                                                        │
│ s6-rc: info: service go2rtc: starting                                                                                                                                                                                                                    │
│ s6-rc: info: service go2rtc successfully started                                                                                                                                                                                                         │
│ s6-rc: info: service go2rtc-healthcheck: starting                                                                                                                                                                                                        │
│ s6-rc: info: service frigate: starting                                                                                                                                                                                                                   │
│ s6-rc: info: service go2rtc-healthcheck successfully started                                                                                                                                                                                             │
│ s6-rc: info: service frigate successfully started                                                                                                                                                                                                        │
│ s6-rc: info: service nginx: starting                                                                                                                                                                                                                     │
│ [WARN] /sys/fs/cgroup/cpu.max not found. Falling back to /proc/cpuinfo.                                                                                                                                                                                  │
│ 2025-07-05 12:02:59.797517599  [INFO] Starting NGINX...                                                                                                                                                                                                  │
│ 2025-07-05 12:02:59.903096372  [INFO] No TLS certificate found. Generating a self signed certificate...                                                                                                                                                  │
│ 2025-07-05 12:03:00.445801289  You have successfully opted out to send the telemetry data.                                                                                                                                                               │
│ 2025-07-05 12:03:01.041460839  [INFO] Preparing Frigate...                                                                                                                                                                                               │
│ 2025-07-05 12:03:03.473039219  [INFO] Starting Frigate...                                                                                                                                                                                                │
│ 2025-07-05 12:03:03.473818221  [INFO] Preparing new go2rtc config...                                                                                                                                                                                     │
│ 2025-07-05 12:03:05.773704801  [INFO] Starting go2rtc...                                                                                                                                                                                                 │
│ 2025-07-05 12:03:06.379262955  14:03:06.378 INF go2rtc platform=linux/amd64 revision=fa580c5 version=1.9.9                                                                                                                                               │
│ 2025-07-05 12:03:06.379395076  14:03:06.379 INF config path=/dev/shm/go2rtc.yaml                                                                                                                                                                         │
│ 2025-07-05 12:03:06.380777264  14:03:06.380 INF [api] listen addr=:1984                                                                                                                                                                                  │
│ 2025-07-05 12:03:06.382303434  14:03:06.382 INF [rtsp] listen addr=:8554                                                                                                                                                                                 │
│ 2025-07-05 12:03:06.389071826  14:03:06.388 INF [webrtc] listen addr=:8555                                                                                                                                                                               │
│ 2025-07-05 12:03:09.773376944  [INFO] Starting go2rtc healthcheck service...                                                                                                                                                                             │
│ s6-rc: info: service nginx successfully started                                                                                                                                                                                                          │
│ s6-rc: info: service certsync: starting                                                                                                                                                                                                                  │
│ s6-rc: info: service certsync successfully started                                                                                                                                                                                                       │
│ s6-rc: info: service legacy-services: starting                                                                                                                                                                                                           │
│ 2025-07-05 12:03:24.872793955  [INFO] Starting certsync...                                                                                                                                                                                               │
│ s6-rc: info: service legacy-services successfully started                                                                                                                                                                                                │
│ 2025-07-05 12:03:24.887083403  2025/07/05 14:03:24 [error] 208#208: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 10.244.2.60, server: , request: "GET /ws HTTP/1.1", subrequest: "/auth", upstream: "http://127.0 │
│ 2025-07-05 12:03:24.887098326  2025/07/05 14:03:24 [error] 208#208: *1 auth request unexpected status: 502 while sending to client, client: 10.244.2.60, server: , request: "GET /ws HTTP/1.1", host: "frigate.k8s-prod.home.hellmi.de"                  │
│ 2025-07-05 12:03:24.887153356  10.244.2.60 - - [05/Jul/2025:14:03:24 +0200] "GET /ws HTTP/1.1" 500 579 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36" "10.0.30.125"                         │
│ 2025-07-05 12:03:25.170363154  2025/07/05 14:03:25 [error] 209#209: *3 connect() failed (111: Connection refused) while connecting to upstream, client: 10.244.3.0, server: , request: "GET /api/stats HTTP/1.1", subrequest: "/auth", upstream: "http:/ │
│ 2025-07-05 12:03:25.170376341  2025/07/05 14:03:25 [error] 209#209: *3 auth request unexpected status: 502 while sending to client, client: 10.244.3.0, server: , request: "GET /api/stats HTTP/1.1", host: "frigate:5000"                               │
│ 2025-07-05 12:03:28.457070194  10.244.1.1 - - [05/Jul/2025:14:03:28 +0200] "GET / HTTP/1.1" 200 6835 "-" "kube-probe/1.31" "-"                                                                                                                           │
│ 2025-07-05 12:03:29.735231128  [2025-07-05 14:03:29] frigate.util.config            INFO    : Checking if frigate config needs migration...                                                                                                              │
│ 2025-07-05 12:03:29.930500197  [2025-07-05 14:03:29] frigate.util.config            INFO    : frigate config does not need migration...                                                                                                                  │
│ 2025-07-05 12:03:30.171206121  2025/07/05 14:03:30 [error] 228#228: *7 connect() failed (111: Connection refused) while connecting to upstream, client: 10.244.3.0, server: , request: "GET /api/stats HTTP/1.1", subrequest: "/auth", upstream: "http:/ │
│ 2025-07-05 12:03:30.171280124  2025/07/05 14:03:30 [error] 228#228: *7 auth request unexpected status: 502 while sending to client, client: 10.244.3.0, server: , request: "GET /api/stats HTTP/1.1", host: "frigate:5000"                               │
│ 2025-07-05 12:03:30.206682189  127.0.0.1 - - [05/Jul/2025:14:03:30 +0200] "" 400 0 "-" "-" "-"                                                                                                                                                           │
│ 2025-07-05 12:03:30.329027586  [2025-07-05 14:03:30] frigate.config.config          WARNING : living_room is configured to track ['face'] objects, which are not supported by the current model.                                                         │
│ 2025-07-05 12:03:30.350009062  [2025-07-05 14:03:30] frigate.config.config          WARNING : master_bedroom is configured to track ['face'] objects, which are not supported by the current model.                                                      │
│ 2025-07-05 12:03:30.374501416  [2025-07-05 14:03:30] frigate.config.config          WARNING : corridor_downstairs is configured to track ['face'] objects, which are not supported by the current model.                                                 │
│ 2025-07-05 12:03:30.386265068  [2025-07-05 14:03:30] frigate.app                    INFO    : Starting Frigate (0.16.0-f141b58)                                                                                                                          │
│ 2025-07-05 12:03:30.485810576  [2025-07-05 14:03:30] frigate.app                    INFO    : Creating directory: /tmp/cache                                                                                                                             │
│ 2025-07-05 12:03:30.900649746  2025/07/05 14:03:30 [error] 208#208: *9 connect() failed (111: Connection refused) while connecting to upstream, client: 10.244.2.60, server: , request: "GET /ws HTTP/1.1", subrequest: "/auth", upstream: "http://127.0 │
│ 2025-07-05 12:03:30.902383605  2025/07/05 14:03:30 [error] 208#208: *9 auth request unexpected status: 502 while sending to client, client: 10.244.2.60, server: , request: "GET /ws HTTP/1.1", host: "frigate.k8s-prod.home.hellmi.de"                  │
│ 2025-07-05 12:03:30.902396027  10.244.2.60 - - [05/Jul/2025:14:03:30 +0200] "GET /ws HTTP/1.1" 500 579 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36" "10.0.30.125"                         │
│ 2025-07-05 12:03:30.970614963  [2025-07-05 14:03:30] peewee_migrate.logs            INFO    : Starting migrations                                                                                                                                        │
│ 2025-07-05 12:03:30.981923289  [2025-07-05 14:03:30] peewee_migrate.logs            INFO    : There is nothing to migrate                                                                                                                                │
│ 2025-07-05 12:03:31.345014631  [2025-07-05 14:03:31] frigate.app                    INFO    : Recording process started: 382                                                                                                                             │
│ 2025-07-05 12:03:31.363313300  [2025-07-05 14:03:31] frigate.app                    INFO    : Review process started: 384                                                                                                                                │
│ 2025-07-05 12:03:31.400402545  [2025-07-05 14:03:31] frigate.app                    INFO    : go2rtc process pid: 129                                                                                                                                    │
│ 2025-07-05 12:03:31.702823963  [2025-07-05 14:03:31] detector.coral                 INFO    : Starting detection process: 407                                                                                                                            │
│ 2025-07-05 12:03:31.740939386  [2025-07-05 14:03:31] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as pci:0                                                                                                                     │
│ 2025-07-05 12:03:31.745092244  [2025-07-05 14:03:31] frigate.app                    INFO    : Output process started: 424                                                                                                                                │
│ 2025-07-05 12:03:31.836152634  INFO: Created TensorFlow Lite XNNPACK delegate for CPU.                                                                                                                                                                   │
│ 2025-07-05 12:03:31.850384500  [2025-07-05 14:03:31] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found                                                                                                                                           │
│ 2025-07-05 12:03:33.692838089  [2025-07-05 14:03:33] frigate.app                    INFO    : Camera processor started for living_room: 484

Relevant go2rtc log output

│ 14:04:27.975 INF go2rtc platform=linux/amd64 revision=fa580c5 version=1.9.9                                                                                                                                                                              │
│ 14:04:27.978 INF config path=/config/go2rtc.yaml                                                                                                                                                                                                         │
│ 14:04:27.980 INF [api] listen addr=:1984                                                                                                                                                                                                                 │
│ 14:04:27.982 INF [rtsp] listen addr=:8554                                                                                                                                                                                                                │
│ 14:04:27.986 INF [webrtc] listen addr=:8555                                                                                                                                                                                                              │
│ 14:04:48.055 WRN [rtsp] error="streams: dial tcp 10.0.50.117:554: i/o timeout" stream=master_bedroom                                                                                                                                                     │
│ 14:04:48.112 WRN [rtsp] error="streams: dial tcp 10.0.50.117:554: i/o timeout" stream=master_bedroom_sub                                                                                                                                                 │
│                                                                                                                                                                                                                                                          │
│                                                                                                                                                                                                                                                          │
│

Operating system

Other Linux

Install method

Docker Compose

Network connection

Wired

Camera make and model

UVC G3 Flex

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

frigate: 0.16.0-beta3
go2rtc: 1.9.9

[hawkeye217]

Frigate just copies your camera's stream when recording without any kind of processing.

You may want to try using the ffmpeg module with go2rtc or using 0.15's version of go2rtc (1.9.2).

See the documentation:

https://docs.frigate.video/guides/configuring_go2rtc/#what-if-my-video-doesnt-play
https://docs.frigate.video/configuration/advanced/#custom-go2rtc-version

[runningman84]

I have go2rtc as an external pod/container, does that matter here?

[hawkeye217]

You're missing out on enhanced live view by using an external version of go2rtc. We recommend using frigate's internal version.