[HW Accel Support]: ffmpeg processes spike CPU usage on live view startup #19722

Damix48 · 2025-08-23T09:50:41Z

Damix48
Aug 23, 2025

Describe the problem you are having

I’m using a Ryzen 9700x and I’ve set everything up to use hardware acceleration with VAAPI. Everything works correctly, and I get very low CPU and GPU usage.
However, there’s one problem: when I open the live view in Frigate, CPU and GPU usage spike very high for the first 1–2 minutes. New ffmpeg processes are spawned for each camera, like this:
/usr/lib/ffmpeg/7.0/bin/ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.16.0-c2f8de9 -rtsp_transport tcp -timeout 10000000 -i rtsp://127.0.0.1:8554/reolink_wifi_sub -r 5 -vf fps=5,scale_vaapi=w=1536:h=576,hwdownload,format=nv12,eq=gamma=1.4:gamma_weight=0.5 -threads 2 -f rawvideo -pix_fmt yuv420p pipe:
This causes CPU usage to go close to 100%.
What’s strange is that if I stay on the live view, after 1–2 minutes these processes are terminated, CPU usage goes back to normal, and I’m still able to watch the live streams from the cameras.

Version

0.16.0-c2f8de9

Frigate config file

mqtt:
  enabled: false

ffmpeg:
  hwaccel_args: preset-vaapi

detect:
  enabled: false

detectors:
  onnx:
    type: onnx

model:
  model_type: dfine
  width: 640
  height: 640
  input_tensor: nchw
  input_dtype: float
  path: /config/model_cache/dfine_m_obj2coco.onnx
  labelmap_path: /labelmap/coco-80.txt

objects:
  track:
    - person
    - cat
    - dog
    - bird

record:
  enabled: true
  expire_interval: 60
  sync_recordings: true
  retain:
    days: 2
    mode: all
  alerts:
    retain:
      days: 30
  detections:
    retain:
      days: 30

tls:
  enabled: false

go2rtc:
  streams:
    cassa:
      - rtsp://[redacted]/live1.sdp
      - "ffmpeg:cassa#audio=aac"
    entrata_nonni: 
      - ffmpeg:http://[redacted]/video/mjpg.cgi#video=h264
    condizionatore: 
      - ffmpeg:http://[redacted]/video/mjpg.cgi#video=h264#hardware
    esterna_rotante_sub:
      - rtsp://[redacted]/2
    esterna_rotante_main:
      - rtsp://[redacted]/1
    piazzale_sub:
      - rtsp://[redacted]/Preview_01_sub
    piazzale_main:
      - rtsp://[redacted]/Preview_01_main
    casa_cancelli_sub:
      - rtsp://[redacted]/Preview_01_sub
    casa_cancelli_main:
      - rtsp://[redacted]/Preview_01_main
    garage_nonni_sub:
      - rtsp://[redacted]/Preview_01_sub
    garage_nonni_main:
      - rtsp://[redacted]/Preview_01_main
    retro_nonni_sub:
      - rtsp://[redacted]/Preview_01_sub
    retro_nonni_main:
      - rtsp://[redacted]/Preview_01_main
    reolink_wifi_sub:
      - rtsp://[redacted]/Preview_01_sub
    reolink_wifi_main:
      - rtsp://[redacted]/Preview_01_main
    casa_retro_sub:
      - rtsp://[redacted]/Preview_01_sub
    casa_retro_main:
      - rtsp://[redacted]/Preview_01_main
    negozio_sinistra_sub:
      - rtsp://[redacted]/Preview_01_sub
    negozio_sinistra_main:
      - rtsp://[redacted]/Preview_01_main
    reolink_nonni_sub:
      - rtsp://[redacted]/ReolinkLumus/sub
    reolink_nonni_main:
      - rtsp://[redacted]/ReolinkLumus/main

  webrtc:
    candidates:
      - [redacted]:8555
      - stun:8555

cameras:
  cassa:
    enabled: true
    detect:
      enabled: false
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/cassa?mp4
          input_args: preset-rtsp-restream
          roles:
            - detect
            - record
    motion:
      mask: 0.003,0.092,0.205,0.082,0.204,0,0,0
  
  entrata_nonni:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/entrata_nonni
          roles:
            - detect
            - record
  
  condizionatore:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/condizionatore
          roles:
            - detect
            - record
    motion:
      mask: 0.91,0.063,1,0.108,1,0,0.799,0,0.787,0.038,0.8,0.066
  
  esterna_rotante:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/esterna_rotante_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/esterna_rotante_main
          input_args: preset-rtsp-restream
          roles:
            - record
    live:
      streams:
        esterna_rotante_sub: esterna_rotante_sub
    onvif:
      host: [redacted]
      port: [redacted]
      user: [redacted]
      password: [redacted]
  
  garage_nonni:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/garage_nonni_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/garage_nonni_main
          input_args: preset-rtsp-restream
          roles:
            - record
    live:
      streams:
        garage_nonni_sub: garage_nonni_sub
    motion:
      mask:
        - 0.342,0.017,0.345,0.072,0.643,0.079,0.644,0.013
        - 0.873,0,0.879,0.103,1,0.131,1,0
      threshold: 50
      contour_area: 20
      improve_contrast: true
  
  retro_nonni:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/retro_nonni_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/retro_nonni_main
          input_args: preset-rtsp-restream
          roles:
            - record
    live:
      streams:
        retro_nonni_sub: retro_nonni_sub
    motion:
      mask: 0.337,0.013,0.339,0.075,0.644,0.075,0.645,0.013
      threshold: 50
      contour_area: 20
      improve_contrast: true
  
  casa_retro:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/casa_retro_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/casa_retro_main
          input_args: preset-rtsp-restream
          roles:
            - record
    live:
      streams:
        casa_retro_sub: casa_retro_sub
    motion:
      mask:
        - 0.338,0.008,0.337,0.079,0.646,0.074,0.646,0.007
        - 0.696,0.107,0.716,0.245,0.869,0.294,0.873,0.257,0.836,0.142
        - 0.516,0.128,0.518,0.237,0.617,0.238,0.618,0.128
      threshold: 50
      contour_area: 20
      improve_contrast: true
  
  piazzale:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/piazzale_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/piazzale_main
          input_args: preset-rtsp-restream
          roles:
            - record
    live:
      streams:
        piazzale_sub: piazzale_sub
    zones: {}
    motion:
      mask: 
        0.02,0.55,0.189,0.317,0.213,0.305,0.38,0.256,0.501,0.268,0.631,0.283,0.703,0.317,0.816,0.431,0.896,0.516,0.926,0.421,0.961,0.264,0.965,0,0.001,0,0,0.497
      threshold: 50
      contour_area: 50
      improve_contrast: true

  negozio_sinistra:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/negozio_sinistra_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/negozio_sinistra_main
          input_args: preset-rtsp-restream
          roles:
            - record
    live:
      streams:
        negozio_sinistra_sub: negozio_sinistra_sub

  reolink_wifi:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/reolink_wifi_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/reolink_wifi_main
          input_args: preset-rtsp-restream
          roles:
            - record
    live:
      streams:
        reolink_wifi_sub: reolink_wifi_sub
    motion:
      mask: 
        0.003,0.495,0.32,0.175,0.442,0.117,0.609,0.085,0.773,0.15,0.88,0.231,0.912,0.21,1,0.278,1,0,0,0
  
  casa_cancelli:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/casa_cancelli_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/casa_cancelli_main
          input_args: preset-rtsp-restream
          roles:
            - record
    live:
      streams:
        casa_cancelli_sub: casa_cancelli_sub
    motion:
      mask: 0.343,0,0.343,0.08,0.644,0.079,0.643,0
  
  entrata_nonni_reolink:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/reolink_nonni_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/reolink_nonni_main
          input_args: preset-rtsp-restream
          roles:
            - record
    live:
      streams:
        reolink_nonni_sub: reolink_nonni_sub
    motion:
      mask: 0,0.608,1,0.149,1,0,0,0

version: 0.16-0

docker-compose file or Docker CLI command

services:
  frigate:
    container_name: frigate
    restart: unless-stopped
    stop_grace_period: 30s
    image: ghcr.io/blakeblackshear/frigate:stable-rocm
    shm_size: 4096mb
    devices:
      - /dev/dri/renderD128:/dev/dri/renderD128
      - /dev/kfd:/dev/kfd
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /home/nucleus/frigate/config:/config
      - /mnt/atom/frigate:/media/frigate
      - type: tmpfs
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - 8971:8971
      - 8554:8554
      - 8555:8555/tcp
      - 8555:8555/udp
      - 1984:1984
    environment:
      FRIGATE_RTSP_PASSWORD: "password"
      LIBVA_DRIVER_NAME: radeonsi 
      HSA_OVERRIDE_GFX_VERSION: "10.3.0"

Relevant Frigate log output

no relevant logs

Relevant go2rtc log output

no relevant logs

FFprobe output from your camera

not relevant i think

Install method

Docker Compose

Object Detector

Other

Network connection

Wired

Camera make and model

reolink, dlink

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

No response

Answered by Damix48

Nov 25, 2025

Yeah, maybe the problem is unrelated to the ffmpeg process I listed. However, I see high CPU usage when I open the live view (or reload the live view page). After a few minutes, it returns to normal, even with the live view still open. Do you have any tips to debug this behavior, or is it expected?

I am experiencing the exact same problem. Any solutions to it?

My problem was the input_args: preset-rtsp-restream in the configuration of the cameras. I switched to input_args: preset-rtsp-generic and everything worked as expected.

View full answer

hawkeye217 · 2025-08-23T10:55:19Z

hawkeye217
Aug 23, 2025
Collaborator

I don't think the AMD GPU supports the RF-DETR model. Are you seeing the spike when objects are detected? The ffmpeg process you've noted is one related to object detection.

I'd suggest using a YOLOv9 model instead of RF-DETR.

9 replies

Damix48 Aug 23, 2025
Author

Yeah, maybe the problem is unrelated to the ffmpeg process I listed. However, I see high CPU usage when I open the live view (or reload the live view page). After a few minutes, it returns to normal, even with the live view still open. Do you have any tips to debug this behavior, or is it expected?

hawkeye217 Aug 23, 2025
Collaborator

No, that is not expected. With your configuration, Frigate doesn't spawn new ffmpeg processes for live view - it only makes a browser websocket connection to a go2rtc stream.

1reven Nov 25, 2025

Yeah, maybe the problem is unrelated to the ffmpeg process I listed. However, I see high CPU usage when I open the live view (or reload the live view page). After a few minutes, it returns to normal, even with the live view still open. Do you have any tips to debug this behavior, or is it expected?

I am experiencing the exact same problem. Any solutions to it?

Damix48 Nov 25, 2025
Author

Yeah, maybe the problem is unrelated to the ffmpeg process I listed. However, I see high CPU usage when I open the live view (or reload the live view page). After a few minutes, it returns to normal, even with the live view still open. Do you have any tips to debug this behavior, or is it expected?

I am experiencing the exact same problem. Any solutions to it?

My problem was the input_args: preset-rtsp-restream in the configuration of the cameras. I switched to input_args: preset-rtsp-generic and everything worked as expected.

Answer selected by hawkeye217

1reven Nov 25, 2025

My problem was the input_args: preset-rtsp-restream in the configuration of the cameras. I switched to input_args: preset-rtsp-generic and everything worked as expected.

Awesome, seems to have done it for me as well. Thanks for taking the time to respond.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[HW Accel Support]: ffmpeg processes spike CPU usage on live view startup #19722

Uh oh!

{{title}}

Uh oh!

Replies: 1 comment 9 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{editor}}'s edit

{{editor}}'s edit

Uh oh!

Select a reply

Uh oh!

Uh oh!

[HW Accel Support]: ffmpeg processes spike CPU usage on live view startup #19722

Uh oh!

Damix48 Aug 23, 2025

Describe the problem you are having

Version

Frigate config file

docker-compose file or Docker CLI command

Relevant Frigate log output

Relevant go2rtc log output

FFprobe output from your camera

Install method

Object Detector

Network connection

Camera make and model

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Replies: 1 comment · 9 replies

Uh oh!

hawkeye217 Aug 23, 2025 Collaborator

Uh oh!

Damix48 Aug 23, 2025 Author

Uh oh!

hawkeye217 Aug 23, 2025 Collaborator

Uh oh!

1reven Nov 25, 2025

Uh oh!

Damix48 Nov 25, 2025 Author

Uh oh!

Uh oh!

1reven Nov 25, 2025

Damix48
Aug 23, 2025

Replies: 1 comment 9 replies

hawkeye217
Aug 23, 2025
Collaborator

Damix48 Aug 23, 2025
Author

hawkeye217 Aug 23, 2025
Collaborator

Damix48 Nov 25, 2025
Author