[Config Support]: Enabling HWAccel stops stream

[davidmpier]

Describe the problem you are having

Setting up Frigate initially and I am attempting to use my old 1080ti for hardware acceleration. Streams are working fine but when I turn on the hwaccel_args flag, the stream fails and the errors indicate it cannot load. I have installed the Nvidia Container toolkit and confirmed with nvidia-smi that my container can access the driver/device. As a newbie to both Docker and Linux, it's possible I missed something but I've tried searching through the issues and found nothing quite relevant that addresses my issues.

Version

0.13.2-6476F8A

Frigate config file

mqtt:
  enabled: true

cameras:
  front_door:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://redacted:[email protected]:554/Streaming/Channels/2
          roles:
            - detect
      hwaccel_args: preset-nvidia-h264
    detect:
      enabled: false
      height: 720
      width: 1280

Relevant log output

2024-07-23 12:57:42.875370130  [INFO] Preparing Frigate...
2024-07-23 12:57:42.885018495  [INFO] Starting Frigate...
2024-07-23 12:57:43.977918058  [2024-07-23 12:57:43] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-07-23 12:57:43.998577839  [2024-07-23 12:57:43] peewee_migrate.logs            INFO    : Starting migrations
2024-07-23 12:57:44.001732733  [2024-07-23 12:57:44] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-07-23 12:57:44.006439329  [2024-07-23 12:57:44] frigate.app                    INFO    : Recording process started: 449
2024-07-23 12:57:44.008507665  [2024-07-23 12:57:44] frigate.app                    INFO    : go2rtc process pid: 98
2024-07-23 12:57:44.011455092  [2024-07-23 12:57:44] frigate.comms.mqtt             ERROR   : Unable to connect to MQTT server: Invalid host.
2024-07-23 12:57:44.025451665  [2024-07-23 12:57:44] detector.cpu                   INFO    : Starting detection process: 458
2024-07-23 12:57:44.027630315  [2024-07-23 12:57:44] frigate.app                    INFO    : Output process started: 460
2024-07-23 12:57:44.027809208  [2024-07-23 12:57:44] frigate.detectors              WARNING : CPU detectors are not recommended and should only be used for testing or for trial purposes.
2024-07-23 12:57:44.036073876  [2024-07-23 12:57:44] frigate.app                    INFO    : Camera processor started for front_door: 465
2024-07-23 12:57:44.041849545  [2024-07-23 12:57:44] frigate.app                    INFO    : Capture process started for front_door: 466
2024-07-23 12:57:45.410890579  [2024-07-23 12:57:45] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:57:45.411212136  [2024-07-23 12:57:45] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:57:45.411390589  [2024-07-23 12:57:45] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:57:45.423137799  [2024-07-23 12:57:45] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:57:45.423296617  [2024-07-23 12:57:45] frigate.video                  ERROR   : front_door: ffmpeg process is not running. exiting capture thread...
2024-07-23 12:58:04.066058451  [2024-07-23 12:58:04] watchdog.front_door            ERROR   : Ffmpeg process crashed unexpectedly for front_door.
2024-07-23 12:58:04.066139600  [2024-07-23 12:58:04] watchdog.front_door            ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-07-23 12:58:04.066231966  [2024-07-23 12:58:04] ffmpeg.front_door.detect       ERROR   : [h264 @ 0x5580749e51c0] Cannot load libnvcuvid.so.1
2024-07-23 12:58:04.066297976  [2024-07-23 12:58:04] ffmpeg.front_door.detect       ERROR   : [h264 @ 0x5580749e51c0] Failed loading nvcuvid.
2024-07-23 12:58:04.066366768  [2024-07-23 12:58:04] ffmpeg.front_door.detect       ERROR   : [h264 @ 0x5580749e51c0] Failed setup for format cuda: hwaccel initialisation returned error.
2024-07-23 12:58:04.066429195  [2024-07-23 12:58:04] ffmpeg.front_door.detect       ERROR   : Impossible to convert between the formats supported by the filter 'Parsed_fps_0' and the filter 'auto_scale_0'
2024-07-23 12:58:04.066493998  [2024-07-23 12:58:04] ffmpeg.front_door.detect       ERROR   : Error reinitializing filters!
2024-07-23 12:58:04.066553730  [2024-07-23 12:58:04] ffmpeg.front_door.detect       ERROR   : Failed to inject frame into filter network: Function not implemented
2024-07-23 12:58:04.066618439  [2024-07-23 12:58:04] ffmpeg.front_door.detect       ERROR   : Error while processing the decoded data for stream #0:0
2024-07-23 12:58:05.442581210  [2024-07-23 12:58:05] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:58:05.442689677  [2024-07-23 12:58:05] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:58:05.443098413  [2024-07-23 12:58:05] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:58:05.443254199  [2024-07-23 12:58:05] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:58:05.443446227  [2024-07-23 12:58:05] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:58:05.443584764  [2024-07-23 12:58:05] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.
2024-07-23 12:58:05.443726879  [2024-07-23 12:58:05] frigate.video                  ERROR   : front_door: Unable to read frames from ffmpeg process.

Frigate stats

{"cameras":{"front_door":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":0.0,"capture_pid":466,"detection_enabled":0,"detection_fps":0.0,"ffmpeg_pid":1509,"pid":465,"process_fps":0.0,"skipped_fps":0.0}},"cpu_usages":{"1":{"cmdline":"/package/admin/s6/command/s6-svscan -d4 -- /run/service","cpu":"0.0","cpu_average":"0","mem":"0.0"},"15":{"cmdline":"s6-supervise s6-linux-init-shutdownd","cpu":"0.0","cpu_average":"0","mem":"0.0"},"16":{"cmdline":"/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B","cpu":"0.0","cpu_average":"0","mem":"0.0"},"24":{"cmdline":"s6-supervise s6rc-fdholder","cpu":"0.0","cpu_average":"0","mem":"0.0"},"25":{"cmdline":"s6-supervise go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"26":{"cmdline":"s6-supervise s6rc-oneshot-runner","cpu":"0.0","cpu_average":"0","mem":"0.0"},"27":{"cmdline":"s6-supervise go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"28":{"cmdline":"s6-supervise go2rtc-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"29":{"cmdline":"s6-supervise nginx-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"30":{"cmdline":"s6-supervise frigate-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"31":{"cmdline":"s6-supervise frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"32":{"cmdline":"s6-supervise nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"43":{"cmdline":"/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --","cpu":"0.0","cpu_average":"0","mem":"0.0"},"44":{"cmdline":"/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules","cpu":"0.0","cpu_average":"0","mem":"0.0"},"89":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"90":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"91":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"98":{"cmdline":"/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml","cpu":"0.0","cpu_average":"0","mem":"0.1"},"106":{"cmdline":"python3 -u -m frigate","cpu":"2.9","cpu_average":"0","mem":"2.1"},"107":{"cmdline":"bash ./run.user go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"118":{"cmdline":"nginx: master process nginx","cpu":"0.0","cpu_average":"0","mem":"0.1"},"154":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"155":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"156":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"162":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"178":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"203":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"239":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"268":{"cmdline":"nginx: worker process","cpu":"0.3","cpu_average":"0","mem":"0.0"},"295":{"cmdline":"nginx: cache manager process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"447":{"cmdline":"frigate.logger       ","cpu":"0.2","cpu_average":"0","mem":"1.1"},"449":{"cmdline":"frigate.recording_manager","cpu":"0.2","cpu_average":"0","mem":"1.1"},"457":{"cmdline":"/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(38)","cpu":"0.0","cpu_average":"0","mem":"0.1"},"458":{"cmdline":"frigate.detector.cpu ","cpu":"0.0","cpu_average":"0","mem":"1.1"},"460":{"cmdline":"frigate.output       ","cpu":"0.3","cpu_average":"0","mem":"1.1"},"464":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"465":{"cmdline":"frigate.process:front_door","cpu":"0.0","cpu_average":"0","mem":"1.1"},"466":{"cmdline":"frigate.capture:front_door","cpu":"0.3","cpu_average":"0","mem":"1.1"},"471":{"cmdline":"ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1471":{"cmdline":"sleep 30s","cpu":"0.0","cpu_average":"0","mem":"0.0"}},"detection_fps":0.0,"detectors":{"cpu":{"detection_start":0.0,"inference_speed":10.0,"pid":458}},"gpu_usages":{"NVIDIA GeForce GTX 1080 Ti":{"dec":"0.0%","enc":"0.0%","gpu":"0.0%","mem":"0.91%"}},"processes":{"go2rtc":{"pid":98},"logger":{"pid":447},"recording":{"pid":449}},"service":{"last_updated":1721765362,"latest_version":"0.13.2","storage":{"/dev/shm":{"free":126.2,"mount_type":"tmpfs","total":128.0,"used":1.8},"/media/frigate/clips":{"free":889640.4,"mount_type":"ext4","total":937667.0,"used":323.7},"/media/frigate/recordings":{"free":889640.4,"mount_type":"ext4","total":937667.0,"used":323.7},"/tmp/cache":{"free":953.7,"mount_type":"tmpfs","total":953.7,"used":0.0}},"temperatures":{},"uptime":698,"version":"0.13.2-6476f8a"}}

Operating system

Debian

Install method

Docker Compose

Object Detector

TensorRT

Any other information that may be helpful

No response

[NickM-27]

ERROR : [h264 @ 0x5580749e51c0] Cannot load libnvcuvid.so.1

the nvidia container toolkit doesn't seem to be mounted correctly, you can search for this error in the issues list to find other issues and how users solved it

[davidmpier]

I feel silly because searching it now today I did find some guidance to manually install the nvidia decode runtime libraries. For anyone else having issues like me, this thread set me straight: #5166