Custom objects

[sampotato-dev]

Hello,

Apologies if this has already been asked, I've tried to research but have not found any comprehensive information about what I want to achieve.
I want to add a turtle object to frigate to monitor my pet turtle, specifically to know which side of the tank he is on for an auto-feeder I have built.

Currently I have the cat and dog objects configured but they are not very accurate (probably because a turtle isn't a cat or dog.. It does match sometimes but it isn't very reliable)

Has anyone been able to add a custom object to frigate without using frigate+? If anyone has any info or advise that would be amazing.
Or would frigate+ be the best option for me to create the custom object?

Edit: I don't want to loose the ability to match person, car, dog or cat objects. If I add a custom model does that need to include all objects I want to detect?

Thanks in advance.

[inkeep-ai-assistant[bot]]

Based on the available documentation, there are two main approaches to detect custom objects like a turtle in Frigate:

Using a Custom Model

You can use a custom ONNX model trained to detect turtles(1). The model configuration allows you to specify custom models with their own labelmaps(1).

To configure a custom model, you'll need to specify the model path and labelmap in your configuration(1):

model:
  path: /path/to/custom_model.tflite
  labelmap_path: /path/to/labelmap.txt
  width: 320
  height: 320
  input_pixel_format: rgb
  input_tensor: nhwc

(1)

The labelmap file would need to include "turtle" as one of the detected labels(2).

Using Frigate+

Frigate+ offers models specifically trained on images from security cameras and supports various animal labels(3). Currently, Frigate+ supports these animals: dog, cat, deer, horse, bird, raccoon, fox, bear, cow, squirrel, goat, rabbit, skunk, kangaroo(3).

While "turtle" is not currently listed as a supported label in Frigate+(3), you could check if there are candidate labels available by editing your camera settings in Frigate+(3). Candidate labels include animals like chicken, hedgehog, and rodent(3), though turtle isn't explicitly mentioned.

For your specific use case, training a custom model would likely be the most reliable approach since turtle detection isn't currently a standard Frigate+ label. However, this requires obtaining or training an ONNX model that can detect turtles.

📚 Sources:

1. Advanced Options
2. I have set up a custom model, but Frigate cannot recognize people
3. Models

---

Have another question? Just tag @inkeep.