[Support]: #20550
Replies: 2 comments 22 replies
-
|
Based on your error logs and configuration, you're encountering ONNX runtime initialization issues with both Jina V1 and V2 models on your Rock 5B system. The error shows graph initialization failures during model loading. For your Rock 5B setup, you should consider using the V1 model with the Try this configuration: semantic_search:
enabled: True
model: "jinav1"
model_size: smallThe documentation notes that semantic search requires a minimum of 8GB of RAM and works by running a large AI model locally on your system (1). Small or underpowered systems like a Raspberry Pi will not run Semantic Search reliably or at all (1). While the Rock 5B is more capable than a Pi, the Additionally, the V2 model has significantly higher RAM and GPU requirements, leading to increased inference time and memory usage (1). The documentation specifically states that if you plan to use V2, ensure your system has ample RAM and a discrete GPU, and that CPU inference with the For most users, especially native English speakers, the V1 model remains the recommended choice (1). Since you're experiencing initialization failures with both models, start with the V1 📚 Sources: Have another question? Just tag @inkeep. |
Beta Was this translation helpful? Give feedback.
-
|
Rock5b 16GB I've switch from
semantic_search: docker-compose.yml config.yml |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Describe the problem you are having
I am unable to run either V1 or V2 semantic search. When running the V1 search, the docker container fails to download all of the files and between two docker containers, it is inconsistent in which files fail to load. I posted a comment on the r/frigate subredit here link which shows the graphic.
When running the V2 version, the semantic search appears to load from the frontend of Frigate, but when executing a search, either the results come back as empty, or the search errors out.
I am running this on a Rock 5B.
Version
0.16.2-4d58206
What browser(s) are you using?
Zen 1.16.4b (Firefox 143.0.4)
Frigate config file
Relevant Frigate log output
Relevant go2rtc log output
FFprobe output from your camera
Frigate stats
No response
Install method
Docker Compose
docker-compose file or Docker CLI command
Object Detector
RKNN
Network connection
Wired
Camera make and model
reolink and amcrest. Various other brands.
Screenshots of the Frigate UI's System metrics pages
Any other information that may be helpful
This is a fresh install. I've tried both the V1 and V2 semantic search. I have tried completely removing everything and starting a fresh new docker container and am experiencing the same issues.
The new container has issues downloading the text
Beta Was this translation helpful? Give feedback.
All reactions