Server capacity & resources

[aslam-t]

Question (Not an Issue)

Hi team,

I have a question rather than a issue. Please bear with me as I have no knowledge of vosk internals.
So, I am hosting a docker instance of vosk-server. My primary use case is to utilize it in a conferencing system as transcriber. It works fine with my initial testing with few users but some clarity on following is still required before I confidently release:

1. Which resource is most important for vosk-server CPU, RAM or GPU etc.?
2. How many instances are enough to handle 1000 concurrent sessions?
3. Do we have a pointer if such info already exists.?

I am only transcribing English for now, no other language, if that matter for my case.

Looking forward to any help.

Thanks

[nshmyrev]

Which resource is most important for vosk-server CPU, RAM or GPU etc.

Memory bandwidth and model size are most restricting factors.

How many instances are enough to handle 1000 concurrent sessions?

10 CPU servers of 48 cores each or 5 GPU servers with RTX4090

[zhq1]

Is there any way to optimize CPU usage? For example, not recognizing the contents of silent packages