API server?

[d33tah]

Lovely project! I'd love to be able to plug it into OpenWebUI. Would you consider it in-scope to implement a proxy OpenAI-compatible API server that takes a query/context and runs llm-consortium on it?

[irthomasthomas]

Hi, I implemented this as a separate plugin for now which can serve any llm model.

llm install llm-model-gateway
llm serve