Implement C# API for LLMs

[amakropoulos]

The C# interface is plugged into LLMUnity.
It could be migrated here to allow to use the library with C# in general.

[psocolovsky]

a good start would be to separate pure c# from any monobehaviour dependency

[amakropoulos]

This feature is my current focus right now.

I'm implementing LlamaLib as a common C++ back-end that can be used from:

• C# with bindings
• Unity
• Unreal

I want to migrate a large part of LLMUnity directly into LlamaLib:

• auto-determining and loading the correct architecture backend on runtime (LLMLib.cs, LLM.cs)
• LLM Agent functionality with local and remote support (LLMCaller.cs, LLMCharacter.cs)

A lot of work 🙂 !
I can keep you in the loop if you are interested (or even contribute).
You can also find me on Discord for more direct communication.

[psocolovsky]

yes it is a lot of work.

luckily those modules are not huge.
one of the biggest issues is that you won't have perfect backward compatibility, it would be really hard to achieve that. thing is people will likely inherit LLM / LLMCharacters for custom classes. if you need to do this you need to start from the API. for example, LLM has several variables that work as configuration. that will have to go to the llamalib. probably the simplest way to do this is a json for future compatibility; it likely work better if you have a configuration object that is defined in llamalib and accessed from unity script. LLM configuration variables should be properties instead of simple variables to allow better maintenance, customization for example let to add a onchange hook event on some property or validate/debug some value. but this is just one single aspect, can you share your plans? let's chat in discord