Open
Description
Prerequisites
- I am running the latest code. Mention the version if possible as well.
- I carefully followed the README.md.
- I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
- I reviewed the Discussions, and have a new and useful enhancement to share.
Feature Description
Support for the EXAONE 4.0 model architecture
Motivation
Hello, maintainers!
We are excited to announce the upcoming release of our new model series, EXAONE 4.0.
As part of the release, we would like to provide .GGUF files of the model checkpoints for end users.
To make this possible, we kindly ask for support for the EXAONE 4.0 architecture in llama.cpp and, in turn, other GGUF-compatible libraries.
The implementation of the architecture is available in our PR on Huggingface Transformers.
We would really appreciate your consideration in adding support for EXAONE 4.0 models.
Thank you very much for your attention and support!
Possible Implementation
The implementation of the architecture is available in our PR on Huggingface Transformers.