[Question]How can I use the Madlad model?

[DHLee-94]

I would like to try using Madlad models or hugging face models.

Most of the Hugging Face models only have encoder.onnx and decoder.onnx, but I don't know what to do.
Please help.

[niedev]

Hi @DHLee-94,
I'm having a conversation about the same topic here.
For Madlad the official support will come in the future (as soon as I will have enough time to work on the app), probably it will be much easier for you to wait the official support.

[nwdxlgzs]

I would like to try using Madlad models or hugging face models.

Most of the Hugging Face models only have encoder.onnx and decoder.onnx, but I don't know what to do. Please help.

#153 I implemented a framework can run optimum export model(encoder.onnx+decoder_merge.onnx+tokenizer.json), may be it can help you (with some modify?i guess). onnx-runtime is too slow, if you want to enjoy fast infer, select a good runtime(with more inference acceleration) is very imporant.