Is it possible to run passage retrieval models?

[semoal]

We would like to run this model to do hybrid search, https://huggingface.co/naver/efficient-splade-VI-BT-large-doc, is it possible with the current API or should we introduce another method like classify, rerank, add another for mask?

[semoal]

Tried calling embed and looks quite good; gonna test it with our current RAG to see if its enough

[michaelfeil]

Have you tried to assert the difference between the original implementation and infinity? Can you load it via sentence transformers? Maybe you need to choose the mean/cls pooling method, or add a sentence transformers config in the upstream repo.

i think infinity itself is compatible, it might need adaption to be consumable from sentence transformers.

[ouz-m]

@semoal hi, do you have any updates on this topic? I am curious to hear how it turned out!