Does this work for a selective copy task like the one in the mamba paper?

[augix]

I tried to learn a selective copy task with this infini transformer implementation. It was not successful. Any idea?

[dingo-actual]

I'm not the best person to ask about this because I didn't develop the architecture. I only wrote an implementation of it. Wish I could be of more help, sorry!