lang_token_dim Error

Hello! Thank you very much for your contribution!
I have the following question: If I use t5-base, the text embeddings generated by t5 encoding have a dimension of 768, while lang_token_emb in RDT is 4096. Is there an issue here?