[BUG-UI/UX] Emojis cause wrong start:end indexes in SpanQuestion

[cceyda]

Describe the bug

If a spanQuestion record contains emoji the start&end indexes are recorded wrong!
Example:
"Some text yeah 🚀 rocket" -> If I try to tag the word "rocket" I get a warning message in UI

This happens because the indexes are overflowing (because emoji unicode lengths are calculated differently in javascript and python. This was also an issue in v1 with detailed explanation as to the cause here: #2353)
This should be resolved by using either using python style length calculation for the span start:end or translating between UI idx calculations and python calculations.

You wont even know that anything is wrong if you only tag words in the middle and have emojis in the text... it will just be a silent bug recording start:end wrongly off by 1-2 .

To reproduce

No response

Expected behavior

No response

Screenshots

No response

Environment

• OS [e.g. iOS]: irrelevant
• Browser [e.g. chrome, safari]: chrome (but is a js code issue so likely effects all browsers)
• Argilla Version [e.g. 1.0.0]:2.4.1
• ElasticSearch Version [e.g. 7.10.2]: irrelevant

Additional context

I would say critical. At least until resolved there should be a warning in the docs of SpanQuestion to not use with emojis
No response

[damianpumar]

@frascuchon and @jfcalvo we need to tackle this this week if we have time!
I have the proposal to fix it here: #5001

[damianpumar]

Thanks @cceyda to report this issue, we really appreciate that.

[github-actions]

This issue is stale because it has been open for 90 days with no activity.

[cceyda]

still an issue

[github-actions]

This issue is stale because it has been open for 90 days with no activity.

[cceyda]

still an issue & important for non-english languages

[github-actions]

This issue is stale because it has been open for 90 days with no activity.