How to return token ranges when tokenizing text?

[anderleich]

Hi,

Is there any way to return token ranges in the original text after tokenizing?

For example:

Tokenize: "This is a test"
Ranges: (0,4), (6,7), (9,9), (11,14)

Thank you