Skip to content

fix: unicode token boundaries for non-ASCII “Other” scripts - #1

Merged
darkskygit merged 2 commits into
darkskygit:masterfrom
Konf:unicode_fix
Apr 5, 2026
Merged

fix: unicode token boundaries for non-ASCII “Other” scripts#1
darkskygit merged 2 commits into
darkskygit:masterfrom
Konf:unicode_fix

Add tests to cover unicode split issues

a38ef6f
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 error and 1 warning

The logs for this run have expired and are no longer available.