Skip to content

Improve share indexing with AnyAscii #30

Description

@termermc

We can use AnyAscii to convert 𝕌𝕟𝕚𝕔𝕠𝕕𝕖 𝕋𝕖𝕩𝕥 to ASCII in search indexes. My idea is that we keep the original in the index, but then append the AnyAscii'd text to the index if it's different from the original. This will make search indexes bigger, but it will enable much better search for files that are artistic.

For example:

I 𝓵𝓸𝓿𝓮 cats gets indexed as I 𝓵𝓸𝓿𝓮 cats I love cats

I love dogs gets indexed as I love dogs because the AnyAscii version is the same as the original.

We will not augment search queries, only change the way things are indexed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions