consult-line fails to find word in text with diacritics

[SudoerReodus]

If you use consult-line to search within a Arabic or Persian text, it fails to find the word or phrase you are looking, unless you type in the exact diacritics on each and every letter, making consult unusable if the text files you are working with are typed with diacritics.

Especially given the flexible/fuzzy matching nature of consult / consult-line, the expected behavior would be to ignore the diacritics and try to find a match regardless of them.

Some potential starting points for more info:

https://emacs.stackexchange.com/questions/74667/how-to-implement-character-folding-stripping-arabic-text-from-diacritics-or-tas

https://emacs.stackexchange.com/questions/7992/how-to-search-an-arabic-word-in-text-without-its-diacritics-accents

[minad]

See #372. Orderless supports character folding.

[SudoerReodus]

Thanks

(Though it seems that there are some issues with the Orderless' character folding itself, when it comes to handling Arabic / Persian diacritics)

[minad]

I've answered on the Orderless issue tracker. char-fold-to-regexp is provided by Emacs itself, so Orderless cannot do much about this.