[AIS] When Japanese/Chinese/Korean users use whitespaces in the search term, the Search Tokenization does not take the whitespace into account, and so it does not return the document with the same characters in the Search Results - Known Error

[AIS] When Japanese/Chinese/Korean users use whitespaces in the search term, the Search Tokenization does not take the whitespace into account, and so it does not return the document with the same characters in the Search Results Description When a Japanese user searches using a Search Term containing whitespaces, it will not return the expected document with the same whitespaces. If the user removes the whitespaces from the Search Term, it will return the expected document in the Search Results.

Steps to Reproduce

1. Index a document that has an indexed field value of 'ネットワーク ドライブ アクセス要求' - name contains two whitespaces 2. Search for 'ネットワーク ドライブ アクセス要求' - this search term also contains two whitespaces 3. The document indexed in Step 1 is not returned in the Search Results

Workaround Japanese users generally do not use whitespaces between Kanji characters when searching. Even if the document contains whitespaces in the name, if the user searches without whitespaces, it will return the document in the Search Results. However, we will ensure that the Search Tokenization takes any whitespaces into account in the Search Term, and to silently remove them, so that it returns the document as expected, as this also impacts Chinese and Korean languages.