# Search can't find Japanese

**URL:** https://community.fibery.io/t/search-cant-find-japanese/304
**Category:** Bugs & Issues
**Created:** [August 24, 2019, 1:29pm UTC](https://community.fibery.io/t/search-cant-find-japanese/304 "2019-08-24T13:29:12Z")
**Posts on this page:** 10
**Page:** 1

<div class="post-metadata">

### Author: ![rickcogley](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/rickcogley/32/274_2.png) [@rickcogley](https://community.fibery.io/u/rickcogley)
#### Post date: [August 24, 2019, 1:29pm UTC](https://community.fibery.io/t/search-cant-find-japanese/304/1 "2019-08-24T13:29:12Z")

</div>

On v.1.0.54 (build 1548), I added some Japanese to an entity title and to the text of a wiki, but, search does not find it. English works fine.

Does indexing take time?

If it’s a bug, you can use this for test:

日本語 nihongo, Japanese language

---

<div class="post-metadata">

### Author: ![rickcogley](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/rickcogley/32/274_2.png) [@rickcogley](https://community.fibery.io/u/rickcogley)
#### Post date: [September 26, 2019, 9:10am UTC](https://community.fibery.io/t/search-cant-find-japanese/304/2 "2019-09-26T09:10:50Z")

</div>

In v1.0.68 (build 2001), the same thing is happening FYI.

If I search for string `XYZセンサー` exactly (it’s the title of one of my test tasks), I get a hit. But I cannot just search on `センサー`, probably because there is no space before. The thing is, while Japanese does have space characters (in both half and full pitch unicode), you don’t separate parts of Japanese sentences with spaces. Search tokenization is different for CJK languages.

---

<div class="post-metadata">

### Author: ![rickcogley](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/rickcogley/32/274_2.png) [@rickcogley](https://community.fibery.io/u/rickcogley)
#### Post date: [October 14, 2019, 3:22pm UTC](https://community.fibery.io/t/search-cant-find-japanese/304/3 "2019-10-14T15:22:34Z")

</div>

In v1.0.68 (build 2352), it’s the same thing still

---

<div class="post-metadata">

### Author: ![vadim](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/vadim/32/7001_2.png) [@vadim](https://community.fibery.io/u/vadim)
#### Post date: [October 14, 2019, 7:20pm UTC](https://community.fibery.io/t/search-cant-find-japanese/304/4 "2019-10-14T19:20:27Z")

</div>

Hi. Could you please check again? We have tried to reproduce but it works here.

---

<div class="post-metadata">

### Author: ![rickcogley](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/rickcogley/32/274_2.png) [@rickcogley](https://community.fibery.io/u/rickcogley)
#### Post date: [October 14, 2019, 10:05pm UTC](https://community.fibery.io/t/search-cant-find-japanese/304/5 "2019-10-14T22:05:56Z")

</div>

Hi @vadim, created a new task with Name:

XYZ設定

… via a Task Table.

Made settings in it, like assignee, category, state. Clicked the search icon in the sidebar and tried:

- Search XYZ設定 - works
- Search XYZ - works
- Search 設定 - fails
- Search \*設定 - fails (thought I’d see if wildcard is enabled)

Does that help?

---

<div class="post-metadata">

### Author: ![rickcogley](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/rickcogley/32/274_2.png) [@rickcogley](https://community.fibery.io/u/rickcogley)
#### Post date: [October 20, 2019, 12:12am UTC](https://community.fibery.io/t/search-cant-find-japanese/304/6 "2019-10-20T00:12:14Z")

</div>

Still the same in v1.0.68 (build 2443). @vadim did you happen to try the tests I listed above?

Fwiw, search on Japanese does work in Targetprocess…

---

<div class="post-metadata">

### Author: ![vadim](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/vadim/32/7001_2.png) [@vadim](https://community.fibery.io/u/vadim)
#### Post date: [October 20, 2019, 1:04pm UTC](https://community.fibery.io/t/search-cant-find-japanese/304/7 "2019-10-20T13:04:41Z")

</div>

The problem is that it works for me here. We need some time to investigate the problem. ![47%20PM](https://us1.discourse-cdn.com/flex020/uploads/fibery/original/2X/e/e35ed64e3d4e0def3979f1d03927a53d4bc7f5b7.png)

---

<div class="post-metadata">

### Author: ![rickcogley](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/rickcogley/32/274_2.png) [@rickcogley](https://community.fibery.io/u/rickcogley)
#### Post date: [October 20, 2019, 7:07pm UTC](https://community.fibery.io/t/search-cant-find-japanese/304/8 "2019-10-20T19:07:00Z")

</div>

hi @vadim, thanks for trying.

Yes, _that_ works, when you search the exact first thing in a task name.

Even if the task name is something like イメージ不可 or 業務連絡, where the Japanese followed by other Japanese, searching on the _first_ part of those strings does work. That is, searching イメージ returns the イメージ不可 task, and searching 業務 returns the 業務連絡 task. And your example, where Japanese is followed by latin chars, also works as expected.

What _doesn’t_ work is, if you search 不可 or 連絡, the second half of each of the above two examples, or any Japanese from the middle of the string. Nothing is returned. So I guess I can hypothesize, that any Japanese “mid, or end string” is not found, here assuming “string = task name”.

(Also, searching for some remembered text from _inside_ the task, is also not found, no matter what language. Maybe by design?)

In my experience, for CJK languages the search engine has to be told “search also for CJK type languages” because the tokenizer part of the search module has to realize that indexing assuming spaces, won’t work.

Let me know if I can help, with any testing etc.

e.g. searching task number 69:

 ![image](https://us1.discourse-cdn.com/flex020/uploads/fibery/original/2X/8/86b7b341f62d364e4c7fccba124aeea8cdb1ab23.png)

 ![image](https://us1.discourse-cdn.com/flex020/uploads/fibery/original/2X/f/f59d21582b955937d56b695d11a2239e2adc05cc.png)

Edited: a little more precision in words

---

<div class="post-metadata">

### Author: ![vadim](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/vadim/32/7001_2.png) [@vadim](https://community.fibery.io/u/vadim)
#### Post date: [October 25, 2019, 9:12am UTC](https://community.fibery.io/t/search-cant-find-japanese/304/9 "2019-10-25T09:12:31Z")

</div>

You are completely right with your suppose: At this time search indexes only tokens which are surrounded by spaces or other delimiters.

---

<div class="post-metadata">

### Author: ![rickcogley](https://sea2.discourse-cdn.com/flex020/user_avatar/community.fibery.io/rickcogley/32/274_2.png) [@rickcogley](https://community.fibery.io/u/rickcogley)
#### Post date: [October 25, 2019, 9:33am UTC](https://community.fibery.io/t/search-cant-find-japanese/304/10 "2019-10-25T09:33:06Z")

</div>

@vadim yes, Chinese, Japanese and Korean don’t use latin spaces, so search engines are tweaked to allow that kind of language to be indexed.

For example I’ve used [https://fusejs.io/](https://fusejs.io/) on a few projects with Japanese and Chinese, and it works fine. You just have to set the option “tokenize” and it will find even a single Japanese character anywhere in the indexed text.
