On Thu, 31 Jan 2002 12:31:58 +0000 Jean-Michel Hiver <[EMAIL PROTECTED]> wrote:
> However I'm having quite a lot of trouble with Japanese because of > Kanjis (chinese ideograms). ICU does provide Hiragana <=> Latin and > Katakana <=> Latin, but doesn't do anything about kanji. Which does > not surprise me too much given the fact that in Japanese a kanji has > very often more than one pronunciation depending on how and where it's > used. > > Another problem with Japanese is that it seems to me that words are > not separated by spaces. Therefore even if the transliteration worked > for Kanjis I'd end up with lots of endless strings, which is not good > for indexing when you try to split text into keywords. > > Any ideas? Try kakasi or Chasen. They can be accessed via Perl with XS wrapper. kakasi http://kakasi.namazu.org/ Chasen http://chasen.aist-nara.ac.jp/ namazu http://namazu.org/ -- Tatsuhiko Miyagawa <[EMAIL PROTECTED]>
