[HACKERS] tsearch2: enable non ascii stop words with C locale

[Tatsuo Ishii]

Hi,

Currently tsearch2 does not accept non ascii stop words if locale is
C. Included patches should fix the problem. Patches against PostgreSQL
8.2.3.
--
Tatsuo Ishii
SRA OSS, Inc. Japan

*** wordparser/parser.c~        2007-01-16 00:16:11.000000000 +0900
--- wordparser/parser.c 2007-02-10 18:04:59.000000000 +0900
***************
*** 246,251 ****
--- 246,266 ----
  static int
  p_islatin(TParser * prs)
  {
+       if (prs->usewide)
+       {
+               if (lc_ctype_is_c())
+               {
+                       unsigned int c = *(unsigned int*)(prs->wstr + 
prs->state->poschar);
+ 
+                       /*
+                        * any non-ascii symbol with multibyte encoding
+                        * with C-locale is a latin character
+                        */
+                       if ( c > 0x7f )
+                               return 1;
+               }
+       }
+ 
        return (p_isalpha(prs) && p_isascii(prs)) ? 1 : 0;
  }
  

---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings