Re: [Zope-dev] chinese text and zope.index

2010-07-27 Thread Manabu TERADA
Sorry, I can not help you.
It's not that easy to fix zope.index. It's should take more than a few weeks.


2010/7/26 Wichert Akkerman wich...@wiggy.net:
 On 7/26/10 14:52 , Manabu TERADA wrote:

 Hi

 I think zope.index will not work for indexing simplified or traditional
 Chinese.  That is my observation of zope.index when I was working on
 Plone4 CJK indexing.  However by looking at SVN record of zope.indexing,
 I see some changes.  It could be working on Chinese, now.

 I'm afraid it doesn't work at all.

 I feel that zope.index should be fixed to work on CJK as well.
 However, I have not get at it.  When will be the due date for the new
 zope.index which works CJK indexing. (It should not that hard to fix it.)

 I'ld like to have it working today if at all possible :). I have no idea how
 to go about fixing it though.

 PS:
 I don't think it is good idea to use CJKSplitter on a new project.  None
 is maintaining CJKSplitter any more.  Moreover, CJKSplitter will not
 work on Japanese, and some problem on indexing English.

 I looked at cjktools as well, but could not find a splitter in there. That
 might be due to my lack of understanding of CJK languages though.

 Wichert.

___
Zope-Dev maillist  -  Zope-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope )


Re: [Zope-dev] chinese text and zope.index

2010-07-26 Thread Manabu TERADA
Hi

I think zope.index will not work for indexing simplified or traditional
Chinese.  That is my observation of zope.index when I was working on
Plone4 CJK indexing.  However by looking at SVN record of zope.indexing,
I see some changes.  It could be working on Chinese, now.

(On Plone4 CJK indexing I am using Products.ZCTextIndex instead of
zope.indexing.)

I feel that zope.index should be fixed to work on CJK as well.
However, I have not get at it.  When will be the due date for the new
zope.index which works CJK indexing. (It should not that hard to fix it.)

PS:
I don't think it is good idea to use CJKSplitter on a new project.  None
is maintaining CJKSplitter any more.  Moreover, CJKSplitter will not
work on Japanese, and some problem on indexing English.

Cheers,
Manabu TERADA


2010/7/26 Wichert Akkerman wich...@wiggy.net:
 Does anyone have the text index from zope.index working for simplified
 or traditional Chinese? The default pipeline is ships with effectively
 makes sure I never get a search result. I tried to drop the splitter
 from http://www.zope.org/Members/panjunyong/CJKSplitter in. This worked
 a bit better in that I got search results, but there seems to be little
 relation between my query and the result.

 Wichert.

 --
 Wichert Akkerman wich...@wiggy.net   It is simple to make things.
 http://www.wiggy.net/                  It is hard to make things simple.
 ___
 Zope-Dev maillist  -  zope-...@zope.org
 https://mail.zope.org/mailman/listinfo/zope-dev
 **  No cross posts or HTML encoding!  **
 (Related lists -
  https://mail.zope.org/mailman/listinfo/zope-announce
  https://mail.zope.org/mailman/listinfo/zope )

___
Zope-Dev maillist  -  Zope-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope )


Re: [Zope-dev] chinese text and zope.index

2010-07-26 Thread Wichert Akkerman
On 7/26/10 14:52 , Manabu TERADA wrote:
 Hi

 I think zope.index will not work for indexing simplified or traditional
 Chinese.  That is my observation of zope.index when I was working on
 Plone4 CJK indexing.  However by looking at SVN record of zope.indexing,
 I see some changes.  It could be working on Chinese, now.

I'm afraid it doesn't work at all.

 I feel that zope.index should be fixed to work on CJK as well.
 However, I have not get at it.  When will be the due date for the new
 zope.index which works CJK indexing. (It should not that hard to fix it.)

I'ld like to have it working today if at all possible :). I have no idea 
how to go about fixing it though.

 PS:
 I don't think it is good idea to use CJKSplitter on a new project.  None
 is maintaining CJKSplitter any more.  Moreover, CJKSplitter will not
 work on Japanese, and some problem on indexing English.

I looked at cjktools as well, but could not find a splitter in there. 
That might be due to my lack of understanding of CJK languages though.

Wichert.
___
Zope-Dev maillist  -  Zope-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope )


[Zope-dev] chinese text and zope.index

2010-07-25 Thread Wichert Akkerman
Does anyone have the text index from zope.index working for simplified 
or traditional Chinese? The default pipeline is ships with effectively 
makes sure I never get a search result. I tried to drop the splitter 
from http://www.zope.org/Members/panjunyong/CJKSplitter in. This worked 
a bit better in that I got search results, but there seems to be little 
relation between my query and the result.

Wichert.

-- 
Wichert Akkerman wich...@wiggy.net   It is simple to make things.
http://www.wiggy.net/  It is hard to make things simple.
___
Zope-Dev maillist  -  Zope-Dev@zope.org
https://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope )