Hi Joseph
On Mon, Jun 3, 2013 at 10:01 AM, Joseph M'Bimbi-Bene
<[email protected]> wrote:
> I think it is the tokenizing process of Talismane NLP, since my enhancement
> chain is :
> -langdetect
> -talismaneNLP
> -MyVocabulary
>
I also used Talismane when testing and I was not seeing tokens like that
Here are an excerpt of my log (with minSearchTokenLength set to 2)
--- preocess Token 11: AE (lemma: null) linkable=true, matchable=true
| chunk: none
- 10:'*' (lemma: null) linkable=false, matchable=false
- 12:'*' (lemma: null) linkable=false, matchable=false
- 9:'indiquant' (lemma: null) linkable=false, matchable=false
- 13:'une' (lemma: null) linkable=false, matchable=false
- 8:')' (lemma: null) linkable=false, matchable=false
+ 14:'servitude' (lemma: null) linkable=false, matchable=true
>> searchStrings [AE, servitude]
best
Rupert
--
| Rupert Westenthaler [email protected]
| Bodenlehenstraße 11 ++43-699-11108907
| A-5500 Bischofshofen
