Re:Cache (serialized) tokensteam?

2021-11-22 Thread xiaoshi
Can you try to cache the word segmentation results? This will be easier. At 2021-11-22 16:40:42, "Omri" wrote: >We are indexing a lot of similar texts using Lucene analyzers. >From our performance tests we see that the analyzation (converting the text >the tokensteam object) is t

Cache (serialized) tokensteam?

2021-11-22 Thread Omri
We are indexing a lot of similar texts using Lucene analyzers. >From our performance tests we see that the analyzation (converting the text >the tokensteam object) is talking more time that we want. Before digging into the analyzation code, I was thinking about caching the analyzation result sinc