Am Freitag, 29. Mai 2015 11:02:25 UTC+2 schrieb David Pilato:
>
> Yes. Because « Hello. How are you? » is a sentence that can be broken in 
> « hello », « how », « are », « you ».
> But in « I paid it 2.50 euros », I would most likely keep « 2.50 »  as a 
> whole token.
>
>
So far, so easy. And my question is now: From a text "foo.bar", how can I 
generate ALL of the following tokens?

foo
bar
foo.bar
 

-- 
Please update your bookmarks! We have moved to https://discuss.elastic.co/
--- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/e7acf73b-1e15-431c-bee7-1b5f726fb69d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to