Hi everyone,
I'm facing a curious problem.
I defined an analyzer in my settings, this way :
{
"*index*":{
"cluster.name":"test-cluster",
"client.transport.sniff":true,
"*analysis*":{
"*filter*":{
"french_elision":{
"type":"elision",
"articles":[
...skipped...
]
},
"french_stop":{
"type":"stop",
"stopwords":"_french_",
"ignore_case":true
},
"snowball":{
"type":"snowball",
"language":"french"
}
},
"*analyzer*":{
"*my_french*":{
"type":"custom",
"tokenizer":"standard",
"filter":[
"french_elision",
"lowercase",
"french_stop",
"snowball"
]
},
"*lower_analyzer*":{
"type":"custom",
"tokenizer":"keyword",
"filter":"lowercase"
},
"*token_analyzer*":{
"type":"custom",
"tokenizer":"whitespace"
}
}
}
}
}
And in my mapping, i have two text fields. On one of them i specify
explicitly the analyzer to use to my_french, and on the other i let the
global mapping analyzer (also set to my_french) kick in automatically. Here
is the mapping.
{
"*record*":{
"*_all*":{
"enabled":false
},
*"analyzer":"my_french",*
"*properties*":{
"_uuid":{
"type":"string",
"store":"yes",
"index":"not_analyzed"
},
"*a*":{
"*type*":"multi_field",
"*fields*":{
*"a"*:{
"type":"string",
"store":"yes",
"index":"analyzed",
*"analyzer":"my_french"*
},
"*raw*":{
"type":"string",
"store":"no",
"index":"not_analyzed"
},
"*tokens*":{
"type":"string",
"store":"no",
"index":"analyzed",
"analyzer":"token_analyzer"
},
"*lower*":{
"type":"string",
"store":"no",
"index":"analyzed",
"analyzer":"lower_analyzer"
}
}
},
"g_r":{
"type":"string",
"store":"yes",
"index":"analyzed"
}
}
}
}
When i try to analyze with a REST query using my analyzer, the result is
correct :
$ curl -XGET
'localhost:9200/test-index/_analyze?analyzer=*my_french*&pretty=true'
-d "*j'aime les chevaux*"
{
"*tokens*" : [ {
"token" : "*aim*",
"start_offset" : 0,
"end_offset" : 6,
"type" : "<ALPHANUM>",
"position" : 1
}, {
"*token*" : "*cheval*",
"start_offset" : 11,
"end_offset" : 18,
"type" : "<ALPHANUM>",
"position" : 3
} ]
}
But when i index my data and search on it, i don't get the expected result.
So with a facet, i wanted to know what tokens have been stored in the
index, and here is the result :
$ curl -X POST "http://localhost:9200/test-index/_search?pretty=true"; -d
'{"query": {"match": {"_id": "12"}},"facets": {"tokens": {"terms":
{"field": "a"}}}}'
{
"took" : 2,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
},
"*hits*" : {
"total" : 1,
"max_score" : 1.0,
"hits" : [ {
"_index" : "test-index",
"_type" : "record",
"_id" : "12",
"_score" : 1.0,
"_source":{"_uuid":"12","a_t":false,"a_n":false,"a":"J'aime les
chevaux","b_r":null,"b_t":false,"b_n":false,"b":1407664800000,"c_r":null,"c_t":false,"c_n":false,"c":2,"d_r":"m3","d_t":true,"d_n":false,"d":null,"e_r":null,"e_t":false,"e_n":true,"e":12,"f_r":null,"f_t":false,"f_n":false,"f":true,"g_r":"J'aime
les chevaux","g_t":false,"g_n":false,"g":12.0}
} ]
},
"*facets*" : {
"*tokens*" : {
*"_type" : "terms",*
"missing" : 0,
"total" : 2,
"other" : 0,
"*terms*" : [ {
*"term" : "j'aim",*
"count" : 1
}, {
*"term" : "cheval",*
"count" : 1
} ]
}
}
}
As you can see, the tokens are not correct. I expect 'aim' and 'cheval', as
resulting from my analysis, but i got 'j'aim' and 'cheval'.
Anyone could tell me what i missed or what i'm doing wrong here ?
Thanks !
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/c7f4de41-59e4-4b74-96e6-b1157e1d7a8f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
