Re: Unable to preserve special characters in search results of ElasticSearch.

[Anusha]

Hi Thanks,

I resolved this issue,

In order to preserve the special characters and to search the query term in
multiple fields for exact match it is better to change the settings as shown
below.

Settings I updated:

PUT /my_index/_settings?pretty=true
{
"settings" : {
"analysis": {
  "analyzer": {
"wordAnalyzer": {
  "type": "custom",
  "tokenizer": "whitespace",
  "filter": [
"word_delimiter_for_phone","nGram_filter"
  ]
}
  },
  "filter": {
"word_delimiter_for_phone": {
  "type": "word_delimiter",
  "catenate_all": true,
  "generate_number_parts ": false,
  "split_on_case_change": false,
  "generate_word_parts": false,
  "split_on_numerics": false,
  "preserve_original": true
},
 
"nGram_filter": {
   "type": "nGram",
   "min_gram": 1,
   "max_gram": 20,
   "token_chars": [
  "letter"
   ]
}
  }
}
}
}


Mapping settings:
{
“mappings”:{

   "face" : {
 "properties" : {
"{field-1}id" : {
   "type" : "string",
   "index_name" : "change",
   "analyzer": "wordAnalyzer"
   
},
"{field-2}name" : {
"type" : "string",
   "index_name" : "change",
   "analyzer": "wordAnalyzer"
},
"{field-3}Year":
{
"type" : "string",
   "index_name" : "change",
   "analyzer": "wordAnalyzer"
},
"{field-4}Make":
{
"type" : "string",
   "index_name" : "change",
   "analyzer": "wordAnalyzer"
}
 }
  } 



and the query we can use:

GET my_index/face/_search
{
   "query": {
   "match": {
  "change": 
  {
  "query": "A/T o",
  "type": "phrase_prefix"
  }
   }
   }
}


By this we can search for that term in all the fields. In order to search in
only single field we can give that field name in the place of "change" in
match query.

And for to change in mappings I am able to update the analyzers, but not the
index_name, for to add index_name I have deleted the index and again done
the mapping as above.






--
View this message in context: 
http://elasticsearch-users.115913.n3.nabble.com/Unable-to-preserve-special-characters-in-search-results-of-ElasticSearch-tp4072409p4072648.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/1427371817177-4072648.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.

Unable to preserve special characters in search results of ElasticSearch.

[Anusha]

Hi,

I want to preserve the special characters like -, /, (, ) in search results.

Ex: Abc/def a(bc)def a-bcd
response:  If I enter Abc/ the records containing abc/ need to come,
similarly for abc/def records with the following need to come, in the same
way abc/def a(bc) records with the similar combination need to come.


For this I have used different analyzers and filters and the settings and
mappings as follows:

PUT /facebook?pretty=true
{
"settings" : {
"analysis" : {
"filter" : {
"special_character_spliter" : {
"type" : "word_delimiter",
"preserve_original": "true"
}   
},
"analyzer" : {
"my_an" : {
"type" : "pattern",
"pattern" : "[^(*\/*-*\\w\\p{L}]+",
"tokenizer" : "whitespace",
"filter" : [ "special_character_spliter"]
}
}
}
},
 "mappings" : {
"face" : {
"properties" : {
"msg" : {
"type" : "string",
"analyzer": "my_an"

},
"name" : {
"type" : "string"
}
}
}
}
}



and even I have tried with the following settings also:

PUT facebook?pretty=true
{
"settings": {
"index.number_of_replicas": 0,
"analysis": {
"analyzer": {
"msg_excp_analyzer": {
"type": "custom",
"tokenizer": "whitespace",
"filters": ["my_word_delimiter","my_word_pattern",
"lowercase",
"asciifolding",
"shingle",
"standard"]
}
},
"filters": {
"my_word_pattern":
{
   "type" : "pattern_capture",
   "preserve_original" : 1,
   "patterns" : [
  "(\\w+)",
  "(\\p{L}+)",
  "(\\d+)",
  "@(.+)"
   ]
   
},
"my_word_delimiter": {
"type": "word_delimiter",
"preserve_original": "true",
  "catenate_all": "true",
  "type_table": {
"$": "DIGIT",
"%": "DIGIT",
".": "DIGIT",
",": "DIGIT",
":": "DIGIT",
"/": "DIGIT",
"\\": "DIGIT",
"=": "DIGIT",
"&": "DIGIT",
"(": "DIGIT",
")": "DIGIT",
"<": "DIGIT",
">": "DIGIT",
"\\U+000A": "DIGIT"

},
"my_asciifolding": {
"type": "asciifolding",
"preserve_original": true
}
}
}
}
},
"mappings": {
"face": {
"properties": {
"msg": {
"type": "string",
"index": "analyzed",
"analyzer": "msg_excp_analyzer"
},
"name": {
"type": "string",
"index": "analyzed",
"analyzer": "msg_excp_analyzer"
}
}
}
}
}


With above settings I have tried separately inorder to preserve the special
characters in search results,
and i have used query like:

GET facebook/face/_search
{
   
   "query": {
  "bool": {
  "must": [
 {
 "query_string": {
"fields": [
   "msg"
], 
"query": "a/"
 }
 }
  ]
  }
   
}
}


Am getting the following error:

"error": "SearchPhaseExecutionException[Failed to execute phase [query], all
shards failed; shardFailures {[trVZmtb4Qu-QWIqxK5hEfg][facebook][0]:
SearchParseException[[facebook][0]:


May I know what is the problem with , whether is it with my query or
settings?





--
View this message in context: 
http://elasticsearch-users.115913.n3.nabble.com/Unable-to-preserve-special-characters-in-search-results-of-ElasticSearch-tp4072406.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/1427110501486-4072406.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.