Re: Getting query count for individula fields in multi match query
Hi Vineeth,
First of all, thank you for your suggestion.
BTW as you suggested, I can only able to get the no of matched documents.
But what I need is the no of matches of the querystring in each field.
I can also make termquery for each field individually, as it would result
in time consumption I dont want to that.
Could you help me out?
Thanks again.
Regards,
Anand
On Wednesday, 4 February 2015 18:58:35 UTC+5:30, vineeth mohan wrote:
>
> Hi ,
>
> There is a way to do it.
> You need to use the filter aggregation
> <http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-bucket-filter-aggregation.html>
> .
>
> Keep 2 filters one for match on subject field and other on message field.
>
> {
> "query": {
> "multi_match": {
> "query": "this is a test",
> "fields": [
> "subject",
> "message"
> ]
> }
> },
> "aggs": {
> "messageField": {
> "filter": {
> "query": {
> "match": {
> "message": "this is a test"
> }
> }
> }
> },
> "subjectField": {
> "filter": {
> "query": {
> "match": {
> "subject": "this is a test"
> }
> }
> }
> }
> }
> }
>
>
> Thanks
>Vineeth Mohan,
> Elasticsearch consultant,
> qbox.io ( Elasticsearch service provider <http://qbox.io>)
>
>
> On Wed, Feb 4, 2015 at 6:44 PM, Anand kumar > wrote:
>
>>
>> Hi all,
>>
>> Is it possible to get the query count per field, while querying
>> via multi match query?
>>
>> {
>> "multi_match" : {
>> "query":"this is a test",
>> "fields": [ "subject", "message" ]
>> }
>> }
>>
>>In above query, can i able to get the the no of matches from the
>> subject field and message field, is there any other way to make it?
>>
>>Any suggestion would be helpful.
>>
>>Thanks in advance.
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "elasticsearch" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to elasticsearc...@googlegroups.com .
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/elasticsearch/13ddfd94-ed9b-4fda-a768-fcd21c14fc37%40googlegroups.com
>>
>> <https://groups.google.com/d/msgid/elasticsearch/13ddfd94-ed9b-4fda-a768-fcd21c14fc37%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/e2fa7b1b-7720-4e94-885a-12f62b0cd0f8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Getting query count for individula fields in multi match query
Hi all,
Is it possible to get the query count per field, while querying via
multi match query?
{
"multi_match" : {
"query":"this is a test",
"fields": [ "subject", "message" ]
}
}
In above query, can i able to get the the no of matches from the
subject field and message field, is there any other way to make it?
Any suggestion would be helpful.
Thanks in advance.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/13ddfd94-ed9b-4fda-a768-fcd21c14fc37%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Re: Indexing and searching on special characters
In the type_table mentioned above, assinging "= => DIGIT" instead of "=
=>ALPHA" yields the indexing as I expected.
On Monday, 24 November 2014 23:18:58 UTC+5:30, Anand kumar wrote:
>
>
> Hi all,
>
> I've been using elasticsearch-1.2.1 and I've been indexing .xml and .jsp
> file content.
>
> And this is how my index has been analyzed as:
>
> "settings": {
> "analysis": {
> "filter": {
> "word_delimiter" : {
>"type" : "word_delimiter",
>"preserve_original" : true,
>"split_on_case_change" : false,
>"stem_english_possessive" : false,
>"type_table" : [
> "# => ALPHA",
> "@ => ALPHA",
> "$ => ALPHA",
> "& => ALPHA",
> "? => ALPHA",
> "= => ALPHA"
> ]
> }
> },
> "analyzer": {
> "custom_analyzer" : {
>"type" : "custom",
>"tokenizer" : "whitespace",
>"filter" : ["word_delimiter", "lowercase"]
> }
> }
> }
>
>
> And the file contains one of the lines as, *<%@ page
> import="java.util.Vector" %>*.
>
> While searching the index as *import="java.**, i'm getting the result as
> expected. But while searching for the keyword* "import"*, I dint get any
> of the result.
>
> On analyzing with the help of kopf plugin, I came to know my content
> *import="java.util.Vector"
> *was indexed into *import="java.util.Vector", **import=, **java, util and
> vector.*
>
> But what I want is *import= *to be indexed as it is and as well as* import,
> *so that it'll match my scenario.
>
> Also I've tried other option i.e. without the type_table, in that case my
> search results gets reversed. The keyword search for *"import"* works and
> *import="java.*"
> *doesn't seems to be working.
>
> Anybody have any idea on how the index should be analyzed to get my
> desired index?
>
>
>
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/a0073b0d-aa4b-4160-b6a7-35fe718e2107%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Indexing and searching on special characters
Hi all,
I've been using elasticsearch-1.2.1 and I've been indexing .xml and .jsp
file content.
And this is how my index has been analyzed as:
"settings": {
"analysis": {
"filter": {
"word_delimiter" : {
"type" : "word_delimiter",
"preserve_original" : true,
"split_on_case_change" : false,
"stem_english_possessive" : false,
"type_table" : [
"# => ALPHA",
"@ => ALPHA",
"$ => ALPHA",
"& => ALPHA",
"? => ALPHA",
"= => ALPHA"
]
}
},
"analyzer": {
"custom_analyzer" : {
"type" : "custom",
"tokenizer" : "whitespace",
"filter" : ["word_delimiter", "lowercase"]
}
}
}
And the file contains one of the lines as, *<%@ page
import="java.util.Vector" %>*.
While searching the index as *import="java.**, i'm getting the result as
expected. But while searching for the keyword* "import"*, I dint get any of
the result.
On analyzing with the help of kopf plugin, I came to know my content
*import="java.util.Vector"
*was indexed into *import="java.util.Vector", **import=, **java, util and
vector.*
But what I want is *import= *to be indexed as it is and as well as* import,
*so that it'll match my scenario.
Also I've tried other option i.e. without the type_table, in that case my
search results gets reversed. The keyword search for *"import"* works and
*import="java.*"
*doesn't seems to be working.
Anybody have any idea on how the index should be analyzed to get my desired
index?
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/27051ee9-7b25-461c-96ee-36cc1747ed11%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Re: Facing slowness while searching a content
Hi Adrien, Thank you so much for your reply. Yes both the clusters were having the same configurations. And one more point, I missed out. I've configured the master node and data node in separate docker container. Did the usage of docker has anything to do with this slowness issue. Thanks again in advance. -Anand On Tuesday, 18 November 2014 16:59:38 UTC+5:30, Adrien Grand wrote: > > There are so many moving factors, it is hard to help. Do both clusters > have exactly the same hardware, network infrastructure, number of nodes, > ... ? You can potentially try to capture where your nodes are spending time > during slow queries with the hot_threads API. > > On Tue, Nov 18, 2014 at 9:58 AM, Anand kumar > wrote: > >> And also addition to this, when I import the indices to another cluster, >> all the cluster wont be available in the newer cluster. What should be done >> to make all the indices available over there? >> >> >> On Monday, 17 November 2014 15:00:43 UTC+5:30, Anand kumar wrote: >>> >>> >>> >>> I'm having a search engine for source code of different repositories. In >>> which the cluster consist of about 500 indices and about 1.8 million >>> documents with its full content. >>> >>> And am facing slowness issue while searching the content, its taking a >>> little extra time to display the results. >>> >>> Those indices in the cluster were imported from the other cluster, if so >>> will the metadata of those indices will cause any difference in search >>> performance? Previously it was working fine, but after importing indices to >>> another cluster and searching in the new cluster makes the performance >>> degradation. >>> >>> My configurations for the index is as: >>> >>> index.number_of_shards: 1 >>> index.number_of_replicas: 0 >>> >>> >>> Any suggestions would be helpful. >>> >>> Regards, >>> Anand >>> >>> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearc...@googlegroups.com . >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/67c80fa3-71c6-4bf7-81aa-6782ae50df82%40googlegroups.com >> >> <https://groups.google.com/d/msgid/elasticsearch/67c80fa3-71c6-4bf7-81aa-6782ae50df82%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Adrien Grand > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/c19983f9-0a4a-4c9d-95a6-7371d383521e%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Facing slowness while searching a content
And also addition to this, when I import the indices to another cluster, all the cluster wont be available in the newer cluster. What should be done to make all the indices available over there? On Monday, 17 November 2014 15:00:43 UTC+5:30, Anand kumar wrote: > > > > I'm having a search engine for source code of different repositories. In > which the cluster consist of about 500 indices and about 1.8 million > documents with its full content. > > And am facing slowness issue while searching the content, its taking a > little extra time to display the results. > > Those indices in the cluster were imported from the other cluster, if so > will the metadata of those indices will cause any difference in search > performance? Previously it was working fine, but after importing indices to > another cluster and searching in the new cluster makes the performance > degradation. > > My configurations for the index is as: > > index.number_of_shards: 1 > index.number_of_replicas: 0 > > > Any suggestions would be helpful. > > Regards, > Anand > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/67c80fa3-71c6-4bf7-81aa-6782ae50df82%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Facing slowness while searching a content
I'm having a search engine for source code of different repositories. In which the cluster consist of about 500 indices and about 1.8 million documents with its full content. And am facing slowness issue while searching the content, its taking a little extra time to display the results. Those indices in the cluster were imported from the other cluster, if so will the metadata of those indices will cause any difference in search performance? Previously it was working fine, but after importing indices to another cluster and searching in the new cluster makes the performance degradation. My configurations for the index is as: index.number_of_shards: 1 index.number_of_replicas: 0 Any suggestions would be helpful. Regards, Anand -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/002c6047-a0b9-4760-9b35-5d0ed2c46e5c%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: How to connect elasticsearch instance of docker VMs from two different machine?
Thank you Mark for your precious time. On Monday, 15 September 2014 17:08:48 UTC+5:30, Mark Walkom wrote: > > Your problem is a docker networking issue, not an ES one. > I'm not familiar with docker so can't help much more sorry. > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: ma...@campaignmonitor.com > web: www.campaignmonitor.com > > On 15 September 2014 21:34, Anand kumar > > wrote: > >> >> Hi Mark, >> >> Thanks for your reply. >> >> Yeah, both the hosts belonged to same network. >> I cant able to use telnet, instead I tried ssh. >> >> >> On Monday, 15 September 2014 16:36:53 UTC+5:30, Mark Walkom wrote: >>> >>> Are they on the same network? >>> Can you telnet to each of the hosts? >>> >>> It looks like the two nodes don't have access to each other, hence the >>> no route to host error. >>> >>> Regards, >>> Mark Walkom >>> >>> Infrastructure Engineer >>> Campaign Monitor >>> email: ma...@campaignmonitor.com >>> web: www.campaignmonitor.com >>> >>> On 15 September 2014 21:02, Anand kumar wrote: >>> >>>> >>>> Hi all, >>>> >>>> I'm trying to connect two ES instances using docker VM and both as >>>> master nodes, but the instances belong to two different hosts from the >>>> same >>>> network. >>>> >>>> My docker commands are as below: >>>> >>>> host1 : $ docker run -t -i --name="master-node-01" -p 9200:9200 -p >>>> 9300:9300 >>>> host2 : $ docker run -t -i --name="master-node-02" -p 9200:9200 -p >>>> 9300:9300 (as the host were different, am using the same port for both) >>>> >>>> And I used the configurations as follows: >>>> >>>> host1 : discovery.zen.ping.unicast.hosts: ["host2"] >>>> host2 : discovery.zen.ping.unicast.hosts: ["host1"] >>>> >>>> When i tried to start the host2 instance after starting the host1, I >>>> cant able connect the host2 with the host1 >>>> >>>> and tried some other configurations like >>>> >>>> host1 : discovery.zen.ping.unicast.hosts: ["host2:9200"] >>>> host2 : discovery.zen.ping.unicast.hosts: ["host1:9200"] >>>> >>>> host1 : discovery.zen.ping.unicast.hosts: ["xxx.xxx.xx.xx:9200"] >>>> host2 : discovery.zen.ping.unicast.hosts: ["xxx.xxx.xx.xx:9200"] >>>> >>>> But I'm getting the following issues, Is it possible to connect the VMs >>>> of different host through ES >>>> >>>> [2014-09-15 09:46:46,920][WARN ][transport.netty ] >>>> [ES_MASTER_NODE_1] exception caught on transport layer [[id: 0x2f06682e]], >>>> closing connection >>>> java.net.NoRouteToHostException: No route to host >>>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) >>>> at sun.nio.ch.SocketChannelImpl.finishConnect( >>>> SocketChannelImpl.java:708) >>>> at org.elasticsearch.common.netty.channel.socket.nio. >>>> NioClientBoss.connect(NioClientBoss.java:150) >>>> at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss. >>>> processSelectedKeys(NioClientBoss.java:105) >>>> at org.elasticsearch.common.netty.channel.socket.nio. >>>> NioClientBoss.process(NioClientBoss.java:79) >>>> at org.elasticsearch.common.netty.channel.socket.nio. >>>> AbstractNioSelector.run(AbstractNioSelector.java:318) >>>> at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.run( >>>> NioClientBoss.java:42) >>>> at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run( >>>> ThreadRenamingRunnable.java:108) >>>> at org.elasticsearch.common.netty.util.internal. >>>> DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) >>>> at java.util.concurrent.ThreadPoolExecutor.runWorker( >>>> ThreadPoolExecutor.java:1145) >>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run( >>>> ThreadPoolExecutor.java:615) >>>> at java.lang.Thread.run(Thread.java:724) >>>> >>>> >>>> Any suggestion would be helpful. Thanks in advance. >>>> >>>> >>>> -- >>>> You received this message b
Re: How to connect elasticsearch instance of docker VMs from two different machine?
Hi Mark, Thanks for your reply. Yeah, both the hosts belonged to same network. I cant able to use telnet, instead I tried ssh. On Monday, 15 September 2014 16:36:53 UTC+5:30, Mark Walkom wrote: > > Are they on the same network? > Can you telnet to each of the hosts? > > It looks like the two nodes don't have access to each other, hence the no > route to host error. > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: ma...@campaignmonitor.com > web: www.campaignmonitor.com > > On 15 September 2014 21:02, Anand kumar > > wrote: > >> >> Hi all, >> >> I'm trying to connect two ES instances using docker VM and both as >> master nodes, but the instances belong to two different hosts from the same >> network. >> >> My docker commands are as below: >> >> host1 : $ docker run -t -i --name="master-node-01" -p 9200:9200 -p >> 9300:9300 >> host2 : $ docker run -t -i --name="master-node-02" -p 9200:9200 -p >> 9300:9300 (as the host were different, am using the same port for both) >> >> And I used the configurations as follows: >> >> host1 : discovery.zen.ping.unicast.hosts: ["host2"] >> host2 : discovery.zen.ping.unicast.hosts: ["host1"] >> >> When i tried to start the host2 instance after starting the host1, I cant >> able connect the host2 with the host1 >> >> and tried some other configurations like >> >> host1 : discovery.zen.ping.unicast.hosts: ["host2:9200"] >> host2 : discovery.zen.ping.unicast.hosts: ["host1:9200"] >> >> host1 : discovery.zen.ping.unicast.hosts: ["xxx.xxx.xx.xx:9200"] >> host2 : discovery.zen.ping.unicast.hosts: ["xxx.xxx.xx.xx:9200"] >> >> But I'm getting the following issues, Is it possible to connect the VMs >> of different host through ES >> >> [2014-09-15 09:46:46,920][WARN ][transport.netty ] >> [ES_MASTER_NODE_1] exception caught on transport layer [[id: 0x2f06682e]], >> closing connection >> java.net.NoRouteToHostException: No route to host >> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) >> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708) >> at >> org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:150) >> at >> org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) >> at >> org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) >> at >> org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318) >> at >> org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) >> at >> org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) >> at >> org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> at java.lang.Thread.run(Thread.java:724) >> >> >> Any suggestion would be helpful. Thanks in advance. >> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearc...@googlegroups.com . >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/d7450d33-b569-493c-8391-e3c68be0cd02%40googlegroups.com >> >> <https://groups.google.com/d/msgid/elasticsearch/d7450d33-b569-493c-8391-e3c68be0cd02%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/4070c285-0b91-43db-b9ee-61e674202a83%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
How to connect elasticsearch instance of docker VMs from two different machine?
Hi all, I'm trying to connect two ES instances using docker VM and both as master nodes, but the instances belong to two different hosts from the same network. My docker commands are as below: host1 : $ docker run -t -i --name="master-node-01" -p 9200:9200 -p 9300:9300 host2 : $ docker run -t -i --name="master-node-02" -p 9200:9200 -p 9300:9300 (as the host were different, am using the same port for both) And I used the configurations as follows: host1 : discovery.zen.ping.unicast.hosts: ["host2"] host2 : discovery.zen.ping.unicast.hosts: ["host1"] When i tried to start the host2 instance after starting the host1, I cant able connect the host2 with the host1 and tried some other configurations like host1 : discovery.zen.ping.unicast.hosts: ["host2:9200"] host2 : discovery.zen.ping.unicast.hosts: ["host1:9200"] host1 : discovery.zen.ping.unicast.hosts: ["xxx.xxx.xx.xx:9200"] host2 : discovery.zen.ping.unicast.hosts: ["xxx.xxx.xx.xx:9200"] But I'm getting the following issues, Is it possible to connect the VMs of different host through ES [2014-09-15 09:46:46,920][WARN ][transport.netty ] [ES_MASTER_NODE_1] exception caught on transport layer [[id: 0x2f06682e]], closing connection java.net.NoRouteToHostException: No route to host at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708) at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:150) at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318) at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) Any suggestion would be helpful. Thanks in advance. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d7450d33-b569-493c-8391-e3c68be0cd02%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Analyzer doesn't seems to be working on special characters
I'm having that symbol in my ES indices only. Yeah some problem existing with the encoding itself. I've tried using setHighlighterEncoding to "HTML", but still the problem persists. There is no problem in indexing and searching, but while displaying in the browser, the issue emerges. The actual text contains copyright symbol, but after the indexing it has been changed to � symbol. I just know wanna know, how this has been changing into this format and is there any other way of encoding to resolve it? Thanks a lot for your reply. On Thu, Aug 7, 2014 at 9:56 PM, Ivan Brusic wrote: > The problem might be with your encoding, not the analyzer. Your content is > in one format and either your output is in another or your viewer > (terminal, browser) is in another. Make sure everything is consistent > (UTF-8 for most people). > > Where are you seeing the � character? > > -- > Ivan > > > On Thu, Aug 7, 2014 at 9:21 AM, Anand kumar wrote: > >> >> >> Hi all, >> >> While indexing the special characters such as copyright symbol, the >> analyzers seems to be not working. >> >> For instance, the copyright symbol © is indexed as question mark symbol >> inside black diamond � . >> >> Any suggestion would be greatly appreciated. Thanks in advance. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearch+unsubscr...@googlegroups.com. >> >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com >> <https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/elasticsearch/_FN0tsUkJYs/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAeyq0CYaCsDgWZ5GVziTr39PVShCoay9yfg%3DjMi9KU%3Dw%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAeyq0CYaCsDgWZ5GVziTr39PVShCoay9yfg%3DjMi9KU%3Dw%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- *Kind regards,* *K.Anandkumar,* *+91-96778 44774* -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAH9YyJTF8N1ivs-3mKE%3DrwG9pdAbqGYFXDWP5Wkp6rFQ6w0SVQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Analyzer doesn't seems to be working on special characters
Hi all, While indexing the special characters such as copyright symbol, the analyzers seems to be not working. For instance, the copyright symbol © is indexed as question mark symbol inside black diamond � . Any suggestion would be greatly appreciated. Thanks in advance. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e143c15c-bf31-49da-91ec-16c542bb51d7%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: EsRejectedExecutionException
Thank you Ivan. If so i'm having 500 indices, each splitted into 5 shards. And while starting the instance, it'll update each shards. In that case, will it create 500*5 requests? Also i don't have any warmer or percolator. As percolator are fixed on processor size, is there any chance of automatic updation on these? Thanks again for reporting this. On Thursday, 31 July 2014 22:41:19 UTC+5:30, Ivan Brusic wrote: > > The thread pool will reject any search requests when there are 1000 > actions already queued. > > > http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-threadpool.html > > Do you have this many search requests at one time? Do you have warmers > and/or percolators running since you mentioned it occurred at startup? > > -- > Ivan > > > On Thu, Jul 31, 2014 at 12:36 AM, Anand kumar > wrote: > >> Hi All, >> >> In my cluster, I'm having around 500 indices. When i'm trying to start >> the elasticsearch instance, its showing the following exception. >> Why its happening, what should be done to resolve it? >> >> Thanks, >> Anand >> >> >> [2014-07-31 11:50:01,551][DEBUG][action.search.type ] [ESCS_NODE] >> [components][3], node[VQMkI5CBRB2hDEnZ5yVLcw], [P], s[STARTED]: Failed to >> execute [org.elasticsearch.action.search.SearchRequest@c34bbb8] lastShard >> [true] >> org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: >> rejected execution (queue capacity 1000) on >> org.elasticsearch.search.action.SearchServiceTransportAction$23@60cfc409 >> at >> org.elasticsearch.common.util.concurrent.EsAbortPolicy.rejectedExecution(EsAbortPolicy.java:62) >> at >> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) >> at >> java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372) >> at >> org.elasticsearch.search.action.SearchServiceTransportAction.execute(SearchServiceTransportAction.java:509) >> at >> org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:203) >> at >> org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.sendExecuteFirstPhase(TransportSearchQueryThenFetchAction.java:80) >> at >> org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:171) >> at >> org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.start(TransportSearchTypeAction.java:153) >> at >> org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction.doExecute(TransportSearchQueryThenFetchAction.java:59) >> at >> org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction.doExecute(TransportSearchQueryThenFetchAction.java:49) >> at >> org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:63) >> at >> org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:101) >> at >> org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:43) >> at >> org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:63) >> at >> org.elasticsearch.client.node.NodeClient.execute(NodeClient.java:92) >> at >> org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:212) >> at >> org.elasticsearch.rest.action.search.RestSearchAction.handleRequest(RestSearchAction.java:75) >> at >> org.elasticsearch.rest.RestController.executeHandler(RestController.java:159) >> at >> org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:142) >> at >> org.elasticsearch.http.HttpServer.internalDispatchRequest(HttpServer.java:121) >> at >> org.elasticsearch.http.HttpServer$Dispatcher.dispatchRequest(HttpServer.java:83) >> at >> org.elasticsearch.http.netty.NettyHttpServerTransport.dispatchRequest(NettyHttpServerTransport.java:294) >> at >> org.elasticsearch.http.netty.HttpRequestHandler.messageReceived(HttpRequestHandler.java:44) >> at >> org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) >> at >> org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) >> at >> org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(Defau
EsRejectedExecutionException
Hi All, In my cluster, I'm having around 500 indices. When i'm trying to start the elasticsearch instance, its showing the following exception. Why its happening, what should be done to resolve it? Thanks, Anand [2014-07-31 11:50:01,551][DEBUG][action.search.type ] [ESCS_NODE] [components][3], node[VQMkI5CBRB2hDEnZ5yVLcw], [P], s[STARTED]: Failed to execute [org.elasticsearch.action.search.SearchRequest@c34bbb8] lastShard [true] org.elasticsearch.common.util.concurrent.EsRejectedExecutionException: rejected execution (queue capacity 1000) on org.elasticsearch.search.action.SearchServiceTransportAction$23@60cfc409 at org.elasticsearch.common.util.concurrent.EsAbortPolicy.rejectedExecution(EsAbortPolicy.java:62) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372) at org.elasticsearch.search.action.SearchServiceTransportAction.execute(SearchServiceTransportAction.java:509) at org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:203) at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.sendExecuteFirstPhase(TransportSearchQueryThenFetchAction.java:80) at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:171) at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.start(TransportSearchTypeAction.java:153) at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction.doExecute(TransportSearchQueryThenFetchAction.java:59) at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction.doExecute(TransportSearchQueryThenFetchAction.java:49) at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:63) at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:101) at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:43) at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:63) at org.elasticsearch.client.node.NodeClient.execute(NodeClient.java:92) at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:212) at org.elasticsearch.rest.action.search.RestSearchAction.handleRequest(RestSearchAction.java:75) at org.elasticsearch.rest.RestController.executeHandler(RestController.java:159) at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:142) at org.elasticsearch.http.HttpServer.internalDispatchRequest(HttpServer.java:121) at org.elasticsearch.http.HttpServer$Dispatcher.dispatchRequest(HttpServer.java:83) at org.elasticsearch.http.netty.NettyHttpServerTransport.dispatchRequest(NettyHttpServerTransport.java:294) at org.elasticsearch.http.netty.HttpRequestHandler.messageReceived(HttpRequestHandler.java:44) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:145) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459) at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536) at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstr
Re: Auto completion using completion suggester
Hi Chris, Thanks a lot for your reply, but the test scenario which you've mentioned in the post cant be accessed. Could you please help me out? On Thu, Jul 24, 2014 at 2:47 PM, Christian Rütgers < christian.ruetg...@grintsch.com> wrote: > Dear Anand, > > I really appreciate your question because I face a similar problem, still > unsolved (you may refer to this post > <https://groups.google.com/forum/?fromgroups#!topicsearchin/elasticsearch/suggest$20OR$20completion$20OR$20typeahead/elasticsearch/yiebM3dm4EE>). > I hope someone comes up with a solution. > > Kind Regards, > Christian > > Am Dienstag, 22. Juli 2014 10:23:44 UTC+2 schrieb Anand kumar: > >> While using the completion suggester, the entire content will be matched >> for the query. >> Instead of that, I want to have the completion to be enabled for the >> terms in the index. >> >> Is it possible using completion suggester or should I have to go for >> other options? >> >> Thanks, >> Anand >> > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/elasticsearch/vVKz2H5LZnU/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/19f7d12b-63be-409b-9b43-c3b884fdbeaa%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/19f7d12b-63be-409b-9b43-c3b884fdbeaa%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- *Kind regards,* *K.Anandkumar,* -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAH9YyJQTqMHJKyd10iigWNJWw%2B%2BMQCQyVHzuOnnv6zF8K%2BPU9A%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Auto completion using completion suggester
While using the completion suggester, the entire content will be matched for the query. Instead of that, I want to have the completion to be enabled for the terms in the index. Is it possible using completion suggester or should I have to go for other options? Thanks, Anand -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8dd9d723-9350-41f1-89f7-24441e0c3232%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
how can we implement ngram_anlyzer without affecting the phrase_search
Hi,
I want to search the ngram analyzed data without being affected the results
of phrase search.
If I used the ngram analyzer, it affects the phrase search results. For
instance, I'm querying for the string "phrase query", it would display the
results for exact match, instead it outputs match for "phrase" and "query".
Here are the settings I've been using, what should be done to get the
desired result.
"settings" : {
"index": {
"analysis" : {
"analyzer" : {
"my_ngram_analyzer" : {
"tokenizer" : ["my_ngram_tokenizer", "whitespace"],
"filter" : "lowercase"
}
},
"tokenizer" : {
"my_ngram_tokenizer" : {
"type" : "nGram",
"min_gram" : "3",
"max_gram" : "20",
"token_chars": [ "letter", "digit" ]
}
}
}
}
}
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/c60981f8-d2f1-417e-bc32-170390fed9f8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Re: Is it possible to highlight the text with respect to no. of lines instead of no. of fragments
Thank u Nik for your reply. On Friday, 9 May 2014 20:25:55 UTC+5:30, Nikolas Everett wrote: > > > > > On Fri, May 9, 2014 at 8:29 AM, Anand kumar > > wrote: > >> >> >> Am having an index of huge content, from which I just want to have the >> highlighting of the specific text. >> >> The highlighted text might have appear as many as times, all I want to >> have two or more lines before and after the line of highlighted text, by >> which i can have a snippet of text with highlighted parts are in the middle >> of the snippet, so that they can be easily located and identified from a >> huge content of file. >> >> Is it possible? >> >> > The only segmentation options are based on characters, sentences, and > grabbing the contents of the whole field. The trick with lines is, unless > the text contains explicit new lines and you only wrap on new lines, then > you have to estimate line breaks based on the rendering context. Stuff > like width in pixels and the font. If you want to be precise you need the > screen dpi as well and a font rendering engine that works similarly. Some > contexts don't properly render ligatures, some do. And its 1000x worse > when you leave English and go to something like Arabic or Sanskrit. There > be dragons. > > But, if you are talking about code, or something else with explicit > newlines and that only wraps on newlines, then the answer is still no, but > it wouldn't be hard to implement. > > Nik > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/892cbfdf-5783-4a0b-a06c-328c0e3f2b72%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Is it possible to highlight the text with respect to no. of lines instead of no. of fragments
Am having an index of huge content, from which I just want to have the highlighting of the specific text. The highlighted text might have appear as many as times, all I want to have two or more lines before and after the line of highlighted text, by which i can have a snippet of text with highlighted parts are in the middle of the snippet, so that they can be easily located and identified from a huge content of file. Is it possible? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/04094295-1848-4fef-a210-255d135f365e%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
