Hiding common fields in ESresponse
Hi ES Users,
Is there any way I can hide some of the common fields which are being
returned as a response by ES.
e.g if I get the response as below:
*{
took: 74
timed_out: false
_shards: {
total: 15
successful: 15
failed: 0
}
hits: {
total: 24
max_score: 0.15932977
hits: [
{
_index: prashant
_type: session
_id: LeIDrUNmSKGC5Sl9Y8O0Zw
_score: 0.15932977
fields: {
Time: [
2014-01-08T15:01:26
]
}
}
{
_index: prashant
_type: session
_id: dlpQGXk_TOyfNnUEG6skeQ
_score: 0.14296037
fields: {
Time: [
2014-01-08T15:01:26
]
}
}
*
Now I want the ES to response without
*took,timed_out,_shards,total,successful,failed* value as well I dont want
the Name of the *_index* and *_type * as I am executing the query to
particular index and type.
So is there a way to filter the ES response in that way?
--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Hiding-common-fields-in-ESresponse-tp4052073.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1395127849748-4052073.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.
Re: Hiding common fields in ES response
Is there any way around for this case? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Hiding-common-fields-in-ES-response-tp4052073p4052099.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1395145565239-4052099.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Suppressing the content in Cluster response
Hi ES Users,
I have indexed a large sample of data to ES. Now I am running the cluster
query to categorize the data on the basis of Content. But I don't want the
Content field to be returned as ES response i.e. I want only the Cluster
labels and ID's so is there any way around this scenario?
For ex:
If my query is :
{
search_request: {
fields: [
Content
],
query: {
match: {
Content: *mobile*
}
}
},
query_hint: mobile,
field_mapping: {
content: [
fields.Content
]
},
algorithm: lingo3g
}
In this case I will get the response which will contain the
fields-Content as well as Cluster labels and ID's.
So is there a way I can suppress the Content as return and perform the
categorization as well.
--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Suppressing-the-content-in-Cluster-response-tp4052109.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1395149021409-4052109.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.
Re: Upload/index document to Elastic Search
Use Mapper attachments plugin to index the attachement type docs in ES. https://github.com/elasticsearch/elasticsearch-mapper-attachments https://github.com/elasticsearch/elasticsearch-mapper-attachments -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Upload-index-document-to-Elastic-Search-tp4051542p4051619.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394618024850-4051619.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Installing elasticsearch on red hat linux - error command not found
If you have copied the files from windows to linux and then executing ES. Then try dos2unix elasticseacrh and then run ES -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Installing-elasticsearch-on-red-hat-linux-error-command-not-found-tp4051545p4051622.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394618375164-4051622.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Cluster query to fetch particular label records in carrot2
Hi ES Users,
Is there any specific query which can be used to fetch the records of one
particular label.
e.g.: Using _search_with_clusters I got response as
*{id: 3
score: 0.9494177601684511
label: Nokia
phrases: [
Nokia
]
documents: [
XQqcFFOlRDm7-FfIVz-U1A
rXJT_mKpQWKB9x9Zs2ipJw
]
}
{
id: 4
score: 0.9399315182096429
label: Samsung
phrases: [
Samsung
]
documents: [
rXJT_mKpQWKB9x9Zs2ipJw
nxrIS71jRGqcJ1U11LPlJw
]
}
{
id: 5
score: 0.9353337839487279
label: LG
phrases: [
LG
]
documents: [
2wGWpV8OQXCPWwlnsm_uCw
nxrIS71jRGqcJ1U11LPlJw
]
}*
Now suppose I want to filter the response for one particular label say Nokia
so is there any query which I can fire to get the specific set of record?
--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1394529582225-4051485.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.
Re: Cluster query to fetch particular label records in carrot2
As the cluster labels will be known after performing one search query.
So if my search query is:
{
search_request: {
Content
],
query: {
match: {
_all: mobile
}
},
size: 1000,
from:0
},
query_hint: mobile,
field_mapping: {
content: [
fields.Content
]
},
algorithm: lingo3g
}
I will get the results as mentioned in previous post.
So what query should be executed if I knows that there is one cluster for
mobile search as Nokia.
Add the cluster's label as a boolean must-occur phrase to your search
query.
According to this you mean to say that I should execute like:
{
search_request: {
fields: [
Host,
URL,
Content
],
query: {
bool: {
must: {
term: {
Content: Nokia
}
}
}
},
size: 1000,
from: 0
},
query_hint: Nokia,
field_mapping: {
content: [
fields.Content
]
},
algorithm: lingo3g
}
Correct me if I am wrong.
--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485p4051487.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1394530422299-4051487.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.
Re: Cluster query to fetch particular label records in carrot2
Hi Dawid, Any input for the above problem case? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485p4051507.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394536882990-4051507.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Cluster query to fetch particular label records in carrot2
Sorry If I have asked a question which is not relevant to forum. I explored the Project repository already and what I got for Web App is war file at http://project.carrot2.org/download.html http://project.carrot2.org/download.html But I was just thinking if there is any source code(html files) instead of war files to check for some html page rendering and all. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485p4051525.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394539584840-4051525.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Cluster query to fetch particular label records in carrot2
Yes I checked this link as well till the web app. Which is having the code altogether as java code. What I thought is if we are doing any search just through json request in html pages so it is storing some info as cookies in client side and through HTML pages only the results are being retrieved later on click of label name. As I don't have working experience in Java so I didn't go through in depth of code and was thinking there are some html files only to retrieve the data (just like the example of data mining is there in carrot2 plugin). -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485p4051532.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394540645462-4051532.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Cluster query to fetch particular label records in carrot2
Yes that's what I was looking for throughout the source code and not able to pullout. What I was interested to know through the source code is How data is handled on web after firing the first query(which returns the set of cluster labels and on user event we can navigate through various labels) that I was unable to locate properly in source code. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485p4051539.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394541560076-4051539.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Cluster query to fetch particular label records in carrot2
It could be a silly question but just wanted to know that can we integrate the carrot2 web application with our Elasticsearch instance? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485p4051544.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394544666935-4051544.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space
Hi gkwelding, I have checked explicitly on my box and the value for MAX_OPEN_FILES and MAX_MAP_COUNT has been set to 65535. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4051415.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394443468998-4051415.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Real time vs On demand cluster
Hi Dawid, If I understood correctly wrt ES, 1) Once we send the docs to ES it will index the data (Clustering i.e. assign cluster labels will not happen at this time). And only the documents will be stored to ES. 2) Once we send the search query it will fetch the records, and on top of that record the clustering (assign cluster labels and maintain hierarchy) will happen. And one more thing, Is there any concept like Real time clustering and On demand clustering in ES? ~Prashant -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151p4051276.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394180442801-4051276.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Real time vs On demand cluster
Hi Dawid, On-demand and real time happens on a subset of documents from the index and should return clusters within a reasonable amount of time (so that users can interact with the system). This means that there is no concept like real time and on demand in ES. Only after firing the search query the documents will be clustered and returned as response. Off-line or batch clustering would denote a situation when you're clustering all your documents, without the context of any query. Is offline clustering supported by carrot2 or any other plugin available in ES? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151p4051290.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394187405585-4051290.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space
Hi Clinton/gkwelding,
Any suggestion to overcome this issue as I tried by increasing the heap size
and still getting the same error.
Below are the call logs for the issue:
error: array index out of bounds
[2014-03-05 21:03:25,212][WARN ][monitor.jvm
] [Node225] [gc][young][5079][15545] duration [10.1s], col
lections [2]/[18.7s], total [10.1s]/[2m], memory [1.9gb]-
[1.7gb]/[1.9gb], all_pools {[young] [20.7mb]-[7.7mb]/[33.
3mb]}{[survivor] [4.1mb]-[4.1mb]/[4.1mb]}{[old] [1.9gb]-
[1.7gb]/[1.9gb]}
error: array index out of bounds
[2014-03-05 21:07:58,490][WARN ][http.netty ] [Node225] Caught
exception while handling client http traffic, closing connection [id:
0x1da386d5, /192.168.0.251:36240 = /192.168.0.225:9200]
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays.java:3065)
at
org.elasticsearch.common.bytes.BytesArray.toBytes(BytesArray.java:114)
at
org.elasticsearch.common.io.Streams.copyToByteArray(Streams.java:165)
at
org.elasticsearch.common.io.Streams.copyToByteArray(Streams.java:84)
at
org.elasticsearch.http.HttpServer.handlePluginSite(HttpServer.java:197)
at
org.elasticsearch.http.HttpServer$PluginSiteFilter.process(HttpServer.java:129)
at
org.elasticsearch.rest.RestController$ControllerFilterChain.continueProcessing(RestController.java:216)
at
org.elasticsearch.http.HttpServer.internalDispatchRequest(HttpServer.java:118)
at
org.elasticsearch.http.HttpServer$Dispatcher.dispatchRequest(HttpServer.java:83)
at
org.elasticsearch.http.netty.NettyHttpServerTransport.dispatchRequest(NettyHttpServerTransport.java:291)
at
org.elasticsearch.http.netty.HttpRequestHandler.messageReceived(HttpRequestHandler.java:43)
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at
org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:145)
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at
org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459)
at
org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536)
at
org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435)
at
org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at
org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at
org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at
org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at
org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4051291.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1394189475860-4051291.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.
Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space
MAX_OPEN_FILES and MAX_MAP_COUNT are not being set explicitly, so having default value only i.e. 65535. And still its crashing with same error :( -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4051302.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394196505087-4051302.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space
Hi Clinton/gkwelding, I tried sending the document one by one as well for indexing. So suppose my document is of 5 MB so it gets indexed and not giving any exception. But in other hand for some documents which is in KB or about 1 MB is giving the exception of out of memory. Though mapping are same for both the scenario. And the memory is 2 GB. So what could be the issue for that? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4051143.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394100262943-4051143.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Real time vs On demand cluster
What is the limit for clustering the document in case of real time cluster and on demand cluster? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394102476115-4051151.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Real time vs On demand cluster
I just wanted to know that is there any difference between Real time vs On demand cluster wrt no of document to be indexed. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151p4051246.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394168898486-4051246.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Real time vs On demand cluster
Hi Mark, I read some where that there are clustering like real time and on demand so was keen to know about that. I have one more concern that might be the silly one but still wanted to know about that *whether clustering happens at the time when we are indexing the data to ES or it happens while retrieving the data from ES by any of search query (e.g. by carrot2 plugin)* So in other words is it like that indexing the data to ES does clustering of documents as well? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151p4051253.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394173839749-4051253.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Real time vs On demand cluster
The indexing happens as soon as you post a document to ES, not as you query it. ES will automatically replicate the document (depending on your setup) at the same time. This is fine for indexing. But what happens exactly wrt clustering. Clustering means I wanted to know like I submitted one docs to ES so Indexing will happen at that time. So is it like that clustering of documents will also happens at the same time. Or the clustering will happen, while we will fire the _search_with_clusters query to ES ? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151p4051256.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1394174526533-4051256.post%40n3.nabble.com. For more options, visit https://groups.google.com/d/optout.
Re: Real time vs On demand cluster
There are two scenario.
1) I am submitting the documents to ES for indexing.
2) I am executing a search query using cluster plugin.
Just to elaborate through example.
*Step 1:
*curl -xPOST 'http://192.168.0.179:9200/prashant' -d
{
mappings: {
emp: {
properties: {
empid: {type:long, store:no,
precision_step:0 },
empname: {type:string, store:yes,
index:analyzed },
empage: {type:integer, store:yes,
precision_step:0 },
empstatus: {type:string, store:yes,
index:analyzed }
}
}
}
}
*Step 2:
*Now adding the documnets by :
curl -xPOST 'http://192.168.0.179:9200/prashant/emp' -d
{
empid: 1,
empname: ABC,
empage: 25,
empstatus:permanent
}
*Step 3:
*Now if I _search_with_clusters for the documents like
{
search_request: {
query: {
match: {
_all: ABC
}
},
size: 1000,
from:0
},
query_hint: ,
field_mapping: {
content: [
_source.empname
]
},
algorithm: lingo3g
}
It will return 1000 of record in hierarchical structure with the cluster
label and all.
*So my question is whether the clustering of documents will happen at step2
or step3?*
--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151p4051258.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1394175348897-4051258.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.
Re: Error ReduceSearchPhaseException
One more observation in above scenario. 1) The records returned by the mobile is 287 so if I set the size (in query) as 287 it is working fine but in case of =287 it is throwing the exception. 2) The records returned by the samsung is 191 so if I set the size as 191 it is working fine also in case of =191 it is working fine. So just to conclude the keywords which are throwing exception works fine if I am giving the size = total records. But I hope it(size) shouldn't be dependent on the number of records returned. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050892.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393916876166-4050892.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space
I tried increasing the heap value by 2GB as well by ES_MAX_MEM: 2g but it gave the same error. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4050916.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393940458101-4050916.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space
Just wanted to know that as I was using 1GB as Heap Size I was getting an error. So I increased it to 2GB (Heap , system has 4GB) so in that scenario also I got the error at same point. So if I increased the memory from 1 GB to 2 GB, at least it should process one more record in compare to previous scenario. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4050919.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393941390342-4050919.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space
Hi gkwelding, I am using the bulk API for indexing the data. And also refresh parameter is not set. So what could be the issue for that exception. Let me know if you require any other input for the same. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4050982.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393997721475-4050982.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Error ReduceSearchPhaseException
Hi All, Below is the logs for the same issue: [2014-03-03 22:40:24,956][DEBUG][action.search.type ] [Node164] failed to reduce search org.elasticsearch.action.search.ReduceSearchPhaseException: Failed to execute phase [fetch], [reduce] at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.finishHim(TransportSearchQueryThenFetchAction.java:182) at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$3.onResult(TransportSearchQueryThenFetchAction.java:156) at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$3.onResult(TransportSearchQueryThenFetchAction.java:150) at org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteFetch(SearchServiceTransportAction.java:407) at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.executeFetch(TransportSearchQueryThenFetchAction.java:150) at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction$2.run(TransportSearchQueryThenFetchAction.java:134) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:636) Caused by: lingo3g.ft$c: bytes can be at most 32766 in length; got 131074 at lingo3g.ft.a(Unknown Source) at lingo3g.ft.a(Unknown Source) at lingo3g.cx.a(Unknown Source) at lingo3g.cx.a(Unknown Source) at lingo3g.df.b(Unknown Source) at lingo3g.df.a(Unknown Source) at lingo3g.v.a(Unknown Source) at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.a(Unknown Source) at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.a(Unknown Source) at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm$1.process(Unknown Source) at org.carrot2.text.clustering.MultilingualClustering.clusterByLanguage(MultilingualClustering.java:237) at org.carrot2.text.clustering.MultilingualClustering.process(MultilingualClustering.java:119) at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.process(Unknown Source) at org.carrot2.core.ControllerUtils.performProcessing(ControllerUtils.java:106) at org.carrot2.core.Controller.process(Controller.java:356) at org.carrot2.core.Controller.process(Controller.java:269) at org.carrot2.elasticsearch.ClusteringAction$TransportClusteringAction$1.onResponse(ClusteringAction.java:664) at org.carrot2.elasticsearch.ClusteringAction$TransportClusteringAction$1.onResponse(ClusteringAction.java:623) at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.innerFinishHim(TransportSearchQueryThenFetchAction.java:198) at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.finishHim(TransportSearchQueryThenFetchAction.java:180) ... 8 more -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050798.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393847237503-4050798.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Error ReduceSearchPhaseException
Ok Dawid, waiting for your reply... -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050805.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393849374162-4050805.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Error ReduceSearchPhaseException
I have sent the particular scenario in which I am getting the error. Also I am using common words token only for search not any awkward tokens. So just let me know if the issue gets fixed or any temporary solution is there to solve the same. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050884.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393910578831-4050884.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Error ReduceSearchPhaseException
Tony, I am not using any Regex in my query explicitly. Is there any place in config file or somewhere else where I can confirm for the same if its taking internally? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050773.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393825646592-4050773.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Error ReduceSearchPhaseException
Hello All, Did any one encountered the same issue if yes then please let me know the solution. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050686.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393577820463-4050686.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Elasticsearch output format with head plugin
Hi All,
I am using head plugin to access the elastic search through GUI and cluster
plugin to cluster the data.
So is there anyway I can display any particular field in GUI of
elasticsearch.
For ex:
If my query is
*{
search_request: {
fields: [
Content
],
query: {
match: {
_all: mobile
}
}
},
field_mapping: {
content: [
fields.Content
]
},
}*
And response will be everything as *took, size, data, label, clusters,
phrases * etc.
So is there any way I can display only label/cluster in elasticsearch GUI
with the help of any other plugin or other way out.
--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Elasticsearch-output-format-with-head-plugin-tp4050614.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1393506468844-4050614.post%40n3.nabble.com.
For more options, visit https://groups.google.com/groups/opt_out.
Re: Text Categorization in ES
So it means that all the classification has to be done prior, on the basis of user defined scenario. And automatically this feature is not supported either through carrot or Lingo3g. Like we have the feature of word-delimiter, hunspell filter etc. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Text-Categorization-in-ES-tp4050194p4050517.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393406374665-4050517.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
ES Response Time
Hi All, Is there any way to measure end-to-end response time for a query in elastic search? That is the time taken from the time query is executed and the result is shown on the ES UI. And what does took parameter means in response ouput? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/ES-Response-Time-tp4050525.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393414287516-4050525.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Text Categorization in ES
Hi All, To be specific I want a query like : Searching for Laptop will automatically give result for Dell, Sony, HP, Lenevo, Samsung... as well. As lingo3g is used for clustering the documents so it will store the reference for above terms as well. For that I have installed Carrot2 and Lingo3g on top of ES. So what should be my query wrt lingo3g to search the specified items. Or is there anything else I have to do to make it work. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Text-Categorization-in-ES-tp4050194p4050512.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1393399736105-4050512.post%40n3.nabble.com. For more options, visit https://groups.google.com/groups/opt_out.
