Suppressing the content in Cluster response

Hi ES Users, I have indexed a large sample of data to ES. Now I am running the cluster query to categorize the data on the basis of "Content". But I don't want the "Content" field to be returned as ES response i.e. I want only the Cluster labels and ID's so is there any way around this scenario?

Re: Hiding common fields in ES response

Is there any way around for this case? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Hiding-common-fields-in-ES-response-tp4052073p4052099.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are

Re: discovery.zen.ping.unicast.hosts Value

As per my guess *discovery.zen.ping.unicast.hosts* value should be set to *IP:port* in both of the config files. For example try this out: discovery.zen.ping.unicast.hosts : ["node1_IP:9300","node2_IP:9300"] -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/disco

Hiding common fields in ESresponse

Hi ES Users, Is there any way I can hide some of the common fields which are being returned as a response by ES. e.g if I get the response as below: *{ took: 74 timed_out: false _shards: { total: 15 successful: 15 failed: 0 } hits: { total: 24 max_score: 0.15932977 hits: [ { _index: prashant _typ

Re: Installing elasticsearch on red hat linux - error command not found

If you have copied the files from windows to linux and then executing ES. Then try dos2unix elasticseacrh and then run ES -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Installing-elasticsearch-on-red-hat-linux-error-command-not-found-tp4051545p4051622.html Sen

Re: Upload/index document to Elastic Search

Use Mapper attachments plugin to index the attachement type docs in ES. https://github.com/elasticsearch/elasticsearch-mapper-attachments -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Upload

Re: Cluster query to fetch particular label records in carrot2

It could be a silly question but just wanted to know that can we integrate the carrot2 web application with our Elasticsearch instance? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485p4051544.h

Re: Cluster query to fetch particular label records in carrot2

Yes that's what I was looking for throughout the source code and not able to pullout. What I was interested to know through the source code is "How data is handled on web after firing the first query(which returns the set of cluster labels and on user event we can navigate through various labels)"

Re: Cluster query to fetch particular label records in carrot2

Yes I checked this link as well till the web app. Which is having the code altogether as java code. What I thought is if we are doing any search just through json request in html pages so it is storing some info as cookies in client side and through HTML pages only the results are being retrieved

Re: Cluster query to fetch particular label records in carrot2

Sorry If I have asked a question which is not relevant to forum. I explored the Project repository already and what I got for Web App is war file at http://project.carrot2.org/download.html But I was just thinking if there is any source code(html file

Re: Cluster query to fetch particular label records in carrot2

Hi Dawid, Any input for the above problem case? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485p4051507.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You rece

Re: Cluster query to fetch particular label records in carrot2

I was also looking for one query to be fired and returned the result as well as cluster but I got stuck when it came to display the record of particular label. >>The code for the web site you provided a snapshot of is open source and is part of the Carrot2 project. Can I get the UI code for this s

Re: Cluster query to fetch particular label records in carrot2

By adding the filter cause it will filter the data and return the Cluster labels. But its not necessary that if I search with the cluster labels(as filter) so I will be getting the same records(same set of record ID in one particular cluster) as I will get in case of former query. Just to explain

Re: Cluster query to fetch particular label records in carrot2

As the cluster labels will be known after performing one search query. So if my search query is: { "search_request": { "Content" ], "query": { "match": { "_all": "mobile" } }, "size": 1000, "from":0 }, "query_hint": "mobile", "field_mapping":

Cluster query to fetch particular label records in carrot2

Hi ES Users, Is there any specific query which can be used to fetch the records of one particular label. e.g.: Using _search_with_clusters I got response as *{id: 3 score: 0.9494177601684511 label: Nokia phrases: [ Nokia ] documents: [ XQqcFFOlRDm7-FfIVz-U1A rXJT_mKpQWKB9x9Zs2ipJw ] } { id: 4

Re: Error "array index out of bounds java.lang.OutOfMemoryError: Java heap space"

I am using Red Hat. [root@localhost /]# lsb_release LSB Version: :core-3.1-amd64:core-3.1-ia32:core-3.1-noarch:graphics-3.1-amd64:graphics-3.1-ia32:graphics-3.1-noarch [root@localhost /]# lsb_release -a LSB Version: :core-3.1-amd64:core-3.1-ia32:core-3.1-noarch:graphics-3.1-amd64:graphics-3.

Re: Error "array index out of bounds java.lang.OutOfMemoryError: Java heap space"

Hi gkwelding, I have checked explicitly on my box and the value for MAX_OPEN_FILES and MAX_MAP_COUNT has been set to 65535. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4051

Re: Error "array index out of bounds java.lang.OutOfMemoryError: Java heap space"

MAX_OPEN_FILES and MAX_MAP_COUNT are not being set explicitly, so having default value only i.e. 65535. And still its crashing with same error :( -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-he

Re: Error "array index out of bounds java.lang.OutOfMemoryError: Java heap space"

Hi Clinton/gkwelding, Any suggestion to overcome this issue as I tried by increasing the heap size and still getting the same error. Below are the call logs for the issue: error: array index out of bounds [2014-03-05 21:03:25,212][WARN ][monitor.jvm ] [Node225] [gc][young][5079][15545] duration

Re: Real time vs On demand cluster

Hi Dawid, >>"On-demand" and "real time" happens on a subset of documents from the index and should return clusters >>within a reasonable amount of time (so that users can interact with >>the system). This means that there is no concept like real time and on demand in ES. Only after firing the s

Re: Real time vs On demand cluster

Hi Jörg, Thanks for the clarification for most of the things. So I can say at time of indexing the clustering wont be happen and at time of search(After retrieving search document) , carrot2 will cluster the document and return the response as cluster. Also as you told we can even create the "Sup

Re: Real time vs On demand cluster

Hi Dawid, If I understood correctly wrt ES, 1) Once we send the docs to ES it will index the data (Clustering i.e. assign cluster labels will not happen at this time). And only the documents will be stored to ES. 2) Once we send the search query it will fetch the records, and on top of that reco

Re: Real time vs On demand cluster

There are two scenario. 1) I am submitting the documents to ES for indexing. 2) I am executing a search query using cluster plugin. Just to elaborate through example. *Step 1: *curl -xPOST 'http://192.168.0.179:9200/prashant' -d { "mappings": { "emp": { "properties": {

Re: Real time vs On demand cluster

>>The indexing happens as soon as you post a document to ES, not as you query it. ES will automatically replicate the document (depending on your setup) at the same time. This is fine for indexing. But what happens exactly wrt clustering. Clustering means I wanted to know like I submitted one doc

Re: Real time vs On demand cluster

Hi Mark, I read some where that there are clustering like real time and on demand so was keen to know about that. I have one more concern that might be the silly one but still wanted to know about that *"whether clustering happens at the time when we are indexing the data to ES or it happens whil

Re: Real time vs On demand cluster

I just wanted to know that is there any difference between Real time vs On demand cluster wrt no of document to be indexed. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151p4051246.html Sent from the ElasticSearch Users ma

Real time vs On demand cluster

What is the limit for clustering the document in case of real time cluster and on demand cluster? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151.html Sent from the ElasticSearch Users mailing list archive at Nabble.com.

Re: Error "array index out of bounds java.lang.OutOfMemoryError: Java heap space"

Hi Clinton/gkwelding, I tried sending the document one by one as well for indexing. So suppose my document is of 5 MB so it gets indexed and not giving any exception. But in other hand for some documents which is in KB or about 1 MB is giving the exception of out of memory. Though mapping are s

Re: Error "array index out of bounds java.lang.OutOfMemoryError: Java heap space"

Hi gkwelding, I am using the bulk API for indexing the data. And also refresh parameter is not set. So what could be the issue for that exception. Let me know if you require any other input for the same. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ar

Re: Error "array index out of bounds java.lang.OutOfMemoryError: Java heap space"

Just wanted to know that as I was using 1GB as Heap Size I was getting an error. So I increased it to 2GB (Heap , system has 4GB) so in that scenario also I got the error at same point. So if I increased the memory from 1 GB to 2 GB, at least it should process one more record in compare to previou

Re: Error "array index out of bounds java.lang.OutOfMemoryError: Java heap space"

I tried increasing the heap value by 2GB as well by ES_MAX_MEM: 2g but it gave the same error. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4050916.html Sent from the Elasti

Error "array index out of bounds java.lang.OutOfMemoryError: Java heap space"

Hi ES users, I am getting the following exception while indexing huge amount of data(say ~5GB) to ES node. Exception: 1) /*array index out of bounds java.lang.OutOfMemoryError: Java heap space*/ Dumping heap to java_pid6721.hprof ... 2) /*java.lang.OutOfMemoryError: PermGen space Dumping heap t

Re: Error "ReduceSearchPhaseException"

One more observation in above scenario. 1) The records returned by the "mobile" is 287 so if I set the "size" (in query) as < 287 it is working fine but in case of >=287 it is throwing the exception. 2) The records returned by the "samsung" is 191 so if I set the "size" as < 191 it is working fin

Re: Error "ReduceSearchPhaseException"

I have sent the particular scenario in which I am getting the error. Also I am using common words token only for search not any awkward tokens. So just let me know if the issue gets fixed or any temporary solution is there to solve the same. -- View this message in context: http://elasticsearc

Re: Error "ReduceSearchPhaseException"

Ok Dawid, waiting for your reply... -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050805.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are subsc

Re: Error "ReduceSearchPhaseException"

Hi All, Below is the logs for the same issue: [2014-03-03 22:40:24,956][DEBUG][action.search.type ] [Node164] failed to reduce search org.elasticsearch.action.search.ReduceSearchPhaseException: Failed to execute phase [fetch], [reduce] at org.elasticsearch.action.search.type.Transpo

Re: Elasticsearch output format with "head" plugin

Hi Binh, Actually I did the same but the problem is I want to fetch multiple record. For ex. 1) There is query which returns multiple clusters and that clusters have labels. 2) Now I want to fetch the label from all clusters . 3) So if I am writing the query like return { label:root.clusters[0].

Re: Error "ReduceSearchPhaseException"

Tony, I am not using any Regex in my query explicitly. Is there any place in config file or somewhere else where I can confirm for the same if its taking internally? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p40

Re: Elasticsearch output format with "head" plugin

Any help for the same issue? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Elasticsearch-output-format-with-head-plugin-tp4050614p4050687.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are

Re: Error "ReduceSearchPhaseException"

Hello All, Did any one encountered the same issue if yes then please let me know the solution. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050686.html Sent from the ElasticSearch Users mailing list archive at Na

Elasticsearch output format with "head" plugin

Hi All, I am using head plugin to access the elastic search through GUI and cluster plugin to cluster the data. So is there anyway I can display any particular field in GUI of elasticsearch. For ex: If my query is *{ "search_request": { "fields": [ "Content" ], "query": {

Re: Exact phrase match - city names example

Try using the term query as term query is not analyzed so it might search the exact term only. { "query" : { "term" : { "street" : "xxx" } } } -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Exact-phrase-match-city-names-example-tp4019310p4050604.html Sent from

Error in running cluster query

Hi All, I am executing a cluster query to fetch the documents and cluster it using Carrot2. If I am doing the query with the words "*mobiles, samsung, test*" it works fine but if I do the query with word "*mobile*" it is giving the following exception. *error: ReduceSearchPhaseException[Faile

ES Response Time

Hi All, Is there any way to measure end-to-end response time for a query in elastic search? That is the time taken from the time query is executed and the result is shown on the ES UI. And what does took parameter means in response ouput? -- View this message in context: http://elasticsearch-u

Re: Text Categorization in ES

So it means that all the classification has to be done prior, on the basis of user defined scenario. And automatically this feature is not supported either through carrot or Lingo3g. Like we have the feature of word-delimiter, hunspell filter etc. -- View this message in context: http://elasti

Re: Text Categorization in ES

Hi All, To be specific I want a query like : Searching for Laptop will automatically give result for "Dell, Sony, HP, Lenevo, Samsung..." as well. As lingo3g is used for clustering the documents so it will store the reference for above terms as well. For that I have installed Carrot2 and Lingo3g