Hiding common fields in ESresponse

2014-03-18 Thread prashy
Hi ES Users, Is there any way I can hide some of the common fields which are being returned as a response by ES. e.g if I get the response as below: *{ took: 74 timed_out: false _shards: { total: 15 successful: 15 failed: 0 } hits: { total: 24 max_score: 0.15932977 hits: [ { _index: prashant

Re: Hiding common fields in ES response

2014-03-18 Thread prashy
Is there any way around for this case? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Hiding-common-fields-in-ES-response-tp4052073p4052099.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you

Suppressing the content in Cluster response

2014-03-18 Thread prashy
Hi ES Users, I have indexed a large sample of data to ES. Now I am running the cluster query to categorize the data on the basis of Content. But I don't want the Content field to be returned as ES response i.e. I want only the Cluster labels and ID's so is there any way around this scenario? For

Re: Upload/index document to Elastic Search

2014-03-12 Thread prashy
Use Mapper attachments plugin to index the attachement type docs in ES. https://github.com/elasticsearch/elasticsearch-mapper-attachments https://github.com/elasticsearch/elasticsearch-mapper-attachments -- View this message in context:

Re: Installing elasticsearch on red hat linux - error command not found

2014-03-12 Thread prashy
If you have copied the files from windows to linux and then executing ES. Then try dos2unix elasticseacrh and then run ES -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Installing-elasticsearch-on-red-hat-linux-error-command-not-found-tp4051545p4051622.html

Cluster query to fetch particular label records in carrot2

2014-03-11 Thread prashy
Hi ES Users, Is there any specific query which can be used to fetch the records of one particular label. e.g.: Using _search_with_clusters I got response as *{id: 3 score: 0.9494177601684511 label: Nokia phrases: [ Nokia ] documents: [ XQqcFFOlRDm7-FfIVz-U1A rXJT_mKpQWKB9x9Zs2ipJw ] } { id: 4

Re: Cluster query to fetch particular label records in carrot2

2014-03-11 Thread prashy
As the cluster labels will be known after performing one search query. So if my search query is: { search_request: { Content ], query: { match: { _all: mobile } }, size: 1000, from:0 }, query_hint: mobile, field_mapping: { content: [

Re: Cluster query to fetch particular label records in carrot2

2014-03-11 Thread prashy
Hi Dawid, Any input for the above problem case? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Cluster-query-to-fetch-particular-label-records-in-carrot2-tp4051485p4051507.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You

Re: Cluster query to fetch particular label records in carrot2

2014-03-11 Thread prashy
Sorry If I have asked a question which is not relevant to forum. I explored the Project repository already and what I got for Web App is war file at http://project.carrot2.org/download.html http://project.carrot2.org/download.html But I was just thinking if there is any source code(html

Re: Cluster query to fetch particular label records in carrot2

2014-03-11 Thread prashy
Yes I checked this link as well till the web app. Which is having the code altogether as java code. What I thought is if we are doing any search just through json request in html pages so it is storing some info as cookies in client side and through HTML pages only the results are being retrieved

Re: Cluster query to fetch particular label records in carrot2

2014-03-11 Thread prashy
Yes that's what I was looking for throughout the source code and not able to pullout. What I was interested to know through the source code is How data is handled on web after firing the first query(which returns the set of cluster labels and on user event we can navigate through various labels)

Re: Cluster query to fetch particular label records in carrot2

2014-03-11 Thread prashy
It could be a silly question but just wanted to know that can we integrate the carrot2 web application with our Elasticsearch instance? -- View this message in context:

Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space

2014-03-10 Thread prashy
Hi gkwelding, I have checked explicitly on my box and the value for MAX_OPEN_FILES and MAX_MAP_COUNT has been set to 65535. -- View this message in context:

Re: Real time vs On demand cluster

2014-03-07 Thread prashy
Hi Dawid, If I understood correctly wrt ES, 1) Once we send the docs to ES it will index the data (Clustering i.e. assign cluster labels will not happen at this time). And only the documents will be stored to ES. 2) Once we send the search query it will fetch the records, and on top of that

Re: Real time vs On demand cluster

2014-03-07 Thread prashy
Hi Dawid, On-demand and real time happens on a subset of documents from the index and should return clusters within a reasonable amount of time (so that users can interact with the system). This means that there is no concept like real time and on demand in ES. Only after firing the search

Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space

2014-03-07 Thread prashy
Hi Clinton/gkwelding, Any suggestion to overcome this issue as I tried by increasing the heap size and still getting the same error. Below are the call logs for the issue: error: array index out of bounds [2014-03-05 21:03:25,212][WARN ][monitor.jvm ] [Node225] [gc][young][5079][15545] duration

Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space

2014-03-07 Thread prashy
MAX_OPEN_FILES and MAX_MAP_COUNT are not being set explicitly, so having default value only i.e. 65535. And still its crashing with same error :( -- View this message in context:

Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space

2014-03-06 Thread prashy
Hi Clinton/gkwelding, I tried sending the document one by one as well for indexing. So suppose my document is of 5 MB so it gets indexed and not giving any exception. But in other hand for some documents which is in KB or about 1 MB is giving the exception of out of memory. Though mapping are

Real time vs On demand cluster

2014-03-06 Thread prashy
What is the limit for clustering the document in case of real time cluster and on demand cluster? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151.html Sent from the ElasticSearch Users mailing list archive at Nabble.com.

Re: Real time vs On demand cluster

2014-03-06 Thread prashy
I just wanted to know that is there any difference between Real time vs On demand cluster wrt no of document to be indexed. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Real-time-vs-On-demand-cluster-tp4051151p4051246.html Sent from the ElasticSearch Users

Re: Real time vs On demand cluster

2014-03-06 Thread prashy
Hi Mark, I read some where that there are clustering like real time and on demand so was keen to know about that. I have one more concern that might be the silly one but still wanted to know about that *whether clustering happens at the time when we are indexing the data to ES or it happens

Re: Real time vs On demand cluster

2014-03-06 Thread prashy
The indexing happens as soon as you post a document to ES, not as you query it. ES will automatically replicate the document (depending on your setup) at the same time. This is fine for indexing. But what happens exactly wrt clustering. Clustering means I wanted to know like I submitted one docs

Re: Real time vs On demand cluster

2014-03-06 Thread prashy
There are two scenario. 1) I am submitting the documents to ES for indexing. 2) I am executing a search query using cluster plugin. Just to elaborate through example. *Step 1: *curl -xPOST 'http://192.168.0.179:9200/prashant' -d { mappings: { emp: { properties: {

Re: Error ReduceSearchPhaseException

2014-03-04 Thread prashy
One more observation in above scenario. 1) The records returned by the mobile is 287 so if I set the size (in query) as 287 it is working fine but in case of =287 it is throwing the exception. 2) The records returned by the samsung is 191 so if I set the size as 191 it is working fine also in

Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space

2014-03-04 Thread prashy
I tried increasing the heap value by 2GB as well by ES_MAX_MEM: 2g but it gave the same error. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-array-index-out-of-bounds-java-lang-OutOfMemoryError-Java-heap-space-tp4050914p4050916.html Sent from the

Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space

2014-03-04 Thread prashy
Just wanted to know that as I was using 1GB as Heap Size I was getting an error. So I increased it to 2GB (Heap , system has 4GB) so in that scenario also I got the error at same point. So if I increased the memory from 1 GB to 2 GB, at least it should process one more record in compare to

Re: Error array index out of bounds java.lang.OutOfMemoryError: Java heap space

2014-03-04 Thread prashy
Hi gkwelding, I am using the bulk API for indexing the data. And also refresh parameter is not set. So what could be the issue for that exception. Let me know if you require any other input for the same. -- View this message in context:

Re: Error ReduceSearchPhaseException

2014-03-03 Thread prashy
Hi All, Below is the logs for the same issue: [2014-03-03 22:40:24,956][DEBUG][action.search.type ] [Node164] failed to reduce search org.elasticsearch.action.search.ReduceSearchPhaseException: Failed to execute phase [fetch], [reduce] at

Re: Error ReduceSearchPhaseException

2014-03-03 Thread prashy
Ok Dawid, waiting for your reply... -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050805.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are

Re: Error ReduceSearchPhaseException

2014-03-03 Thread prashy
I have sent the particular scenario in which I am getting the error. Also I am using common words token only for search not any awkward tokens. So just let me know if the issue gets fixed or any temporary solution is there to solve the same. -- View this message in context:

Re: Error ReduceSearchPhaseException

2014-03-02 Thread prashy
Tony, I am not using any Regex in my query explicitly. Is there any place in config file or somewhere else where I can confirm for the same if its taking internally? -- View this message in context:

Re: Error ReduceSearchPhaseException

2014-02-28 Thread prashy
Hello All, Did any one encountered the same issue if yes then please let me know the solution. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050686.html Sent from the ElasticSearch Users mailing list archive at

Elasticsearch output format with head plugin

2014-02-27 Thread prashy
Hi All, I am using head plugin to access the elastic search through GUI and cluster plugin to cluster the data. So is there anyway I can display any particular field in GUI of elasticsearch. For ex: If my query is *{ search_request: { fields: [ Content ], query: { match:

Re: Text Categorization in ES

2014-02-26 Thread prashy
So it means that all the classification has to be done prior, on the basis of user defined scenario. And automatically this feature is not supported either through carrot or Lingo3g. Like we have the feature of word-delimiter, hunspell filter etc. -- View this message in context:

ES Response Time

2014-02-26 Thread prashy
Hi All, Is there any way to measure end-to-end response time for a query in elastic search? That is the time taken from the time query is executed and the result is shown on the ES UI. And what does took parameter means in response ouput? -- View this message in context:

Re: Text Categorization in ES

2014-02-25 Thread prashy
Hi All, To be specific I want a query like : Searching for Laptop will automatically give result for Dell, Sony, HP, Lenevo, Samsung... as well. As lingo3g is used for clustering the documents so it will store the reference for above terms as well. For that I have installed Carrot2 and Lingo3g