Re: Copy _id to another retrievable field with Query String

Hello , There is a ids query , that might be helpful here. LINK - http://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-ids-query.html Also a direct query on _id is working for me - { "query": { "query_string": { "query": "_id:1116275896960111667sdsd7328349520"

Re: nodes disconnect without apparent reason

I am not running across regions, but I am running on 2 availability zones in the same region. I have 2 data nodes in each region, and each shard is replicated exactly twice, once in each region. On Monday, April 6, 2015 at 3:19:25 AM UTC+3, Mark Walkom wrote: > > Are you running across regions?

Re: river jdbc plugin install for windows-not working

Hi any solution for the above issue. As i was researching more the issue also could happen because you have two java versions but when i run the java version in cmd o get only one On Monday, April 6, 2015 at 9:06:59 AM UTC+5:30, Sanu Vimal wrote: > > Hi > Everything worked on a linux machine. N

Re: Elastic Search river date pattern

Hi Jorg, yes mysql and es servers are running in different timezones. mysql running in PST timezone where as es servers running on CDT timezone. Thanks phani On Friday, April 3, 2015 at 8:14:00 PM UTC+5:30, Jörg Prante wrote: > > Do you run MySQL and ES in different timezones? >

Re: Elastichsearch CDH Hadoop Integration

> > Hi Costin, > Does it supports exact value search? rather than % like % search? > e,g I have two json records, I only want to exact search eventtype is ‘Detection/Aband22oned’ records, but the eventtype is ‘Detection/Aband22oned d’ records also return to me. What should be the c

Re: Minimum disk space needed to account for segment merges

Disk watermarks are of no use when all nodes on cluster are running low on disk and it is the existing shards which receive continuous writes. It would be great if ES can error such writes on low disk space rather than letting the index go red. Regarding need for 40GB free space for 2 x 10GB se

Re: Elastichsearch CDH Hadoop Integration

Hi Costin, Does it supports exact value search? rather than % like % search? On Wednesday, April 1, 2015 at 6:08:45 PM UTC+8, Ravi sai kumar wrote: > > Thank you so much Costin. I will configure it in locally. > > On Wednesday, April 1, 2015 at 6:00:02 PM UTC+8, Costin Leau wrote: >> >> Elastics

Elasticsearch v-1.5 showing high CPU & memory utilization

Hi, We've recently started using elasticsearch(V-1.5) on one of our app & started facing following issues.. - Generating Logs ( Exceptionally very high viz.. 5 min 5GB log ) - High CPU Utilization - In-spite of deleting logs, disk space was not released. Needed Hard boot the server to release

Re: river jdbc plugin install for windows-not working

Hi Vineeth, Since i am in windows i dint do it through cygwin for executing shell commands. But I downloades river 1.5 where there are two jar files and put it into the plugins/jdbc folder in elastic search. The folders were created by me since they were not present. Then I downloaded mysql-co

Re: river jdbc plugin install for windows-not working

Hi Sanu , Didi you perform 3rd and fourth steps told here - https://github.com/jprante/elasticsearch-river-jdbc Thanks Vineeth On Mon, Apr 6, 2015 at 9:33 AM, Sanu Vimal wrote: > I have put all the files of mysql jdbc connector to the plugin/jdbc folder > where my river jars are st

Re: Exception with posting jdbc river config

Hi Jorg, Though converting to binary it still dosent parse do you have any documentation for jdbc river in windows.The linux one was very helpful but not much support for windows.\ Regards, Sanu -- You received this message because you are subscribed to the Google Groups "elasticsearch" gr

Elasticsearch 1.4.2 JVM memory leak ?

Hi, We have about 30 node elasticsearch cluster. We often run in to out of memory issue and when I look in the JVM memory which is usually around 75-80% which is 24-25 gigs of 30 gigs heap. The filter cache and field cache add to up 5GB on a node, I'm trying to understand whats the other 15-20

Re: river jdbc plugin install for windows-not working

I have put all the files of mysql jdbc connector to the plugin/jdbc folder where my river jars are still i get the below error curl -XPUT "http://localhos[2015-04-06 09:29:44,105][ERROR][river.jdbc.SimpleRiverSource] while opening rea d connection: jdbc:mysql://localhost:3306/test No suitable dr

Re: river jdbc plugin install for windows-not working

Hi , You need to copy the java jars of mysql jdbc libraries to the plugins folder. It wont otherwise work. Thanks Vineeth Mohan, Elasticsearch consultant, qbox.io ( Elasticsearch service provider ) On Mon, Apr 6, 2015 at 9:06 AM, Sanu Vimal wro

river jdbc plugin install for windows-not working

Hi Everything worked on a linux machine. Now i need to use the river jdbc plugin in the windows but there is not much documentation or support. I tried everything created the plugin folder with river jdbc in the jdbc folder added all type of mysql connectors in the folder i also added the jar

Re: Is it possible to filter on multiple fields?

Hello Ali , You need to use bool query for that. Filtered query is not the best match for that. You can see some code samples here

Re: Connect Mysql to elastic search

Hi Everything worked on a linux machine. Now i need to use the river jdbc plugin in the windows but there is not much documentation or support. I tried everything created the plugin folder with river jdbc in the jdbc folder added all type of mysql connectors in the folder i also added the jar

Re: Delete old content from index

Hi , I understand that you are looking to index incremental data. In that case the following approach is the best i can think of - 1. Make a unique key per document. This key can be the URL or shah hash sum of some other field that makes sense to be a unique key. 2. Use the unique key a

Kibana 4 - Visualization Question

Hi, I have a data set which includes the the medal types won by each country along with the year they won the medal. Below is the sample data.. "_source": { - "message": [ - "4183,1924-06-01,Summer,"NURMI, Paavo",Men,FIN,Finland,Athletics,3000m team,Gold " ], - "@vers

Re: Minimum disk space needed to account for segment merges

There are watermark's on disk use - http://www.elastic.co/guide/en/elasticsearch/reference/current/index-modules-allocation.html#disk I don't follow why merging two 10GB segments needs 40GB though. On 6 April 2015 at 10:27, Ankit Malpani wrote: > Dont we need to consider space for compound file

Re: Cluster Healt Status "red", I can´t add data on some of my index

Thanks for your reply, I already thought I had lost the data of another server, it really was not wise to delete the ElasticSearch when I discovered the problem. So please tell me how is the procedure to re-index the data? -- You received this message because you are subscribed to the Google G

Re: Minimum disk space needed to account for segment merges

Dont we need to consider space for compound file formats? Worst case scenario of CFS enabled, forceMerge to 1 segment would need 40GB free space for 2 x 10GB segments? Also index.merge.policy.max_merge_size defaults to unbounded, is there some recommended numbers around this? There are no disk

Re: Building a Elasticsearch REST service

Elasticsearch is a RESTful service, what exactly are you wanting to do? Also there are a number of official clients that already handle lots of things, I'd suggest you look at those. On 3 April 2015 at 20:45, Roshan d wrote: > I have 2 applications, one from which I am putting data into elastic

Re: nodes disconnect without apparent reason

Are you running across regions? On 5 April 2015 at 23:27, Noni Peri wrote: > Hi, > > I have a 12 node cluster (3 master, 4 data, 5 client) running on AWS. > I am using the cloud-aws plugin. > > Currently I am running 1.5.0, but this has been happening on 1.4.3 as well > (not at all before 1.4.3)

Re: Add non existing settings in cluster settings in elasticsearch

What version are you on, what OS, what java version and release, how much data do you have in the cluster, how are you monitoring the cluster? On 29 March 2015 at 02:09, Ayman wrote: > Hi there, > > Recently i have built elasticsearch with fluentd and Kibana and all is > working fine, but we are

Re: Cluster Healt Status "red", I can´t add data on some of my index

If you have already deleted data from the other host then you are out of luck and you can only recover the data that you have on the existing server. You'll have to re-index unfortunately. On 6 April 2015 at 09:13, Tiago Rodrigues wrote: > I have two servers on the same network with ElasticSearc

Cluster Healt Status "red", I can´t add data on some of my index

I have two servers on the same network with ElasticSearch (one for testing and one for production), apparently they communicate with each other, and this information was not clear to me until I have this problem. After some time using the ElasticSearch to store data, some queries Index were not

Re: chunk-wise incremental data feed into ES jdbc feeder/river

JDBC plugin supports MySQL streaming mode out of the box: https://github.com/jprante/elasticsearch-river-jdbc/issues/520#issuecomment-89789655 If it does not work, I'm available for help to find alternatives. I would love to know more about the observed DB timeout. The MySQL timeouts can be chan

Re: unable to get script_fields to work

Will try that when I get a chance.thx On 4:52am, Apr 5, 2015, at 4:52am, Wouter van Atteveldt wrote: >I had the same problem, but I think that the docs are plain wrong, and >it >should be script instead of script_file. In any case, if I do that it >works >fine. > >I've posted an issue under

Re: Add non existing settings in cluster settings in elasticsearch

I dropped the HEAP size to 31g as per your recommendation but i still have issues. Sorry i'm newbie to elasticsearch can you please guide me to add new node without losing the current indexed data? I have attached screenshot from my cluster. I'm having high load when trying to execute a bulk o

nodes disconnect without apparent reason

Hi, I have a 12 node cluster (3 master, 4 data, 5 client) running on AWS. I am using the cloud-aws plugin. Currently I am running 1.5.0, but this has been happening on 1.4.3 as well (not at all before 1.4.3) Every once in a while, a node (data node most of the time) appears to get disconnected

Delete old content from index

Hi, At different random times throughout the day I am going to do a "crawl" of data which I am going to feed into elasticsearch. This bit is working just fine. However the index should reflect only what was found in my most recent crawl and I currently have nothing to remove the content in the

Re: Getting XML into ES efficiently

Ok. I think that's a fair comment and is likely the root I will take. Thank you both for your help. > On 4 Apr 2015, at 20:33, Norberto Meijome wrote: > > Hi, > My gut feel is don't add this to the ES setup itself. Horses for courses - > have your script (Python +1) running somewhere taking c

Re: unable to get script_fields to work

I had the same problem, but I think that the docs are plain wrong, and it should be script instead of script_file. In any case, if I do that it works fine. I've posted an issue under https://github.com/elastic/elasticsearch/issues/10438 Test program and session: https://gist.github.com/vanatt

Is it possible to filter on multiple fields?

Hi there, I'm able to filter on one field at a time, using: client.prepareSearch(index) .setTypes(type) .setQuery( new FilteredQueryBuilder(null, FilterBuilders .termFilter(field, value)));