Re: Constant High (~99%) CPU on 1 of 5 Nodes in Cluster

Also is it always the master node that goes awry? On Aug 3, 2014 12:54 AM, "smonasco" wrote: > What jumps out at me is your that the CPU work you're doing seems to be > very index related, your garbage collections are trying hard on the errant > machine and not getting anywhere and you have a lot

Re: Constant High (~99%) CPU on 1 of 5 Nodes in Cluster

What jumps out at me is your that the CPU work you're doing seems to be very index related, your garbage collections are trying hard on the errant machine and not getting anywhere and you have a lot of deleted docs. Tell us about your indexing strategy? Tell us things like routing, how bursty

Re: elasticsearch jdbc-river do not import data from mysql

The latest comma? "type" : "test", Should be "type" : "test" -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 3 août 2014 à 03:14, mithril a écrit : There is a error seems be the key. >> [2014-08-03 09:10:57,791][DEBUG][action.index ] [Amina

Re: Is this process is strange?

You should really ask this on the logstash list. However its probably the logstash-web service. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 3 August 2014 01:56, vjbangis wrote: > logstash 1814 10.2 17.2 14271

Re: elasticsearch jdbc-river do not import data from mysql

There is a error seems be the key. > [2014-08-03 09:10:57,791][DEBUG][action.index ] [Amina Synge] >> [_river][0], node[95_1PcghS5aXgd3PQqqBFA], [P] >> , s[STARTED]: Failed to execute [index {[_river][my_jdbc_river][_meta], >> source[{ >> "type" : "jdbc", >> "jdbc" : { >>

Re: elasticsearch jdbc-river do not import data from mysql

Yeah, I'm using Sense.Thank you for pointing out that, but GET /test/test/_search?pretty&q=* result do not change. On Saturday, August 2, 2014 10:36:00 PM UTC+8, Jörg Prante wrote: > > You are using Sense? > > Use > > PUT /_river/my_jdbc_river/_meta > > not > > PUT /_river/my_jdbc_river/_meta -d

Re: curl dictionary key and value search

Use nested type http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/mapping-nested-type.html#mapping-nested-type Jörg On Sun, Aug 3, 2014 at 12:25 AM, ali koyuncu wrote: > My data structere has a key value pair like below: > > > {"content_type":0,"semantic":[{"Key":"all","Va

curl dictionary key and value search

My data structere has a key value pair like below: {"content_type":0,"semantic":[{"Key":"all","Value":0},{"Key":"tg","Value":1}],"user_local_id":1} {"content_type":0,"semantic":[{"Key":"all","Value":1},{"Key":"tg","Value":0}],"user_local_id":2} I want to get datas which has the semantic Key is "a

Re: Purpose / Significance of Port Ranges (9300-9400)

Found the relevant code and your description does appear to match up (NettyTransport): PortsRange portsRange = new PortsRange(port); final AtomicReference lastException = new AtomicReference<>(); boolean success = portsRange.iterate(new PortsRange.PortCallback() {

Re: Frustrated with REST API

Because I don't know your system setup, I have to do wild guessing. If it is not the network, can you observe frequent index recovery or shard reallocations? 503 (service unavailable) is a code that is sent when shards are not available. Have you set replica level by any chance or are indices rep

Re: Purpose / Significance of Port Ranges (9300-9400)

Thanks for the reply. Ok, I guess this comment in the config still confuses me: # Elasticsearch, by default, binds itself to the 0.0.0.0 address, and listens # on port [9200-9300] for HTTP traffic and on port [9300-9400] for node-to-node # communication. *(the range means that if the port is b

Re: Purpose / Significance of Port Ranges (9300-9400)

1. No, there is one port in use per node (beside HTTP on port 9200). You can define the ports in the configuration. 2. First, do not configure ports for public access. You should set up your ES cluster only in a private network. The question if only port 9300 is "open" or more ports does not deter

Re: High count of threadpools getting created

A posting of how you get it to work and what pitfalls you encountered would be awesome! Not sure how to get this into official Elasticsearch docs, but I'm confident the ES team would welcome anything, a pull request, or a pointer to a blog... Jörg On Sat, Aug 2, 2014 at 6:04 PM, John D. Ament

Purpose / Significance of Port Ranges (9300-9400)

I'm running elasticsearch in a somewhat locked down environment and the less ports I have open, the better. I guess my questions boil down to: 1) Why do you need multiple ports open in the 93xx range? 2) Will anything bad happen if I just have 9300 open? Will performance suffer, and if so, in

Re: Diagnosing a slow query

10 to 20% of the time queries take the better part of a second when only on one node and you indicate the queries are very similar in nature. For that second do a lot of queries show up all at once or are they spaced out? Do you see a spike in query requests? Do you see the CPU max out? Do you se

Issues with index routing allocation in 1.3.1

I noticed an issue after upgrading from 0.90.9 to 1.3.1 that the index.routing.allocation.include._ip setting per index is not being properly handled. I have used this setting in the past to move indices to an arching server for long term storage (outside of the cluster). In the past the past

Re: SocketTimeoutException while using JEST to connect to ES

My client was not able to communicate with ES server. It was a HTTP proxy issue. Try looking around this for your case. On Sat, Aug 2, 2014 at 4:48 PM, Renu wrote: > I'm facing the same issue. Using Jest 0.1.0 version. Is there any solution > for this problem? > > > On Wednesday, June 25, 2014

Re: High count of threadpools getting created

Jorg, Sorry, I may not have been clear. At this point, all of the classpath issues are resolved. I was wondering if you guys would be interested in a documentation patch where I can go over how I did this configuration, in case anyone else wants to try this with their JBoss/WildFly instances. A

Is this process is strange?

logstash 1814 10.2 17.2 1427156 175584 pts/0 SNl 15:26 0:18 /usr/bin/java -Djava.io.tmpdir=/var/lib/logstash -Xmx500m -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -Djava.awt.headless=true -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -jar /opt/logstash/vendor/jar/jru

Re: High count of threadpools getting created

Yes, because Elasticsearch is patching/overriding some dependencies by simply reimplementing some classes, the elasticsearch jar must precede at least Lucene and Joda jars in the classpath. All that I have left as a hint to avoid the sudden thread pool inits is to examine the code if there are un

Re: If I have ELK stack running on EC2. How can I make the ES as a cluster?

Thanks to that Aaron. BTW, should the "data" path be the same size and path with each other (node/s). let say Node* 1* path.data: /data/elasticsearch size = 100GB (EBS) Node *2* path.data: /data/elasticsearch size = 100GB (EBS) -- You received this message because you are subscribed to the G

Re: Frustrated with REST API

I have considered network before but I don't understand a few things: 1) Why would these API calls work consistently if the cluster was green versus yellow or red? 2) Before I make these calls I can check the health of the cluster and 100% of the nodes are "checked in". Therefore it is not like n

Re: High count of threadpools getting created

Jorg, I've looked at that before. While my app has a set of REST endpoints, we don't really deploy anything as servlets. Everything we do is either EJB or CDI endpoints, so trying to configure a servlet is a pain. I ended up just building a @Singleton @Startup to boot ES by reading in elasticse

Re: High count of threadpools getting created

You surely had a look at the official support for ES in a servlet? https://github.com/elasticsearch/elasticsearch-transport-wares/blob/master/src/main/java/org/elasticsearch/wares/NodeServlet.java Does this approach match your setup? I do not really prefer this approach, instead, I use a Transpo

Re: Frustrated with REST API

This looks a a network configuration challenge. You should review your whole network setup. Look at network device config, host names, gateway setup, DNS name resolution, routers/switches (if your ES clusters spans over subnetworks). If your network setup is not 100% solid, requests over the wire

Re: High count of threadpools getting created

Actually, it was more environmental than anything. This happened after I was doing some module reconfiguration in wildfly to deploy elasticsearch as a module, instead of embedded in the WAR. Turns out that you need to add sun.jdk as a dependency. I didn't notice as I had declared other dependenci

Re: ES reports 4 nodes but only 3 severs. One node is used twice

This is a client node for sure. Jörg On Sat, Aug 2, 2014 at 4:58 AM, David Montgomery wrote: > Hi, > > ES is showing 4 nodes but I only have 3. How do I resolve? One address is > used twice > 172.31.6.204 > > > { > "ok" : true, > "cluster_name" : "elasticsearch", > "nodes" : { > "

Frustrated with REST API

This is going to sound like a bit of a gripe session so I apologize in advance. There seems to be a lot of instability and ineffectiveness around using the REST API to make configuration changes. I realize there have been some issues related to the NPE returns on certain calls. In addition to t

Re: High count of threadpools getting created

Looks like a programming error. Without having a look at the code "ServerService" causing this, it is not possible to find explanations. Jörg On Fri, Aug 1, 2014 at 6:38 PM, John D. Ament wrote: > Hi all > > Based on another thread I started, I'm embedding ES into my application. > Starting

Re: elasticsearch jdbc-river do not import data from mysql

You are using Sense? Use PUT /_river/my_jdbc_river/_meta not PUT /_river/my_jdbc_river/_meta -d Jörg On Sat, Aug 2, 2014 at 10:43 AM, Ikaros andi wrote: > I do as doc(here ) > says, > > PUT /_river/my_jdbc_river/_meta -d > { > "type"

Re: raw field in top N query not working

Anyone? please? On Saturday, August 2, 2014 1:26:51 AM UTC+3, Eitan Vesely wrote: > > Hi all, > > i have a field named "msg" in my index that holds an error message string. > when trying to count the top N errors i set the field to msg.raw yet i > still see that the terms are all the words compri

Re: SocketTimeoutException while using JEST to connect to ES

I'm facing the same issue. Using Jest 0.1.0 version. Is there any solution for this problem? On Wednesday, June 25, 2014 1:53:29 PM UTC+5:30, anuj maheshwari wrote: > > Hi, > > I am evaluating Log Stash and Elastic Search for one of our requirement. I > have to query data from Elastic Search in

Re: Elasticsearch throwing exception while starting on Redhat

You should use the service wrapper on RHEL/CentOS https://github.com/elasticsearch/elasticsearch-servicewrapper It works like a charme. Jörg On Fri, Aug 1, 2014 at 5:13 PM, wrote: > Hi, > > I am trying to install elasticsearch on Redhat. I have downloaded > and installed latest elastic

Re: Constant High (~99%) CPU on 1 of 5 Nodes in Cluster

Sorry for hickhacking the post with more questions, but why is the memory going all the way up and then dropping for the other nodes, is that normal? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop recei

Re: ES reports 4 nodes but only 3 severs. One node is used twice

Paste config, u have 2 processes running in the same box -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view thi

elasticsearch jdbc-river do not import data from mysql

I do as doc(here ) says, PUT /_river/my_jdbc_river/_meta -d { "type" : "jdbc", "jdbc" : { "url" : "jdbc:mysql://localhost:3306/test", "user" : "root", "password" : "123123", "sql" : "select * from test