Re: elasticsearch dies every other day

nodes, you're likely to be at that limit. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 15 July 2014 22:32, Klavs Klavsen kl...@enableit.dk wrote: define at capacity ? I can easily give it more ram.. it has had

Re: Logstash sends email from NOWHERE

You should really ask this on the Logstash mailing list :) Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 16 July 2014 01:13, Sergey Zemlyanoy s.zemlya...@gmail.com wrote: Hi! We have one server where logstash

Re: How many tcp connections should ES/logstash generate ?

for the operation to complete. What are the specs for your node, how much heap does ES have? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 16 July 2014 00:43, Bastien Chong bastien...@gmail.com wrote: I have a basic setup

Re: can not open index

Check your ES logs, it should show something useful. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 16 July 2014 14:50, jin201...@gmail.com wrote: Hello. I have trouble to open index that I closed yesterday

Re: Elasticsearch 1.2 list of settings

Nice work Jörg, it might be worth setting this up as a repo so that changes can be submitted. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 14 July 2014 18:33, joergpra...@gmail.com joergpra...@gmail.com wrote

Re: excessive merging/small segment sizes

I/O issues can indicate underlying hardware issues. If you are running RAID then check your controller status including the battery and the array and individual disk status. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web

Re: Elasticsearch-Indexing data in two different DataCenters

How are you expecting to index the data to one cluster? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 15 July 2014 07:33, srikanth ramineni ri.srika...@gmail.com wrote: Hi , i want to index same data in two

Re: elasticsearch dies every other day

Looks like your cluster is at capacity. Try closing/deleting some old indexes, adding more nodes or more RAM. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 14 July 2014 23:22, smonasco smona...@gmail.com wrote

Re: Elasticsearch-Indexing data in two different DataCenters

You'll have to send another request, but someone might be able to give you some hints around optimising that in your code. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 15 July 2014 09:12, srikanth ramineni

Re: tiering storage / Curator

Nope, you can use allocation awareness to have indexes on different machines - http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/index-modules-allocation.html Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web

Re: Suggestion for a Test ELK Deployment ( Best Performance/ Load Balancing / Security / HA)

on your requirements and systems. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 13 July 2014 16:31, Stefano Ruggiero stefano.sec...@gmail.com wrote: Thanks alot for the answer, you confirm my worries about a cross

Re: best practice wanted for huge number of index time serial data

This is pretty standard for logstash type data. Use daily indexes, don't use TTL. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 14 July 2014 11:40, LiMac cnwangy...@gmail.com wrote: Hi folks, I am trying

Re: Garbage collection pauses causing cluster to get unresponsive

How much data does that all come out to be, GB and doc count? How many indexes and how many shards per index? 60k/s is pretty high volume! Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 14 July 2014 12:46, Srinath

Re: Suggestion for a Test ELK Deployment ( Best Performance/ Load Balancing / Security / HA)

of the community baed solutions to ACLs if that's what you want. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 12 July 2014 21:02, Stefano Ruggiero stefano.sec...@gmail.com wrote: Hi all, i would like to start

Re: Docker Elasticsearch using Unicast

ES will try to connect via unicast based on whatever you have in your config. What does the discovery.zen.ping.unicast line look like? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 12 July 2014 05:00, Tony P

Re: How to improve search performance in ES ?

that side? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 12 July 2014 05:01, coder mukulnit...@gmail.com wrote: Hi Jörg, I have seen these links. I'm using ngram tokenizer. Issue which I'm facing is slow response

Re: What types of SSDs?

You could setup a hot and cold based allocation system, put your highly accessed (hot) indexes on the SSDs and then the rest on the spinning disk. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 11 July 2014 23:35

Re: Facing problem with Elasticsearch and lumberjack setup

You will want to ask that on the logstash list, as it's related to that code base and not elasticsearch. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 10 July 2014 16:22, Gaurav Sharma gaurav.sha

Re: Elasticsearch for Sensitive Data (Bank Data)

That'd be hard to answer as it'd depend on what laws are involved. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 10 July 2014 20:40, George Viju vijuit...@gmail.com wrote: Hi, Can Elasticsearch can be used

Re: What types of SSDs?

gear with commodity SSDs (ie not enterprise branded ones) makes a lot of sense. Then it's a matter of treating hardware as a real throw away commodity and not worrying if you lose N units, which leveraged along with ES's scalability and redundancy would be very effective. Regards, Mark Walkom

Re: Am I pushing my cluster's resource limits? (OOME)

Which java release are you running, OpenJDK or Oracle? What's your query rate like? Check out monitoring plugins like ElasticHQ and marvel, they will give you insight around cluster state and statistics. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma

Re: Balance between number of indices and shards per index

drop smaller units (ie indexes) of data to suit your needs, and if you use elasticsearch-curator then your retention can be automatically managed. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 8 July 2014 17:16

Re: CLA sign required even for tiny typo fix?

I'd support this for what it's worth :) Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 8 July 2014 21:27, Lukáš Vlček lukas.vl...@gmail.com wrote: Hi, http://www.infoworld.com/d/open-source-software/red-hat

Re: Can a data node be set up to only be allocated replicas?

/replicas. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 9 July 2014 03:12, Ned Campion nedcamp...@gmail.com wrote: Never mind. Anyone please correct me if I'm wrong, but after some thought I think I've convinced

Re: Any issues using 2 shards for an index?

Writes *and* reads :) You may also end up with some nodes holding more, smaller shards than others, which will mean uneven load. If you have potential for many small indexes, check out routing as an alternative. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma

Re: Any issues using 2 shards for an index?

Yep that is all manageable, but you may cross a point where managing that becomes more hassle than it's worth. Something to keep in mind. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 9 July 2014 12:24, Drew

Re: Elasticsearch Not Working

You need to provide more details for people to be able to effectively help. How are you verifying this, what method are you using? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 8 July 2014 10:03, shriyansh jain

Re: Elasticsearch Not Working

What command? Please be explicit, provide what you are running and the output. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 8 July 2014 10:25, shriyansh jain shriyanshaj...@gmail.com wrote: I am just running

Re: Kibana Elasticsearch Shards and replication

Once you have a cluster, all data on any node is accessible. It does this by passing the query to the master node which then collects the data as required from the other nodes. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web

A brief blog on query performance optimisation

a cluster. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from

Re: Need some ideas: Getting visits from hits out of logstash index

Are you using kibana? You should be able to extract this pretty simply if you are, if not, check it out. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 6 July 2014 19:12, Stefan Hasenstab b00n...@gmail.com wrote

Re: Elasticsearch wont start on Ubuntu 14.04

Are you sure, unless I am misreading this, the OS is picking up v6; + for jdir in '$JDK_DIRS' + '[' -r /usr/lib/jvm/java-6-openjdk-amd64/bin/java -a -z '' ']' + JAVA_HOME=/usr/lib/jvm/java-6-openjdk-amd64 Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma

Re: Elasticsearch cluster re-start problem.

Can you elaborate, do you mean recover the indexes? What do your logs show? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 6 July 2014 00:01, Tarun Jangra ta...@izap.in wrote: Hi, I have: ES: 1.1.0 version s3

Re: Min Hard Drive Requirements

have for the index, or how many are you trying to optimise (merge) down to? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 2 July 2014 18:13, Ophir Michaeli ophirmicha...@gmail.com wrote: Hi all, I'm testing

Re: [ANN] ElasticUI AngularJS Directives - Easily Build an Interface on top of Elasticsearch

Very cool, I'll pass this onto some of our devs :) Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 2 July 2014 20:56, Yousef El-Dardiry yousefdard...@gmail.com wrote: Hi all, I just open sourced a set

Re: Min Hard Drive Requirements

Ok, how many were you reducing to? How big is the index? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 3 July 2014 02:03, Ophir Michaeli ophirmicha...@gmail.com wrote: When I tried to optimize the index had 51

Re: Recommended Hardware Specs Sharding\Index Strategy

The heap should be as big as your largest shard, irrespective of what index it belongs to or if it's a replica. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 3 July 2014 05:50, mrno42 doug...@gmail.com wrote

Re: Looking to build a logging solution with threshold alerting.

There was another thread on this very recently, and some people are using riemann for this. Take a look in the archives and you can probably find some useful info. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 2

Re: Visibility

Depends what you want to do really. There are plugins like ElasticHQ, Marvel, kopf and bigdesk that will give you some info. You can also hook collectd into the stack and take metrics, or use plugins from nagios etc. What monitoring platforms do you have in place now? Regards, Mark Walkom

Re: Elasticsearch Memory issue

for heap, leaving the other half for OS caching, which increases performance of ES. In your case under the best possible circumstances, you should only really be using 12GB of your total 24GB. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web

Re: Routing not working for ES

FYI this is a community mailing list, not a SLA based support channel. If you are patient someone will answer when they can spare some time. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 1 July 2014 17:30

Re: Server Reqirements for Elasticsearch+Webmaker

You need more system resources, 1GB is a tiny amount of RAM for ES to run on. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 1 July 2014 17:51, arshpreet singh arsh...@gmail.com wrote: I am using Elasticsearch

Re: Server Reqirements for Elasticsearch+Webmaker

want a minimum of 2GB heap for Elasticsearch (so 4GB total system), even to test on. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 1 July 2014 17:55, arshpreet singh arsh...@gmail.com wrote: On Tue, Jul 1, 2014

Re: Small Scale elasticsearch implementation.

This doesn't appear to be an ES specific issue, but I can see you've cross posted this to the LS list so I'll reply there :) Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 2 July 2014 00:40, Erica areck

Re: Memory issues on ES client node

Are you using anything to monitor your cluster, plugins like ElasticHQ or Marvel? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 2 July 2014 05:58, joergpra...@gmail.com joergpra...@gmail.com wrote: Do you have

Re: Memory issues on ES client node

The plugins I mentioned before give you insight into cluster state, specifically around GC. They would be worth installing if you want to troubleshoot this. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 2 July

Re: Elasticsearch wont start on Ubuntu 14.04

You're on Java 6 by the looks of it, ES won't run on anything less than 7. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 1 July 2014 22:57, Steven Yue jinche...@gmail.com wrote: Hi, Alex Below is the output

Re: ES seems slow and ineffecient

Can you elaborate on the timeouts? What Elasticsearch version, what java version? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 30 June 2014 18:40, Dan Storm l33tna...@gmail.com wrote: I have a cluster setup

Re: Elasticsearch automatically condensed my shards?

, are you 100% sure you don't have replicas set? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 30 June 2014 23:51, x0ne bran...@9bplus.com wrote: I should also mention, shard allocation shows 5 shards per index

Re: Elasticsearch Memory issue

. You could try disabling bloom filter cache as this will reduce your memory usage a little, take a look Elasticsearch Curator which can do this for you. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 1 July 2014 01:04

Re: recent spam

Good idea, I'll ask Leslie@ES. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 30 June 2014 06:14, Warner Onstine warn...@gmail.com wrote: Hi all, is there any way to set up the group to be first-post flagged so

Re: Newbie: Logstash clean install - 30% cpu ?

You should really ask that over on the Logstash list :) https://groups.google.com/forum/#!forum/logstash-users Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 29 June 2014 09:03, André van der Wiel aw

Re: Anyone have elasticsearch-1.2.0-noarch.rpm?

There's a critical bug with 1.2.0 which is why it was removed. See http://www.elasticsearch.org/blog/elasticsearch-1-2-1-released/ Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 26 June 2014 21:38, Антон Кикоть

Re: Unsure of growth of index when nothing happening (clean install)

Which index is growing? Chances are it is the marvel index(es), which is expected. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 27 June 2014 10:07, Grant Christensen grant.christen...@supercorp.com.au wrote

Re: Unsure of growth of index when nothing happening (clean install)

Sure is. There's more info in the docs http://www.elasticsearch.org/guide/en/marvel/current/ Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 27 June 2014 10:11, Grant Christensen grant.christen...@supercorp.com.au

Re: Multi-tenancy strategy: 1 index with 1 shard and 1 replica per client

, and hence indexes. You could also look at having a few indexes and use aliases and routing as this would be a much more efficient way of doing things. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 27 June 2014 11

Re: Multi-tenancy strategy: 1 index with 1 shard and 1 replica per client

with parent+child relationships chances are it will take a fair while to get a response to any query. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 27 June 2014 11:49, Drew Kutcharian d...@venarc.com wrote: Hi

Re: ES heap size slowly but surely increasing

Are you indexing new data? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 24 June 2014 20:01, Aldian aldian...@gmail.com wrote: Hi I upgraded to 1.2.1 and set memory options to 2GB. Two weeks have passed now

Re: ElasticSerach Cluster behind loadbalancer

This is something you would need to co-ordinate outside of ES, there is nothing native that could do it. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 24 June 2014 20:29, Tarun Jangra ta...@izap.in wrote: hi

Re: ElasticSerach Cluster behind loadbalancer

Yes they can both occur in parallel, performance may drop a little but it will still respond to queries and indexing. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 24 June 2014 20:39, Tarun Jangra ta...@izap.in

Re: ES heap size slowly but surely increasing

Yes, but there is still overhead that the cluster needs to store in memory, the metadata about the data. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 24 June 2014 23:38, Aldian aldian...@gmail.com wrote: Yes I

Re: Overloading by indexing?

TPS is usually transactions per second. Are you monitoring your cluster, and your memory/heap usage? How are you coming to the conclusion that it's a networking issue? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com

Re: Indexing stopped working

Check out ElasticHQ instead of head, it gives you more insight into cluster and node performance. How much is your heap? What ES and java versions are you on? It's probable you are running into the limits of your node, but a bit more info would clarify this. Regards, Mark Walkom Infrastructure

Re: [logstash-users] Re: Kibana dashboards - A community repository

I'm definitely open to expanding this. I am thinking it might even grow to include LS configs (eg custom grok patterns), as they are an important part of the visuals. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com

Re: Garbage collector logs long passes

Preferably 50% of system RAM, in your case 16G. You also really want to upgrade to 1.X, there are a lot of performance improvements. What version and release of java are you running? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web

Re: ES instability

How much data do you have in the cluster, index count and total size? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 23 June 2014 20:53, Klavs Klavsen kl...@enableit.dk wrote: https://lh3.googleusercontent.com

Re: ES instability

It's a good idea not to embed/attach images as this list does go to a lot of people. It'd be better to just link to them from an image hosting site :) Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 23 June 2014 20

Re: ES instability

, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 23 June 2014 21:06, Klavs Klavsen kl...@enableit.dk wrote: ES yml: index.warmer.enabled: false cluster.name: elasticsearch node.name: p-elasticlog02 node.master: true

Re: Storage type in Elasticsearch

You'll get the best performance from SSDs (obviously), but ES compresses data natively so you won't get much out of doing the same on the FS level. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 23 June 2014 22:45

Re: ES instability

and release, what are your node specs, how many indexes and how large are they? Make sure you're monitoring your cluster using plugins like ElasticHQ or Marvel to give you insight into what is happening. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com

Re: issues with file input from logstash to elastic - please read

You'll have better luck sending this to the Logstash mailing list :) Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 21 June 2014 08:02, Eitan Vesely eitan...@gmail.com wrote: Guys, its been more than a week i've

Re: Splunk vs. Elastic search performance?

I wasn't aware that the elasticsearch_http output wasn't recommended? When I spoke to a few of the ELK devs a few months ago, they indicated that there was minimal performance difference, at the greater benefit of not being locked to specific LS+ES versioning. Regards, Mark Walkom Infrastructure

Re: How to create 2 elasticsearch cluster instances on two machine

Have a search for unicast zen discovery in the docs and you will be good to go. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 19 June 2014 17:52, JONBON DASH jonbonwo...@gmail.com wrote: Hi Pulkit, Thanks

Re: Documents on Elastic search and Kibana

http://www.elasticsearch.org/resources/ has videos and documentation that will help. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 19 June 2014 17:44, srinu konda konda.srin...@gmail.com wrote: Hi, I

Re: Logstash limitting ElasticSearch heap

. If you can gist/pastebin a bit more info on your cluster, node specs, versions, total indexes and size etc it may help. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 18 June 2014 22:53, Antonio Augusto Santos mkha

Re: Splunk vs. Elastic search performance?

I'd be interested in knowing what problems you had with ELK, if you don't mind sharing. I understand the ease of splunk, but ELK isn't that difficult if you have some in-house linux skills. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web

Re: Problem setting up cluster with NAT address

No, that's outside the scope of ES to understand. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 18 June 2014 19:25, pmartins pedro.mart...@spms.min-saude.pt wrote: So, just to be clear: If we have a ES cluster

Re: Jenkins build data visualization

Certainly can, Openstack use something very similar - http://docs.openstack.org/infra/elastic-recheck/readme.html Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 18 June 2014 21:36, Robert Diebels robertdieb

Re: Kibana chart data view understanding

This is where things can get tricky as you will have to figure out what panel type to use, but I think you may want to start with a histogram. Play around from there. It is a bit tough when you start, but you will pick it up pretty easily! Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email

Re: Swap indexes?

Instance as in cluster, or node? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 17 June 2014 18:31, Lee Gee lee...@gmail.com wrote: Is it possible to have one ES instance create an index and then have a second

Re: Garbage collector logs long passes

Upgrade to a newer version of ES, also upgrade java, and if you can, increase your heap. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 17 June 2014 21:00, Kevin Qi p8kevi...@gmail.com wrote: *Hi,* *We

Re: ElasticSearch - search statistic - like google analytics

ES doesn't store this natively, you'd have to put something in-between the user and ES to capture and collate this information. Your LS idea seems like a good one to solve it. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web

Re: Problem setting up cluster with NAT address

You can only define one address for ES to use. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 18 June 2014 00:12, pmartins pedro.mart...@spms.min-saude.pt wrote: Hi, Thanks for the reply. The firewall

Re: ElasticSearch not starting after switching network.

It could be a change of network interface which has caused problems with the firewall? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 16 June 2014 19:06, Ashok Chidige achid...@gmail.com wrote: yes, but I've

Re: Help needed: CentOS ES-Logstash-Kibana running, but 0 docs, 0 indices

You might want to take this over to the Logstash mailing list instead as that appears to be the problem. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 16 June 2014 17:39, 'Robert AMS' via elasticsearch

Re: Tribe node data compliance across regions

It's best explained in the docs http://www.elasticsearch.org/guide/en/elasticsearch/reference/1.x/modules-tribe.html Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 17 June 2014 05:24, Kyle House kylewho

Re: Update single field of a document

The thread you are quoting here is nearly 4 years old, it might be better if you start a new thread as it's possible the info contained in this will be out of date. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 15

Re: Training Information needed

Keep an eye on http://purchases.elasticsearch.com/ for something close to you. You can also sign up to the weekly newsletter and keep track of the blog. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 16 June 2014

Re: Share a document across multiple indices

This isn't something that can be done natively in ES. You could however have index A, B and C that you can apply a replication factor to, then use aliases to group them into logical units. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web

Re: Deleteing index times out

How big is the index? Have you had a look at your ES logs to see if there is anything? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 15 June 2014 02:33, Kiran Koduru crazycreatur...@gmail.com wrote: I am trying

Re: Help needed: CentOS ES-Logstash-Kibana running, but 0 docs, 0 indices

Try swapping the host in your LS output to the actual IP of VM. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 14 June 2014 18:34, 'Robert AMS' via elasticsearch elasticsearch@googlegroups.com wrote: Als POC

Re: ingest performance degrades sharply along with the documents having more fileds

It's not surprising that the time increases when you have an order of magnitude more fields. Are you using the bulk API? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 13 June 2014 15:57, Maco Ma mayaohu

Re: How ElasticSearch nodes syncrhonise in Cluster when nodes have different Index mappings

That depends on how you do the migration, it's not something ES handles automatically, you need to do it yourself. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 13 June 2014 19:47, Bhupali Kalmegh bhupali

Re: Query multiple strings in a field in kibana3?

You can save dashboards with the query, if that is what you want. You will need to save one per query though. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 13 June 2014 18:15, Siddharth Trikha siddharthtrik

Re: Linear Scaling with ES

The answer is - it depends. If you can provide a bit more detail on what you've done, your setup etc, maybe someone can provide more assistance. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 14 June 2014 07:48

Re: Showing stats from delete operation

You will need to raise a github request for this. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 14 June 2014 08:41, jb...@locu.com wrote: Would it be possible to add some stats to the response from

Re: Changing Kibana-int based on context

I don't think you can do this dynamically within kibana. The better way would be to run multiple instances of KB and then use a proxy to handle the redirects. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 14 June

elasticsearch curator — version 1.1.0 released

to be a whole heap of cool stuff added, snapshots, aliases, allocation routing and more! Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com -- You received this message because you are subscribed to the Google Groups elasticsearch

Re: elasticsearch curator — version 1.1.0 released

It has a prefix setting, but not a suffix. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 14 June 2014 13:35, Ivan Brusic i...@brusic.com wrote: The addition of the snapshot feature is interesting, but I just

Re: Elasticsearch 1.2 Delete and Reinstall

Is it a single node cluster? Howe are you installing things; deb, rpm, zip? How are you uninstalling it? Exact commands for the above will be helpful :) Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 12 June 2014

<    5   6   7   8   9   10   11   12   13   >