Re: With 1.5.0, facet date_histograms min/max now return Infinity or -Infinity instead of numeric values?

> and java.lang.Double.NEGATIVE_INFINITY. That is, ES never updates min/max > while processing values, because there are no values. > > I would recommend to switch to the aggregation framework, since the old > facet classes will be dropped from Elasticsearch 2.0 > > Jörg > > > On Mon, Apr 6,

Re: With 1.5.0, facet date_histograms min/max now return Infinity or -Infinity instead of numeric values?

Much appreciated. Chris On Mon, Apr 6, 2015 at 9:34 AM, Chris Neal wrote: > Hi All, > > This seems like something that should be communicated somewhere if a type > has changed return values. Prior to 1.5.0, facet return values were always > numeric, now I'm getting "I

With 1.5.0, facet date_histograms min/max now return Infinity or -Infinity instead of numeric values?

Hi All, This seems like something that should be communicated somewhere if a type has changed return values. Prior to 1.5.0, facet return values were always numeric, now I'm getting "Infinity" and "-Infinity". See example below: This query: { "facets":{ "0":{ "date_histogram":{

Re: Please help to understand these Exceptions

Fair enough. :) Thanks for all the replies! Chris On Thu, Mar 12, 2015 at 11:08 PM, Mark Walkom wrote: > The limit of a node is hard to definitively know as use cases vary so > much, but from what I have seen 3TB on 3 nodes is pretty dense. > > On 12 March 2015 at 08:09, Chris

Re: Please help to understand these Exceptions

pressure. I'd add another > one or two and see how things look after that. > > On 11 March 2015 at 07:21, Chris Neal wrote: > >> Again Mark, thank you for your time :) >> >> 157 Indicies >> 928 Shards >> Daily indexing that adds 7 indexes per day >>

Re: Please help to understand these Exceptions

: > It looks like heap pressure. > How many indices, how many shards, how much data do you have in the > cluster? > > On 8 March 2015 at 19:24, Chris Neal wrote: > >> Thank you Mark for your reply. >> >> I do have Marvel running, on a separate cluster even, so I d

Please help to understand these Exceptions

Hi all, I'm hoping someone can help me piece together the below log entries/stack traces/Exceptions. I have a 3 node cluster in Development in EC2, and two of them had issues. I'm running ES 1.4.4, 32GB RAM, 16GB heaps, dedicated servers to ES. My idex rate averages about 10k/sec. There were n

Search multiple indices in Kibana 4?

Hi all, Trying out Kibana 4's new release today, and was wondering is this is still possible. In Kibana 3, you could simply comma-delimit all the index patterns you wanted to expose to your searches, but that doesn't seem possible in Kibana 4. I have indexes named like: company-customer-MMD

Re: Terms facet changing "date" to "long"

gt; Lucene.NET committer and PMC member > > On Thu, Feb 5, 2015 at 7:29 PM, Chris Neal > wrote: > >> Please excuse the bump of my own question. :) After almost 8 months, I >> still have this question! Just wanted to get it in front of people's eyes >> again. &

Re: Terms facet changing "date" to "long"

much appreciated! Chris On Mon, Jun 30, 2014 at 3:21 PM, Chris Neal wrote: > Hello all, > > The issue is I have a terms panel in Kibana that I want to group events by > a "date" field from each record (Not the @timestamp field). The terms > panel is taking my nicely formatted

Re: Shard size / Index number / server count and performance

ever when querying, 100 indices with 1 shard is the same as 1 index > with 100 shards. > > On 28 January 2015 at 10:11, Chris Neal wrote: > >> Hi all, >> >> I've seen lots of posts about this, and want to make sure I'm >> understanding correctly. >> >

Shard size / Index number / server count and performance

Hi all, I've seen lots of posts about this, and want to make sure I'm understanding correctly. Background: - Our cluster has 6 servers. They are Dell R720xd with 64GB RAM, 2xE5-2600v2 CPU (2 sockets, 6 cores/socket), 16TB disk - Elasticsearch is set to have 6 shards, and 1 replica, giv

Re: Mysterious index settings overwriting cluster settings

n Wed, Jan 14, 2015 at 11:07 AM, Chris Neal wrote: > Hi Masaru, > > Beautiful! That's exactly it. Thank you very much. :) > > Chris > > On Wed, Jan 14, 2015 at 10:42 AM, Masaru Hasegawa > wrote: > >> Hi Chris, >> >> I think you hit this issue &

Re: Mysterious index settings overwriting cluster settings

mplate (as described in the issue) or > to update them by indices settings API. > > > Masaru > > > On Wed, Jan 14, 2015 at 9:52 AM, Chris Neal > wrote: > >> Hi all. >> >> I'm reposting an earlier thread of mine with a more appropriate subject >&

Mysterious index settings overwriting cluster settings

Hi all. I'm reposting an earlier thread of mine with a more appropriate subject in hopes that someone might have an idea on this one. :) Each node in my cluster has its configuration set via elasticsearch.yml only. I do not apply any index level settings, however the nodes in the cluster are ove

Re: What is ES / Marvel doing to my configurations?

at 1:21 PM, Chris Neal wrote: > I hate to bump my own thread, but I still have not been able to figure > this one out. Just wanted to put it in front of people's eyes again in > hopes that someone might have an idea where these index settings are coming > from. > > Than

Re: What is ES / Marvel doing to my configurations?

I hate to bump my own thread, but I still have not been able to figure this one out. Just wanted to put it in front of people's eyes again in hopes that someone might have an idea where these index settings are coming from. Thanks everyone. On Thu, Jan 8, 2015 at 3:51 AM, Chris Neal

Re: What is ES / Marvel doing to my configurations?

ch more help there I am afraid, someone else should have a > better idea. > > On 7 January 2015 at 13:59, Chris Neal wrote: > >> I also found this very old post: >> >> >> http://elasticsearch-users.115913.n3.nabble.com/How-to-set-max-merged-segment-at-startup-td3282574

Re: What is ES / Marvel doing to my configurations?

ation file is not applying, when I don't have any index specific settings! Again, thanks for reading :) Chris On Tue, Jan 6, 2015 at 8:47 PM, Chris Neal wrote: > Thanks Mark. > > To my knowledge, I've never applied any index level settings. Any idea > where they might be com

Re: What is ES / Marvel doing to my configurations?

;uuid":"yuHSFauVTL-SwKVAwaRdCg","number_of_replicas":"1","number_of_shards":"3","version":{"created":"1040199"} root@ip-10-0-0-45:bddevw07[1006]:~/elasticsearch> I'm still stumped! Thanks so much for

What is ES / Marvel doing to my configurations?

Hi all. My elasticsearch.yml file has these settings with regards to merging: index: codec: bloom: load: false merge: policy: max_merge_at_once: 4 max_merge_at_once_explicit: 4 max_merged_segment: 1gb segments_per_tier: 4 type: tiered scheduler:

How to force unallocated shards to get allocated?

Hi :) I have a 3 node cluster that hit a disk watermark. I fixed the disk space issue, but now I have about 30 shards (both primaries and replicas) that are unassigned, and just sitting there. How can I get ES to "wake up" and allocate them? Thank you! Chris -- You received this message becau

Re: Disk Watermark issues with 1.4.0

art on its own. It seems like I waited several minutes before I did it manually, but I'll pay more attention the next time. Thanks again for the input. Chris On Mon, Dec 1, 2014 at 10:35 AM, Nikolas Everett wrote: > > > On Mon, Dec 1, 2014 at 11:28 AM, Chris Neal > wrote: >

Disk Watermark issues with 1.4.0

Hi all, I'm running 1.4.0. and using the default settings for: cluster.routing.allocation.disk.watermark.low and cluster.routing.allocation.disk.watermark.high I hit an OOME which caused me to need to cycle a node, and then all shards that should live on that node stayed unallocated once I broug

Re: Kibana and regular expressions help please

Ok, I had a thought. Does a field need to be analyzed in order to work with regular expressions perhaps? There is a mapping for this field that defines it as a type of string, and an index of not_analyzed. Just wondering. On Mon, Nov 17, 2014 at 8:50 PM, Chris Neal wrote: > Hello every

Kibana and regular expressions help please

Hello everyone, I need some help getting regular expressions to work in Kibana please. I've tried several things that I thought would work, and none did. I must be missing something basic. :) I have events in ES that contain a field called "event_detail". Here are two examples: Success|I:0,C:t

Re: Yet another OOME: Java heap space thread :S

A followup as promised. 5 days of up-time, no OOME yet. So far so good! One more update after a few more days Again, thank you Jorg! :) On Wed, Sep 17, 2014 at 11:54 AM, Chris Neal wrote: > Thank you so very much for the reply! > > That makes sense. I will look at the gist as

Re: Yet another OOME: Java heap space thread :S

what happens behind the > scene, it is just a rough estimate) > > With 15g in your setting, the risk is high to overallocate the heap when > your index gets large. > > Jörg > > > On Wed, Sep 17, 2014 at 5:43 PM, Chris Neal > wrote: > >> Sorry to bump my own

Re: Yet another OOME: Java heap space thread :S

o much for your time. Chris On Thu, Jul 31, 2014 at 10:06 AM, Chris Neal wrote: > Ooops. Sorry. That was a copy/paste error. It is using 16GB. Here is > the correct process arguments: > > /usr/bin/java -Xms16g -Xmx16g -Xss256k -Djava.awt.headless=true -server > -XX:+

Re: What the heck is this search?? :)

gs > simple. > > Is this a problem for you in any way? > > Cheers, > Boaz > > On Thursday, August 21, 2014 6:37:02 PM UTC+2, Chris Neal wrote: >> >> Done. Will report back. >> >> Thank you! >> >> >> >> On Thu, Aug 21, 2014 at 11:27

Re: gateway.recover_after_nodes & minimum_master_nodes in a distributed environment?

> email: ma...@campaignmonitor.com > web: www.campaignmonitor.com > > > On 26 August 2014 23:37, Chris Neal wrote: > >> Hello all, >> >> Question >> about gateway.recover_after_nodes and discovery.zen.minimum_master_nodes in >> a distributed ES clus

gateway.recover_after_nodes & minimum_master_nodes in a distributed environment?

Hello all, Question about gateway.recover_after_nodes and discovery.zen.minimum_master_nodes in a distributed ES cluster. By "distributed" I mean I have: 2 nodes that are data only: 'node.data' => 'true', 'node.master' => 'false', 'http.enabled' => 'false', 1 node that is a master/s

Re: One large index vs. many smaller indexes

uld introduce a new node in your cluster to > improve your cluster capacity. > > > On Mon, Aug 25, 2014 at 12:07 AM, Chris Neal > wrote: > >> Adrien, >> >> Thanks so much for the response. It was very helpful. I will check out >> those links on capacity planni

Re: One large index vs. many smaller indexes

ticsearch/guide/current/capacity-planning.html > > > > On Fri, Aug 22, 2014 at 9:08 PM, Chris Neal > wrote: > >> Hi all, >> >> As the subject says, I'm wondering about index size vs. number of indexes. >> >> I'm indexing many application log file

One large index vs. many smaller indexes

Hi all, As the subject says, I'm wondering about index size vs. number of indexes. I'm indexing many application log files, currently with an index by day for all logs, which will make a very large index. For just a few applications in Development, the index is 55GB a day (across 2 servers). In

Re: What the heck is this search?? :)

Freelance Developer & Consultant > Author of RavenDB in Action <http://manning.com/synhershko/> > > > On Thu, Aug 21, 2014 at 7:22 PM, Chris Neal > wrote: > >> Thanks guys for the thoughts. Plugins didn't even occur to me, but they >> should have. >

Re: What the heck is this search?? :)

; sized installation. >>> >>> -- >>> >>> Itamar Syn-Hershko >>> http://code972.com | @synhershko <https://twitter.com/synhershko> >>> Freelance Developer & Consultant >>> Author of RavenDB in Action <http:/

What the heck is this search?? :)

Hi guys, I'm working through some performance concerns in my cluster, and I turned on the slow log feature. I'm seeing this in the index_search_slowlog.log log: [2014-08-20 06:37:52,734][INFO ][index.search.slowlog.query] [elasticsearch-ip-10-0-0-41] [index-20140731][0] took[6s], took_millis[608

Re: ES 1.3.0 and 1.2.3 released

Bump for Bigdesk 3 :) On Thu, Jul 24, 2014 at 12:40 AM, Lukáš Vlček wrote: > Hi, > > Bigdesk (2.x) uses JSONP. Elasticsearch is dropping JSONP support starting > with 1.3 release. Still you can enable it in Elasticsearch but I do not > recommend it if Bigdesk would be the only reason. From my p

Re: ip type and support for a port?

.com/dadoonet> | @elasticsearchfr >> <https://twitter.com/elasticsearchfr> >> >> >> Le 31 juillet 2014 à 18:39:33, joergpra...@gmail.com ( >> joergpra...@gmail.com) a écrit: >> >> Maybe it would help to implement a new ES data type for URI/URL? >> >

Re: ip type and support for a port?

IP. It's a port. > > -- > *David Pilato* | *Technical Advocate* | *Elasticsearch.com* > @dadoonet <https://twitter.com/dadoonet> | @elasticsearchfr > <https://twitter.com/elasticsearchfr> > > > Le 31 juillet 2014 à 16:56:29, Chris Neal (chris.n...@derbysof

Re: Yet another OOME: Java heap space thread :S

> > > -- > David ;-) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > > Le 30 juil. 2014 à 19:47, Chris Neal a écrit : > > Hi everyone, > > First off, apologies for the thread. I know OOME discussions are somewhat > overdone in the group, but I need

Re: ip type and support for a port?

e what you mean by IP ports? > > Transport protocols like TCP has ports, but IP (Internet addresses) is > used to address hosts on a network. > > Jörg > > > > On Wed, Jul 30, 2014 at 11:02 PM, Chris Neal > wrote: > >> Hi all, >> >> I'm trying t

Yet another OOME: Java heap space thread :S

Hi everyone, First off, apologies for the thread. I know OOME discussions are somewhat overdone in the group, but I need to reach out for some help for this one. I have a 2 node development cluster in EC2 on c3.4xlarge AMIs. That means 16 vCPUs, 30GB RAM, 1Gb network, and I have 2 500GB EBS vol

ip type and support for a port?

Hi all, I'm trying to use the ip type in ES, but my IPs also have ports. That doesn't seem to be supported, which was a bit of a surprise! Does anyone know of a way to do this? Or does it sound like a good feature to add support for to this type? Thanks! Chris -- You received this message be

Re: Managing ES servers with differing data disk sizes

Thanks very much guys for your input. I'm in the process of upgrading from 1.2.2 to 1.3.1 now, so I'll read up on the Index Shard Allocation link! Chris On Tue, Jul 29, 2014 at 11:16 AM, Nikolas Everett wrote: > > > > On Tue, Jul 29, 2014 at 12:12 PM, Chris Neal > w

Managing ES servers with differing data disk sizes

Hello ES users, I have a question about how to manage an ES cluster where the servers have different sized data disks. I have 4 servers with 1 x 1TB disks for ES data, and I am planning on adding an additional 2 servers that will have 4 x 4TB disks for ES data. Is ES "aware" of the capacity of i

Kibana and histograms not based on dates?

Hi all, I was trying to build a histogram that shows each day's change based on a numeric X axis rather than a date. >From what I can see, the histogram in Kibana is based only on date, so X axis can only be date or time. There are two facets of histogram in ES http://www.elasticsearch.org/guid

Re: Am I pushing my cluster's resource limits? (OOME)

er > Campaign Monitor > email: ma...@campaignmonitor.com > web: www.campaignmonitor.com > > > On 11 July 2014 03:12, Chris Neal wrote: > >> Hi everyone, >> >> I have a 2 node development cluster in EC2 on c3.2xlarge AMIs. That >> means 8 vCPUs, 15GB RAM

Am I pushing my cluster's resource limits? (OOME)

Hi everyone, I have a 2 node development cluster in EC2 on c3.2xlarge AMIs. That means 8 vCPUs, 15GB RAM, 1Gb network, and I have 2 500GB EBS volumes for Elasticsearch data on each AMI. I'm running Java 1.7.0_55, and using the G1 collector. The Java args are: /usr/bin/java -Xms8g -Xmx8g -Xss25

Terms facet changing "date" to "long"

Hello all, The issue is I have a terms panel in Kibana that I want to group events by a "date" field from each record (Not the @timestamp field). The terms panel is taking my nicely formatted dates (2014-07-31) and turning them into longs since UTC (140356800). I did a quick test by creating

List of all possible config parameters for elasticsearch.yml?

Hi. Can someone point me to a place where all possible ES config parameters for elasticsearch.yml are listed and defined? This has very few: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/setup-configuration.html This has many, but not all (like indices.fielddata.cache.siz

Kibana Terms panel showing date fields as longs?

Hello :) I have some log data indexed in ES and trying to visualize in Kibana and getting strange behavior related to dates. I have Terms panel with the following settings: Terms mode: terms Field: date Length 10 Order: count For some reason, the "date" column in the panel is showing up as a lo

Re: Elasticsearch support for Java 1.8?

t I would love to hear someone who actually tried :) >> >> >> On Tuesday, June 17, 2014 3:19:37 PM UTC+2, Chris Neal wrote: >>> >>> Hi, >>> >>> I saw this blog post from April stating java 1.7u55 as being safe for >>> Elasticsearch, b

Elasticsearch support for Java 1.8?

Hi, I saw this blog post from April stating java 1.7u55 as being safe for Elasticsearch, but I didn't see anything about Java 1.8 support. Just wondering if it was :) http://www.elasticsearch.org/blog/java-1-7u55-safe-use-elasticsearch-lucene/ Thanks! Chris -- You received this message becaus

Re: Puppet Enterprise elasticsearch config hash?

' => { > 'name' => 'puppet-test-node', > > } > } > > } > > > On 04/22/2014 11:30 AM, Chris Neal wrote: > > Hi all, > > This is most likely a noob question, so I apologize. I'v

Puppet Enterprise elasticsearch config hash?

Hi all, This is most likely a noob question, so I apologize. I've googled as well and was not able to find an answer to this seeminly basic question. I'm using Puppet Enterprise 3.1.2 along with this module to install/manage Elasticsearch: https://forge.puppetlabs.com/elasticsearch/elasticsea