ES Choking on Seemingly Valid JSON

2015-03-27 Thread David Kleiner
Error, with some parameters modified to protect the innocent. the JSON here does pass the lint validator, is it the empty params : {} that throws it off? [2015-03-27 16:00:21,010][DEBUG][action.bulk ] [host / Luis Buñuel] [eventlog-2015.03][4] failed to execute bulk item

Re: ES Choking on Seemingly Valid JSON

2015-03-27 Thread David Kleiner
Got it, thank you Joerg! On Friday, March 27, 2015 at 3:42:36 PM UTC-7, Jörg Prante wrote: You have mixed plain strings and json objects for field json in your data. This is not allowed. Jörg On Fri, Mar 27, 2015 at 10:10 PM, David Kleiner david@gmail.com javascript: wrote

Help with mapping update

2015-03-24 Thread David Kleiner
Greetings, I am trying to update mapping to make certain fields not_analyzed. The index gets created from default template, now I'm trying to add the following mapping to it (long) and get an error. The index is empty. I'm probably missing something very obvious. Thank you, David

Re: Help with mapping update

2015-03-24 Thread David Kleiner
TTL, it's very resource intensive and if you are using time based data then you should use time based indices. On 25 March 2015 at 08:28, David Kleiner david@gmail.com javascript: wrote: Greetings, I am trying to update mapping to make certain fields not_analyzed. The index gets

Re: Help with mapping update

2015-03-24 Thread David Kleiner
I got the index template to work, turns out it's really straightforward. I now do have .raw fields and all the world is green. I'll add the template to my other index so it gets geoip mapping when I roll to April. Cheers, David On Tuesday, March 24, 2015 at 2:28:38 PM UTC-7, David Kleiner

Re: Help with mapping update

2015-03-24 Thread David Kleiner
documents with .raw fields in them.. And I did remove the TTL so my cluster is happy again. On Tuesday, March 24, 2015 at 4:36:05 PM UTC-7, David Kleiner wrote: I got the index template to work, turns out it's really straightforward. I now do have .raw fields and all the world is green. I'll

Re: Help with mapping update

2015-03-24 Thread David Kleiner
Indeed, it just works in 4! Thank you again, David On Tuesday, March 24, 2015 at 5:49:16 PM UTC-7, Mark Walkom wrote: Are you using KB4 or 3? If 4 then you need to refresh the fields under the index settings. On 25 March 2015 at 11:06, David Kleiner david@gmail.com javascript: wrote

Re: Logstash Geohash Question

2015-03-18 Thread David Kleiner
In my case, it's ES 1.4.4, KB4 4.0.1, I use logstash-forwarder to logstash-forwarder input, rabbitmq output, geoip filter in logstash and ES river plugin, no template. Perhaps I should've created a dedicated template but I now have 3 years worth of index data and reindexing it will be

Logstash Geohash Question

2015-03-06 Thread David Kleiner
Hi, Are there any plans to add calculating geohash to Logstash? Now that Kibana4 is out and won't accept geo coordinates for its map visualization... Thanks, David -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this

Kibana4: Exporting Results

2015-03-06 Thread David Kleiner
Hi, Question about Kibana4: will it be possible to export search results, ideally in CSV format, like it's been possible with Kibana 2? I'm planning to migrate my Kibana 2 users to version 4 and the lack of CSV export results is a blocker. Thanks, David -- You received this message

Exporting search results in Kibana v.4

2014-12-01 Thread David Kleiner
Greetings Kibana.4 fans, There is an export button in Kibana 4 (see screenshot) but it doesn't do anything meaningful. Is it just a mock-up for future functionality? Cu's are missing the ability to save searches to excel... Thanks, David -- You received this message because you are

Re: Exporting search results in Kibana v.4

2014-12-01 Thread David Kleiner
PM UTC-8, David Kleiner wrote: Greetings Kibana.4 fans, There is an export button in Kibana 4 (see screenshot) but it doesn't do anything meaningful. Is it just a mock-up for future functionality? Cu's are missing the ability to save searches to excel... Thanks, David -- You

Re: Exporting search results in Kibana v.4

2014-12-01 Thread David Kleiner
Went through closed Kibana.4 closed tickets, found it fixed with commit to master. Will rebuild and redeploy. Hopefully will work then. On Monday, December 1, 2014 4:04:45 PM UTC-8, David Kleiner wrote: Greetings Kibana.4 fans, There is an export button in Kibana 4 (see screenshot

Re: Failing Replica Shards

2014-11-29 Thread David Kleiner
it was OK to drop it. Upgrading to more recent ES version helped too. HTH, David On Saturday, November 29, 2014 2:48:45 AM UTC-8, Mehmet Cem Güntürkün wrote: Hey David, I have same problem now. Have you found a solution for that problem? 26 Ağustos 2014 Salı 23:08:55 UTC+3 tarihinde David

Kibana v.2 broken after ES 1.4 Upgrade?

2014-11-13 Thread David Kleiner
Hello fellow E/searchers, After taking a plunge from 1.3.4 to 1.4.0, my Kibana v.2 instance is broken: [ 2014-11-13 14:26:52.0246 9520/7f41041e5700 Pool2/Implementation.cpp:1172 ]: [App 9567 stderr] NoMethodError - undefined method `count' for nil:NilClass: [ 2014-11-13 14:26:52.0247

Re: Corrupted Shard on Recovery

2014-11-11 Thread David Kleiner
: Hi David, did you manage to fix your issue? I'm observing exactly the same symptoms as you with one of my indices. Hardware seems to be OK. Thanks Christoph Am Mittwoch, 3. September 2014 23:13:26 UTC+2 schrieb David Kleiner: Another data point, replica shard that's trying to initialized

Re: Corrupted Shard on Recovery

2014-09-03 Thread David Kleiner
September 2014 14:58, David Kleiner david@gmail.com javascript: wrote: Greetings, I tried to overcome slowly recovering replica set, changed the number of replicas on index to 0, then to 1, getting this exception

Re: Corrupted Shard on Recovery

2014-09-03 Thread David Kleiner
On 3 September 2014 14:58, David Kleiner david@gmail.com wrote: Greetings, I tried to overcome slowly recovering replica set, changed the number of replicas on index to 0, then to 1, getting this exception

Corrupted Shard on Recovery

2014-09-02 Thread David Kleiner
Greetings, I tried to overcome slowly recovering replica set, changed the number of replicas on index to 0, then to 1, getting this exception:

Re: Explicitly Copying Replica Shards That Fail to Start

2014-08-29 Thread David Kleiner
the replica and then add it back and see how you go. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com javascript: web: www.campaignmonitor.com On 29 August 2014 08:40, David Kleiner david@gmail.com javascript: wrote: Greetings, I am still

Explicitly Copying Replica Shards That Fail to Start

2014-08-28 Thread David Kleiner
Greetings, I am still having a problem with recovery of 5 replica shards in 2 indices of mine, 3-way cluster. The replica shards fail to initialize and are jumping around two secondary nodes. The primary shards are fine. What is my path to recovery? Is copying master shard to secondary

Re: Elasticsearch for logging. HOW to configure automatic creation of the new index every day?

2014-08-27 Thread David Kleiner
. It looks trivial, but for uninitiated take some mental effort to realize. :-) Konstantin On Tuesday, August 26, 2014 1:32:52 PM UTC-7, David Kleiner wrote: Hello Konstantin, You can use index value of name-%{+.MM.dd} in your elasticsearch output in logstash (link: http

Failing Replica Shards

2014-08-26 Thread David Kleiner
Hello, In the past couple of days I've been getting a lot of error messages about corrupted replica shards. The primary shards come up fast after ES process restart but replicas take a long time to come back. Sometimes it takes a few node restarts to 'kick' the nodes to start replica shards.

Re: Elasticsearch for logging. HOW to configure automatic creation of the new index every day?

2014-08-26 Thread David Kleiner
Hello Konstantin, You can use index value of name-%{+.MM.dd} in your elasticsearch output in logstash (link: http://logstash.net/docs/1.4.2/outputs/elasticsearch#index) HTH, David On Tuesday, August 26, 2014 10:01:39 AM UTC-7, Konstantin Erman wrote: Most of the guides I could find