Kibana 4 - Custom Columns in a DataTable

2015-04-15 Thread John D. Ament
Hi, I'm looking into Kibana for some analytics on top of my data. One report I wanted to demonstrate is like a datatable, however the columns are meant to be ranges on top of a numeric field. Is there anyway to setup a datatable based on ranges? I don't see an option. John -- You received

High response time with 45 concurrent users

2015-02-22 Thread John D. Ament
Hi, I have a system with about 50k documents indexed. It's a single data master node (4gb heap I believe) w/ 2 client nodes connected. Aside from redundancy issues, we noticed that when there were 45 concurrent users, response times on our queries were taking upwards of 6s. With user load

Re: ElasticSearch 1.3.4 - Duplicate data sometimes

2014-11-21 Thread John D. Ament
Ended up reducing the shard count... fixed the issue. On Thursday, November 20, 2014 11:51:45 AM UTC-5, John D. Ament wrote: Hi, I was wondering how I might be able to trouble shoot issues with duplicate data coming back from queries. In my query, I perform an aggregate query, something

ElasticSearch 1.3.4 - Duplicate data sometimes

2014-11-20 Thread John D. Ament
Hi, I was wondering how I might be able to trouble shoot issues with duplicate data coming back from queries. In my query, I perform an aggregate query, something like this: final SearchResponse searchResponse = client() .prepareSearch(indexName) .setTypes(OBJ_TYPE) .setFetchSource(true)

Re: Performance problems with large data volumes

2014-11-06 Thread John D. Ament
How would index aliases help here? On Wednesday, November 5, 2014 11:50:34 AM UTC-5, Jörg Prante wrote: Use index aliases: one physical index, 4000 aliases. Jörg On Tue, Nov 4, 2014 at 3:42 PM, John D. Ament john.d...@gmail.com javascript: wrote: Hi, So I have what you might want

Re: Performance problems with large data volumes

2014-11-05 Thread John D. Ament
: + bulkItemResponse.getFailureMessage()); } } System.exit(-1); } } }).setConcurrentRequests(this.threads ).setBulkActions(this.bulkSize).build(); } } 2014-11-04 17:53 GMT+01:00 John D. Ament john.d...@gmail.com javascript:: And actually now that I'm looking at it again - I wanted to ask

Performance problems with large data volumes

2014-11-04 Thread John D. Ament
Hi, So I have what you might want to consider a large set of data. We have about 25k records in our index, and the disk space is taking up around 2.5 gb, spread across a little more than 4000 indices. Currently our master node is set for 6gb of ram. We're seeing that after loading this data

Re: Performance problems with large data volumes

2014-11-04 Thread John D. Ament
:) Also, 6GB Heap is not too much, but that depends on your use case Georgi On Tuesday, November 4, 2014 3:42:19 PM UTC+1, John D. Ament wrote: Hi, So I have what you might want to consider a large set of data. We have about 25k records in our index, and the disk space is taking up around

Re: Performance problems with large data volumes

2014-11-04 Thread John D. Ament
are very brief in describing you problem :) Georgi 2014-11-04 17:05 GMT+01:00 John D. Ament john.d...@gmail.com javascript:: Georgi, Thanks for the quick reply! I have 4k indices. We're creating an index per tenant. In this environment we've created 4k tenants. We're running out

Re: Performance problems with large data volumes

2014-11-04 Thread John D. Ament
? On Tuesday, November 4, 2014 11:37:46 AM UTC-5, John D. Ament wrote: Georgi, I'm indexing the data through regular index request via java final IndexResponse response = esClient.client().prepareIndex(indexName, type) .setSource(json).setRefresh(true).execute().actionGet

Aggregates - include source data

2014-08-18 Thread John D. Ament
Hi, From looking at the docs, didn't seem overly clear. Is it possible to include the data in an aggregate, or is it counts only? John -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails

Re: Inexplicable wrong results in automated tests

2014-08-05 Thread John D. Ament
sure that all test data is ready for searching. 03 август 2014, неделя, 18:22:50 UTC+3, John D. Ament написа: Hi So after running a few rounds of local automated tests, I've noticed that sometimes I get the wrong results in my index. This seems to only be an issue with my automated tests

Re: Inexplicable wrong results in automated tests

2014-08-04 Thread John D. Ament
On Sun, Aug 3, 2014 at 8:22 AM, John D. Ament john.d...@gmail.com javascript: wrote: Hi So after running a few rounds of local automated tests, I've noticed that sometimes I get the wrong results in my index. This seems to only be an issue with my automated tests and not when running

Inexplicable wrong results in automated tests

2014-08-03 Thread John D. Ament
Hi So after running a few rounds of local automated tests, I've noticed that sometimes I get the wrong results in my index. This seems to only be an issue with my automated tests and not when running the application manually (at least I haven't seen the wrong results after several

Re: High count of threadpools getting created

2014-08-02 Thread John D. Ament
. John On Sat, Aug 2, 2014 at 10:43 AM, joergpra...@gmail.com joergpra...@gmail.com wrote: Looks like a programming error. Without having a look at the code ServerService causing this, it is not possible to find explanations. Jörg On Fri, Aug 1, 2014 at 6:38 PM, John D. Ament john.d.am

Re: High count of threadpools getting created

2014-08-02 Thread John D. Ament
starts and stops. Can you clarify what are the Lucuene 4.9 quirks? Jörg On Sat, Aug 2, 2014 at 4:52 PM, John D. Ament john.d.am...@gmail.com wrote: Actually, it was more environmental than anything. This happened after I was doing some module reconfiguration in wildfly to deploy

Re: High count of threadpools getting created

2014-08-02 Thread John D. Ament
and are not really singletons in some situations. In short words I'm glad I could leave all those EJB annoyances behind and rely on JSR 330 (Guice style). Jörg On Sat, Aug 2, 2014 at 5:07 PM, John D. Ament john.d.am...@gmail.com wrote: Jorg, I've looked at that before. While my app has a set of REST

High count of threadpools getting created

2014-08-01 Thread John D. Ament
Hi all Based on another thread I started, I'm embedding ES into my application. Starting today, and I'm sure there's something that got thrown into the mix causing this, we have started seeing high counts of thread pools getting created and the application never fully booting. I see this in

elasticsearch.yml - Weird clustering behavior

2014-07-27 Thread John D. Ament
Hi all I'm currently deploying two nodes of elasticsearch. The first node is the standalone application, running on my local machine, using up port 9300 and 9200 for the WEB UI. As far as I know, it's using the configuration from elasticsearch.yml in the config folder of the application.

Re: Deploying ElasticSearch 1.3 to Wildfly 8.1

2014-07-26 Thread John D. Ament
downsides (think of heap memory). Then you can exclude MVEL and ASM from ES jars safely, and most other dependencies too, just keep the ES jar and Lucene core jar with the query builders, this is enough for TransportClient. Jörg On Sat, Jul 26, 2014 at 3:44 AM, John D. Ament john.d

Re: Deploying ElasticSearch 1.3 to Wildfly 8.1

2014-07-26 Thread John D. Ament
[INFO] +- log4j:log4j:jar:1.2.17:compile [INFO] +- org.slf4j:slf4j-api:jar:1.6.2:compile [INFO] +- net.java.dev.jna:jna:jar:4.1.0:compile [INFO] \- org.fusesource:sigar:jar:1.6.4:compile On Sat, Jul 26, 2014 at 1:51 PM, John D. Ament john.d...@gmail.com javascript: wrote: Yeah, I know ASM

Re: Deploying ElasticSearch 1.3 to Wildfly 8.1

2014-07-26 Thread John D. Ament
On Sat, Jul 26, 2014 at 3:12 PM, John D. Ament john.d...@gmail.com javascript: wrote: So, I'm assuming all this means I can safely remove expression, mvel, asm from my packaging requirements? I like this idea BTW https://github.com/elasticsearch/elasticsearch/issues/4859

Re: Deploying ElasticSearch 1.3 to Wildfly 8.1

2014-07-25 Thread John D. Ament
services like scripting in Wildfly deployment (this is how I do it currently) Jörg On Fri, Jul 25, 2014 at 3:30 AM, John D. Ament john.d...@gmail.com javascript: wrote: Hi all I was tinkering a bit with ElasticSearch. I think my target runtime may end up being embedded, just based on our

Deploying ElasticSearch 1.3 to Wildfly 8.1

2014-07-24 Thread John D. Ament
Hi all I was tinkering a bit with ElasticSearch. I think my target runtime may end up being embedded, just based on our deployment model. Probably not a big deal to get multiple nodes talking to each other and no additional hardware to deploy. I was trying to start the application in