Correct way to apply multiple nested filters

2015-04-19 Thread barak
Hi all, I'm having some difficulties running queries with multiple nested filters. Consider the following mapping: { template : products, mappings : { Product : { dynamic : false, properties : { id : { type : long

Re: Very sluggish Elasticsearch node; not sure why

2015-04-19 Thread christian . dahlqvist
Hi, You seem to have quite a large number of shards (1180) for a single node with only 7GB heap. As the total data volume is a bit over 600GB, the average shard size is only a bit over 500MB, which is not very large. As each shard is a separate Lucene index and carries some overhead, you would

Re: Correct way to apply multiple nested filters

2015-04-19 Thread barak
The following works, although I'm not sure why the previous query didn't.. AndFilterBuilder keywordFilter = andFilter( termFilter( reviews.positive.keywords.id, id ), rangeFilter( reviews.positive.keywords.score ).from( score ).includeLower( true ) ); NestedFilterBuilder nestedKeywordFilter =

Re: Very sluggish Elasticsearch node; not sure why

2015-04-19 Thread Mark Walkom
I'd guess that you are hitting the capacity of the node. Try closing/deleting indices or upgrading the instance. On 19 April 2015 at 13:03, Dave Galbraith david92galbra...@gmail.com wrote: So I've got this Elasticsearch single-node instance running out on an EC2 m3.2xlarge in the cloud. I'm

Re: Kibana - Error including scripted fields in aggregation

2015-04-19 Thread kexik
The same problem here. elasticsearch 1.5.1-1 on Arch Linux community. Were you able to make it work yet? On Thursday, April 9, 2015 at 2:21:10 AM UTC+2, ashish kudva wrote: Hello, I am trying to add a manually created scripted field using the dropdown box withing Aggregation: Any

Re: Kibana - Error including scripted fields in aggregation

2015-04-19 Thread ashish kudva
Thanks for letting me know. Appreciate it. For my future reference to ask such questions, can you us know which irc channel did you post that question? On Sunday, April 19, 2015 at 5:25:03 PM UTC-5, ke...@reversity.org wrote: I've asked on IRC and got this: Unfortunatly that feature was

Re: jdbcRiver rebuilding after restart.

2015-04-19 Thread joergpra...@gmail.com
It is up to the SQL statement to control the rows that are fetched when the JDBC river restarts. Note that rivers are deprecated. One of the reason because rivers are obsoleted is the undefined state if a node restarts. JDBC river simply re-runs the SQL statement. Use the JDBC plugin in

Re: equivalent of sql join and update

2015-04-19 Thread Mark Walkom
Logstash has a translate filter - http://www.elastic.co/guide/en/logstash/current/plugins-filters-translate.html However KB3 has this functionality built in, where you can change a displayed value to something else, it'll be released in KB4 soon. On 19 April 2015 at 22:11, dna lor

Re: Kibana - Error including scripted fields in aggregation

2015-04-19 Thread kexik
I've asked on IRC and got this: Unfortunatly that feature was removed due to a security issue with Groovy. For now you can only use Lucene Expressions for scripted fields. We are working to try and get the date functionality back. On Thursday, April 9, 2015 at 2:21:10 AM UTC+2, ashish kudva

Re: Elasticseach issue with some indicies not populating data

2015-04-19 Thread Don Pich
Thanks for taking the time to answer David. Again, got my training wheels on with an ELK stack so I will do my best to answer. Here is an example. The one indecy that is working has a fresh directory with todays date in the elasticsearch directory. The ones that are not working do not have a

has_parent does not support filter

2015-04-19 Thread jim ross
Hello, I'm new to ElasitcSearch and struggling a bit trying to learn the query syntax. Spent ages trying to get a query working that searches children and uses a filter on parent, specifically find all persons named Jim within a given geo distance of a branch location, like this: /_search {

Re: Elasticseach issue with some indicies not populating data

2015-04-19 Thread David Pilato
From an Elasticsearch point of view, I don't see anything wrong. You have a way too much shards for sure so you might hit OOM exception or other troubles. So to answer to your question, check your Elasticsearch logs and if nothing looks wrong, check logstash. Just adding that Elasticsearch is

Elasticseach issue with some indicies not populating data

2015-04-19 Thread dpich
I am new to elasticsearch and have a problem. I have 5 indicies. At first all of them were running without issue. However, over the last 2 weeks, all but one have stopped generating data. I have run a tcpdump on the logstash server and confirmed that logging packets are getting to the

Re: Elasticseach issue with some indicies not populating data

2015-04-19 Thread David Pilato
Are you using the same exact JVM version? Where do those logs come from? LS ? ES ? Could you try the same with a cleaned Elasticsearch ? I mean with no data ? My suspicion is that you have too many shards allocated on a single (tiny?) node. What is your node size BTW (memory / heap size)?

Re: creation_date in index setteing

2015-04-19 Thread Mark Walkom
It's when the index was created, it's unix epoch time. On 20 April 2015 at 14:06, tao hiko taoh...@gmail.com wrote: I query setting information of index and found that have creation_date field but I cannot understand what is value. Can you explain me more? settings: { index:

creation_date in index setteing

2015-04-19 Thread tao hiko
I query setting information of index and found that have creation_date field but I cannot understand what is value. Can you explain me more? settings: { index: { creation_date: 1425631497164, uuid: A9ZXMK7zTjSyB_oWpvf7fg, analysis: {

jdbcRiver rebuilding after restart.

2015-04-19 Thread GWired
I have a river created using the column strategy. Whenever the system reboots or restarts it appears that the river is forgetting it's last place and starts all over again. These systems will do updates from time to time and rebuilding the indexes is taking a really long time slowing down