Re: Marvel license file/order number baked into a container

Hi Joel, You can block write access to the monitoring cluster marvel is installed on. When you enter the the license details, Marvel will fail storing that information in ES and will give you a command you can run manually on the server (assuming it runs behind a proxy). You can use that comman

Re: shingle filter for sub phrase matching

There are a couple of problems with the example code: - the second document posted with id '1' (which was EFGR) replaces the first document with id '1' and so you lose the EFGR document. Similarly with the posts to id '3'. That is probably why Nick could not find EFGR or Lung. He should have

Re: Returning partial strings in Kibana visualisation

{"script": "_value.substring(0,8)"} works for you, needing groovy sandbox enabled. On Wednesday, April 29, 2015 at 9:39:33 PM UTC+8, Stuart Kenworthy wrote: > > I have a number of different load injector boxes and processes that > generate load through our system under test. The tool in use pro

GeoNames, Autocomplete and boost

Hi. I'm trying to improve autocomplete search results on a GeoNames Cities index. I have been using django-haystack, but have run into issues there. I may need to replace it, or bypass it. But my question here pertains to indexing and querying with autocomplete using multiple fields. Users ex

Re: Documents not deleted when using DeleteRequest within BulkProcessor

No as soon as you have only one index for this alias, indexing and deleting should work. I don’t see anything suspicious here. Any chance you could share on github your full code? When you say that "nothing happens", do you mean that you never get the debug LOG « Processing {} … » ? Or do you

Re: Max documents 10,500?

The question of relative size has, I believe, led me to the problem. I create aliases. After the load, I have the alias point to the new index. One of the indexes had a bad document that made the change alias mechanism fail. This means I kept loading the document into an index but the alias

Re: ES upgrade

Are you running the same ES and java versions on all your nodes and clients? On 1 May 2015 at 21:21, wrote: > Hi All > >i upgraded elastic search from 1.4.2 to 1.5.2 i am getting following > warning from console after upgrade please explain me the following error > why it is coming. > > [20

Re: Max documents 10,500?

Could you compare disk size (/data dir) for your two elasticsearch instances? Also, could you GIST the result of a simple _search?pretty on both nodes? -- David Pilato - Developer | Evangelist elastic.co @dadoonet | @elasticsearchfr

Re: SHIELD terms lookup filter : AuthorizationException BUG

I'm having the same problem with Elasticsearch 1.4.5 with shield 1.1 On Thursday, April 23, 2015 at 2:03:23 PM UTC-5, Jay Modi wrote: > > Hi Bert, > > I don't know of a workaround to accomplish this in a single query right > now. We have been discussing how to fix this issue in depth over the pas

Re: Max documents 10,500?

No, for two reasons: 1. I am using the exact same code and data on both machines. 2. I've seen duplicates in the past and I get an error message. Thanks. Blake On Friday, May 1, 2015 at 2:50:57 PM UTC-5, David Pilato wrote: > > Any chance you are using the same id multiple times? > > > --

Re: How to take a snapshots of a specific index with the php library?

Figured it out. The key was to use $params['body'] instead of $params['custom']. Which is odd since that's what I tried in the first place. I guess I must have had some other bug in the way at the time that got fixed as I was testing things... On Thursday, April 30, 2015 at 5:10:58 PM UTC-7, Da

Re: Max documents 10,500?

Any chance you are using the same id multiple times? -- David Pilato - Developer | Evangelist elastic.co @dadoonet | @elasticsearchfr | @scrutmydocs > Le 1 mai 2015 à 21:25, Blake McBri

Re: Max documents 10,500?

I changed the code to read: var counter = 0; exports.addDoc = function (index, type, id, doc, callback) { if (client !== undefined) { var json = { index: index, type: type, id: id, body: doc }; if (counter++ % 1000 === 0

abnormal "file" input behavior?

I have a file of logging records I am using to debug some "filter" parses. I am using "file" input and have set "starting_position" to "beginning". So I startup logstash see what I get and killed it and make fixes and go again. I have seen if sometimes it reads the file and sometimes not. I

Re: Max documents 10,500?

Could you add a counter in your JS app to make sure you sent all docs? I suspect something wrong in your index process -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 1 mai 2015 à 20:40, Blake McBride a écrit : > > The log only contains: > > [2015-05-01 18:22:10,398][

Re: Max documents 10,500?

The log only contains: [2015-05-01 18:22:10,398][INFO ][cluster.metadata ] [mmsapp-na-component] [components-1430504530354] creating index, cause [api], templates [], shards [5]/[1], mappings [index_name, component] Each document is being added individually from JavaScript via: exports

Re: Evaluating Moving to Discourse - Feedback Wanted

> Why do you find IRC unfriendly? Have you tried using a web based client like irccloud.com? I use webchat.freenode.net. There's a big difference between, "Here's our live chat app." and "Learn how to connect to IRC in order to use live chat." I actively avoided live chat for years simply because

Re: Shield and Proxy Users

Thanks Michael. Are you interested in Shield performing the authorization with AD/LDAP for a given proxy user (assumed as being authenticated by your application) or would/can your application also pass the authorization information and then Shield restricts access accordingly? On Wednesday, Ap

Re: Evaluating Moving to Discourse - Feedback Wanted

On Fri, May 1, 2015 at 7:26 PM, David Reagan wrote: > Moving away from mailing lists for anything except announcements would be > awesome. Forums are a much better way to have solid discussions with > multiple people in. Email is fine, but when you add in more than a couple > people, it gets conf

Re: Evaluating Moving to Discourse - Feedback Wanted

Moving away from mailing lists for anything except announcements would be awesome. Forums are a much better way to have solid discussions with multiple people in. Email is fine, but when you add in more than a couple people, it gets confusing fast. Forums are also far more user friendly for peo

Re: Max documents 10,500?

If you have nothing in logs it could mean that you have an issue with your injector. May be you are using bulk but you don't check the bulk response? David > Le 1 mai 2015 à 18:36, Blake McBride a écrit : > > Greetings, > > I have two similar but unrelated machines. I am adding 50,000+ docum

Max documents 10,500?

Greetings, I have two similar but unrelated machines. I am adding 50,000+ documents to each. Afterwards, one shows the 50,000+ documents and the other only shows 10,500. The second machine seems to be capping out at 10,500. Why, and how can I correct this? The relevant facts are as follows

Re: Perma-Unallocated primary shards after a node has left the cluster

Probably super evident but the output above was actually from _cat/allocation?v not /recovery, sorry about that. On Wednesday, April 29, 2015 at 5:19:08 PM UTC-7, Alex Schokking wrote: > > Hi guys, I would really appreciate some help understanding what's going > down with shard allocation in thi

Re: How to replicate this type of search

Thanks John! It's all very clear now. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on

Re: "too many open files" problems and suggestions on cluster configuration

The number of open files does not depend on the number of documents. A shard comes not for free. Each shard can take around ~150 open file descriptors (sockets, segment files) and up to 400-500 if actively being indexed. Take care of number of shards, if you have 5 shards per index, and 2000 indi

Re: How to replicate this type of search

Yes, that's correct. Depending on your application, it might be easier to have the filters as a dropdown. Similar how sites like Amazon allow you to choose which department to search within. Otherwise you'll have to rely on your users to type in the correct syntax - which might be what you want

Re: How to replicate this type of search

Thanks John & Ivan for your insight. Very helpful. Just to see if I'm getting this: In order to have a search where my users can type "title: {query term}" to limit the search only to titles, I need to program my application to parse the query string and then add the additional filters to the E

Re: "too many open files" problems and suggestions on cluster configuration

How to calculate the best amount of shards? пятница, 1 мая 2015 г., 18:21:47 UTC+3 пользователь David Pilato написал: > > Add more nodes or reduce the number of shards per node. > > -- > David ;-) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 1 mai 2015 à 17:05, Ann Yablunovskaya

Re: "too many open files" problems and suggestions on cluster configuration

Add more nodes or reduce the number of shards per node. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 1 mai 2015 à 17:05, Ann Yablunovskaya a écrit : > > I am looking for suggestions on cluster configuration. > > I have 2 nodes (master/data and data), 544 indices, abo

"too many open files" problems and suggestions on cluster configuration

I am looking for suggestions on cluster configuration. I have 2 nodes (master/data and data), 544 indices, about 800 mil documents. If I try to insert more documents and create more indices, I will catch error "too many open files". My node's configuration: CentOS 7 Intel(R) Xeon(R) CPU x16 RA

Re: Marvel license file/order number baked into a container

For anyone else coming across this, an Elasticsearch engineer confirmed to me in this question that it's not currently possible but a feature request for it has now been opened. On Wednesday, April 29, 2015 at 3:07:21 PM

Re: How to Boost

I got it: To add an array of var to an anonymous type add them like this. var field1 = new {field="Name^20"}; var field2 = new {field = "_all"}; var field3 = new {field = "Id^20"}; var myfields = new [] {field1,field2}; This is slick now it puts th

ES upgrade

Hi All i upgraded elastic search from 1.4.2 to 1.5.2 i am getting following warning from console after upgrade please explain me the following error why it is coming. [2015-05-01 06:15:13,361][WARN ][transport.netty ] [ES_Node1] exception caught on transport layer [[id: 0xc483723b

Re: Failed to get setting group for [threadpool.] setting prefix and setting [threadpool.bulk] because of a missing '.'

It was a few months ago so I don't exactly recall the command line we used, but it must have been something like: curl -X PUT -d '{ "persistent" : { "threadpool.bulk": { "type": "fixed", "queue_size": 250 } } }' localhost:9200/_cluster/settings m. On Thursday, April 30, 2015 at