Re: How many elastic search shards should I have for a physical node?

Each shard is a Lucene instance. It uses memory, file descriptors, CPU, IO... You should keep its number per node small. If you are a RDBMS user, you probably limit the number of databases you manage on a single physical machine, right? HTH -- David ;-) Twitter : @dadoonet / @elasticsearchfr

Re: Searching for foo should also find occurrence of foo.bar

Yes. Because « Hello. How are you? » is a sentence that can be broken in « hello », « how », « are », « you ». But in « I paid it 2.50 euros », I would most likely keep « 2.50 » as a whole token. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet

Re: Searching for foo should also find occurrence of foo.bar

is more for english text which means that a dot need to have a space after it in order to be considered as a break between two tokens. Make sense? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr

Re: Searching for foo should also find occurrence of foo.bar

I would use 2 analyzers and multi field: https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping-core-types.html#_multi_fields_3 https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping-core-types.html#_multi_fields_3 -- David Pilato - Developer | Evangelist

Re: Where is Elasticsearch storing data

to https://discuss.elastic.co/, please join us there for any future discussions! On 28 May 2015 at 01:27, David Pilato da...@pilato.fr wrote: by default in path.data dir. In zip or tar.gz distribution, it’s in data dir -- David Pilato - Developer | Evangelist elastic.co @dadoonet

Re: Elasticsearch: 2-node cluster with failover

Add another node (master only : data false) with minimal HEAP and set minimum master nodes to 2 or set minimum master nodes to 2 but in that case your cluster will stop working in case of failure of any node or network failure -- David Pilato - Developer | Evangelist elastic.co @dadoonet

Re: Where is Elasticsearch storing data

by default in path.data dir. In zip or tar.gz distribution, it’s in data dir -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 27 mai 2015 à

Re: Wild card query with case insensitive search

Don't use wildcard query unless you want it to be slow. Prefer using ngrams based analyzers (will cost you more disk space). HTH David Le 26 mai 2015 à 22:29, Sagar Shah sagarshah1...@gmail.com a écrit : Hello everyone, We are trying to replace application log storage from postgres db with

Re: Querying indexed data in different computer Elasticsearch

25, 2015 at 8:00 AM, David Pilato da...@pilato.fr wrote: Can you describe all steps you do, one by one, with all commands you run? Also paste all your logs? David Le 24 mai 2015 à 23:17, Kartik Singhal gkkart...@gmail.com a écrit : Yes. I first indexed kimchy and queried for kimchy

Re: Querying indexed data in different computer Elasticsearch

, David Pilato da...@pilato.fr wrote: I think you misunderstand how Elasticsearch works. You don't need to share a filesystem across multiple nodes. Just start a first node with a cluster name like mycluster. Index your data. Start a client node or a transport client, which connects to your

Re: Querying indexed data in different computer Elasticsearch

I think you misunderstand how Elasticsearch works. You don't need to share a filesystem across multiple nodes. Just start a first node with a cluster name like mycluster. Index your data. Start a client node or a transport client, which connects to your running cluster and you are done. --

Re: Querying indexed data in different computer Elasticsearch

. They will just download my code and the indexed data and then with the help of my code they will query the data. On Sun, May 24, 2015 at 3:59 PM, David Pilato da...@pilato.fr wrote: It means that your users are connected on the same network or that you want them to use Elasticsearch

Re: Querying indexed data in different computer Elasticsearch

No I have no idea. But for sure I would never use such a cluster name! May be your cluster is not really started and you are not waiting enough time for you index to have at least a yellow status? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet

Re: Querying indexed data in different computer Elasticsearch

, really helping me a lot. Sorry, I know I am doing some silly mistake here but I am not able to identify it as I am new to the ES. regards, Kartik On Sun, May 24, 2015 at 8:05 PM, David Pilato da...@pilato.fr wrote: No I have no idea. But for sure I would never use such a cluster name

Re: Querying indexed data in different computer Elasticsearch

with simply mycluster, still not working. Thanks regards, Kartik On Mon, May 25, 2015 at 2:20 AM, David Pilato da...@pilato.fr wrote: I meant something else. At first you indexed kimchy and search for kimchi. Check your file access rights. Might be your issue. And please remove the clustername

Re: @timestamo and Date in the logs are not matching

Definitely a logstash question. You need to use the date filter to reconciliate dates. Please use the logstash discussion group for this at https://discuss.elastic.co/ https://discuss.elastic.co/ -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet

Re: Error handling for HTTP search API

, fields: [ foo ], default_operator: AND } } } But that’s not exactly what you are looking for. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs

Re: Cpu fluctuating due to java.exe

] [AEPLES1] All shards failed for phase: [query] On Wednesday, May 6, 2015 at 1:15:27 PM UTC+5:30, David Pilato wrote: What is wrong ? I mean that if you are doing indexing for example, that's fine if your CPU is used. But may be you are running out of memory and GC is running all the time

Re: Cpu fluctuating due to java.exe

Nothing noticeable. Do you have an empty cluster when starting ? Is this happening all the time although you don't have any activity on the cluster? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 6 mai 2015 à 10:45, Chetan Dev cheten@carwale.com a écrit : Hi,

Re: Cpu fluctuating due to java.exe

What is wrong ? I mean that if you are doing indexing for example, that's fine if your CPU is used. But may be you are running out of memory and GC is running all the time ? Hard to say without any details / logs... BTW me moved to https://discuss.elastic.co/ -- David ;-) Twitter : @dadoonet

Re: Error handling for HTTP search API

Try simple_query_string. BTW we moved to https://discuss.elastic.co/ David Le 7 mai 2015 à 06:56, Snixtor snix...@gmail.com a écrit : I have an application allowing users to specify the query value of a query_string query. If the user inputs invalid search syntax, e.g. their search is

Re: Error handling for HTTP search API

. On Thursday, 7 May 2015 15:01:55 UTC+10, David Pilato wrote: Try simple_query_string. BTW we moved to https://discuss.elastic.co/ David Le 7 mai 2015 à 06:56, Snixtor sni...@gmail.com a écrit : I have an application allowing users to specify the query value of a query_string query

Re: script_fields giving error

Read this: http://www.elastic.co/guide/en/elasticsearch/reference/current/modules-scripting.html#_enabling_dynamic_scripting Note that we moved to https://discuss.elastic.co/ David Le 6 mai 2015 à 06:26, Mohit Garg mohitga...@gmail.com a écrit : I am using elastic 1.5.0. When I run this

Re: get number of pending document writes?

In tests, you need to refresh the index before searching. Elasticsearch is a near real time search engine. See http://www.elastic.co/guide/en/elasticsearch/reference/current/indices-refresh.html Note that we moved the mailing list to https://discuss.elastic.co/ David Le 6 mai 2015 à 04:32,

Re: add mapping for geo_point with java

How do you send your mapping? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 4 mai 2015 à 08:32, Dharshana Ratnayake darthsh...@gmail.com a écrit : Hi Guys Im trying to save documents in elasticsearch where one field i want to map a geo_point with lat and lon But

Re: how to safely clean old documents (by date)

Definitely the second option. Use scan and scroll (search for reindex on the website). Instead of renaming, I would use aliases and switch the alias from old to new index. Then close or remove the old index. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 3 mai 2015 à

Re: how to safely clean old documents (by date)

the current index to the new one On Monday, May 4, 2015 at 12:15:22 AM UTC+3, David Pilato wrote: Definitely the second option. Use scan and scroll (search for reindex on the website). Instead of renaming, I would use aliases and switch the alias from old to new index. Then close or remove

Re: Documents not deleted when using DeleteRequest within BulkProcessor

mean that the document has not been removed ? How do you test all that? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 30 avr. 2015 à 19:10

Re: Max documents 10,500?

If you have nothing in logs it could mean that you have an issue with your injector. May be you are using bulk but you don't check the bulk response? David Le 1 mai 2015 à 18:36, Blake McBride blake1...@gmail.com a écrit : Greetings, I have two similar but unrelated machines. I am

Re: Max documents 10,500?

Could you compare disk size (/data dir) for your two elasticsearch instances? Also, could you GIST the result of a simple _search?pretty on both nodes? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com

Re: too many open files problems and suggestions on cluster configuration

Add more nodes or reduce the number of shards per node. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 1 mai 2015 à 17:05, Ann Yablunovskaya lad.sh...@gmail.com a écrit : I am looking for suggestions on cluster configuration. I have 2 nodes (master/data and data),

Re: Max documents 10,500?

Any chance you are using the same id multiple times? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 1 mai 2015 à 21:25, Blake McBride

Re: Max documents 10,500?

search not connected', undefined); } }; On Friday, May 1, 2015 at 11:42:12 AM UTC-5, David Pilato wrote: If you have nothing in logs it could mean that you have an issue with your injector. May be you are using bulk but you don't check the bulk response? David Le 1 mai 2015 à 18

Re: How to fix cluster health yellow with Elastic Search

information to say more for now. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 30 avr. 2015 à 10:50, James Crone arafay...@gmail.com a écrit

Re: [ANN] Elasticsearch Mapper Attachment plugin 2.3.0 released

? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 30 avr. 2015 à 12:47, Prashant Agrawal prashant.agra...@paladion.net a écrit : Yes, Though

Re: [ANN] Elasticsearch Mapper Attachment plugin 2.3.0 released

So why not doing that in your application? If you look into _source.file.content and _source.file._content, older docs will have BASE64 content in content and null in _content and the opposite for newer docs. Do I miss anything? -- David Pilato - Developer | Evangelist elastic.co @dadoonet

Re: [ANN] Elasticsearch Mapper Attachment plugin 2.3.0 released

-fields.html Does it help? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 30 avr. 2015 à 12:12, Prashant Agrawal prashant.agra...@paladion.net

Re: How to fix cluster health yellow with Elastic Search

to do that. If your plan is to do that in production, please don’t! Don’t run more than one node per machine unless you have more than 64gb RAM. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr

Re: LIKE Query

/current/mapping-analysis.html Answering to your question, using ngrams would probably help here. Hope this helps -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https

Re: Troubleshooting Elasticsearch queries

https://gist.github.com/dadoonet/0b161423d0acafecb012 -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 30 avr. 2015 à 14:45, trekr5 cebi

[ANN] Elasticsearch Smart Chinese Analysis plugin 2.4.4 released

Heya, We are pleased to announce the release of the Elasticsearch Smart Chinese Analysis plugin, version 2.4.4. Smart Chinese Analysis plugin integrates Lucene Smart Chinese analysis module into elasticsearch.. https://github.com/elasticsearch/elasticsearch-analysis-smartcn/

Re: [ANN] Elasticsearch Japanese (kuromoji) Analysis plugin 2.4.3 released

Sorry. Was a typo. You should have read Update to elasticsearch 1.4.5 Le jeudi 30 avril 2015 15:48:44 UTC+2, David Pilato a écrit : Heya, We are pleased to announce the release of the *Elasticsearch Japanese (kuromoji) Analysis plugin*, *version 2.4.3* The Japanese (kuromoji) Analysis

Re: Safe to use prefix query on analysed field?

Well. If you’d like to enhance the documentation, feel free to send a pull request! :) -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 29

Re: duplicate documents in query,

when indexing one of your docs? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 29 avr. 2015 à 17:58, David Pilato da...@pilato.fr a écrit

Re: possible networking problem?

Try 0.0.0.0 not localhost David Le 29 avr. 2015 à 22:29, Sitka sitkaw...@gmail.com a écrit : Here is the message output from Kibana when I start it up: c:\Kibana\kibana-4.0.2-windows\binkibana.bat {@timestamp:2015-04-29T17:11:32.713Z,level:info,message:No existing k ibana index

Re: Documents not deleted when using DeleteRequest within BulkProcessor

Do you try to delete a doc using an alias? Any failure or error reported by the bulk processor? Hard to tell more without seeing the code / data. David Le 30 avr. 2015 à 02:03, Diana Tuck dtu...@gmail.com a écrit : Trying to index/delete documents within one BulkProcessor object in the Java

Re: possible networking problem?

in the loop to capture the data interchange between browser and Kibana. You can see GET outgoing on the left and the refusal on the right. On Wednesday, April 29, 2015 at 1:31:14 PM UTC-7, David Pilato wrote: Try 0.0.0.0 not localhost David Le 29 avr. 2015 à 22:29, Sitka sitk

Re: bulkProcessor never calls afterBulk?

Try to remove setBulkSize. What is the other part of your code? David Le 30 avr. 2015 à 00:30, Scott Chapman scottedchap...@gmail.com a écrit : Here's my code example, I get something printed beforeBulk. But never see anything printed for afterBulk. And yes, a document is getting written.

Re: i need some help

It sounds incorrect. Have a look at bulk documentation. You are probably missing something. Note that it’s hard to answer without a complete recreation script. Look at https://www.elastic.co/help https://www.elastic.co/help -- David Pilato - Developer | Evangelist elastic.co @dadoonet https

Re: duplicate documents in query,

Which elasticsearch version have you? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 29 avr. 2015 à 16:44, Georgi Ivanov georgi.r.iva

Re: How to process Lat Long fields using default Logstash config and mapping to use in Kibana 4 tile map

David Pilato: It's not an issue IMO but just a default configuration. FYI here is a sample config file I just used to parse some CSV data: input { stdin {} } filter { csv { separator = ; columns = [ id,name,slug,uic,uic8_sncf,longitude,latitude,parent_station_id

Re: Tranfer Kibana 4 dashboards

I'm using SNAPSHOT elasticsearch feature for that. I save .kibana index. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 28 avr. 2015 à 19:55, Kellan Strong vaid.kel...@gmail.com a écrit : Hello All, In Kibana 3 you were able to save the dashboards you created to

Re: Deploy elasticsearch to local maven repo

It’s a maven question not related to elasticsearch. That said mvn install will do what you want. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs

Re: Search local only

. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 27 avr. 2015 à 17:14, Christophe Rosko christo...@digiteka.com a écrit : Hi ! I have

Re: How to process Lat Long fields using default Logstash config and mapping to use in Kibana 4 tile map

It's not an issue IMO but just a default configuration. FYI here is a sample config file I just used to parse some CSV data: input { stdin {} } filter { csv { separator = ; columns = [ id,name,slug,uic,uic8_sncf,longitude,latitude, parent_station_id,is_city,country,

Re: How elasticsearch search works??

If you use a query string or simple query string, searching for priority:2 will search in priority field only. Using a query dsl with filters will make this more obvious and more efficient performance wise. HTH David Le 26 avr. 2015 à 14:23, jigish thakar jigishptha...@gmail.com a écrit :

Re: How to process Lat Long fields using default Logstash config and mapping to use in Kibana 4 tile map

You need to use the mutate filter and move your fields into a location one. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 25 avr. 2015 à 22:13, Rodger Moore rodgerb...@gmail.com a écrit : Hi there! My question is fairly simple but I'm having trouble finding a

Re: script_lang not supported [groovy]

Not sure it’s your issue but elasticsearch 1.5 uses Groovy 2.4.0 dependency groupIdorg.codehaus.groovy/groupId artifactIdgroovy-all/artifactId version2.4.0/version /dependency -- David Pilato - Developer | Evangelist elastic.co @dadoonet

Re: Bulk indexing creates a lot of disk read OPS

, is it an issue for you? If not, keeping all defaults values might be good. Best -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 24 avr. 2015 à

Re: Bulk indexing creates a lot of disk read OPS

Merging segments could be the cause here? David Le 24 avr. 2015 à 09:54, Eran era...@gmail.com a écrit : Forgot some stats: I have 10 shards, no replicas, all on the same machine. ATM, there are some 1.5 billion records in the index. On Friday, April 24, 2015 at 10:18:27 AM UTC+3,

Re: FreeBSD 10.1 install elasticsearch plugin fails

No. 2.43 does not exist. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 24 avr. 2015 à 12:53, Pccom Frank pccom.fr...@gmail.com a écrit

Re: BulkProcessor pest practices

a problem, failure); bulk.add(request); } }) .setBulkActions(pageSize) .setFlushInterval(TimeValue.timeValueSeconds(5)) .build(); } -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet

Re: FreeBSD 10.1 install elasticsearch plugin fails

Yes. I told you. The plugin version is 2.4.3 not 2.43 /usr/local/bin/elasticsearch-plugin install elasticsearch/elasticsearch-mapper-attachments/2.4.3 -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com

Re: FreeBSD 10.1 install elasticsearch plugin fails

The command you write is totally wrong. You set a url, you define the wrong version... And it sounds you renamed plugin script but that's not an issue. Whatever. Doc says: bin/plugin install elasticsearch/elasticsearch-mapper-attachments/2.5.0 Try bin/plugin install

Re: Master node refuse to accept its role

are unable to see each other. So the data node is now reporting that it cannot see any master nodes and its failing to start. On Wednesday, April 22, 2015 at 4:01:12 PM UTC+3, David Pilato wrote: I just ran a small test on a ec2 instance. I just set node.master: true node.data: false

Re: Users data flow

. It will go to whichever shard. You don’t really need to worry about it. Then another question might be « how many shard I will need » and the answer is it depends but I would say: try to keep it as minimal as possible. Make sense? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https

Re: Users data flow

://www.elastic.co/guide/en/elasticsearch/guide/current/scale.html http://www.elastic.co/guide/en/elasticsearch/guide/current/faking-it.html http://www.elastic.co/guide/en/elasticsearch/guide/current/faking-it.html -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet

Re: bulk index request dataloss

of filling the memory? You could also think of setting replicas to 0 before bulk and the reactivate to 1 after injection. Having SSD drives can also help but may be you have already that? My 2 cents -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet

Re: FreeBSD 10.1 install elasticsearch plugin fails

, David Pilato da...@pilato.fr wrote: The command you write is totally wrong. You set a url, you define the wrong version... And it sounds you renamed plugin script but that's not an issue. Whatever. Doc says: bin/plugin install elasticsearch/elasticsearch-mapper-attachments/2.5.0 Try bin

Re: Master node refuse to accept its role

cloud.aws.access_key: ACCESS_KEY cloud.aws.secret_key: SECRET_KEY discovery.type: ec2 node.master: true node.data: false -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https

Re: upgrade java for elasticsearch node

conservative here and don’t try to mix things. My 2 cents -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 22 avr. 2015 à 09:14, Jason Wee peich

Re: org.elasticsearch.index.mapper.MapperParsingException: failed to parse -- NEED HELP

I think you mapping expects an object for the error field but you sent a string in it. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le

Re: What web server Elasticsearch use on windows?

Elasticsearch provides its own web server so you don’t need to provide anything else than a JVM. Netty is used BTW. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https

Re: Master node refuse to accept its role

Which versions for: Elasticsearch Cloud-aws-plugin ? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 22 avr. 2015 à 12:41, Zaid Amir redserpe...@gmail.com a écrit : Hi, I am starting a new cluster and I want it to be set with two nodes. One is a data only node

Re: Analyzers in Elastic search

You could start here http://www.elastic.co/guide/en/elasticsearch/guide/current/mapping-analysis.html ? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 22 avr. 2015 à 12:58, Sharath Chandra t.sharath...@gmail.com a écrit : Hi every one, I am very new to Elastic

Re: How to diagnose slow queries every 10 minutes exactly?

really hitting the limit of what I know how to troubleshoot with ES, hence I am really hoping for help here :) On Monday, April 20, 2015 at 10:23:46 PM UTC-7, David Pilato wrote: Could you run a hot_threads API call when this happens? Anything in logs about GC? BTW 200 indices is a lot for 2

Re: No hits if fields are not stored

I’m not saying that you need to send all your data. But to send one document at least which is supposed to match. So then we can play with your script and try to fix it. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https

Re: Elasticsearch Version Upgrade

that the client won’t provide X or Y value. So he won’t try to read it. That said, the best thing to do is to test it! :D -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https

Re: No hits if fields are not stored

I don’t understand. Could you GIST a full recreation scripts which demonstrate what you are seeing? -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com

Re: No hits if fields are not stored

, content_*^2, content_ukw ] } } }' #No hits will be returned without setting the store property to true for filename and content fileds On Tuesday, April 21, 2015 at 1:59:33 PM UTC+3, David Pilato wrote: I don’t understand. Could you GIST a full recreation scripts

Re: Elasticsearch Version Upgrade

It should work fine. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 21 avr. 2015 à 14:08, Costya Regev cos...@totango.com a écrit : Hi , We have Elasticsearch Servers running with Es Version 1.4.2,our client version is 1.4.1. We are about to upgrade our Es

Re: Elasticsearch Version Upgrade

boundary, or only post 1.x? On 22/04/2015 12:03 am, David Pilato da...@pilato.fr wrote: This should work in both ways. The client knows what is the node version. The node knows what is the client version. So basically, if one knows he should not send a new data because the other one is too

Re: How to diagnose slow queries every 10 minutes exactly?

Could you run a hot_threads API call when this happens? Anything in logs about GC? BTW 200 indices is a lot for 2 nodes. And how many shards/replicas do you have? Why do you need so many indices for 2m docs? David Le 21 avr. 2015 à 01:16, Dave Reed infinit...@gmail.com a écrit : I have a

Re: Bulk Index from Remote Host

That's fine but you need to split your bulk into smaller bulk requests. Don't send a 10gb bulk in one call! :) David Le 21 avr. 2015 à 00:40, TB txind...@gmail.com a écrit : We are planning to bulk insert about 10 Gig data ,however we are being forced to do this from a remote host. Is

Re: Index Size and Replica Impact

You don't have to set replicas to 3. It depends on the number of shards you have for your index. If you are using default (5), then you probably have today something like: Node 1 : 4 shards Node 2 : 3 shards Node 3 : 3 shards Each shard should be around 600mb size (If using all defaults). What

Re: Elasticseach issue with some indicies not populating data

Having unassigned shards is perfectly fine on a one node cluster. The fact that your cluster were yellow does not mean your cluster was not behaving correctly. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com

Re: Elasticseach issue with some indicies not populating data

this output to make sure something is meant to be sent in elasticsearch: output { stdout { codec = rubydebug } elasticsearch { protocol = http host = localhost } } -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr

Re: Elasticseach issue with some indicies not populating data

From an Elasticsearch point of view, I don't see anything wrong. You have a way too much shards for sure so you might hit OOM exception or other troubles. So to answer to your question, check your Elasticsearch logs and if nothing looks wrong, check logstash. Just adding that Elasticsearch is

Re: Elasticseach issue with some indicies not populating data

Administrator 2) | O: 701-952-5925 3320 Westrac Drive South, Suite A * Fargo, ND 58103 Facebook | Youtube| Twitter | Google+ | Instagram | Linkedin | Our Guiding Principles “If it goes on a truck we got it, if it’s fun we do it” – RealTruck.com On Sun, Apr 19, 2015 at 2:38 PM, David Pilato

Re: How do element-based array query?

You need to define nested documents. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 18 avr. 2015 à 16:33, Terra Sacer terrasa...@gmail.com

Re: timestamp

You need to reindex in a new index. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 16 avr. 2015 à 17:33, Antoine Brun a...@ubiqube.com a écrit : Hello, based on the comments I could create a new index with _timestamp activated and it works great. Now my probleme

Re: how to change the store value of a field

No you need to reindex -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 16 avr. 2015 à 17:52, Antoine Brun a...@ubiqube.com a écrit : Hello, is there any simple way to update a mapping and change the store value of a field? I'm trying to enable _timestamp: curl

Re: I did download the newest version Kibana and got following error as starting

Kibana version 3 Or upgrade your Elasticsearch cluster to at least the last 1.4 version or 1.5 (better) David Le 15 avr. 2015 à 07:57, guoyiqi...@gmail.com a écrit : Hello, Folks I did download the newest version Kibana and got following error as starting: Kibana: This version of

Re: Getting error after upgrading to elasticsearch 1.5

Sounds like you are mixing versions or have incompatible plugins? David Le 15 avr. 2015 à 07:17, Prasad Lele prasad.lel...@gmail.com a écrit : HI Friends, I have upgraded my elasticsearch from 1.0 to 1.5. However now I am getting below error in logs and the app wont start. Please

Re: copy_to not working

Nothing. Elasticsearch does not modify _source field which contains the document you sent. It does create in the inverted index a new field. You can use it to query, compute or retrieve if you stored it. -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com

Re: Is there any posibility to create index/type/id/../../.. in elastic search - i mean multi level paths instead of restricting upto 3

You can't out of the box. But you could probably add a REST layer in the middle to translate what you need to Elasticsearch ? David Le 12 avr. 2015 à 15:13, margam.ravitej...@gmail.com a écrit : Hello, I have requirement where I need multi level paths like

Re: Enabling different discovery plugin

Package name is important here. Have a look at aws cloud plugin If you need code example BTW. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 10 avr. 2015 à 21:51, Vinicius Carvalho viniciusccarva...@gmail.com a écrit : Hi there, I wrote plugins before, but I'm not

Re: mapper-attachments 2.5.x not in maven repository

Sorry. I forgot to release the repository. It’s done and should be synched on Maven central soonish. Thanks for raising that! -- David Pilato - Developer | Evangelist elastic.co @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs

Re: [ANN] Deprecating Rivers

I agree James. That's a nice suggestion (warn when running deprecated code). BTW we have a lot of work in the code such as mark some Java classes as deprecated, modify docs... Things will come. IMO it's better to announce the deprecation sooner than later. That's the purpose of this blog post.

Re: Sort search results based on query parameters

(java in this case) On Tuesday, April 7, 2015 at 12:17:01 PM UTC+5:30, David Pilato wrote: You mean that Java is a mandatory term? In that case use a must clause instead of should. David Le 7 avr. 2015 à 08:03, rav...@gmail.com a écrit : Hello, I am trying to search for some

  1   2   3   4   5   6   7   8   9   10   >