Delete Elasticsearch

I tried upgrading elasticsearch to 1.2 yesterday and it broke most of my scripts, even after trying adjustments listed in the documentation. I think there were problems with the update and I would like to completely remove it from my system and then do a fresh install. How can I do this in

Re: Delete Elasticsearch

rm -r data should help I guess -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 11 juin 2014 à 08:31, John sok...@gmail.com a écrit : I tried upgrading elasticsearch to 1.2 yesterday and it broke most of my scripts, even after trying adjustments listed in the

Re: Forcing sync of replicas

Hi Michael, The fix option of check_on_startup checks indices and removes the *segments* that are corrupted, this is a lucene level operation and is primarily meant to be used in extreme cases where you only had one copy of shards and those got corrupted. In your cases, since the primaries

Elasticsearch 1.2 Delete and Reinstall

I recently upgraded to elasticsearch 1.2.1 and have since seen most of my scripts stop working. Nothing seems to work properly and I think I may have messed up during the upgrade. How can I properly delete elasticsearch and all associated data so I can reinstall it from scratch (all data,

Re: Using Jetty plugin

Hi, do you want to restrict access to the physical location (e.g. /opt/elasticsearch/data/elasticsearch/0/indices/index-name) or do you want to restrict access to some type of logs? For the 2nd option you could look at this thread

Re: Creating a browse interface from ES

Welcome to the show :) I also build library catalog on Elasticsearch professionally. Some time ago I wrote a Perl Dancer starter app just to show how very basic features like a hit list and facets are look like. https://github.com/jprante/Elasticsearch-Dancer-App The browsing UI you mean is a

Re: 1.2.0 routing issue and explicit routing

On Tue, Jun 10, 2014 at 11:44 PM, Ralph Meijer ral...@ik.nu wrote: * Does using explicit routing (in this cased defined in mapping to use a customer id field) have the same routing issue? Yes. The issue is on the hashing function, so it occurs when using explicit routing as well. * Does

Re: elasticsearch: simple cluster. Can't change nodes. Please, help.

Thanks for answering me. But all works now! I made all necessary operations very slowly and carefully with full restart of servers. And all work properly. I am really don't understand what the matter was. Maybe I should to restart some service or process besides elasticsearch service to make

Mapping between 2 Indexed documents; Parent/Child

I have this relations between these objects : An account contains many categories, each categories contains many emails, each email has many attachment I'm trying to index all these objects in order to make a multicriteria search engine; bidirectionnel search. Example: I'm able to search for

Re: Upgrade to 1.2.1 routing fix tool gives stack trace.

I don't think this issue is known, would you have the server-side logs as well? It would help me to see the stack trace for this NullPointerException. On Tue, Jun 10, 2014 at 4:21 PM, Luke Wilson-Mawer lukewilsonma...@gmail.com wrote: I am getting a stack trace when I run the routing fix tool

Re: elasticsearch memory usage

Hi, I'm a beginner in elasticsearch. I'm using also ubuntu for elasticsearch(version 1.1.0). My issue : where should I set the ES_MIN/MAX_SIZE(= ES_HEAP_SIZE)? In /etc/elasticsearch/elasticsearch.yml or /etc/default/elasticsearch or /etc/init.d/elasticsearch? From what i read i should set

Re: elasticsearch memory usage

For ubuntu put it in /etc/default/elasticsearch. Try that and then see if the command uses the right values (it should). You will get better performance and stability from Oracle java if you can install it. It's also a good idea to start your own thread rather than post in old ones :) Regards,

Urgent

Bonjour, Je viens de travailler sur elasticsearch, j'ai récupéré les données à partir d'une base de données postgresql mais j'arrive pas de faire la suppression et la mise à jour des données avec elasticsearch. Vous avez une idée svp ? Merci d'avance. Cordialement. -- You received this

Re: Urgent

Have you tried the schedule setting in JDBC river plugin? https://github.com/jprante/elasticsearch-river-jdbc#time-scheduled-execution-of-jdbc-river You can also try the feeder mode of the JDBC plugin, combined with cronjob from your crontab. Best, Jörg 2014-06-11 11:27 GMT+02:00 Sekrafi

Re: ElasticSearch Memory settings

As per my other response - /etc/default/elasticsearch for ubuntu/debian Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 11 June 2014 19:22, Ciprian turcancipria...@gmail.com wrote: Hi, I'm a beginner in

Re: Forcing sync of replicas

Thanks, I didn't think of moving the shards. Should have been faster as well. On Wednesday, 11 June 2014 09:03:44 UTC+2, Boaz Leskes wrote: Hi Michael, The fix option of check_on_startup checks indices and removes the *segments* that are corrupted, this is a lucene level operation and is

Re: Urgent

Merci pour votre réponse Jorg Prante. Oui je l'ai essayé mais ça n'a pas marché ! voila qu'est ce que j'ai mis . curl -XPUT 'localhost:9200/_river/dossiersexemp/_meta' -d ' { type : jdbc, jdbc : { index : i_dossiersexemp, type : t_dossiersexemp,

Aggregation equivalent of Facet global : true ?

Is there a way of specifying the scope of an aggregation (if there is I cant seem to find it)? I want to achieve the equivalent of a Facet global : true. Do I need to use facets instead of aggregations in this case? I am just doing term aggregations - to give the user a dropdown list to

Re: Mismatch versions ES AWS Plugin?

Having the same issue here. Installed 2.1.1 on CentOS via RPM following this guide: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/setup-repositories.html Then this: http://www.elasticsearch.org/tutorials/elasticsearch-on-ec2/ Using: bin/plugin -install

Re: Aggregation equivalent of Facet global : true ?

You can do this by running a `global` aggregation: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-bucket-global-aggregation.html On Wed, Jun 11, 2014 at 12:02 PM, mooky nick.minute...@gmail.com wrote: Is there a way of specifying the scope of an

Re: Aggregation equivalent of Facet global : true ?

Aha. I missed that. Many thanks. On Wednesday, 11 June 2014 11:23:57 UTC+1, Adrien Grand wrote: You can do this by running a `global` aggregation: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-bucket-global-aggregation.html On Wed, Jun 11, 2014

3 nodes cluster arhitecture

Hi! My application is reading data from a Sqs and pushing it to elasticseach. This is done from 2 consumers each with a thread pool of 5 threads. That means 10 threads who are inserting/deleting documents in elasticsearch. From other web application the inserted data is read. I want to

Re: 3 nodes cluster arhitecture

For that size just make them all data+master nodes. You really want n/2+1 masters, where n = number of nodes, so that you prevent split-brain from occurring, and having all 3 as master will provide that. Just set ES_HEAP_SIZE in the defaults, you don't need to worry about anything else. Regards,

Re: Data migration from solr to elasticsearch

hi, Please help me to migrate solr to elastic search in broadleaf .. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to

JSON string Mapping in elasticsearch

Hi We are in development phase and using one master and two data node setup. I am using elasticserch to save application log in JSON format. So that we could easily create mapping on all josn filed . *Our Log format is very simple JSON string .* *{* *timestamp :,*

Re: Best cluster environment for search

I have just created a issue: https://github.com/elasticsearch/elasticsearch/issues/6463 Regards. Em quinta-feira, 5 de junho de 2014 20h02min05s UTC-3, Mark Walkom escreveu: This would probably be worth raising as a github issue - https://github.com/elasticsearch/ Regards, Mark Walkom

deduplicating using nested query

I have a simple problem where it would be useful to a query like: get me everything that matches query1 except if field foo is in results of query2. The simple solution is to first do query2, fetch the foo field for all the results (potentially thousands), stuff it in some hash and generate a

Re: Urgent

Hi Sekrafi, Please follow some guidelines about this forum: - Use a good title for your thread. Urgent does not mean anything. JDBC river is not removing documents could be better. - Speak english. If you need to speak french, look at the FR ML: 

search by multiple aggregated fields, elastic 1.1

Hi, I'm a little bit newbie on this technology, so I was wondering if it's posible to order for more than one aggregated fields. this is my query: GET my_stats/stats/_search { size : 0, query : { filtered : { query : { match_all : { } }, filter : {

Phrase suggester not delivering any results

I've been trying to get the phrase suggester up and running, but something is wrong. I don't get any results. The search query looks like this: { suggest: { text: schoko, simple_phrase: { phrase: { analyzer: simple, field: title, size: 4,

Re: deduplicating using nested query

Don't know for sure, but did you try using a filter query ? http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-query-filter.html On Wednesday, June 11, 2014 9:52:20 AM UTC-3, Jilles van Gurp wrote: I have a simple problem where it would be useful to a query like:

Re: Sub-aggregations: percentiles of sum

Pretty, pretty, pretty please? ;) I'd also be interested in something like this, so I can do percentiles based on documents count aggregation, for example, without having to reparse/reindex everything. On Wednesday, June 11, 2014 12:01:56 PM UTC-3, Adrien Grand wrote: Hi, This is a

Re: Best cluster environment for search

On Thursday, 5 June 2014 00:54:15 UTC+2, Jörg Prante wrote: Why do you use terms on _id field and not the the ids filter? ids filter is more efficient since it reuses the _uid field which is cached by default. So does the terms filter. The only advantage of the _ids filter is that you

Performance as a sql result cache

Hi, I'm assessing ES as a tool to help with a specific problem. We have some expensive sql to run against a database that takes 300ms. there are 1000 or so rows, so we need to page over these results. I though ES would be a perfect tool to do this, but the results I've seen, while being

Re: Performance as a sql result cache

You should run your search query more than just once. The first time executed, ES will load the Lucene index fields, and ramp up internal resources, which adds some overhead. Subsequent queries will be faster (around 1ms on my MacBook Pro with SSD but SSD is not important, it is the filesystem

Re: Performance as a sql result cache

I was - but only about 20 times. I'll go back and have another look. Thanks. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to

Re: Performance as a sql result cache

ISWYM - down to 6ms now. Thanks again. On Wednesday, 11 June 2014 17:30:11 UTC+1, Dean Pehrsson-Chapman wrote: I was - but only about 20 times. I'll go back and have another look. Thanks. -- You received this message because you are subscribed to the Google Groups elasticsearch group.

Re: Elasticsearch 1.2 Delete and Reinstall

Regarding your problem, are you perhaps running into the fact that dynamic scripts are now disabled by default since 1.2? http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-scripting.html#_enabling_dynamic_scripting In terms of deleting the existing version, it all

Slow search perfomance when using mmap versus memory.

Our servers have 130 GB of RAM and we are giving ElasticSearch 30GB of heap. Each machine contains one shard that is about 3GB with about 1.3 million documents. When we search using a match query and the memory store type, the queries are about twice as fast as when we use mmap (with mlockall

After upgrade to elastic search 1.2.1 getting org.elasticsearch.transport.RemoteTransportException: Failed to deserialize response of type [org.elasticsearch.action.admin.cluster.node.info.NodesInfoRe

Hi We have upgraded our cluster to elastic search 1.2.1 from 0.90.1, its running using java 1.7.0.60 We upgraded clients to use 1.2.1 java library and when running it on a differnt box which has same java 1.7.0.60 I get this exception: 11 Jun 2014 00:38:54,979 INFO [elasticsearch[MN-E

Re: How to map a dynamic map of key values?

Thanks. I was also looking at dynamic mapping templates (http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/mapping-root-object-type.html#_dynamic_templates) too. Would that approach work if I were to flatten my JSON so it'd be more like: { name: john, age: 25,

Re: Facets aren't working

I'm getting results but facets aren't working Can you specify in a bit more detail how facet's aren't working (i.e. what do you want to achieve, what is expected, etc)? Since you base your code on the provided Rails templates, the code should be easily translatable to your use case.

Re: Sub-aggregations: percentiles of sum

Adrien, I am looking forward to this feature and you will manage it quite fast :-) Again, thank you for an answer. You save my time. W dniu wtorek, 10 czerwca 2014 11:33:26 UTC+2 użytkownik Marek Skorek napisał: Hi, I have a question about subaggregations. The case is that I have

Re: After upgrade to elastic search 1.2.1 getting org.elasticsearch.transport.RemoteTransportException: Failed to deserialize response of type [org.elasticsearch.action.admin.cluster.node.info.NodesIn

Adding client.transport.sniffto true in the client seems to work, not sure why I need it now when upgrading to 1.2.1. Thanks -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send

How to index millions of documents using c#?

Hi All, I am looking for a easy way to index millions of document thro my c# console application. The data have been from SQL Server. I know that River is going to be soon deprecated. What is the best way to achieve this? Currently i am using Nest dll, for indexing the documents. I am

Query Result Caching in Elasticsearch similar to SOLR

Is there a way to mimic the Query Result Caching http://wiki.apache.org/solr/SolrCaching#queryResultCache in Elasticsearch? Solr stores the list of documentIDs for a given Query and returns that after the first request. This is similar to IIS Output Cache. The other option is to have a Cache

Re: Slow search perfomance when using mmap versus memory.

Can you share your setup configuration, and an example document and a query? So it is possible to recreate your situation? Also interesting would be OS version, ES version, Java JVM version. Thanks, Jörg On Wed, Jun 11, 2014 at 6:44 PM, MikeP michael...@gmail.com wrote: Our servers have 130

Re: Slow search perfomance when using mmap versus memory.

N.B. of course, also the response times you measured and how you measuring them are of interest. In my tests with ES 1.2.1 and JDK 8u5 on Mac OS X, with a test index of 1.5 mio docs, I see search times of around 1-5ms on mmapfs for random match queries (except the first query after the node

Re: Facets aren't working

Hi Karel, Thanks for replying. What I mean by facets aren't working, that I can't to filter my results. When I submit query I see in my log next : curl -X GET 'http://localhost:9200/companies/company/_search?pretty' -d

Re: Query Result Caching in Elasticsearch similar to SOLR

In Elasticsearch you use filters in queries where the results are cached. More info: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/index-modules-cache.html Jörg On Wed, Jun 11, 2014 at 10:00 PM, sai...@roblox.com wrote: Is there a way to mimic the Query Result Caching

Re: Facets aren't working

Ivan, I think I reply to author instead to all. Sorry On Wednesday, June 11, 2014 3:40:41 PM UTC-6, Ivan Brusic wrote: Can you provide an example where you apply a filter? Keep in mind that if you are using the post filter (the 'filter' in your example), then the facets will not be affected

Re: Slow search perfomance when using mmap versus memory.

Hi Jörg, I'm using ES 1.1.1, JDK7u55, RHEL5. Our documents contains only integers between 0-1,000,000. Our query is a bit unusual as it is basically a match query that only contains ORs and there could be up to 1,000 clauses. For example: {query: { match:{ num_field:{ query:1 2 3

unable to load all stored fields

Hey all, I'm hoping this is just a simple configuration error. I recently upgraded to 1.2.1 and now I am unable to load all stored fields in a query. Using either the Java API or the head plugin, when I send the following query: curl -XGET 'http://localhost:9200/_search' { from: 0,

Re: How to use elasticsearch graphical reports in asp.net

If you mean Kibana dashboards, take a look here this might be of help: https://github.com/synhershko/RavenDB.ElasticsearchReplication/tree/master/Kibana.Host -- Itamar Syn-Hershko http://code972.com | @synhershko https://twitter.com/synhershko Freelance Developer Consultant Author of RavenDB in

Can Native scripts do search while Calculating ?

For starts I've never write a script on ElasticSearch, but I'm interested in knowing if I can write a script that, when run, will do a search on then ElasticSearch cluster. This search would be based on the fields of the doc on which the script would be running. I can imagine that it would have

Need to change 9300 port to connect

Hi, I want to deploy ES on a server which already has another application using 9300 port. When I start ES, it automatically select next free port like 9302 which is expected. Problem is that I am unable to connect to ES cluster even if I specify 9302 port in transport client, log shows that

Custom IdsFilter interface for filtered queries

Hi, We are currently using Lucene and are exploring Elasticsearch for scaling. We have a requirement to filter queries based on doc id and the set of docs to be filtered can be quite large e.g. out of a corpus of 10 million documents, user can choose a set of 5 million and run a query

Replica node

Hi, Is it possible to configure the ES so that a single node will always get the replica shards assigned? When I was in a single-node configuration I just upped the number of replicas for every index to 1 and brought a data-only node to the cluster and of course the replicas all got created on

Re: Replica node

You can force it using this sort of process - http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/index-modules-allocation.html Though unless you have a good reason, it's best to just let ES do it's own thing. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor

Re: Need to change 9300 port to connect

I disabled multicast and enabled unicast with right host and port mapping and that helped me to connect. Let me know if there is any other better alternative. Thanks, Ashish On Thursday, 12 June 2014 09:52:47 UTC+5:30, Ashish Raniwala wrote: Hi, I want to deploy ES on a server which

Re: Elasticsearch 1.2 Delete and Reinstall

I tried deleting the directories an reinstalling but somehow it keeps loading in my old environment even when I try to rm -rf the directories after shutting down the server? Where is elasticsearch hiding these files? On Wed, Jun 11, 2014 at 7:41 PM, Ivan Brusic i...@brusic.com wrote: Regarding

Re: cassandra river plugin installation issue

Is the Hector API issue fixed? I have setup the ebay/cassandra river and it shows 2 documents inside. However I cannot search them. I get an timed out exception. I suspect this is again from Hector API because of the H before timedoutexception.