Could not initialize the shard

2014-02-19 Thread Илья Четверкин
Hey! I have a problem with one shard in my index: "7" : [ { "state" : "INITIALIZING", "primary" : true, "node" : "cphuCdBbTPKfa1hlcCLGVg", "relocating_node" : null, "shard" : 7, "index" : "vkontakte" }, {

Santizing query-strings

2014-02-19 Thread Malte Schirmacher
Hello Elasticsearch-users, are there best practices for sanitizing query strings? What i want to do is a) dont let users issue expensive queries b) hinder *some* users from searching specific fields c) internationalize field names. OK, c) isn't really sanitizing, but i think all 3 points would

Dynamically Allocate Fields in the elasticsearch query

2014-02-19 Thread soumya sengupta
I have a query query: { query_string: { query: query, fields: ["First_Name", "Last_Name"], default_operator: "AND" } } I am using AngularJS. I want the value of the "fields:" to be provided at runtime ( through a checkbox selection by the user from an html page) How should I go about it ?

Re: Unique/Distinct values from elasticsearch query

2014-02-19 Thread soumya sengupta
Thanks, that worked On Wed, Feb 19, 2014 at 5:41 PM, aash dhariya wrote: > You can set the type of the field as multi_field. For example: > > > "value" : { > "type" : "multi_field", > "fields" : { > "value" : { > "type" : "string", >

debug logs when indexing by bulks

2014-02-19 Thread Eric Lu
Hi, I'm using bulks to index billions of docs. I check the logs and I find that it keeps logging like this: [2014-02-20 00:00:01,325][DEBUG][action.bulk ] [Will o' the Wisp] [...][21] failed to execute bulk item (index) index {...} java.lang.ArrayIndexOutOfBoundsException [2014-02-

Re: Multiple Types within an Index

2014-02-19 Thread Roland Pirklbauer
Am Samstag, 5. Januar 2013 12:16:39 UTC+1 schrieb Jörg Prante: > > > Later while searching, you can direct your search client to the index > "library", and all searches to the "identifier" field will be mapped > correctly to the effective mapping of the underlying identifier field. > > > Hello,

Re: No handler found for uri

2014-02-19 Thread Sanuj S.S
Hi Bryan, Could you please give an example ? See below my index details { "_index" : "myindex", "_type" : "snapshot", "_id" : "myindex_backup", "_version" : 1, "exists" : true, "_source" : { "type": "fs", "settings": { "location": "/home/Downloads/backupdir", "c

Re: Deploy ElasticSearch 1.0 on Azure in minutes

2014-02-19 Thread David Pilato
Interesting. Could you describe what it does behind the scene? Thanks! -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 20 févr. 2014 à 03:33, Tejaswi Redkar a écrit : I have made ElasticSearch 1.0 available to be deployed to Windows Azure in the Windows Store App "Apps

Deploy ElasticSearch 1.0 on Azure in minutes

2014-02-19 Thread Tejaswi Redkar
I have made ElasticSearch 1.0 available to be deployed to Windows Azure in the Windows Store App "Apps for Azure". *http://tinyurl.com/lt4dnpp* With the trial version you should be able to deploy it for free. It's available in all the Azure datacenters now. I encour

rangeFilter execution in Java API for 1.0

2014-02-19 Thread Matthew Kehrt
Hi, I'm investigating upgrading an ES installation to 1.0 and I see that numericRangeFilter is deprecated, with the recommendation that rangeFilter with "execution": "fielddata" be used instead. However, in the Java API, RangeFilterBuilder has no "execution" method, or anything similar, and ne

Re: can't order by _boost field, even when "index":"not_analyzed"

2014-02-19 Thread Ivan Brusic
The boost field, like other special fields such as timestamp and id, is set at the root level of a type, not as a property: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/mapping-boost-field.html Perhaps I should have added this confusion as yet another reason why to avoid t

Re: How to specify execution order of filter and query?

2014-02-19 Thread Ivan Brusic
If you trace the code more, you would see that it eventually uses Lucene's LEAP_FROG_FILTER_FIRST_STRATEGY which according to the docs: "Note: This strategy uses the filter to lead the iteration.". This strategy is used when the default threshold (-1) is set and the DocIdSet (basically bits) is "fa

Re: Random scan results?

2014-02-19 Thread Adrien Grand
The issue with this workload is that it is very random I/O-intensive so I'm afraid it might behave badly when your index grows larger than the size of your filesystem cache. (This issue is not specific to Elasticsearch, any data store would suffer from this issue when trying to fetch large numbers

Re: Do I need to wrap a MissingField Filter inside a bool filter?

2014-02-19 Thread Adrien Grand
Indeed there is no need to wrap a missing filter inside of a bool filter and execution performance would be exactly the same. What you just said about filters is correct. On Wed, Feb 19, 2014 at 10:47 PM, JoeZ99 wrote: > just for the purpose of clarification. > > the "bitset" feature is equiva

Re: Delete by date range fails

2014-02-19 Thread Adrien Grand
Hi, If you manage time-based data, the most efficient way to handle deletes would be to have time-based indices. For example if your retention policy is to keep data for the last 6 months, you could use one index per month and delete the index that is 7 months old every month. Since Elasticsearch

Bug with suggest feature when you have a source field at the root of your mapping

2014-02-19 Thread Loïc Bertron
Hello guys, I was trying to play with the suggest feature and get a headache when my first basic example was working but my complexe one wasn't giving results at all. I just figured out that when you have a source field at the higher level of your mapping/document, the suggest feature doesn't

Re: Alias across tribe node clusters?

2014-02-19 Thread Nelson Jeppesen
Can anyone help me or know of a workaround? I've tried creating an alias on a tribe node and I get the following on ES1.0: curl -XPOST 'http://localhost:9200/_aliases' -d ' > { > "actions" : [ > { "add" : { "index" : "1", "alias" : "alias1" } } > ] > }' {"error":"MasterNotDiscover

Re: [hadoop] Getting elasticsearch-hadoop working with Shark

2014-02-19 Thread Costin Leau
Hi, Setting logging in Hive/Hadoop can be tricky since the log4j needs to be picked up by the running JVM otherwise you won't see anything. Take a look at this link on how to tell Hive to use your logging settings [1]. For the next release, we might introduce dedicated exceptions for the simpl

Re: [hadoop] Getting elasticsearch-hadoop working with Shark

2014-02-19 Thread Max Lang
Hey Costin, Thanks for the swift reply. I abandoned EC2 to take that out of the equation and managed to get everything working locally using the latest version of everything (though I realized just now I'm still on hive 0.9). I'm guessing you're right about some port connection issue because I

Re: Do I need to wrap a MissingField Filter inside a bool filter?

2014-02-19 Thread JoeZ99
just for the purpose of clarification. the "bitset" feature is equivalent to the "cacheable" feature. the AND/OR filters can't cache its results since they always have to compare to other docs , but if a filter can be "translated" into a bitset, then it can be "saved" for future references, and

Saved Kibana layouts fail to open later

2014-02-19 Thread BradVido
I'm using logstash-1.3.3-flatjar.jar with embedded Kibana and Elasticsearch. When I create a custom layout in Kibana and then aave it, it seems to save fine. But when I try to load it later, it fails to load. The queries are missing and only some of the filters show up. This especially seems to

Re: Querying on multiple types

2014-02-19 Thread Jinal Shah
Hi Boaz, Thanks for the information. Cheers, Jinal On Tuesday, 18 February 2014 23:34:18 UTC+11, Boaz Leskes wrote: > > Hi Jinal, > > The overhead is marginal. ES initially constructs a filter based on the > incoming types and uses that while searching. The result of that fitler iis > also cac

Re: Setting ES_MIN_MEM and ES_MAX_MEM

2014-02-19 Thread Mark Walkom
/etc/default/elasticsearch is the one you want. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 20 February 2014 03:57, wrote: > Hi guys, > I am trying to set -Xmm and -Xms when starting elasticsearch. It should be

Re: Need help in connecting to remote server to search the logs

2014-02-19 Thread Kotla Praveen
Thanks David it works fine The url to connect to the server has port 9200. My bad Thanks, Praveen K Kotla On Wed, Feb 19, 2014 at 3:30 PM, David Pilato wrote: > Change port number to 9300 > > -- > *David Pilato* | *Technical Advocate* | *Elasticsearch.com* > @dadoonet

can't order by _boost field, even when "index":"not_analyzed"

2014-02-19 Thread JoeZ99
according to martijin's remarks on https://groups.google.com/forum/#!topic/elasticsearch/A5DSgvnTnC0 and also this issue https://github.com/elasticsearch/elasticsearch/issues/3752 , search results should be sortable by _boost field. my particular setup: { "product": { "properties": {

Re: Need help in connecting to remote server to search the logs

2014-02-19 Thread David Pilato
Change port number to 9300 --  David Pilato | Technical Advocate | Elasticsearch.com @dadoonet | @elasticsearchfr Le 19 février 2014 à 19:52:53, praveen kotla (kotlaprav...@gmail.com) a écrit: Hi All, I am new to Elastic Search. I am trying to connect to the remote server and search content in

Re: Random scan results?

2014-02-19 Thread Josh Harrison
Darn ok. Thank you. If I'm retrieving large numbers of random largish (twitter river records) documents, is there a particular pattern I should use for searching? That is, does it make sense to send 20 sequential queries with size 10,000 and random sorting, or a single query with a size of 200,0

Re: Random scan results?

2014-02-19 Thread Adrien Grand
Hi Josh, In order to run efficiently, scan queries read records sequentially on disk and keep a cursor that is used to maintain state between successive pages. It would not be possible to get records in a random order as it would not be possible to read sequentially anymore. On Wed, Feb 19, 2014

Re: Zero Downtime Reindexing

2014-02-19 Thread Nikolas Everett
Here is how I do it: 1. Have index called foo_1392831890 with alias foo pointing to it 2. Create index called foo_1392841890 with new config 3. Scan/scroll everything from the foo alias into foo_1392841890. 4. Swap alias. Time has now warped backwards. 5. Run script to reindex everything tha

Random scan results?

2014-02-19 Thread Josh Harrison
I need to be able to pull 100s of thousands to millions of random documents from my indexes. Normally, to pull data this large I'd do a scan query, but they don't support sorting, so the suggestions I've seen online for randomizing your results don't work (such as those discussed here: http://s

Need help in connecting to remote server to search the logs

2014-02-19 Thread praveen kotla
Hi All, I am new to Elastic Search. I am trying to connect to the remote server and search content in one of the nodes present there. I have kept some dummy cluster name and node names. We actually have different. i tried different settings but nothing working. We have 1 cluster and 12 nodes. We

failed to setup multicast discovery on port [54328] ES can't connect to cluster.

2014-02-19 Thread Oğulcan Selcuk Akbulut
> > [2014-02-19 20:40:58,668][INFO ][node ] > [elastic_inst2] {0.90.0.Beta1}[1368]: initializing ... > [2014-02-19 20:40:58,676][INFO ][plugins ] > [elastic_inst2] loaded [], sites [] > [2014-02-19 20:41:01,402][INFO ][node ] > [elastic_i

Re: Integrate (Install) ActiveMQ river in embedded elastic search

2014-02-19 Thread David Pilato
As soon as the jar file have a es-plugin.properties file, it will be loaded by the node. Of course, you will need then to create the river itself which will require one API Call (prepareIndex). -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 19 févr. 2014 à 17:07, Doru Su

Delete by date range fails

2014-02-19 Thread Terry Healy
Hello, relatively new to ES and struggling to delete old records from an index("iron") , all of which are the same type ("email"). The idea is to purge old data that is no longer of interest. In the examples below, I'm trying to delete all the records from Septemeber of 2013. My use of ES is p

Complex data query

2014-02-19 Thread Denis Uspensky
Hello, guys! I have the following problem. I need to store 2 data structures (tables) in ES. And there should be parent/child relationship between them. Below is the index example: { "settings": { "number_of_shards": 1 }, "mappings": { "testLogs": { "_source": { "enab

Re: Migrating to new cluster

2014-02-19 Thread Tony Su
I was wondering which backup/restore method you intended to use. Snapshot/restore requires 1.0. If you intend to upgrade your 0.9.x cluster to 1.0 first, it looks like possibly a really good option (I intend to start testing snapshot/restore sometime soon. I've already created snapshots and am i

Re: [Hadoop] Any goos tut to start with ?

2014-02-19 Thread Costin Leau
Hi, We tried to make the docs friendly in this regard - each section (from Map/Reduce to Pig) has several examples. There's also a short video which guides you through the various features (with code) available here [1]. Hope this helps, [1] http://www.elasticsearch.org/videos/search-and-ana

Non flatten field path for results

2014-02-19 Thread Han JU
Hi, I found that sometimes the field path in query results are flatten, like: {'a.b': 'my_result'} In fact this happens if 'b' is the only required field under 'a'. However I need to do some post processing on query results and I hope they can be in a consistent format. So I'd like to know is

Upgrading Elasticsearch RPM 1.0.0 Removes user and group

2014-02-19 Thread Steven Williamson
Hi, Unless I am missing something obvious (and i might be) an upgrade of elasticsearch on centos removes the elasticsearch user and group previously added by the package. This of course stops elasticsearch from been able to start. Is anyone else able to reproduce this or am i just loosing the

Highlighting fields of stored nested document with _source disabled

2014-02-19 Thread Angel Cross
Hi all. I'm experiencing problems trying to highlight fields of nested document. The parent document has its _source disabled (enabled : false). Nested document and its fields has store option set to yes. And I'm trying to query and highlight it with the following request { "query": { "que

Setting ES_MIN_MEM and ES_MAX_MEM

2014-02-19 Thread pablitomusa
Hi guys, I am trying to set -Xmm and -Xms when starting elasticsearch. It should be very easy clean, however I am using debian and I am running my elasticsearch by "service" command. I could put it to work editing .../bin/elasticsearch.in.sh or .../init.d/elasticsearch. But I don't think this i

Re: Connector to Oracle to pump data to ES

2014-02-19 Thread R Donovan
Some great suggestions already, we use mule esb to feed a number feeds and data sources into ES Richard On Wednesday, July 25, 2012 8:23:51 PM UTC+1, johnny jebaraj wrote: > > Hi All, > > I am new to ES, I am looking for. > > 1) A connector that should pump my Oracle data to ES on full build.

Re: How to specify execution order of filter and query?

2014-02-19 Thread Binh Ly
Other than what Ivan Brusic already explained, there is also a difference in how the facets/aggregations are computed. In your first example, the aggregations are computed based on the results that match only the query part. In your second example, the aggregations are computed based on the res

Re: Migrating to new cluster

2014-02-19 Thread Attila Bukor
Hi Tony, Thank you for your response, reading this I'm pretty sure I'm going with Yann's suggestion to simply backup & restore. Your first point confirms that this is a good idea anyway. To answer your second point, both clusters are on the same /24 subnet, the problem is that oldcluster is not

Re: Add an extra flag in ES query to check if a field exists

2014-02-19 Thread Binh Ly
I see, looks like it's an object so you'd probably need to check down to the leaf level, like for example: doc["arranged_retweets.author_gender"].isEmpty() || doc["arranged_retweets.author_link"].isEmpty() -- You received this message because you are subscribed to the Google Groups "elasticse

Re: Migrating to new cluster

2014-02-19 Thread Attila Bukor
Hi Yann, Thank you for your response, you saved me from a *lot* of headache. So the revised flow: - Upgrade oldcluster to 1.0.0. - Implement a logger in the application which dumps all index API calls into a file. - Backup my index on oldcluster following these docs: http://www.elasticsearch.

Re: Internal geo distance calculation in Elastic Search

2014-02-19 Thread Adrien Grand
arc and sloppy_arc use the haversine formula while plane computes distances as if the earth was a plane. Although plane is the fastest option, it only has good accuracy if you are not too far from the equator and if your points are close to each other. The difference between arc and sloppy_arc is

Re: Integrate (Install) ActiveMQ river in embedded elastic search

2014-02-19 Thread Doru Sular
That's all? I don't need any ES api calls? I will try it soon, thank you very much! Doru On Wednesday, February 19, 2014 3:55:40 PM UTC+1, David Pilato wrote: > > I guess you just need to add the river jar and its dependencies in your > class path. > > If you use Maven, it should be very easy. >

Re: Very high sys cpu usage with HTTP KeepAlive

2014-02-19 Thread Tony Su
Just a thought, What do you have pre-configured in Kibana? If you have some dashboards which are pulling large amounts of data at small time intervals, it might have a big effect. Also, I've found that the webserver you use might have a large effect. I haven't tested running Kibana as a plugin

Re: Migrating to new cluster

2014-02-19 Thread Tony Su
Hi, My testing has done a little bit of what you're describing... - FWIW and I don't know why, when I re-insert the data from scratch instead of upgrading a cluster, I'm seeing substantial improvements in node general health. They seem faster, less latencies related to indexing (I assume there

Re: How to specify execution order of filter and query?

2014-02-19 Thread Ivan Hall
Also, I had another question regarding the difference between these two queries: 1) { "query": { ... }, "filter": { ... } } 2) { "filtered": { "query": { ... }, "filter": { ... } } } When I try these they both produce the same results. What is the technical

Re: Add an extra flag in ES query to check if a field exists

2014-02-19 Thread Prince
arranged_retweets do exist in the mapping. I have updated the question (http://stackoverflow.com/questions/21875375/add-an-extra-flag-in-es-query-to-check-if-a-field-exists) with the mapping On Wednesday, February 19, 2014 8:21:23 PM UTC+5:30, Binh Ly wrote: > > I'd check that the field arrange

Re: python library: search over large dataset sorted by timestamp

2014-02-19 Thread Andrew Vine
Thanks, I ended up doing repeated range queries by my timestamp field. On Wed, Feb 19, 2014 at 1:39 PM, Honza Král wrote: > Hi Andrews, > > there is a helper function that will help you with the repeated > searches (do them for you) in the helpers module (0). > > Unfortunately scroll/scan combin

Re: How to specify execution order of filter and query?

2014-02-19 Thread Ivan Hall
I think I screwed up the reply... sorry if you got multiple replies Ivan. What I said in those replies is: Looks like from the github links that a 'filter first' strategy has yet to be implemented. https://github.com/elasticsearch/elasticsearch/blob/master/src/main/java/org/elasticsearch/common

Re: Migrating to new cluster

2014-02-19 Thread Yann Barraud
Hi, If I get you well, you'll face an issue. Renaming oldcluster will make it "forget" previous indexes. (Take a look at data you'll find a dir named "oldcluster"). The step you're missing is to backup data fro oldcluster Then shtudown, rename Then restore... Or even shutdown and restore on ne

Migrating to new cluster

2014-02-19 Thread Attila Bukor
Hey everybody, I have a question regarding the migration of the indices to a new cluster seamlessly. Let me first describe the situation: I have a project which uses Elasticsearch since a few weeks ago. This is our first Elasticsearch project, and as we are satisfied with it, we decided to dedic

[Hadoop] Any goos tut to start with ?

2014-02-19 Thread Yann Barraud
Hi everyone, Do you have a good pointer to a tut to start playing with ES & Hadoop ? Using Hortonworks VM for example ? Thanks. Cheers, Yann -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving

Re: Internal geo distance calculation in Elastic Search

2014-02-19 Thread Hariharan Vadivelu
I have a related question, I know that it supports arc (better precision), sloppy_arc(faster but less precise) or plane (fastest) which one of these distance types is better if I want to show the results to the user considering driving distance between two points? On Wednesday, February 19, 2014

Re: Index Mapping/Routing Help

2014-02-19 Thread Eric Luellen
Thanks! What was throwing me off is that I'm still having the UNIX logs also write to logstash-date as well so I was seeing that information in my main dashboard. I wasn't thinking about it writing 2 different times. Thanks again. On Tuesday, February 18, 2014 4:52:38 PM UTC-5, Binh Ly wrote: >

Re: Integrate (Install) ActiveMQ river in embedded elastic search

2014-02-19 Thread David Pilato
I guess you just need to add the river jar and its dependencies in your class path. If you use Maven, it should be very easy. --  David Pilato | Technical Advocate | Elasticsearch.com @dadoonet | @elasticsearchfr Le 19 février 2014 à 13:56:11, Doru Sular (doru.su...@gmail.com) a écrit: Hello

Re: Internal geo distance calculation in Elastic Search

2014-02-19 Thread Binh Ly
If you go here: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-geo-distance-filter.html You can see the distance_type parameter which specifies the different types of calculations you can do with this filter. -- You received this message because you are subscr

Re: Add an extra flag in ES query to check if a field exists

2014-02-19 Thread Binh Ly
I'd check that the field arranged_retweets exists in your mapping. If it doesn't exist in the mapping, try to add it. After that, your query should start returning results regardless of whether the documents indexed have that field populated or not. -- You received this message because you are

Re: Very high sys cpu usage with HTTP KeepAlive

2014-02-19 Thread K.Cima
Thank you for the information. I tried both following settings in elasticsearch.yml right away. http.tcp_keep_alive: false network.tcp.keep_alive: false But, unfortunately it seemed to have no effect. The cpu usage became high again. K.Cima -- View this message in context: http://elast

Re: Facet Filter used by Kibana

2014-02-19 Thread Binh Ly
The fquery is just a syntactic extension of the query filter in case you need to define extra parameters (fquery and query filters are the same execution-wise). See details here: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-query-filter.html The difference bet

Re: [ANN] es-docs in German

2014-02-19 Thread konrad
Answering myself since I forgot to include the link in last post: 1) we were not aware of any "official" efforts to create translations of the documentation > (see e.g. [1] and some defunct doc-forks for chinese IIRC). > > [1] https://github.com/elasticsearch/elasticsearch/issues/3805 -- You r

Re: General Syntax rules - Any document specifying?

2014-02-19 Thread InquiringMind
Ah, ok! I couldn't find it in the code, but I only did a quick check. However, TimeValue and DistanceUnit are both case-sensitive. Thanks for confirming! Brian On Wednesday, February 19, 2014 8:51:17 AM UTC-5, Binh Ly wrote: > > Should be fine, it is converted to lowercase in code. :) > -- Yo

Re: Why will unicast will not work?

2014-02-19 Thread Binh Ly
Also, some networks do not support multicast. Just FYI. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this

Re: Kibana: Markers

2014-02-19 Thread Binh Ly
If you just have plain Kibana, you can Configure your histogram, under tab Queries, section Markers. Then in there you define your marker query and the field to be displayed in the marker. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To un

Re: General Syntax rules - Any document specifying?

2014-02-19 Thread Binh Ly
Should be fine, it is converted to lowercase in code. :) -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view thi

Re: default-mapping.json only on master?

2014-02-19 Thread Brian
So when done this way I can put it on the master and not all the slave nodes. THANK YOU! I knew there had to be something better than what I was doing. Plus this looks much more flexible. I saw this page before, but I didn't realize it for the entire cluster where as the default-mapping is

Re: Unassigned shards

2014-02-19 Thread Tal Shemesh
ok, i found the problem. the problematic server was in the wrong version of elasticsearch. i hope it will help others :) thanks. On Wed, Feb 19, 2014 at 2:29 PM, Itamar Syn-Hershko wrote: > There's a lot of info missing: how many servers, indexes, shards and > replicas do you have? have you ma

Re: Very high sys cpu usage with HTTP KeepAlive

2014-02-19 Thread joergpra...@gmail.com
I think you do not need a proxy. Just disable TCP keep alive in HTTP. It is enabled by default. http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-network.html http.tcp_keep_alive: false Jörg On Wed, Feb 19, 2014 at 1:38 PM, K.Cima wrote: > Hello, > > I am using

Integrate (Install) ActiveMQ river in embedded elastic search

2014-02-19 Thread Doru Sular
Hello everybody, I intend to use ActiveMQ river and elasticsearch integrated in the same JVM. In the ActiveMQ river installation guide is mention the following command bin/plugin -install domdorn/elasticsearch-river-activemq/1.0. What should I do to have the same effect from java code? I want

Very high sys cpu usage with HTTP KeepAlive

2014-02-19 Thread K.Cima
Hello, I am using ElasticSearch 1.0.0 with Kibana 3 on Solaris 11.1. My environment is as following. $ ./elasticsearch -v Version: 1.0.0, Build: a46900e/2014-02-12T16:18:34Z, JVM: 1.7.0_07 $ java -version java version "1.7.0_07" Java(TM) SE Runtime Environment (build 1.7.0_07-b10) Ja

Re: Unassigned shards

2014-02-19 Thread Itamar Syn-Hershko
There's a lot of info missing: how many servers, indexes, shards and replicas do you have? have you made sure to set all the configurations correctly (quorum size, expected number of nodes etc)? You may be experiencing a split-brain situation (if your cluster state is red) or just a temporary hicc

Unassigned shards

2014-02-19 Thread Tal Shemesh
Hi, i am using elasticsearch for a while and one morning i have noticed i have an unassigned shard. i started to play with the cluster (restart some nodes, add more nodes, try to move allocate the shards) and got some more unassigned i realized all the shards which are primary in one of the nodes

Re: Unique/Distinct values from elasticsearch query

2014-02-19 Thread aash dhariya
You can set the type of the field as multi_field. For example: "value" : { "type" : "multi_field", "fields" : { "value" : { "type" : "string", "analyzer" : "custom_ngram_analyzer" }, "value_untouched

Re: client nodes - mapper-attachment plugin

2014-02-19 Thread juanlegrand
On Wednesday, February 19, 2014 7:42:49 AM UTC+1, David Pilato wrote: > > Ah! Causing out of memory exception on node is not the best practice for > sure! :-) > That's one of the reason I would not put Tika in nodes directly. > > One of my TODO item is to move FSRiver to logstash. So extracting c

Re: Facet Filter used by Kibana

2014-02-19 Thread Telvis Calhoun Jr.
Sorry. fixed the links. https://gist.github.com/telvis07/9090254#file-kibana-filtered-query-json - Is a query sent by kibana when I typed a search entry. It uses a fquery as the facet_filter. https://gist.github.com/telvis07/9090254#file-my-query-json - This a query I'm using in my app that use

Facet Filter used by Kibana

2014-02-19 Thread Telvis Calhoun Jr.
https://gist.github.com/telvis07/9090254 - Is a query sent by kibana when I typed a search entry. It uses a fquery as the facet_filter. https://gist.github.com/telvis07/9090254 - This a query I'm using in my app that uses a QueryFilter as the facet_filter. What is the advantage of using an fquer

Re: python library: search over large dataset sorted by timestamp

2014-02-19 Thread Honza Král
Hi Andrews, there is a helper function that will help you with the repeated searches (do them for you) in the helpers module (0). Unfortunately scroll/scan combination doesn't support sorting since it would be very expensive to do. If you need the results sorted you have to use normal search meth

Re: Unique/Distinct values from elasticsearch query

2014-02-19 Thread soumya sengupta
I have got an ngram-analyzer for the field which is preventing me from using facets. What options do I have ? On Wednesday, February 19, 2014 4:36:13 PM UTC+5:30, geeky_sh wrote: > > You could use facet query to get all the unique values for a particular > field. Though you will get the counts t

Re: Network outage keeps split brain status (no recovery by ES) (was issue #5144)

2014-02-19 Thread Robert Stupp
The idea to have three "node groups" (each with one master + N data nodes) sounds good. In this situation quorum will work fine. Combinded with a "read-only" instead of "inoperable" behaviour it would be great. It is not ideal but I think I can convince the ops team to add a third group to the

Re: Unique/Distinct values from elasticsearch query

2014-02-19 Thread aash dhariya
You could use facet query to get all the unique values for a particular field. Though you will get the counts too. On Wed, Feb 19, 2014 at 3:21 PM, soumya sengupta wrote: > How to get unique or distinct values from elastic search query ? > I want to get all the unique vales and not their total c

Re: [ANN] es-docs in German

2014-02-19 Thread konrad
Hi Jörg, thanks for your response! Well done, spotting a patching leftover on first glance I hope this is fixed now. About becoming an "official" translation: We have not thought about that so far. Since... 1) we were not aware of any "official" efforts to create translations of the documenta

Re: Zero Downtime Reindexing

2014-02-19 Thread joergpra...@gmail.com
Zero downtime works by using the atomic switch in the index alias setting. Here is an example, which also allows to decommission nodes for maintenance. 1. your index I1 with data is distributed on node (groups) N1 and N2 2. create an alias A for I1 3. direct your search API to alias A 4. create a

Add an extra flag in ES query to check if a field exists

2014-02-19 Thread Prince
Hi all, Please see this http://stackoverflow.com/questions/21875375/add-an-extra-flag-in-es-query-to-check-if-a-field-exists -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, se

python library: search over large dataset sorted by timestamp

2014-02-19 Thread Andrew Vine
Hi all, I would like to read over all the docs for an index in timestamp order. Does anyone have a suggestion as to what would be the best way to do this using the python client? At the moment I'm using the search function provided

Unique/Distinct values from elasticsearch query

2014-02-19 Thread soumya sengupta
How to get unique or distinct values from elastic search query ? I want to get all the unique vales and not their total count. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, sen

Internal geo distance calculation in Elastic Search

2014-02-19 Thread Mohit Golchha
Hi all, I am new to this group and new to Elastic Search as well. I had been using geo location facilities of Elastic Search and I wondered how internally does the Elastic Search calculates distances between two points on earth. I heard about great circle distance which calculates d

Re: Why will unicast will not work?

2014-02-19 Thread David Montgomery
sorry. I changed to port 9300. It worked! Yeay. Multicast did not work though. Now life is good:) On Wed, Feb 19, 2014 at 4:41 PM, David Montgomery wrote: > Why will unicast will not work? > > > discovery.zen.ping.multicast.enabled: false > discovery.zen.ping.unicast.hosts: > ["198.199.94

Why will unicast will not work?

2014-02-19 Thread David Montgomery
Why will unicast will not work? discovery.zen.ping.multicast.enabled: false discovery.zen.ping.unicast.hosts: ["198.199.94.xxx:9200","192.241.198.yyy:9200"] Both nodes have been restarted. Both have the same config file. Both can telent into each other. Yet I get the below. I am using versi

Can we configure backup and restore functionality throught yml file in the new 1.0 release ? i

2014-02-19 Thread Amulya Varshney
-- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com

Re: Elasticsearch 1.0.0 is now GA

2014-02-19 Thread Norberto Meijome
Agreed is bad form to force reinstall.but surely you would have your yml in a code/cfg repository? On 18/02/2014 9:14 AM, "Tony Su" wrote: > What?! > > Removing and re-installing the ES package either removes the original or > the existing elasticsearch.yml > > The is contrary to conventiona