Re: BigDesk: Persist the ES endpoint?

2014-01-14 Thread Lukáš Vlček
Hi, In this case I usually instruct Bigdesk about node endpoint URL via 'endpoint' URL patameter. It is documented on web or github. So you will end up using URL like the following example: http://bigdesk.org/v/2.2.0/index.html?endpoint=http://complete_path_to_your_endpointconnect=true You can

Troubleshooting search load balancer node connectivity problems

2014-01-14 Thread Jelle Smet
Hi list, I have 2 VM search load balancer nodes and 4 physical master + data nodes. The 2 search load balancer nodes get disconnected from the physical nodes very often. In the process of troubleshooting this I was wondering about following log entry: [2014-01-14

Re: Exact matches on arrays

2014-01-14 Thread joergpra...@gmail.com
Concatenate the array to a string, index it, and use simple string prefix matching. Jörg -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to

Re: unexpected behavior of pagination using offset and size

2014-01-14 Thread Alexander Reelsen
Hey, this rather sounds like a problem inside of your application, which might not be able to cope with requests coming in asynchronous? Hard to tell without more information, of how you use elasticsearch - you should verify first if elasticsearch returns the correct results, before digging

Re: Terms facet on single field but also return associated id

2014-01-14 Thread Alexander Reelsen
Hey, I am not sure I can follow your requirement. Cam you describe what you actually mean with an associated id? What is it associated with? A document? An index? If you want to get the document ids, which actually were part of a facet bucket, this is not possible with facets and you might need

Re: use doc_count in query syntax?

2014-01-14 Thread Alexander Reelsen
Hey, this sounds more like a client side issue, than it makes sense to do on the elasticsearch side. Maybe you can elaborate a bit, what you actually want to do. The doc_count itself is just a field and cannot be used to display or hide information being returned in a query (if thats what you

Re: Elasticsearch Missing Data

2014-01-14 Thread Alexander Reelsen
Hey, regarding the config file... wondering if your naming or your indentation maybe is wrong somewhere? Can you copy the config files and make sure their structure is the same? --Alex On Thu, Jan 9, 2014 at 7:01 PM, Eric Luellen eric.luel...@gmail.com wrote: Alexander, 1. The only odd

Re: search results do not match facet count where it should

2014-01-14 Thread Alexander Reelsen
Hey, just to make sure I understood your query correctly: Your phrase prefix search does not search in the skills field? This means the search for engineer goes somewhere else. Second, when you add the term filter, do you keep the query or are you simply replacing it? Not sure I got that right.

Re: Facets loading time

2014-01-14 Thread oreno
Hi Alexander, yes warmers is exactly what I'm looking into right now. Seems like a good solution, but I still have a problem there. As shown below, I have a facet_filter with changing dates, so I'm having a hard time understanding what my warmer should look like if I want all the range

Temporary disable river allocation (dynamic cluster setting?)

2014-01-14 Thread Michel Conrad
Is it possible to temporary disable river allocation? We want to separate the nodes running the rivers from the nodes holding the data, so that the nodes running the rivers can be temporary shut down or restarted without having an impact on the data nodes. After restarting the river nodes, all

Result metadata

2014-01-14 Thread Savio Teles
How can I get the metadata from a query result? In Java can be implemented like this using SQL: Statement st = connection.createStatement(); ResultSet result = st.executeQuery(sql); result.getMetaData(); -- You received this message because you are subscribed to the Google Groups

Re: Very open Elasticsearch installation

2014-01-14 Thread Nikolas Everett
On Wed, Jan 8, 2014 at 4:01 PM, Nikolas Everett nik9...@gmail.com wrote: On Wed, Jan 8, 2014 at 3:49 PM, David Pilato da...@pilato.fr wrote: I'm a bit disappointed that this search gives no result:

Re: Very open Elasticsearch installation

2014-01-14 Thread Nikolas Everett
On Tue, Jan 14, 2014 at 10:28 AM, InquiringMind brian.from...@gmail.comwrote: Hi, Nik. I seem to be getting very good results and getting them quickly. But I do notice some results like the following. Note that the query string I entered is the title of a book that a good friend (and B-24

Trouble running ElasticSearch in java test with numeric facets and multiple shards

2014-01-14 Thread Henrik Nordvik
Hi, We seem to have stumbled on some issue while running queries against a local elasticsearch node under a JUnit test. We've been able to create a small test case which demonstrates this. The necessary prerequisites for the failure: * 2 or more shards * Any of the DFS search types * A terms

Re: Exact matches on arrays

2014-01-14 Thread Justin Case
Thanks Jörg, I was hoping for an easier solution but it will do for now. Cheers. On Jan 14, 2014, at 11:08 AM, joergpra...@gmail.com wrote: Concatenate the array to a string, index it, and use simple string prefix matching. Jörg -- You received this message because you are subscribed to

Re: Java Client Connection Errors on Upgrade from 0.19.11 to 1.0.0.Beta2

2014-01-14 Thread davrob2
Hi Alexander, Yes, there was potentially an issue with JVM versions which I have address, however, I am still having issue, which I have tried to address with a more simplified configuration - based on the out of the box elasticsearch, rather than the config I've been using for the last couple

Re: Result metadata

2014-01-14 Thread Savio Teles
So, Have I to extract the Java type of each object of response? There is no way to get metadata directly? Thanks for the answer! Em terça-feira, 14 de janeiro de 2014 12h13min44s UTC-2, Savio Teles escreveu: How can I get the metadata from a query result? In Java can be implemented like

Re: Beta2 Java Client: java.nio.channels.UnresolvedAddressException

2014-01-14 Thread davrob2
Hi David, Thanks for the reply, actually this all comes down to inheriting some config that goes back 2 years, which was this: discovery: zen: initial_ping_timeout: 30 I changed this to: discovery: zen: ping_timeout: 30s all is well now, thanks. -David. On Tuesday, 14 January

Re: Result metadata

2014-01-14 Thread Savio Teles
What metadata are you looking for? Just the column type? Yes, just the column type. You can retrieve the mapping from the index [1] Ok! Tks Em terça-feira, 14 de janeiro de 2014 12h13min44s UTC-2, Savio Teles escreveu: How can I get the metadata from a query result? In Java can be

Re: Terms facet on single field but also return associated id

2014-01-14 Thread Ivan Brusic
Just to clarify, when you say there's 2 fields in the row, do you really mean that the field has two values (an array)? If so, the facet results should look like: alexander 1 great 1 viking 1 vinny 1 There is no easy way to achieve what you want. One way would be to great combined keys during

Re: exists filter

2014-01-14 Thread Ivan Brusic
You would need to combine your two filters with a bool filter: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-bool-filter.html The constant score query should be at the top level and the exists/term filters should be combined with a bool filter underneath it. The

How to approach Indexing for a newbie?

2014-01-14 Thread ZenMaster80
I have a project that used an old search engine and I would like to move things to ElasticSearch. I have been doing some reading, and I wanted some perspective on how to approach the problem. - I have bundles(folders) of text/html/pdf/img documents, each folder has an average of 50-100

Re: Cluster state yellow

2014-01-14 Thread David Pilato
Default value for minimum master node is 1. No formula here. It was just an advice. Sorry if I was unclear. :-) -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 14 janv. 2014 à 20:58, Mohit Anchlia mohitanch...@gmail.com a écrit : I didn't quite understand. What I am

Re: base64 strings and range

2014-01-14 Thread InquiringMind
Your client converts IP addresses to base64 strings before it indexes the documents, so it must also use the same conversion to a base64 string when querying the document. Ranges are a little more complicated. For example. if you simply encode 9 and 111 as strings, then you cannot perform

Re: Cluster state yellow

2014-01-14 Thread Mohit Anchlia
What's the problem we face when ES node starts up? Can you please elaborate? On Tue, Jan 14, 2014 at 12:54 PM, joergpra...@gmail.com joergpra...@gmail.com wrote: To be fair, the default minimum_master_node value is -1 (disabled). Problem is, you do not know N when an ES node starts up and

Re: base64 strings and range

2014-01-14 Thread InquiringMind
Quick typing correction: On Tuesday, January 14, 2014 4:00:58 PM UTC-5, InquiringMind wrote: Your client converts IP addresses to base64 strings before it indexes the documents, so it must also use the same conversion to a base64 string when querying the document. Ranges are a little more

Re: How to approach Indexing for a newbie?

2014-01-14 Thread joergpra...@gmail.com
1. Mostly, indexes are result of a partition design outside ES. For example, by time, user, data origin. The beauty of ES is that it can host as many indexes as you wish. 2. If your maximum number of nodes (hosts) you want to spend to ES is known, use that node number for the number of shards. So

Re: How to approach Indexing for a newbie?

2014-01-14 Thread ZenMaster80
Wow, this is exactly what I was looking for. I am a bit curious on #5, I am assuming there is a Java API to access ES, is there any link on how to get started using Java with ES? I would like to know how to import ES framework/API into java project. Thanks again, this is a great clarification!

Re: base64 strings and range

2014-01-14 Thread joergpra...@gmail.com
IPv4 can be encoded to unsigned long (32bit), where range search is available. IPv6 is harder as it is 128bit, where no Java type is available except something like BigDecimal, and no range search. Do not use base64, it is impossible for executing range queries on it. Jörg -- You received

Re: hasParentFilter not working in SearchScrollRequestBuilder in v0.90.10

2014-01-14 Thread Dan Everton
This looks similar to this bug https://github.com/elasticsearch/elasticsearch/issues/4703 thought that's with has_child filters and doesn't throw an error. I wonder if it's a related issue though? There's both curl and JUnit test cases attached there if that helps. Cheers, Dan -- You

Re: Cluster state yellow

2014-01-14 Thread InquiringMind
*Wouldn't the value increase as you add more nodes?* Indeed, it most certainly will. And with unicast discovery, each node will need to be told about the new node. Which is the perfect time to tell it about the newly calculated minimum number of masters. Brian -- You received this

Re: No hit using scan/scroll with has_parent filter

2014-01-14 Thread Martijn v Groningen
I'm a bit confused the first query with has_parent doesn't return hits, but the second does according to your gist or I'm I misreading it. I just did a little test here and has_parent and search with search_type scan seems to work correctly. On 10 January 2014 17:53, Jean-Baptiste Lièvremont

Re: Cluster state yellow

2014-01-14 Thread Mohit Anchlia
But today elasticsearch doesn't do this automatically? On Tue, Jan 14, 2014 at 2:17 PM, InquiringMind brian.from...@gmail.comwrote: *Wouldn't the value increase as you add more nodes?* Indeed, it most certainly will. And with unicast discovery, each node will need to be told about the new

Re: Cluster state yellow

2014-01-14 Thread Mark Walkom
Nope. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 15 January 2014 09:48, Mohit Anchlia mohitanch...@gmail.com wrote: But today elasticsearch doesn't do this automatically? On Tue, Jan 14, 2014 at 2:17 PM,

Re: Cluster state yellow

2014-01-14 Thread Ivan Brusic
Don't forget gateway.expected_nodes :) Wouldn't the value increase as you add more nodes? It will, which is precisely why the value is not computed automatically. The value can decrease/increase over time, but the cluster does not know if this is because it is on purpose or because of failures.

Re: Cluster state yellow

2014-01-14 Thread InquiringMind
*But today elasticsearch doesn't do this automatically?* Short answer: No. Long answer: Nooo. *:-)* For unicast discovery, you need to tell each node the full list of nodes in the cluster. As far as I can tell, that list may include the local node so

Re: How to approach Indexing for a newbie?

2014-01-14 Thread ZenMaster80
Thanks. I added the .jar as a dependency in a simple java project using eclipse. I get this error when I try to run the program, any clues? Exception in thread main java.lang.NoClassDefFoundError: org/apache/lucene/util/Version at org.elasticsearch.Version.clinit(Version.java:42) at

Adding _id to JSON instead of URL when adding doc

2014-01-14 Thread Jason Fill
I have the use case for adding the id to the json doc instead of the URL - basically the URL has to be static (so I cannot add the id each time). Other than using the Bulk creation option, is this possible via the REST API? So I want to send {_id: my-id, first_name: Jason} to

Re: How to approach Indexing for a newbie?

2014-01-14 Thread InquiringMind
*Never mind, I just had to import more jars from /lib.* You can import all jars from /*some_base_path*/lib (for example) by adding a /* to the end of the path, and then add that to the -cp / -classpathoption's value, separating multiple paths with semicolons. That single * (and *not*

Case (lower and upper) issue with TermsFacetBuilder result

2014-01-14 Thread Chetana
I am using the 'term facet' functionality of ElasticSearch 0.90.2 on a paticular field (datatype). The field (datatype) stores one of the enum values in camel case (example : sampleType). I am using a standard analyzer for index and search which internally uses lowercase filter. The strange

Re: Case (lower and upper) issue with TermsFacetBuilder result

2014-01-14 Thread Chetana
I have observed this behavior on Ubantu 11.10 version. On Wednesday, January 15, 2014 10:29:41 AM UTC+5:30, Chetana wrote: I am using the 'term facet' functionality of ElasticSearch 0.90.2 on a paticular field (datatype). The field (datatype) stores one of the enum values in camel case

Problem with float in range facet

2014-01-14 Thread Jettro Coenradie
Hi, I have a float field that I want to use in a range facet. I give one range to the facet like the following query. { query: { matchAll: {} }, facets: { imageSize: { range: { field: imageSize, ranges: [ { from: 1.9 } ]

Is multi-tanency possible in Elastic Search

2014-01-14 Thread Prasad Lele
Hi, We are planning to implement elasticsearch along with logstash. However the kind of requirement we have, we want that each customer has his own login and should be able to view only his data. Also for administration purpose would like to have user's role based access control. Can anyone

Re: Cluster state yellow

2014-01-14 Thread joergpra...@gmail.com
It's not a a matter of unicast vs. multicast or failure vs. non-failure. It's only the cluster admin who knows what the maximum number of nodes is. For ES it is impossible to find that out during runtime, and therefore, minimum_master_nodes is a user defined setting. Jörg -- You received this

Re: Bulk indexing slow down when data amount increase

2014-01-14 Thread joergpra...@gmail.com
replica = 0 reduces the indexing workload to only the required shards, no duplicate indexing occurs. Do not forget to increase replica level after bulk has completed. queue = 50 instructs a node to reject bulk requests when more than 50 bulk requests per node are active. This saves a node from

Re: Adding _id to JSON instead of URL when adding doc

2014-01-14 Thread joergpra...@gmail.com
You can send a bulk request http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/docs-bulk.html Jörg -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an