Re: How to include lucene jar files in the pom.xml

Only add elasticsearch as a dependency and Lucene jars will be added. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 28 févr. 2014 à 08:25, Niranjan Kumar a écrit : Hi All, I am creating a spring maven project and need to include the jar files of lucene. What should be

How to include lucene jar files in the pom.xml

Hi All, I am creating a spring maven project and need to include the jar files of lucene. What should be my dependency of lucene in the pom.xml file so that lucene jar files are included in my project. Thanks&Regards Niranjan Kumar -- You received this message because you are subscribed to th

Re: Automatically deleting logs.

I think you are looking for this: https://github.com/elasticsearch/elasticsearch/issues/2114 By now, you have to manage it yourself. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 28 févr. 2014 à 07:35, san a écrit : When the storage of Elasticsearch is full, i want to

Re: Potential leak when ES embedded in Tomcat webapp?

Undeploying the webapp is not enough. Sadly IIRC due to a very old issue in Guava, all threads are not stopped. So you have to restart the container. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 28 févr. 2014 à 05:00, "amit.soni" a écrit : Actually I have been seeing e

Automatically deleting logs.

When the storage of Elasticsearch is full, i want to get the oldest logs automatically deleted to accommodate new logs. Could someone help me in achieving this? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group an

Re: Potential leak when ES embedded in Tomcat webapp?

Actually I have been seeing error as well. Unfortunately, it is quite intermittent and hence tough to reproduce it. On Tuesday, August 2, 2011 1:30:51 AM UTC-7, kimchy wrote: > > Or even if you can recreate it with a plain Main? If not, and you can > recreate it with a way, its fine as well. > >

Re: modify index after creation

Thank you Brian :) On Thu, Feb 27, 2014 at 9:32 PM, InquiringMind wrote: > Giovanni, > > This list isn't exhaustive, but... the most useful index-level settings > that can be modified for an existing index are refresh interval and number > of replicas. > > You may add character filters, tokenize

Is there a way to know the space (disk/memory) used per field in an index?

In an index multiple fields are indexed. Is there a way to know the amount of space (disk/memory) that is taken up on a per field basis? Also, space (disk/memory) that is used for "nested" docs and their indexes. Thanks Ash -- You received this message because you are subscribed to the Google

Re: the appropriate memory settings for elasticsearch-1.0.0

50% of total system memory is standard. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 28 February 2014 13:15, 沈国权 wrote: > Dear all: > I'm a newer to elasticsearch. Now I will to develop a application > wit

the appropriate memory settings for elasticsearch-1.0.0

Dear all: I'm a newer to elasticsearch. Now I will to develop a application with the elasticsearch included. There is a question confused me. That's the memory settings. I will use the elasticsearch-1.0.0 for my application. there are tow settings that ES_MIN_MEM and ES_MAX_MEM I don't know

[Pls]how to use doc to update json object, There is some exception

I use update to update json object, this is some wrong.Please help me. 1,I insert a log to es. curl -XPOST 'localhost:9200/12/1/3/_update' -d '{"doc":{"price":[{"costprice":1,"icsonprice":1,"name":"1123","pid":1,"pricetype":1,"purchaseprice":1,"shipmentprice":1}],"product":{"status":2330,"type"

Re: Help Understanding custom_filters_score Error

Hi Chris, Thanks for getting back to me. Originally had trouble getting your example to work, but after reading your statement; "the correct solution is that 'filters' and 'query' must be at the same level" I realised your example didn’t have them at the same level, oops! Once I sorted

Re: elasticsearch performance issue with load increasing reponse time is increasing

Here is the query's i am using first query returns the parent instance id's based on those parent instance is trigirreng the second query. SearchResponse response = elasticClient.prepareSearch("ibdataindex").setTypes("coveredibsa").setQuery(QueryBuilders.termsQuery("SERIAL_NUMBER", serialNo)

Re: terms facet/agg not working for nested types in 1.x

That worked! After further review, I did in fact have that in my 0.90.7 config, but it got lost in translation to my 1.0.1 config. MANY THANKS!! On Thursday, February 27, 2014 6:03:59 PM UTC-5, Binh Ly wrote: > > Try: > > { >"_default_": { > "properties": { > "foo": { >

Re: terms facet/agg not working for nested types in 1.x

Try: { "_default_": { "properties": { "foo": { "type": "nested", *"include_in_parent": true,* "properties": { "bar": { "index": "analyzed", "type": "string" } }

Re: Global highlighting settings not available in the Java API?

Thanks for your confirmation! I've opened a ticket: https://github.com/elasticsearch/elasticsearch/issues/5281 On Thursday, February 27, 2014 5:41:43 PM UTC-5, Binh Ly wrote: > > I took a closer look and indeed you are correct, the REST API actually has > some logic in there to trickle it down t

terms facet/agg not working for nested types in 1.x

I'm running Elasticsearch 1.0.1 with 1 node, 1 shard, 0 replicas for this test. My $ES_HOME/config/default-mapping.json is the following: { "_default_": { "properties": { "foo": { "type": "nested", "properties": { "bar": {

Re: Single thread with high CPU usage

Hi Nik, Thanks, that was spot on! Clearing the field cache immediately caused a drop in cpu usage to normal. If I understand the documenation correctly the field cache size is unbounded per default, so I'll look into setting a limit. It seems you can't set the field cache size limit using the c

Re: Global highlighting settings not available in the Java API?

I took a closer look and indeed you are correct, the REST API actually has some logic in there to trickle it down to the fields level (which I didn't expect). Can you please open a ticket? In the meantime, I'd probably just fall back to .setSource() if absolutely needed. Thanks! -- You receiv

Re: Human-readable output option needs some additions

Hi Brian, Those are good suggestions. I've filed them as https://github.com/elasticsearch/elasticsearch/issues/5280. Thanks! Sean On Thursday, February 27, 2014 3:47:34 PM UTC-5, InquiringMind wrote: > > Adding the human=true parameter is useful, but it only seems to be > applied to the byte

Re: Global highlighting settings not available in the Java API?

Yeah I tried that too: Map options = new HashMap(); options.put("fragment_size", 0); options.put("number_of_fragments", 0); searchRequestBuilder.setHighlighterOptions(options); but the query ends up looking like this: "highlight" : { "options" : { "number_of_fragments" : 0, "fra

Re: Global highlighting settings not available in the Java API?

Just a quick untested look at the code, but you might want to try: SearchRequestBuilder.setHighlighterOptions(options); -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an e

Re: Percolate Query Scoring and Fields

Binh, I was afraid of that. That lines up with all the information I've seen in the documentation. I was just hoping there was something I was missing. I've already done what you've suggested for fetching the fields. I guess I could attempt to score the results myself.

Re: Percolate Query Scoring and Fields

Unfortunately neither is possible at the moment. The score part that you ask is interesting in which I could see some interesting applications. For the second one, you'll probably just need to do an _mget or second search to retrieve extra metadata from the percolator queries. There is a scoring

Re: Multi-tenant Search

Hi Noor, In a multiple-index search, all indices are weighted equally for scoring purposes. You shouldn't see any difference in importance between any of your tenants' indices. Thanks, Sean On Thursday, February 27, 2014 9:14:26 AM UTC-5, Noor wrote: > > I have a multi-tenant application wher

Re: indexing binary

When you do a search, it will return your full _source document by default. If you supplied a value for the text field at index time, then the text field is included in the returned _source. If you supply some other field at index time, then that field will also be returned from the _source. The

Re: Logstash and Elastisearch doesn't communicate

Logstash 1.4 is due for release soon, and will include support for Elasticsearch 1.0.x. On Thursday, February 27, 2014 1:16:37 PM UTC-5, Sean Clemmer wrote: > > Logstash 1.3.3 is meant to work with Elasticsearch 0.90.9. See "VERSION > NOTE" in http://logstash.net/docs/1.3.3/outputs/elasticsearch

Re: Logstash and Elastisearch doesn't communicate

You're better off using the elasticsearch_http output. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 28 February 2014 05:16, Sean Clemmer wrote: > Logstash 1.3.3 is meant to work with Elasticsearch 0.90.9. See "V

Re: Global highlighting settings not available in the Java API?

The link to the corresponding documentation for version 0.90.XX is here: http://www.elasticsearch.org/guide/en/elasticsearch/reference/0.90/search-request-highlighting.html#highlighting-settings I was thinking that perhaps 0.90 did not include them, but they are also listed in that version docum

Human-readable output option needs some additions

Adding the human=true parameter is useful, but it only seems to be applied to the byte counts. For example, when looking at my local MacBook's running instance, and isolating just the process and Java information, the "heap_init" : "256mb" is added to reflect the "heap_init_in_bytes" : 268435456

Global highlighting settings not available in the Java API?

I'm trying to set the global highlighting settings through the Java API for "fragment_size" and "number_of_fragments" as documented here: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-highlighting.html#highlighting-settings I don't see anything in SearchReq

Percolate Query Scoring and Fields

Is it possible to have a percolate query return a score for how well each percolate query matches the document and return extra fields from the percolate query as part of the results? Given the percolate query below: { "query" : { "match" : { "query" : "blue" } }, "other_field" : "test" } and t

Re: modify index after creation

Giovanni, This list isn't exhaustive, but... the most useful index-level settings that can be modified for an existing index are refresh interval and number of replicas. You may add character filters, tokenizers, and analyzers to an existing index. You may add new fields but in general cannot

modify index after creation

Hello. A simple question, only to be secure of what I found on the web: is it possible to modify an index after creation? If true, what kind of modification is supported? Thank you Giovanni -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. T

Re: indexing binary

Sorry for the confusion - I do want PDFs, but I am concerned with the retrieval of the image file when it ocr text is searched. I must be missing something. As showing below, I provide two fields "text" and the "content". In your second post you say I don't need the "content' field for images? S

Re: es 1.0.1 network.host

Hi, I've just run a few tests with 1.0.1 and 0.90.12, and in both cases if I set network.host in elasticsearch.yml and restart the service, the transport_address and http_address are updated to match the new address. Could you post your complete elasticsearch.yml? That might help give an idea

Re: APT repositories available?

Thank you, that's it.That was a consequence of my (apparently wrong) chef config. On Wednesday, February 26, 2014 6:40:58 PM UTC-8, Mark Walkom wrote: > > I think you have it incorrectly; > deb http://packages.elasticsearch.org/elasticsearch/1.0/debian stable main > > Not; > deb http://packag

Re: indexing binary

Binh, Thanks, With your help I think I am closer to the answer. Wih the sample mapping you provided, I should be able to provide the base 64 contents of the image file as the "contents" field, and the ocrtext as "text field. So, when the ocr text is searched, i can return the "content" which is

Re: Logstash and Elastisearch doesn't communicate

Logstash 1.3.3 is meant to work with Elasticsearch 0.90.9. See "VERSION NOTE" in http://logstash.net/docs/1.3.3/outputs/elasticsearch On Thu, Feb 27, 2014 at 8:47 AM, Héctor Moreno Blanco < hector.moreno.bla...@gmail.com> wrote: > Helloy everyone, > > I have installed elasticsearch-1.0.1-1.noarc

Re: indexing binary

Oh, the attachment part is for your PDF. If you don't need to index PDFs then just remove that part: PutMappingResponse putMappingResponse = new PutMappingRequestBuilder( client.admin().indices()). setIndices(INDEX_NAME).setType(DOCUMENT_TYPE).setSource( XCont

Re: indexing binary

Thanks, it sounds like you are treating it as an attachment, In your example, what is the "fileContents" in .field("content", fileContents) ? How do I get file contents of an image, I know in the case of the pdf, this is content text of the pdf. Correct, I don't want to index the image binary,

elasticsearch queries in kibana

I have setup a dashboard that displays incoming message rates in a graph, filtered terms in a pie graph and all with nothing really to do. I want to be able to display a table/graph or some other type of panel to display elapsed time between two datetime fields that appear in my message:

Re: problem with kibana and index

I had a similar issue and the problem was the .conf file in logstash. I had to ensure tcp input type was set to codex => "json" On Thursday, February 27, 2014 11:26:55 AM UTC-5, Phil gib wrote: > > Hello > my context : logstash 1.3.2 + ES 0.90.11 + kibana3 > > I have a perfect pipe of these too

Logstash and Elastisearch doesn't communicate

Helloy everyone, I have installed elasticsearch-1.0.1-1.noarch and logstash-1.3.3-flatjar.jar. I can't make logstash communicate to elasticsearch. In elasticsearch.yml I have set just the cluster name (the rest is the default configuration). And I have this logstash.conf file (very simple): i

Re: elasticsearch performance issue with load increasing reponse time is increasing

It would help if you can post the query you use, and how the lines you send correspond to the number of threads, and how you fire off the queries in parallel. Jörg -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group

problem with kibana and index

Hello my context : logstash 1.3.2 + ES 0.90.11 + kibana3 I have a perfect pipe of these tools when i send my own logs files tranformed by logstash ( ES works and kibana also with different configured dashboards ) but now when i try to send directly json format to ES it works , but kibana

Re: copy_to objects?

Wondering what you are trying to do and if it could be or not a feature request. Could you describe what you are trying to achieve with some JSON examples? Thanks! --  David Pilato | Technical Advocate | Elasticsearch.com @dadoonet | @elasticsearchfr Le 27 février 2014 à 14:47:43, Binh Ly (bin

Re: Exact phrase match - city names example

I get the same results as you using your example Thanks for posting it. I am not sure why my original example does not work, but that is for me to figure out! Thanks again. On Thursday, June 14, 2012 2:02:28 PM UTC-4, Greg Silin wrote: > > Hi, > One of our fields in the index stores city n

es 1.0.1 network.host

I'm trying to become familar with elasticsearch so spun up an instance on a cloud service. The instance has a public IP address and as well as a private address. elasticsearch is set to the private IP address and if I edit etc/elasticsearch/elasticsearch.yml and set the *network.host* to the p

Re: How to count??

Your distinct count should be the size of the terms array: facets.tag.terms.length -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@go

Re: How to count??

Hello Binh Thanks. It's my query { "query" : { "bool": { "must": [ {"query_string": { "query": "\"(Google)b...@gmail.com\"" }} ], "must": [ {"query_string": { "query"

Re: elasticsearch performance issue with load increasing reponse time is increasing

While all the threads are running, can you check the search thread pool stats: curl "localhost:9200/_nodes/stats/thread_pool?pretty" It is possible that 1 or more searches are in the queue so they would wait until the search threadpool has availability again. -- You received this message beca

Re: Help Understanding custom_filters_score Error

James, It's been a little while, but if my memory serves me correctly, the correct solution is that 'filters' and 'query' must be at the same level in the custom_filters_score query and you still need a filtering or limiting query in the query section, e.g.: custom_filters_score : { query : {

Re: Help Understanding custom_filters_score Error

You should be able to put your "overall query" into the top query part of your custom_filters_score. FYI, the function_score should now be used in ES 1.0. The function_score has the flexibility to either augment your top level query scores, or replace them if needed - check the boost_mode param

Multi-tenant Search

I have a multi-tenant application where in which each tenant has separate index specific to tenant. My question is that if I search something from _all index how can I ensure in elasticsearch that it will search for relevant query from each index. Means, how can I give equal importance to each

Re: copy_to objects?

Unfortunately, no it does not. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web vi

Re: Exact phrase match - city names example

So if I do this: curl -s -XPUT 'localhost:9200/test' -d '{ "mappings": { "name": { "properties": { "street": { "type": "string", "index" : "not_analyzed" } } } } } Then I do this: curl -s -XPUT 'localhost:9200/test/name/5' -d '{ "street

Re: indexing binary

You certainly can add a new field, and then just put the OCR text into that new field. So for example: Mapping: PutMappingResponse putMappingResponse = new PutMappingRequestBuilder( client.admin().indices()).setIndices(INDEX_NAME).setType(DOCUMENT_TYPE).setSource(

Re: Exact phrase match - city names example

Thanks for the reply Prashy - I tried performing a term query like you suggested; I get the same results (all documents containing main are returned...E Main St, W Main St...) Do you only get one document returned using the example I provided above (doc id 9/"Main")?? On Thursday, February 27,

Elasticsearch output format with "head" plugin

Hi All, I am using head plugin to access the elastic search through GUI and cluster plugin to cluster the data. So is there anyway I can display any particular field in GUI of elasticsearch. For ex: If my query is *{ "search_request": { "fields": [ "Content" ], "query": {

Re: Aggregation for query facets?

You'll want the filter aggregation: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-bucket-filter-aggregation.html -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and sto

Re: How to count??

Field collapsing is coming in a future version of ES. For now, you can use a terms facet and the all_terms option: { "query" : { "match_all" : { } }, "facets" : { "tag" : { "terms" : { "field" : "distinctid", "all_terms" : t

Re: ElasticSearch server lock up

We have several fixes relate to this in 0.90.12 and 1.0.1 - can you guys try and upgrade? would be awesome if you could report back! simon On Thursday, January 23, 2014 1:47:31 AM UTC+1, JBartak wrote: > > We had an interesting problem today while running a 3 data node > ElasticSearch 90.7 clus

Aggregation for query facets?

I’m currently changing all of my facet code to use the new aggregations in ElasticSearch 1.0. What aggregation should be used in place of the QueryFacet? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and sto

Re: How to count??

I mean like mysql query select count( distinct id ) from tablename; Thanks Nick Chang於 2014年2月27日星期四UTC+8下午2時51分39秒寫道： > > Hello > > I want to analysis " who read the how many books?" > > When bookid is duplicate, I don't want to count. > > POST /bookdatas/_search > { > "size": 0, > "fac

elasticsearch performance issue with load increasing reponse time is increasing

Hi All We had elasticsearch with 4 Nodes the the Cluster each 8gb memory. when we are calling the elastic search query from java with 25 threads first thread is taking 400 msec where as last is taking around 5secs its more than 10 times. we had 50 million of data with 5 shards and 0 replicas.

Re: upgrading from elasticsearch 0.90.5 to 1.0.1

You might want to do an few minor upgrades before to ensure you don't take a massive leap with lucene, I recall some people have had issues with that. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 27 February 2014

upgrading from elasticsearch 0.90.5 to 1.0.1

Hello all, I have a huge elasticsearch cluster with around 150 Tb of data indexed into it. It has 32 nodes and more than 3000 shards in active state. I am planning to upgrade this elasticsearch cluster from version 0.90.5 to 1.0.1. Are there any index compatibility issues that I need to be awar

Re: Bug in Java PutMapping API?

@Andre might be a stupid question, but why are you trying to set a format for a string field and set 'index' on a long field? Afaics from the guide (http://www.elasticsearch.org/guide/en/elasticsearch/reference/1.x/mapping-core-types.html) neither of these things are supported, so is it that su