Re: bool query with filter giving error

2014-03-17 Thread Subhadip Bagui
Hi Clinton, Thanks for your reply. I tried as suggested and the same is working now :) One question though, I have to pass the text field in lower case always as the same is getting analyzed by standard analyzer I guess. Is there any way to pass multiple match in bool for text search so that I

Re: query edition problem kibana

2014-03-17 Thread Phil gib
thanks ok, understood now it works philippe On Friday, March 14, 2014 7:13:28 PM UTC+1, Binh Ly wrote: You'll need to use the query_string syntax: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-query-string-query.html It should be something like:

Re: Problem with configuring index template via file

2014-03-17 Thread Sergey Zemlyanoy
Finally I managed to solve it! It was caused by wrong template path - /etc/elasticsearch/config/templates/sometemplate.json It should be /etc/elasticsearch/templates/sometemplate.json Thanks a lot! On Friday, March 14, 2014 8:41:26 PM UTC+2, Binh Ly wrote: I can think of 2 reasons: 1)

Re: WARN while updating index settings

2014-03-17 Thread Tomasz Romanczuk
W dniu piątek, 14 marca 2014 17:26:58 UTC+1 użytkownik Tomasz Romanczuk napisał: Hi, I'm using percolate index to store some queires. After node start (used java API) I try to update index settings: client.admin().indices().prepareClose(INDEX_NAME).execute().actionGet();

not able to pass multiple term in bool query

2014-03-17 Thread Subhadip Bagui
Hi, I'm trying to make a bool query where sending mutiple term under should block as given in link http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-bool-query.html But I'm getting SearchPhaseExecutionException while trying to execute below query. Please inform

Re: not able to pass multiple term in bool query

2014-03-17 Thread David Pilato
I just tried to copy and paste your JSON in:  http://jsonformatter.curiousconcept.com/ I get Error:Expecting comma or ], not }.[Code 6, Structure 86] Error:Expecting comma or }, not ].[Code 7, Structure 87] Error:Multiple JSON root elements[Code 22, Structure 115] Error:Extra closing }[Code 14,

Re: Mapping for Java HashMap

2014-03-17 Thread Tomislav Poljak
Hi, I think first you need to define is what is the requirement (or expectation) of hashMap (sub)object in index - do you need to search on key/value pairs? Like for example, query = 'hashMap.N_10290607:XY' ? If not, if you only need to store json serialization of haspmap as part of bigger

OutOfMemoryError: Direct buffer memory

2014-03-17 Thread Daniel Guo
I use elasticsearch as an index server. And I deploy a web project to create index and search result from my es server. I got the following error from the logs of the web project: [elasticsearch[Vengeance][transport_client_worker][T#12]{New I/O worker #6249}] WARN

Attachment plugin

2014-03-17 Thread Paweł Młynarczyk
Hello I've found elasticsearch-mapper-attachments plugin already, but I was wandering if there was a plugin that allows users to access indexed files via URL file. I mean, that I'd like to download files directly from Elasticsearch using some special URL. Any thoughts on this? Best regards

Re: Client fork-bombs on server error

2014-03-17 Thread magnus
Yes I can try downgrading as an experiment, getting to it ASAP. System info: ElasticSearch 0.90.7. $ cat /etc/issue Red Hat Enterprise Linux Server release 6.4 (Santiago) Kernel \r on an \m $ cat /etc/lsb-release

Re: Attachment plugin

2014-03-17 Thread Paweł Młynarczyk
Thank you very much for the answer. W dniu poniedziałek, 17 marca 2014 10:51:57 UTC+1 użytkownik Paweł Młynarczyk napisał: Hello I've found elasticsearch-mapper-attachments plugin already, but I was wandering if there was a plugin that allows users to access indexed files via URL file. I

Re: Corrupted ElasticSearch index ?

2014-03-17 Thread Clinton Gormley
Are you sure you didn't run out of disk space or file handles at some stage, or have an OOM exception? On 16 March 2014 16:37, bizzorama bizzor...@gmail.com wrote: Hi, it turned out that it was not a problem of ES version (we tested on both 0.90.10 and 0.90.9) but just a ES bug ... after

Re: Mechanism of internal search with multiple indices

2014-03-17 Thread Clinton Gormley
Hi Mohit All documents stored in a single index are stored at the same level, regardless of their type. The _type is just a hidden field in each document. So if you do a search like: GET /index_one,index_two/_search { query: { match: { field_foo: some search terms }}} then it queries

Re: OutOfMemoryError: Direct buffer memory

2014-03-17 Thread Clinton Gormley
Are you sending an enormous bulk indexing request? If so, try to send fewer docs at a time, eg 1,000 On 17 March 2014 10:39, Daniel Guo daniel5...@gmail.com wrote: I use elasticsearch as an index server. And I deploy a web project to create index and search result from my es server. I got

Re: OutOfMemoryError OOM while indexing Documents

2014-03-17 Thread Alexander Ott
At the moment i can provide only the jvm stats ... i will capture the other stats as soon as possible. We use 5-20 threads which will proccess bulks with a max size of 100 entries. We only use one node/maschine for development so we have no cluster for development... The maschine has 64gb RAM

Re: elasticsearch memory usage

2014-03-17 Thread Clinton Gormley
On 17 March 2014 09:18, Amit Soni amitson...@gmail.com wrote: Hello team - I see the recommendation here in this thread to use JDK 1.7 update 25. However in the websitehttp://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/requirements.htmlupdate 51 is recommended. Hi Amit

not able to read reserved character in query dsl

2014-03-17 Thread Subhadip Bagui
Hi, I have some document fields with value like CLOUD_TYPE: AWS-EC2 I'm trying below query to get the results, but it's giving me 0 values. Please let me know the correct way to fetch the query POST /aricloud/_search { query: { filtered: { query: { bool: {

Re: Corrupted ElasticSearch index ?

2014-03-17 Thread bizzorama .
No, when things are running everything is ok, indexes break during restart/powerdown 17-03-2014 13:11, Clinton Gormley cl...@traveljury.com napisał(a): Are you sure you didn't run out of disk space or file handles at some stage, or have an OOM exception? On 16 March 2014 16:37, bizzorama

Re: not able to read reserved character in query dsl

2014-03-17 Thread David Pilato
probably your text has been analyzed with default analyzer. AWS-EC2 - aws, ec2 Term queries are not analyzed. So you need to either send the exact same term which is in the inverted index either change your mapping and set it as not analyzed either use a MatchQuery instead which is analyzed.

Re: How to use JOIN operation in elasticsearch?

2014-03-17 Thread Nagarajan S
let the where condition is m.english = 91 On Monday, 17 March 2014 19:02:16 UTC+5:30, Nagarajan S wrote: I have sql like select s.name from Student s join Mark m on s.sid = m.sid where s.sid = 101 how can i replicate the same functionality in elastic search ? Thanks and Regards,

Re: Attachment plugin

2014-03-17 Thread David Pilato
I don't think so. --  David Pilato | Technical Advocate | Elasticsearch.com @dadoonet | @elasticsearchfr Le 17 mars 2014 à 14:30:07, Paweł Młynarczyk (zwar...@gmail.com) a écrit: Thank you very much for your answer. As I can see, you are decoding the whole elasticsearch response. I would like

Re: OutOfMemoryError: Direct buffer memory

2014-03-17 Thread Daniel Guo
Yes, my bulk size is 10,000. I'll try to make it smaller. Thanks a lot, Clinton! On Monday, March 17, 2014 8:33:07 PM UTC+8, Clinton Gormley wrote: Are you sending an enormous bulk indexing request? If so, try to send fewer docs at a time, eg 1,000 On 17 March 2014 10:39, Daniel Guo

Re: 1.0.2 Release Date

2014-03-17 Thread Adam Georgiou
same here. Would love to have an estimate on a release date. On Wednesday, March 12, 2014 11:38:04 AM UTC-4, Justin Uang wrote: Hi, One of the bugs in 1.0.1 is hitting us in production, and I was wondering when there would be an official release of 1.0.2? Thanks! Justin -- You

Re: Corrupted ElasticSearch index ?

2014-03-17 Thread Mac Jouz
Hi, Thanks Karol, changing ES version does not change the problem indeed. 2 complementary questions if I may: - You wrote that you copied the mapping file on ES location, did you try a way to do so dynamically with a REST call ? - Otherwise did you apply the modification for the specific

Re: Corrupted ElasticSearch index ?

2014-03-17 Thread Mac Jouz
Same symptom for me, neither OOM, nor full disk space, only an ES restart... Le lundi 17 mars 2014 14:00:11 UTC+1, bizzorama a écrit : No, when things are running everything is ok, indexes break during restart/powerdown 17-03-2014 13:11, Clinton Gormley cl...@traveljury.com javascript:

Re: Search query containing an equal character

2014-03-17 Thread Guillaume Loetscher
Hi, No one knows ? I can't imagine that no one hasn't done a query on a string containing a = character in it. Maybe my question is not clear enough. If so, please tell me where, I'll try to make it clearer. Many thanks, Le samedi 15 mars 2014 00:02:08 UTC+1, Guillaume Loetscher a écrit :

Re: DateRange aggregation semantics - include_lower/include_upper?

2014-03-17 Thread mooky
Is it practical to have an optimised/flexible implementations? Re-reading, that sentence doesn't make sense. What I meant to ask is whether it would be practical to have 2 implementations - an optimised one and a flexible one? -Nick On Wednesday, 12 March 2014 11:09:44 UTC, mooky wrote:

Re: Search query containing an equal character

2014-03-17 Thread Binh Ly
Your field is likely using the standard analyzer which by default which strips the = symbol. If you have the raw (not_analyzed) field indexed, you can do something like this: fieldname.raw:*client=localhost.localdomain* This is probably not the best query to execute (because of the wildcards),

Using machine learning and TF-IDF for record linkage, fuzzy grouping, and deduplication?

2014-03-17 Thread Shrin King
Given a new big department merged from three departments. A few employees worked for two or three departments before merging. That means, the attributes of one person might be listed under different departments' databases. One additional problem is that one person can have different first

Re: 1.0.2 Release Date

2014-03-17 Thread Ivan Brusic
I have no answers, but you can always keep track of open issues on Github: https://github.com/elasticsearch/elasticsearch/issues?direction=desclabels=v1.0.2page=1sort=updatedstate=open -- Ivan On Mon, Mar 17, 2014 at 9:37 AM, Adam Georgiou apg...@gmail.com wrote: same here. Would love to

Re: not able to pass multiple term in bool query

2014-03-17 Thread Binh Ly
Can you show the full error message details? -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion

Re: Timeouts on Node Stats API?

2014-03-17 Thread Clinton Gormley
Good to hear! Thanks for reporting back On 17 March 2014 15:04, Xiao Yu m...@xyu.io wrote: I still don't have any definitive logs or traces that point to the exact cause of this situation but it appears to be some weird scheduling bug with hyper threading. Our nodes are running on OpenJDK

Re: Using machine learning and TF-IDF for record linkage, fuzzy grouping, and deduplication?

2014-03-17 Thread Clinton Gormley
I'd start with the more_like_this query and see how far that takes you. clint On 17 March 2014 18:28, Shrin King aoi...@gmail.com wrote: Given a new big department merged from three departments. A few employees worked for two or three departments before merging. That means, the attributes

Re: Corrupted ElasticSearch index ?

2014-03-17 Thread bizzorama .
Hi, we tried both ways but: First worked but was temporary and worked as index quickfix (after powerdown it was lost again), of course we used the rest interfaces to fix mappings that were already broken (we could not pump all data again so we had to fix it somehow). We applied the mapping file

[ANN] Elasticsearch Azure cloud plugin 2.1.0 released

2014-03-17 Thread Elasticsearch Team
Heya, We are pleased to announce the release of the Elasticsearch Azure cloud plugin, version 2.1.0. The Azure Cloud plugin allows to use Azure API for the unicast discovery mechanism and add Azure storage repositories.. https://github.com/elasticsearch/elasticsearch-cloud-azure/ Release

Re: Using machine learning and TF-IDF for record linkage, fuzzy grouping, and deduplication?

2014-03-17 Thread joergpra...@gmail.com
I can only describe the approach how I use ES for data cleaning, regarding author names in ~50 millions of academic journal articles. - key construction phase: define the information of the identifiying key. Candidates are last name, address, home phone (strong assumption is a person has only one

Re: Creating dynamic fields from a field

2014-03-17 Thread pablitomusa
Thank you very much for the hints ;) If it matters, you can call the _analyze API to produce the tokens before you inject your fields. Is there an URL there I can call? Or only using the internal API? Your cluster state will eventually become enormous. Yes, I saw it coming but was

Re: Creating dynamic fields from a field

2014-03-17 Thread Ivan Brusic
There is an REST API: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-analyze.html If you are using Java, you can avoid the network roundtrip by creating the AnalysisService locally. For hints, see the test class:

I need wifi to find Wi-Fi

2014-03-17 Thread Raja Akhtar
I've really been scratching my head on this, but nothing seems to be working. So far, I have everything working as expected, but what I wan't now is when someone types wifi, it searches results with Wi-Fi I have word-delimiter on, and have made all recommended changes, but I'm still not seeing

Re: Search query containing an equal character

2014-03-17 Thread Guillaume Loetscher
Le lundi 17 mars 2014 18:28:29 UTC+1, Binh Ly a écrit : Your field is likely using the standard analyzer which by default which strips the = symbol. If you have the raw (not_analyzed) field indexed, you can do something like this: fieldname.raw:*client=localhost.localdomain* I don't

Re: Scaling to 150k/sec

2014-03-17 Thread johnar
We haven't tried Java 8 or changing garbage collection yet -- I've heard mixed results on GC.We're using SSD storage on Azure, and have a fairly tweaked out config. I was thinking about turning off any kind of analysis in the template to get it to scale... On Sunday, March 16, 2014

Re: Corrupted ElasticSearch index ?

2014-03-17 Thread Mac Jouz
Finally I fixed dynamically the broken index but taking account your answer I'm going to add files to avoid future problems Thanks Karol Regards José Le lundi 17 mars 2014 19:25:31 UTC+1, bizzorama a écrit : Hi, we tried both ways but: First worked but was temporary and worked as

What is the best javascript client for ES with least # of dependencies?

2014-03-17 Thread pulkitsinghal
I want to use a javascript client for ES that has the least # of dependencies because it will make it easier to port it onto Parse.com as a cloud module. The more dependencies and/or files involved, the messier it looks when bringing in an existing npm module to an environment like Parse. So

Re: I need wifi to find Wi-Fi

2014-03-17 Thread Boaz Leskes
Hi Raja, You have a couple of issues. First, you use the standard tokenizer, that one splits words on a `-` , so you already loose the Wi-FI combination there. Next the tokens are passed through an ngram filter, which chops them up more (may or may not be what you want). You can see what

Re: I need wifi to find Wi-Fi

2014-03-17 Thread Raja Akhtar
Hi Boaz, Thank you so much. That worked like a charm! I can't believe I missed that. I really appreciate the quick response :) Cheers, Raja On Monday, 17 March 2014 21:29:30 UTC, Boaz Leskes wrote: Hi Raja, You have a couple of issues. First, you use the standard tokenizer, that one

Geoshape Filters via Java API

2014-03-17 Thread Yeroc
All, We're upgrading to v1.0 from v0.90 and have run into an issue we're not sure how to resolve. We have been applying the geoshape filter in our queries via the Java API using: FilterBuilders.geoShapeFilter(fieldName, shape); but now in v1.0 we can no longer pass in a Shape to the

Re: Constantly increasing memory outside of Java heap

2014-03-17 Thread Jos Kraaijeveld
As a follow-up, when the server is nearing maximum memory, the memory use stops increasing. This would indeed support Zachary's caching theory, although I'm still confused as to why it shows up as 'in use' memory rather than 'cached' memory. In any case, it does not block me right now. It's

Re: DELETE snapshot request (which was long-running and had not yet completed) is hung

2014-03-17 Thread Igor Motov
Hi Swaroop, I tried to reproduce it, but in my case snapshot failed with AccessDenied almost immediately after I started it. Any other pointers besides PUT only permissions? On Tuesday, March 11, 2014 1:44:00 AM UTC-4, Swaroop wrote: Hi Igor, It seems that the S3 bucket had PUT only

To the Governing body

2014-03-17 Thread area map
*To the Governing body* * Seek open forgiveness to Muslims for your torture* The punishment and curse of Allah Subhanahu Wa Ta'ala, imposed on you in the form of recurrent natural calamities, incurable diseases and tremendous unprecedented economic crisis, are only due to your inhuman

integration test issues with elasticsearch

2014-03-17 Thread slushi
I have been getting sporadic failures with my elastic search based integration tests on 0.90.11. The tests seem to work on and off, when they fail, either my queries don't retrieve any documents or I get an execution failure. I was using a local in memory node, but I switched to the

Re: Scaling to 150k/sec

2014-03-17 Thread johnar
We have a bunch of different things going into elasticsearch, mostly network-related telemetry. The latest painful one is IPFIX (netflow). The aggregation we're working on looks like this: { _index: ipfix-2014.03.17, _type: logs, _id: oA5uhOc9QpCaH9iGPlY7AQ, _score: null, _source: {

Re: not able to pass multiple term in bool query

2014-03-17 Thread Subhadip Bagui
Hi Binh, I was an issue with json format creation. Now I validated the json and getting result. Thanks.. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to