Re: How to index a csv file with Elastic Search

You can also look at https://github.com/xxBedy/elasticsearch-river-csv -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 1 mars 2014 à 02:29, Raffaele Sena a écrit : What kind of queries would you want to be performing ? If you just want to search for any record containing

Configuring TTL mapping in JAVA API

Hi, Can someone please let me know , how do we add mappings(_mapping) to add ttl in java api( Just as we add via json {enabled:true }).I tried searching for it but cudn't find anything relevant. Any help would be appreciated. Regards, Naveen. -- You received this message because you ar

Re: How to index a csv file with Elastic Search

What kind of queries would you want to be performing ? If you just want to search for any record containing the search terms you pass, then you can just index the CSV records as single strings. You still need to wrap them in a JSON "document", but it can be {"record":"csv-record-thingy"}. If you

How to index a csv file with Elastic Search

I am a nebiew to elastic search. I have eleastic search and head running on a VM. Can someone point me to the steps to index a csv file and search from it. Your asistance would be greatly appreciated. Thanks, Vidya -- You received this message because you are subscribed to the Google Groups

[ANN] Japanese (kuromoji) Analysis plugin for elasticsearch 2.0.0 released

Heya, We are pleased to announce the release of the Japanese (kuromoji) Analysis plugin for elasticsearch, version 2.0.0. The Japanese (kuromoji) Analysis plugin integrates Lucene kuromoji analysis module into elasticsearch.. https://github.com/elasticsearch/elasticsearch-analysis-kuromoji/

[ANN] Japanese (kuromoji) Analysis plugin for elasticsearch 1.8.0 released

Heya, We are pleased to announce the release of the Japanese (kuromoji) Analysis plugin for elasticsearch, version 1.8.0. The Japanese (kuromoji) Analysis plugin integrates Lucene kuromoji analysis module into elasticsearch.. https://github.com/elasticsearch/elasticsearch-analysis-kuromoji/

Re: upsert if modified

Thanks. Unfortunately we have no such field. This may be a useful feature to include in ES. Since the update doc is already being merged with the existing doc, the isModified could easily be done during the merge. On Friday, February 28, 2014 12:20:11 PM UTC-5, Andrew Mehler wrote: > > Is the

SearchParseException if run query with sorting on not yet created type of document.

Hello, I need to run queries periodically. But because my mappings created dynamically it is possible that I could run query against document type which is not yet created. And if my query need to sort on some field I'm getting SearchParseException: Failed to execute phase [query], all shards f

[ANN] ICU Analysis plugin for elasticsearch 2.0.0 released

Heya, We are pleased to announce the release of the ICU Analysis plugin for elasticsearch, version 2.0.0. The ICU Analysis plugin integrates Lucene ICU module into elasticsearch, adding ICU relates analysis components.. https://github.com/elasticsearch/elasticsearch-analysis-icu/ Release No

[ANN] Phonetic Analysis for elasticsearch 2.0.0 released

Heya, We are pleased to announce the release of the Phonetic Analysis for elasticsearch, version 2.0.0. The Phonetic Analysis plugin integrates phonetic token filter analysis with elasticsearch.. https://github.com/elasticsearch/elasticsearch-analysis-phonetic/ Release Notes - elasticsearch

Re: elasticsearch log to windows event log

> > Great thanks. > Ken -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit

Re: upsert if modified

No there is no such capability. However, there is something that may be of interest. When you update/insert, you can pass a version along with it. This version can be set to "come from an external source" in which case you have complete control over the semantics of the version and how updates

Re: storing K/V configuration in elasticsearch

If you're asking if there is a way to use a field name in your query say "field1", and then have it actually look at another field say "fieldxyz" or "fieldabc" at query time, no there is no such capability. The best way to do this is probably in some kind of configuration that is part of your a

Re: Elasticsearch 1.0.0 is now GA

On Tuesday, February 25, 2014 9:56:34 AM UTC-6, InquiringMind wrote: > > I always start Elasticsearch from within my own wrapper script, es.sh. > > Inside this wrapper script is the following incantation: > > NODE_OPT="-D*es.node.name *=$(uname -n | cut -d'.' > -f1)" > > > I

Re: Update Byte Array Field Java API

I haven't tried the API, but in the script, it may be better to use base64 encoding for binary content. Don't ask how this is possible because I don't know. Maybe not in MVEL but another language. Jörg -- You received this message because you are subscribed to the Google Groups "elasticsearch"

Re: Kibana 3 index settings

I have it working now. Thanks -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web vi

Re: Kibana 3 index settings

Thanks! On Friday, February 28, 2014 1:28:59 PM UTC-5, spezam . wrote: > > Tom, > as Binh wrote, those are indexes name of my three ES cluster nodes. > Indexes that I want to query all at once via Kibana 3. > > > > > > On Friday, February 28, 2014 5:16:10 PM UTC+1, Binh Ly wrote: >> >> Tom, tha

Update Byte Array Field Java API

Hi Everyone, Has anyone ever experimented with or know of a way to update a field which contains a byte array using the Java API? For example I have the following index: client.prepareIndex(INDEX_NAME, INDEX_TYPE) .setSource( jsonBuilder

Re: boolean field

Regarding the mapping, i have it manually defined as boolean. I too don't like auto mapping. And yet, ES accepts any string and, when i perform a get, also returns any string instead of true/false (doesn't converte before upgrading ir fetching). Even funnier is that it accepts a real boolean (tr

Re: Kibana 3 index settings

Tom, as Binh wrote, those are indexes name of my three ES cluster nodes. Indexes that I want to query all at once via Kibana 3. On Friday, February 28, 2014 5:16:10 PM UTC+1, Binh Ly wrote: > > Tom, that is a name mask to tell Kibana which indexes it should be looking > at. That setting is a

[ANN] Smart Chinese Analysis plugin for elasticsearch 2.0.0 released

Heya, We are pleased to announce the release of the Smart Chinese Analysis plugin for elasticsearch, version 2.0.0. Smart Chinese Analysis plugin integrates Lucene Smart Chinese analysis module into elasticsearch.. https://github.com/elasticsearch/elasticsearch-analysis-smartcn/ Release Not

upsert if modified

Is there a way to instruct the update api to 'upsert if modified' ? From what I can tell, a new document will be updated wether or not anything has changed. Say I get a daily snapshot of users and their information from some external source. Most days ~85% of the user data will not have chang

[ANN] Stempel (Polish) Analysis plugin for elasticsearch 2.0.0 released

Heya, We are pleased to announce the release of the Stempel (Polish) Analysis plugin for elasticsearch, version 2.0.0. The Stempel (Polish) Analysis plugin integrates Lucene stempel (polish) analysis module into elasticsearch.. https://github.com/elasticsearch/elasticsearch-analysis-stempel/

Re: boolean field

Binh, It's even more interesting. The behavior you describe matches the configuration and REST parsing rules. But the document _source is JSON and a boolean value must be either *true* or *false*. So my recommendation is to use the configuration and REST interface as a forgiving practice to get

Re: marvel shows empty dashboard

On Sunday, 2 February 2014 18:02:04 UTC, Boaz Leskes wrote: > > [loads of great stuff snipped] >> > Just in case it helps anyone else out there, I was suffering with blank Marvel dashboards (logstash 1.3.3 with ES 1.0.1) and it turned out to be a permissions problem on the marvel plugin directory

Re: Bug in Java PutMapping API?

David and Tim: Thanks for the quick feedback. It turns out that Tim was correct in that ES was dropping the invalid attributes from my custom mapping. Thanks for pointing that out and for providing a reference to the mapping core types guide (very useful). I'm quickly getting my feet wet with ES a

Re: Kibana 3 index settings

Tom, that is a name mask to tell Kibana which indexes it should be looking at. That setting is accessible from your dashboard - upper right - Configure Dashboard | Index | Default Index. On Friday, February 28, 2014 10:22:15 AM UTC-5, tom rkba wrote: > > > "" >> >> No, wildcards are not supporte

Re: problem with kibana and index

Just a thought, almost all queries Kibana sends has a filter on the @timestamp. In addition it is looking (by default) only in indexes named logstash-*. If your data does not have that field or has values in that field that is not in the range that Kibana is looking, or your index does not matc

storing K/V configuration in elasticsearch

Hi, Quick, silly question. I want to control switching over from searching on one field to another using a configuration property. Since the configuration property is set and used by two applications that only use elasticsearch, need to be able to update it regularly and to have it persist, it

Re: Logstash type disappeared from Elasticsearch

I think this had something to do with the Marvel beta code. ES came back up properly with the index once I uninstalled the marvel beta plugin and cleaned the ES config file. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from

Re: Logstash and Elastisearch doesn't communicate

Hello everybody, Thank you for the help and advices. I think I'll try first the change of versions. When it works, I'll give elasticsearch_http a try. thank you very much. Kind regards. Héctor Moreno El 28/02/2014 16:17, "Tony Su" escribió: > If it's not obvious, Mark's comment is exactly what

Re: Kibana 3 index settings

> "" > > No, wildcards are not supported in the pattern, you can however supply > multiple patterns: > > "pattern": "[logstash-1-].MM.DD,[logstash-2-].MM.DD,", > > "" > > I do not understand what you are doing here. Is this in a querystring field? What exactly are you entering? For e

Re: Logstash and Elastisearch doesn't communicate

If it's not obvious, Mark's comment is exactly what you need to do, Replace in the logstash output elasticsearch with elasticsearch_http This and other things you may want to know if you're running the logstash tutorials are included in a wiki I posted http://en.opensuse.org/User:Tsu2/elastic

Re: problem with kibana and index

hello thanks but the issue is not with logstash ( it works with it) the issue is without logstash ie curl -X POST -> to Kibana On Thursday, February 27, 2014 6:37:35 PM UTC+1, computer engineer wrote: > > I had a similar issue and the problem was the .conf file in logstash. I > h

Re: Error "ReduceSearchPhaseException"

Prahy, Although I don't know the solution, It does look like using a RegEx in your query is causing an overflow of a byte length limit. Accordingly, I suspect if you can find the setting for that, it should solve your problem. Tony -- You received this message because you are subscribed to th

Re: boolean field

Brian, the interesting part is the ES boolean is actually a T/F field and is parsed internally in a different way (not like the Java boolean). I just looked in the code and the values "", "0", "false", "off", "no" are all false. Everything else is true. :) -- You received this message because

Get list of.concret indexes behind aliases in elasticsear 1.X+

I had this working on 0.90.7 but since upgrading to 1.0.1 I havent been able to reachieve that functionailty. It seems something like clientgetMetaData().aliases().get(aliasName).? Anyone have a suggestion? Been stuck on this for a couple hours... Cheers, Dan -- You received this message

Re: boolean field

Good point. So Java's logic is completely opposite to ES. That's going to make life a bit difficult when using Java client. Anyone knows if this is intended behaviour or a oversight? In my case, it's making my updates extremely difficult. I don't know, in the moment of the update, the type of fi

Re: boolean field

But be careful: the docs for the Java 7 Boolean.parseBooleansay that: The boolean returned represents the value true if the string argument is not null and is equal, ignoring case, to the string"true

Re: elasticsearch log to windows event log

I just tried on Windows 7 (I'm logged in as admin and I run ES as admin - if that matters). 1) First thing I did was download and copy the NTEventLogAppender.amd64.dll into my System32 2) Then I did the Regedit instructions here: http://wiki.apache.org/logging-log4j/NTEventLogAppender (Althoug

Re: boolean field

Yup, 0 or false is false. Everything else is true. I do agree it is "odd". -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroup

Re: I am confused by the postFilter and filter of elasticsearch‘s java client

That looks correct to me. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit

Re: Elasticsearch output format with "head" plugin

If you're doing a _search on the "Any Request" tab in head, there is a Result Transformer section at the bottom of your search query. In there you can write a simple transform script. For example, the following script displays only the took and the hits values: return { took: root.took, hits:

Re: [Pls]how to use doc to update json object, There is some exception

Is it possible that you have a different Java version from your development machine and the ES server? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elastics

Re: elasticsearch outofmemory error

Hi David, I'm trying to move elastic search on a new system, but while trying to start the service its giving below exception. Althrough the process is running. There was old elasticsearch 0.90 copied which is not running now as I checked. Please suggest. [2014-02-28 16:40:13,588][WARN ][trans

boolean field

When updating a field with a script, ES allows me to set a field mapped as boolean with any string. So far, this seems to be the only scenario where is possible to update a field with a different type than the one defined in the mapping. Anyone encountered this issue before? Thanks in advance

Re: BigDecimal support

XContentBuilder has support for BigDecimal, but: 1. If you pass the source as a Map when indexing, the BigDecimal handling doesn't get invoked (https://github.com/elasticsearch/elasticsearch/issues/5260). 2. The existing handling should delegate through to Jackson's handling of B

Re: es 1.0.1 network.host

Hi Sean Thanks for helping I started again with a fresh vm but continue to use the rpm’s from ES repository for 1.0 and openjdk 1.7 I'm running it on GCE instance if thats important, The only edit to the supplied elasticsearch.yml in /etc/elasticsearch/ I made was to uncomment the network.h

elasticsearch log to windows event log

Hi Does anyone have an example of logging YAML that uses the event log on Windows? I've tried: http://wiki.apache.org/logging-log4j/NTEventLogAppender http://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/nt/NTEventLogAppender.html But I cannot get it to work. Regards, Ken -- You rec

Re: upgrading from elasticsearch 0.90.5 to 1.0.1

You should take note of the compatibility breaking changes in the release notes of course and do some functional tests with the new version to ensure that you are not affected by those changes. Additionally, I would carefully plan and test the update procedure with a smaller cluster first. In th

Re: elasticsearch outofmemory error

Basically depending on your dataset, it will require more memory or more nodes. ES_HEAP_SIZE=256m is just too low. Start with at least 1Gb RAM As you have a 4Gb machine, you can set it to 2 Gb. If it's a production machine, you should not run other IO heavy services on the same physical box (suc

elasticsearch outofmemory error

Hi, I'm getting the below issue when trying to increase paging in Kibana which is using elasticsearch. [2014-02-28 11:24:29,280][DEBUG][action.search.type ] [Nut] [182865] Failed to execute fetch phase org.elasticsearch.ElasticsearchException: Java heap space at org.elasticsearch.ExceptionsH

I am confused by the postFilter and filter of elasticsearch‘s java client

AFAIK, There are three types search I can perform on elasticsearch: 1. query => which will do scoring and affect the hit 2. filter => which will not do scoring and affect the hit 3. post_filter => which will be applied on the result of query/filter and will not affect the hit and facet aggr

Re: Elasticsearch output format with "head" plugin

Any help for the same issue? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Elasticsearch-output-format-with-head-plugin-tp4050614p4050687.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message because you are

Re: Error "ReduceSearchPhaseException"

Hello All, Did any one encountered the same issue if yes then please let me know the solution. -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Error-ReduceSearchPhaseException-tp4050531p4050686.html Sent from the ElasticSearch Users mailing list archive at Na

Re: Automatically deleting logs.

Take a look at https://github.com/elasticsearch/curator Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 28 February 2014 19:07, David Pilato wrote: > It does not exist. > I really think that you should run a cron j

Re: Automatically deleting logs.

It does not exist. I really think that you should run a cron job and decide what to do in that case. But why not removing logs after a given period? BTW when I say delete logs I mean remove daily index. Deleting logs entry will cost you more space due to how Lucene works behind the scene. --

Re: Automatically deleting logs.

Hi David, Thanks for you response. My requirement is to get the old logs deleted due to non-availability of STORAGE SPACE to accommodate new logs. This is regardless of ttl is expired or not. On Friday, February 28, 2014 12:55:01 PM UTC+5:30, David Pilato wrote: > > I think you are looking fo