Re: ElasticSearch built-in Jackson stream parser is fastest way to extract fields

2015-04-30 Thread Brian
hope this helps. I'd love to publish more details but this is about all I can do for now. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send

Consultant Needed for initial setup / audit / tuning /etc.

2015-04-22 Thread Brian Gruber
Looking to see if we have setup the system efficiently and correctly as well as general guidance. I'm looking for someone to provide some initial consulting (not very long) to give my current setup a nice audit and make sure I've set things up efficiently/correctly. I'm having trouble finding a

Rebuilding master node caused data loss

2015-04-21 Thread Brian
I have a cluster with 5 data nodes, and 1 master node. I decided to test a master node failure, and clearly I miss understood exactly what is stored on the master. I turned down the VM running the master node, and built a new one from scratch. I then added it to the cluster as a master. When

Re: shingle filter for sub phrase matching

2015-04-20 Thread brian
Did you ever figure this out? I have the same exact issue but using different words. On Wednesday, July 23, 2014 at 10:37:03 AM UTC-4, Nick Tackes wrote: > > I have created a gist with an analyzer that uses filter shingle in > attempt to match sub phrases. > > For instance I have entries in t

Re: Creating a dynamic_template with a patch_match of arbitrary depth

2015-04-07 Thread Brian Levine
https://github.com/elastic/elasticsearch/issues/10467 On Friday, April 3, 2015 at 10:36:00 AM UTC-4, Brian Levine wrote: > > I'm indexing documents with nested objects where some of the objects > include unique ids (GUIDS). I want all such fields to be "not_analyzed."

Creating a dynamic_template with a patch_match of arbitrary depth

2015-04-03 Thread Brian Levine
I'm indexing documents with nested objects where some of the objects include unique ids (GUIDS). I want all such fields to be "not_analyzed." The id fields always have an '_id' suffix however, these fields can appear at arbitrary levels in the document hierarchy. I'm trying to come up with a dy

Re: Do I have to explicitly exclude the _all field in queries?

2015-03-24 Thread Brian Levine
OK, I think I figured this out. It's the space between "Brian" and "Levine". The query: "query": "Node.author:Brian Levine" is actually interpreted as Node.author:Brian OR Levine in which case "Levine" is searched for in the _all field.

Do I have to explicitly exclude the _all field in queries?

2015-03-24 Thread Brian Levine
.author:Brian Levine" } }, "fields": ["Node.author"], "explain":true } Note: The Node.author field is not_analyzed. The results from this query include documents for which the Node.author field contains neither "Brian" nor "Levine"

Re: Elastic and Kibana, indexing al Json with an field array looks like a plain String.

2015-02-17 Thread Brian Lowrance
you happen to figure out a solution for this? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussio

Elasticsearch throwing an “OutOfMemoryError[unable to create new native thread]” error

2015-01-30 Thread brian
We just did a rolling restart of our server, but now every few hours our cluster stops responding to API calls. Instead, when we make a call, I get a response like this: curl -XGET 'http://localhost:9200/_cluster/health?pretty' { "error" : "OutOfMemoryError[unable to create new native thread

Re: How does sorting on _id work?

2015-01-27 Thread Brian
when you sort on the id field, you will get a numeric sort. Hope this helps. Brian On Tuesday, January 27, 2015 at 1:28:44 PM UTC-5, Abid Hussain wrote: > > ... can it be that _id is treated as string? If so, is there any way > retrieve the max _id field with treating _id as intege

Re: How to find all docs where field_a === val1 and field_b === val2?

2015-01-14 Thread Brian
} ] } }, "version" : true, "explain" : false, "fields" : [ "_ttl", "_source" ] } Also note that since the _ttl field is being requested (always), then the _source must also be asked for explicitly. If you don't ask for any

Re: How to find all docs where field_a === val1 and field_b === val2?

2015-01-14 Thread Brian
"match" : { "field_b" : { "query" : "val2", "type" : "boolean" } } } ] } } Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. T

Re: Indices Stats using the NodeClient with the Java API

2015-01-13 Thread Brian
esolve index pattern [" + indexPattern + "]: " + e); } } private final Client client; private static final Pattern indexSplitter = Pattern.compile(Pattern .quote(",")); Brian On Tuesday, January 13,

Re: Input file with custom delimiter

2015-01-07 Thread Brian
= null; private longversion = 0; private VersionType versionType = VersionType.INTERNAL; private TimeValue ttl = null; And the actual data line that would follow is similarly constructed using the content builder. I wish I could help you more. Brian On Wednesday, J

Re: Input file with custom delimiter

2015-01-07 Thread Brian
JSON isn't very hard to do. And once that's done, it's an easy matter to add the action and meta data and have a bulk-ready data stream. Brian On Wednesday, January 7, 2015 6:40:34 AM UTC-5, Gopimanikandan Sengodan wrote: > > Hi All, > > We are planning to load the

Analyze array of strings and not just one string

2015-01-05 Thread Brian
able to see the word position of each token exactly as it would be generated by ES when a document is indexed, and this would include the adjusted word positions based on the position offset gap, but as actually calculated by ES and not as guessed by me. Thanks in advance! Brian -- You

Re: Same query, different CPU util when run with Java API versus REST

2014-12-16 Thread Brian
d the combination of my thin server plus Elasticsearch and don't see any performance issues as you describe. Just a thought... Regards, Brian On Monday, December 15, 2014 9:27:18 AM UTC-5, Jeff Potts wrote: > > Yes, updated the gist. Thanks for taking a look at this. > > Jeff &g

Re: "Incompatible encoding" when using Logstash to ship JSON files to Elasticsearch

2014-12-10 Thread Brian
P protocol. Brian On Wednesday, December 10, 2014 3:53:30 PM UTC-5, Vagif Abilov wrote: > > Thank you Aaron, done. I've created an issue. But I'd like to find out if > there's a workaround for this problem. What's really strange that the same > Logstash installat

Re: Query doesn't find results

2014-12-05 Thread Brian
! Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web vi

Re: slow performance on phrase queries in should clause

2014-12-05 Thread Brian
a locally hosted blazingly fast machine. That was its only weak point, but it was a significant weak point. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from i

Re: Cannot find elasticsearch sample data in kibana4 beta 2

2014-12-03 Thread Brian Olson
Upgraded to elasticsearch 1.4.1 - no change On Wednesday, December 3, 2014 12:53:42 PM UTC-5, Brian Olson wrote: > > I'm having some difficulties getting some non-logstash data to show up in > kibana4. All logstash data works fine. I loaded up the "french" dat

Cannot find elasticsearch sample data in kibana4 beta 2

2014-12-03 Thread Brian Olson
I'm having some difficulties getting some non-logstash data to show up in kibana4. All logstash data works fine. I loaded up the "french" data as suggested on the elasticsearch help page (http://www.elasticsearch.org/help) and everything works as far as elasticserach is concerned. I can success

Re: tweezer fixes to status-red don't work, may need sledgehammer

2014-11-24 Thread Brian
from your sledgehammer is causing some corruption. In general, it's not good to mix HTTP REST (curl) commands and scripts that directly handle processes without adequate delays to ensure they aren't hammering on each other. Brian -- You received this message because you are subscri

Spark StreamingContext read streaming updates from ES

2014-11-19 Thread Brian Walsh
Existing Spark support allows us to read or write to ES. Read support is to one shot, that is, read what ES has in it's index now. I'd like to have a Spark thread read streaming updates from ES, using it as a source not a sink. I was wondering if there was a way to write a spark StreamingContex

Re: Question on stemming + synonyms and tokenizerFactory

2014-11-14 Thread Brian
have not seen any problems with performance. Oh, and all my words and phrases can be fully spelled out; it's only when they are used in the subsequent query do they get analyzed (tokenized, stemmed, and whatever else). Brian -- You received this message because you are subscribed to

Re: mapping store:true vs store:false

2014-11-14 Thread Brian
Especially when feeding log data via logstash, I have never used store:true and have found no need to specify it at all. The logstash JSON will be stored as the _source and retrieved by the query so there is no need to use store at all. Anyway, that's my experience. Brian -- You rec

Re: Import java transportClient only

2014-11-14 Thread Brian
at often (regularly, but I don't thrash our deployment folks). It sounds complicated, I suppose. But that was only once, and it's been easy to manage and develop against, easy to deploy, and makes me look very, very good to our deployment folks. Brian P.S. I don't use Guice or

Re: Import java transportClient only

2014-11-14 Thread Brian
our client code stays tiny. Works great for us! Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To vi

Re: Question about Logstash Joining ES Cluster and Index

2014-11-14 Thread Brian
n; logstash runs better on the host on which it's gathering the log files and I vastly prefer one central index template than keeping a bazillion logstash configurations in perfect sync. And if we happen replace logstash for something else, then I still have my index creation templates

Re: ES cluster become red

2014-11-10 Thread Brian
, some timeout expires after repeatedly catching NoNodeAvailableException, or else some other serious exception is thrown: client.admin().cluster().prepareHealth().setTimeout(timeout) .setWaitForYellowStatus().execute().actionGet(); Hope this helps! Brian On Sunday, November 9, 2014 8:22:58 AM

Re: ES 1.3.4 scrolling never ends

2014-11-10 Thread Brian
ndeterminately large result set but still sort the results. One of these days, it might make a good plug-in candidate. But I am not sure how to integrate it with the scan API, so for now it's just part of the Java client layer. Brian -- You received this message because you are subscr

Re: Disabling dynamic mapping

2014-11-10 Thread Brian
uot; }, "sn" : { "type" : "string", "analyzer" : "english_stemming_analyzer" }, "o" : { "type" : "string", "analyzer" : "english_ste

Re: get list of all the fields in indextype of index using java api

2014-11-06 Thread Brian
your automatically mapped fields the way you expect. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.co

Re: ES 1.3.4 scrolling never ends

2014-11-05 Thread Brian
You need to get the scroll ID from each response and use that one in the subsequent scan search. You cannot simply reuse the same scroll ID. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this grou

incomplete results?

2014-11-04 Thread brian
d to md5_hash and the same problem occurs. i would appreciate any insight as to what may be happening here as i've tried everything i can think of .. - brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from thi

Re: Replace analyzer on _all field

2014-10-29 Thread Brian
create the mapping I wish for the message field and all is well (no pun intended!). Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elastics

Re: Differences about label your fields with or without @ in Kibana

2014-10-29 Thread Brian
out the source and then choose the field using R when it's not the same name as the field from Elasticsearch. But I digress. Brian On Wednesday, October 29, 2014 1:20:10 PM UTC-4, Iván Fernández Perea wrote: > > I was using Kibana and wondering which are the differences between usi

Re: Need help to create array type field in elastic search

2014-10-14 Thread Brian
onsecutive values. What this does is that if your field contains multiple values that each has multiple words, a phrase query won't span across values unless the slop value is large enough (n or larger, I seem to recall). Hope this helps. Brian -- You received this message because you

Re: snapshot/restore

2014-10-07 Thread Brian
ct that it's in your 0.90.10 version as well. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com.

Re: Logstash into Elasticsearch Mapping Issues

2014-10-06 Thread Brian
et ES host is required: host => "localhost" # Or whatever _type is desired: Usually the environment name # e.g. qa, devtest, prod, and so on: index_type => "sample" } } Brian -- You received this message because you are subscribed to the Google Groups

Re: Logstash into Elasticsearch Mapping Issues

2014-10-06 Thread Brian
at particular field, the _all field is disabled and Elasticsearch is told to use the message field as the default within a Kibana query via the following Java option when starting Elasticsearch as part of the ELK stack: -Des.index.query.default_field=message I hope this helps! Brian On Thu

Re: Kibana 3.1.1

2014-10-03 Thread Brian
Link went away (404); now it's back but still no release notes... On Thursday, October 2, 2014 11:05:16 AM UTC-4, Brian wrote: > > Looks interesting. But no release notes? > > http://www.elasticsearch.org/downloads/kibana-3-1-1/ > > Brian > -- You received th

Re: search for available fields

2014-10-02 Thread Brian
you've collected the subset of fields within your current response, you still can only search on the ones that are indexed. So for a general solution, you would perhaps want to skip over fields that are stored in the documents but not indexed. Brian On Tuesday, September 30, 2014 6:01:20 P

Kibana 3.1.1

2014-10-02 Thread Brian
Looks interesting. But no release notes? http://www.elasticsearch.org/downloads/kibana-3-1-1/ Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an

Re: Kibana server-size integration with R, Perl, and other tools

2014-10-01 Thread Brian
h large queries, and am hoping that Kibana is only giving me a suggestion to use curl, but isn't telling my browser to use curl. Brian On Friday, September 26, 2014 2:51:38 PM UTC-4, Lance A. Brown wrote: > > On 2014-09-25 11:57 am, Brian wrote: > > And as my part of the bargain,

Checking for tampering of indices

2014-10-01 Thread Brian Wilkins
In Splunk, it is possible to detect tampering of logs. Splunk will take an event at ingestion time and create a hash value based on the event and your certificates/keys. You can then write searches that will re-hash the event to be compared to the original to indicate if anything has changed.

Re: Searching on _all vs bool query on a (large) number of fields

2014-10-01 Thread Brian
I would not say "Diabolical". Perhaps not optimal based on Lucene's internal design. But I do something similar with table-based synonyms. In other words, when matching a synonym of a word, I do not pre-build the database index with synonyms. Instead, I maintain a table (index/type) of words an

Re: Pagination in elasticsearch

2014-10-01 Thread Brian
make further adjustments on the response, limiting the response to the page size you expect. Brian On Thursday, September 25, 2014 6:56:44 PM UTC-4, Malini wrote: > > I have > > SearchRequestBuilder srb = client.prepareSearch("cs").setTypes("csdl"); > srb.setS

Re: Error starting up Elasticsearch

2014-09-30 Thread Brian
shutdown and restarted. Brian On Monday, September 29, 2014 8:28:15 PM UTC-4, larry...@gmail.com wrote: > > I'm using ES 1.1.1 and LS 1.4.2 > > I'm using elasticsearch output not http but I can give it a try > -- You received this message because you are subscr

Re: How does logstash chose which timestamped index to use?

2014-09-30 Thread Brian
and every day. Bottom line: logstash already respects the day in the @timestamp when storing data in ES. Brian On Tuesday, September 30, 2014 2:31:59 PM UTC-4, Matt Hughes wrote: > > > > I have a logstash-forwarder client sending events to lumberjack -> > elasticsearch to ti

Re: search for available fields

2014-09-30 Thread Brian
automatic mapping enabled, this is a very good way to not only discover the searchable fields but also see if they are strings or numbers. Brian On Tuesday, September 30, 2014 11:15:32 AM UTC-4, shooali wrote: > > Hi, > > What is the most efficient way to get all available fields to

Re: elasticsearch blocked futex

2014-09-30 Thread Brian
is just a wild guess. I wouldn't have mentioned something so nebulous, but the symptoms you have are strikingly close to the ones we saw. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and

Re: Kibana server-size integration with R, Perl, and other tools

2014-09-29 Thread Brian
Thanks, Jörg. I will need to find some time to look into this, as it seems exactly like what I was looking for. Thanks again! Brian On Monday, September 29, 2014 12:21:00 PM UTC-4, Jörg Prante wrote: > > It is quite easy to add a wrapper as a plugin in ES in the REST output > routi

Re: Kibana server-size integration with R, Perl, and other tools

2014-09-25 Thread Brian
line. And as my part of the bargain, I will use Perl, R, or whatever else is at my disposal to create custom commands that can run on the Kibana host and perform all of the analysis that our group needs. Brian On Wednesday, September 24, 2014 4:34:43 PM UTC-4, Ashit Kumar wrote: > > Bria

How to fix IndexMissingException

2014-09-09 Thread Brian Wilkins
I recently ran into an issue where my cluster is reporting an IndexMissingException. I tried deleting the faulty index, but I keep getting the same error returned. How do I fix this problem? $ curl -XDELETE 'http://localhost:9200/logstash-2014.09.04.11' {"error":"IndexMissingException[[logstash

Re: Using elasticSearch as repository for UDP published Ceilometer data through logstash and exception is being thrown 'invalid version format'

2014-09-02 Thread Brian Callanan
Bump... Anyone??? On Friday, August 29, 2014 11:28:01 AM UTC-4, Brian Callanan wrote: > > > Hi, Need a little help. I'm Using Openstack Ceilometer and I've configured > it to push metered data over UDP to a host:port. I installed logstash and > configured it to rece

Multi-field collapsing

2014-08-29 Thread Brian Hudson
all of the hits that I want - however I can't (have elasticsearch) sort or page them. It's almost like I'd need a "hitCollector" aggregation which would collect all search hits generated by it's sub aggregations and allow me to specify sort and paging informati

Using elasticSearch as repository for UDP published Ceilometer data through logstash and exception is being thrown 'invalid version format'

2014-08-29 Thread Brian Callanan
Hi, Need a little help. I'm Using Openstack Ceilometer and I've configured it to push metered data over UDP to a host:port. I installed logstash and configured it to receive the the UDP data from Ceilometer using the codec: msgpack. This works great! Really! Now I'm trying to Stuff the data on

Kibana server-size integration with R, Perl, and other tools

2014-08-25 Thread Brian
ocument the graphite / graphviz / other format required to display the plots. Just a thought. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an em

Terms Filter Assistance

2014-08-20 Thread Brian
We have 2 indices (logs & intel) and are trying to search 2 fields in the logs index (src & dst) for any match from the intel ip field. The challenge is the terms filter is expecting 1 document with all the values to be searched for within that document. The intel index has over 150k documents.

Re: bulk thread pool rejections

2014-08-14 Thread Malia, Brian
I found out that the rejections on ES are retried by logstash after a short relay. Increasing the queue by too much costs more memory in ES, which takes away from merges, searches, etc.. I increased threadpool.bulk.queue_size from 50 to 100, I see no lost messages due to the rejections. From

Re: transport client? really?

2014-08-06 Thread Brian
ortunities come dressed in overalls and look like work. But I digress :-) Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+uns

Re: Some observations with Curator

2014-08-06 Thread Brian
erver; it's 2.7.5 on my MacBook (Mavericks) and # HP laptop (Ubuntu 14.04 LTS): $ python --version Python 2.6.6 # Latest released version: $ curator --version curator 1.2.2 Brian On Tuesday, August 5, 2014 8:18:24 PM UTC-4, Aaron Mildenstein wrote: > > Hmm. What version of python are

Some observations with Curator

2014-08-05 Thread Brian
, Logstash, Time-based Indices, Curator*. But whether ELK or KELTIC, the stack is awesome! Many thanks to all who contributed and who continue to drive it forward! Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from

Re: Creating elasticsearch index mandatory?

2014-08-04 Thread Brian
didn't see any of my data. But that's because I had loaded some test data into it, and the default time picker only went back a few minutes into the past. Brian On Monday, August 4, 2014 4:03:05 PM UTC-4, Acche Din wrote: > > Hello All, > > I have a ELK setup 'out of

Re: Node Client with bulk request indefinitely blocked thread when ClusterBlockException is being thrown

2014-08-04 Thread Brian
Alex, By the way, is this bug seen with the TransportClient also, or just the NodeClient? Thanks! Brian On Monday, August 4, 2014 4:27:35 AM UTC-4, Alexander Reelsen wrote: > > Hey, > > Just a remote guess without knowing more: On your client side, the > exception is wrapped,

Re: Failure to execute ttl purge

2014-08-04 Thread Brian
always succeeded. It was rather nice to see that my TTL tests were self-cleaning: I always ended up with an empty index after each run. This discussion may also shed a bit of light: http://elasticsearch-users.115913.n3.nabble.com/TTL-Load-Problems-td4024001.html Brian -- You received this

Re: Python version for curator

2014-08-04 Thread Brian
;s working fine just as expected. And it works superbly! Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegrou

Re: Curl -xget works, but fail when use RESTful client in java

2014-08-01 Thread Brian
n two strings (the server/port, and then the URI path), and then the content type and data as separately specified values elsewhere in the API. Brian On Friday, August 1, 2014 4:59:10 PM UTC-4, Chia-Eng Chang wrote: > > Updated. > I figured out that I need to do url-encode to process some c

Re: SIREn plugin for nested documents

2014-07-23 Thread Brian
ot need to be fetched or cached to perform this operation, and the result was breathtakingly blindingly fast performance. Just FYI. I can discuss off-line if anyone wishes. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To u

Can one do a singular/plural phrase match with the Query String Query?

2014-07-21 Thread Brian Jones
Can one perform the following query using wildcards ( instead of two distinct phrases ) when using a Query String Query? "photographic film" OR "photographic films" These do not seem to work, and return the same number of results as just "photographic film": "photographic film?" "photographic f

Dropped HTTP Connections when Indexing

2014-07-18 Thread Brian Jones
I'm trying to scale my indexing for the first time, and I'm running into connections problems. I reach a scale where cURL connections from my indexers start getting cURL7 errors ( connect failed ). It looks like ES just stops accepting all HTTP connections for a period of time. I cannot find

Re: [ANN] Log4j2 Elasticsearch appender

2014-07-18 Thread Brian
Awesome! I had been wondering to myself about this for a while. Brian On Friday, July 18, 2014 4:08:14 AM UTC-4, Jörg Prante wrote: > > Hi, > > I released a Log4j2 Elasticsearch appender > > https://github.com/jprante/log4j2-elasticsearch > > in the hope it is us

Specifying a Phrase within a Proximity Phrase Search?

2014-07-18 Thread Brian Jones
I'm using the a Query String Query to perform a Proximity Search. I'm wondering if ( and if yes how ) I can nest a phrase within the overall phrase: "wood glue manufacturer"~5 ( where "wood glue" would be kept as a phrase ) My users have access to a Query String Query box and I'm exploring more

Re: Python version for curator

2014-07-16 Thread Brian
File "/usr/lib/python2.6/site-packages/pkg_resources.py", line 546, in resolve raise DistributionNotFound(req) pkg_resources.DistributionNotFound: elasticsearch>=1.0.0,<2.0.0 $ *uname -a* Linux elktest 2.6.32-431.17.1.el6.x86_64 #1 SMP Wed May 7 23:32:49 UTC 2014 x86_64 x86_64

Re: Updating Datatype in Elasticsearch

2014-07-16 Thread Brian
s your logstash configuration leaves the message field pretty much intact, disabling the _all field will reduce disk space, increase performance, while still keeping all search functionality. But then, don't forget to also update your Elasticsearch configuration to specify message

Re: Python version for curator

2014-07-14 Thread Brian
rch/curator I'm not a Python dev (yet, anyway) but I don't believe I left anything out that was explicitly mentioned on the curator github page. Brian On Monday, July 14, 2014 3:00:27 PM UTC-4, Brian wrote: > > A quick question: Is Python 2 acceptable for use with curator, or is

Python version for curator

2014-07-14 Thread Brian
A quick question: Is Python 2 acceptable for use with curator, or is Python 3 required? Thanks! Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an

Re: Setting id of document with elasticsearch-hadoop that is not in source document

2014-07-11 Thread Brian Thomas
lternatives that you thought of? > > Cheers, > > On 7/7/14 10:48 PM, Brian Thomas wrote: > > I am trying to update an elasticsearch index using elasticsearch-hadoop. > I am aware of the *es.mapping.id* > > configuration where you can specify that field in the document t

Re: Setting id of document with elasticsearch-hadoop that is not in source document

2014-07-11 Thread Brian Thomas
does not work for you - any > alternatives that you thought of? > > Cheers, > > On 7/7/14 10:48 PM, Brian Thomas wrote: > > I am trying to update an elasticsearch index using elasticsearch-hadoop. > I am aware of the *es.mapping.id* > > configuration where you can

Sorting on Parent/Child attributes

2014-07-11 Thread Brian Rook
Hello, I'm looking for a solution to a problem I am having. Lets say I have 2 types Person and Pet in an index called customers. Person -account -firstname -lastname -SSN Pet -name -type -id -account I would like to query/filter on fields in both person and pet in order to retrieve people and

Setting id of document with elasticsearch-hadoop that is not in source document

2014-07-07 Thread Brian Thomas
I am trying to update an elasticsearch index using elasticsearch-hadoop. I am aware of the *es.mapping.id* configuration where you can specify that field in the document to use as an id, but in my case the source document does not have the id (I used elasticsearch's autogenerated id when indexi

Re: java.lang.NoSuchFieldError: ALLOW_UNQUOTED_FIELD_NAMES when trying to query elasticsearch using spark

2014-07-07 Thread Brian Thomas
.0.0 \--- compile Version 1.0.1 of jackson-core-asl does not have the field ALLOW_UNQUOTED_FIELD_NAMES, but later versions of it do. On Sunday, July 6, 2014 4:28:56 PM UTC-4, Costin Leau wrote: > > Hi, > > Glad to see you sorted out the problem. Out of curiosity w

Re: java.lang.NoSuchFieldError: ALLOW_UNQUOTED_FIELD_NAMES when trying to query elasticsearch using spark

2014-07-06 Thread Brian Thomas
I figured it out, dependency issue in my classpath. Maven was pulling down a very old version of the jackson jar. I added the following line to my dependencies and the error went away: compile 'org.codehaus.jackson:jackson-mapper-asl:1.9.13' On Friday, July 4, 2014 3:22:30 PM UT

java.lang.NoSuchFieldError: ALLOW_UNQUOTED_FIELD_NAMES when trying to query elasticsearch using spark

2014-07-04 Thread Brian Thomas
I am trying to test querying elasticsearch using Apache Spark using elasticsearch-hadoop. I am just trying to do a query to the elasticsearch server and return the count of results. Below is my test class using the Java API: import org.apache.hadoop.conf.Configuration; import org.apache.hadoo

Re: Kibana browser compatibility issues

2014-07-02 Thread Brian
which in turn points it to the plugins directory as described above, Kibana will be available at the following URL (assuming you're on the same host; change localhost as needed, of course): http://localhost:9200/_plugin/kibana3/ Hope this helps! Brian -- You received this message because y

Re: get rid of _all to optimize storage and perfs (Re: Splunk vs. Elastic search performance?)

2014-07-02 Thread Brian
ing?pretty=true' && echo This particular query looks at one of my logstash-generated indices, and it lets me verify that Elasticsearch and Logstash conspired to create the mappings I expected. I used this command quite a bit until I finally got everything configured correctly.

Re: get rid of _all to optimize storage and perfs (Re: Splunk vs. Elastic search performance?)

2014-06-30 Thread Brian
the very first time. So don't be afraid to change your mappings and leave the old ones behind, and re-add data as needed to get everything just the way you want it. Brian On Monday, June 30, 2014 1:22:34 AM UTC-4, Patrick Proniewski wrote: > > Brian, > > Thank you for the repl

Re: Copy index from production to development instance

2014-06-26 Thread Brian Lamb
2014 2:13:06 PM UTC-3, Brian Lamb wrote: >> >> I should also point out that I had to edit a file in the >> metadata-snapshot file to change around the s3 keys and bucket name to >> match what development was expecting. >> >> On Friday, June 6, 2014 1:11:57 PM UT

Pagination: Determine Page Number Of A Record

2014-06-25 Thread Brian Behling
I have a requirement where a document could be anywhere in a result set and I need to calculate a page number according where this document is in the results. I've been trying many different ideas such as using a script to calculate the page number based on the total count and a counter variable

Returning Many Large Documents and Performace

2014-06-25 Thread Brian Behling
I'm executing a query where I could possibly return 100k results. The documents are quite large, about 3.6 kb per document, 312 mb for 100k of these. When executing the query in ES, the query itself is somewhat fast, about 5 seconds. But it takes longer than a minute to get the results back fro

Global Variable for Script Filter

2014-06-25 Thread Brian Behling
I'm using the following script filter: { "query": { "filtered": { "filter": { "and": [ { "or": [ { "term": { "states": "co" } }

Re: Filtering on Script Value

2014-06-25 Thread Brian Behling
On Wednesday, June 25, 2014 12:02:57 AM UTC-6, Cédric Hourcade wrote: > > Hello, > > You should be able to filter with a script using the script filter: > > http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-script-filter.html > > > Cédric

Re: script_fields vs filter script

2014-06-24 Thread Brian Behling
I'm trying to filter on a calculated script field as well. Have you figured this out Kajal? On Tuesday, May 27, 2014 10:49:35 AM UTC-6, Kajal Patel wrote: > > Hey, > > Can you actually post your solution If you figured out. > I am having similar issue, I need to filter search result based on >

Filtering on Script Value

2014-06-24 Thread Brian Behling
I'm trying to calculate a value for each hit then select or filter on a calculated value. Something like below: "query": { "match_all": {} }, "script_fields" : { "counter" : { "script" : "count++", "params" : {

Re: Proper parsing of String values like 1m, 1q HOUR etc.

2014-06-24 Thread Brian
tly back into a TimeValue. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussio

Re: Proper parsing of String values like 1m, 1q HOUR etc.

2014-06-23 Thread Brian
our own terms to TimeValue strings, then then passes them into the TimeValue class. Brian On Tuesday, June 17, 2014 11:31:37 AM UTC-4, Thomas wrote: > > Hi, > > I was wondering whether there is a proper Utility class to parse the given > values and get the duration in millis

Re: Bulk API possible bug

2014-06-23 Thread Brian
s not at the very end of the document, then Elasticsearch would fail to process and index any information past the error, but would successfully process and index information (if any) before the error. Brian -- You received this message because you are subscribed to the Google Groups "

Re: Getting complete value from ElasticSearch query

2014-06-23 Thread Brian
with those other fields. Brian -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion o

  1   2   >