Re: ingest performance degrades sharply along with the documents having more fileds

2014-06-17 Thread Maco Ma
I tried your script with setting iwc.setRAMBufferSizeMB(4)/ and 48G heap size. The speed can be around 430 docs/sec before the first flush and the final speed is 350 docs/sec. Not sure what configuration Solr uses and its ingestion speed can be 800 docs/sec. Maco On Wednesday, June 18, 201

Retrieving data from Database using Elastic search

2014-06-17 Thread srinu konda
Hi, I am trying to pull data from database using Elastic Search, I have created below river: PUT http://localhost:9200/jdbc_river/river1/_meta { "type":"jdbc" "jdbc": { "url":"Mysql URL" "driver":"Mysql driver" "username":"username" "password":"XXX" "sql":"select * from orders" } } Note:Ab

Re: Splunk vs. Elastic search performance?

2014-06-17 Thread Sabareesh SS
What are the different ways I can make a good use of Elasticsearch? On Saturday, April 19, 2014 3:03:59 AM UTC+5:30, Frank Flynn wrote: > > We have a large Splunk instance. We load about 1.25 Tb of logs a day. We > have about 1,300 loaders (servers that collect and load logs - they may do > ot

Can I sort has_child query result by child's numeric field?

2014-06-17 Thread fiefdx yang
I found this: http://www.slideshare.net/martijnvg/document-relationsbbuz2013 it use custom_score, but it can not work at version 1.2.1. I try to use function_score, but get exception: nested: PropertyAccessException[[Error: could not access: offer; in class: org.elasticsearch.search.lookup.DocLook

Bulk API possible bug

2014-06-17 Thread pablitomusa
Hi guys, today I was using the bulk API and the data was loading just fine into Elasticsearch. However, when querying Elasticsearch the resulting JSON (apparently ok) was invalid, with an extra comma "hits": [{ ... "_source":{...}, }, { ... "_source":{...}, }, }] After a

Re: ingest performance degrades sharply along with the documents having more fileds

2014-06-17 Thread Maco Ma
Hi Mike, new_ES_config.sh(define the templates and disable the refresh/flush): curl -XPOST localhost:9200/doc -d '{ "mappings" : { "type" : { "_source" : { "enabled" : false }, "dynamic_templates" : [ {"t1":{

Re: ingest performance degrades sharply along with the documents having more fileds

2014-06-17 Thread Cindy Hsin
The way we make Solr ingest faster (single document ingest) is by turn off the engine soft commit and hard commit and use a client to commit the changes every 10 seconds. Solr ingest speed remains at 800 docs per second where ES ingest speed drops in half when we increase the fields (ie. from

Re: exclude some documents (and category filter combination) for some queries

2014-06-17 Thread Srinivasan Ramaswamy
Yeah, I forgot to include my actual result. My "not" filter was not working at all. I got all the 3 designs back: 100, 101 and 102. I followed the syntax in the link you sent and it worked :) I tried similar syntax a few times before i posted the question, but i didn't have a "filter" clause insid

Re: Kibana chart data view understanding

2014-06-17 Thread fred . grummit
Yes, I tried all of those steps. There doesn't seem to be a way to get the current Kibana to render multiple lines from different JSON attributes in the same histogram when the documents contain numeric values in the format described. The nearest similar prolem is: https://github.com/elasticse

Re: Stats aggregation, return documents at min/max.

2014-06-17 Thread Dan Isla
I was able to solve my own problem using a terms sub-aggregation on the 'x' values in the interval bucket. { "size": 0, "aggs" : { "vals": { "filter": {"term" : { "component" : "data_to_plot" }}, "aggs": { "values_over_time" : {

Re: exclude some documents (and category filter combination) for some queries

2014-06-17 Thread Ivan Brusic
I jumped the gun when I thought I realized the issue. You listed your expected result, but not your actual result. Are you actually using nested documents? If so, you would need to use nested queries/filters: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-nested-f

Re: Nested vs Parent-Child - index and search side differences

2014-06-17 Thread Adrien Grand
Your understanding is correct. To add more to it, nested documents are stored in contiguous blocks in the index, making it very fast to resolve the parent given a child and vice-versa. On the other hand for parent/child there is sort or a hash table maintained on top of the index to match parents w

Re: Problem setting up cluster with NAT address

2014-06-17 Thread Mark Walkom
You can only define one address for ES to use. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 18 June 2014 00:12, pmartins wrote: > Hi, > > Thanks for the reply. > > The firewall on the node is off, and he can't c

Re: Storing auto generated _id under different name

2014-06-17 Thread Adrien Grand
No, it isn't possible. Why would you like to have the id of the document included in _source? On Tue, Jun 17, 2014 at 8:16 PM, Johny Lam wrote: > Is it possible to have the _id be auto-generated and store it so that it's > in the _source field under a different name, like say "id" instead of "

Re: Scroll Questions

2014-06-17 Thread joergpra...@gmail.com
1. yes 2. facet/aggregations are not very useful while scrolling (I doubt they even work at all) because scrolling works on shard level and aggregations work on indices level 3. a scroll request takes resources. The purpose of ClearScrollRequest is to release those resources explicitly. This is i

Upgrade from 1.0.3 to 1.1.2 and cat shards (and cat indices) give NullPointerException during upgrade

2014-06-17 Thread Christopher Crammond
Has anyone observed a problem when upgrading from ElasticSearch 1.0.3 to 1.1.2 regarding the cat shards (or cat indices)? We recently rolled this out in one of our environments and experienced a NullPointerException (NPE) for some of the cat API calls (for instance: cat/shards or cat/indices).

Re: Facet cache size and other memory metrics

2014-06-17 Thread smonasco
This has something like what I'd like to find in the Cache stats per field section https://github.com/bleskes/elasticfacets , but I'm unsure if it's any good for 1.x On Tuesday, June 17, 2014 4:10:13 PM UTC-6, smonasco wrote: > > For instance I think I remember some plugin that would give you an

Re: Facet cache size and other memory metrics

2014-06-17 Thread smonasco
For instance I think I remember some plugin that would give you an idea how big an impact a facet might have on your field cache, and I think that was suppose to become part of Elasticsearch itself, but I may be dreaming. On Tuesday, June 17, 2014 4:06:35 PM UTC-6, smonasco wrote: > > Hi, > > We

Re: ingest performance degrades sharply along with the documents having more fileds

2014-06-17 Thread Michael McCandless
I tested roughly your Scenario 2 (100K unique fields, 100 fields per document) with a straight Lucene test (attached, but not sure if the list strips attachments). Net/net I see ~100 docs/sec with one thread ... which is very slow. Lucene stores quite a lot for each unique indexed field name and

Facet cache size and other memory metrics

2014-06-17 Thread smonasco
Hi, We're having problems with some nodes hitting the maximum heap size and were looking into ways to get visibility into the field cache impact of different indexes/shards. Any suggestions? --Shannon Monasco -- You received this message because you are subscribed to the Google Groups "elas

Re: ingest performance degrades sharply along with the documents having more fileds

2014-06-17 Thread Michael McCandless
Hi, Could you post the scripts you linked to (new_ES_config.sh, new_ES_ingest_threads.pl, new_Solr_ingest_threads.pl) inlined? I can't download them from where you linked. Optimizing every 10 seconds or 10 minutes is really not a good idea in general, but I guess if you're doing the same with ES

Cannot load index from external file using logstash

2014-06-17 Thread Eitan Vesely
Hi all, i am running one instance of elastic and one of logstash in parallel on the same computer. when trying to load a file into elastic, using logstash that is running the config file below, i get the follwing output msgs on elastic and no file is loaded (when input is configured to be stdi

How to set replication type equal to Async for an index

2014-06-17 Thread pranav amin
Hi, We are planning to create Index with 2 replica's and in order to have better performance we are thinking of doing the replication Async. I'm creating the Index this way - curl -XPUT 'http://localhost:9200/xyz/' -d '{ "settings" : { "number_of_shards" : 2, "number_of_rep

Nested vs Parent-Child - index and search side differences

2014-06-17 Thread Srinivasan Ramaswamy
I searched the forum and internet in general, but i couldn't find clear answers about the differences in scoring. And most of the answers are pretty old. I would like to know all the important current differences/comparison between nested and parent-child documents. What i understood so far 1.

updating a document using Java API

2014-06-17 Thread ESUser
Hi All, As part of an update request, I need to add new fields to a document(search to get the doc-id and then update). With Lucene API's it can be achieved by 1) reading the doc into a temp document 2) update the temp document 3) delete the original document from index and add the temp docume

Storing auto generated _id under different name

2014-06-17 Thread Johny Lam
Is it possible to have the _id be auto-generated and store it so that it's in the _source field under a different name, like say "id" instead of "_id"? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop rec

Re: Scroll Questions

2014-06-17 Thread mooky
One more question I forgot: Rather than looking at hits.length to know if the end of the scroll has been reached, would it not be better to return a null scrollId when the end of the cursor has been reached? On the surface it seems that would be a) more intuitive b) be the same regardless of whi

Scroll Questions

2014-06-17 Thread mooky
Having hit a bunch of issues using scroll, I thought I better improve my understanding of how scroll is supposed to be used (and how its not supposed to be used). 1. Does it make sense to execute a search request with scroll, but SearchType != SCAN? 2. Does it make sense to execute a

Re: No handler found for uri when creating a mapping

2014-06-17 Thread Ivan Brusic
An index can be comprised of multiple types, so the type is not needed in the URL. Try simply 192.168.1.103:9200/nxtxnlogs Cheers, Ivan On Tue, Jun 17, 2014 at 1:14 AM, Abhishek Mukherjee <4271...@gmail.com> wrote: > Hi, > > I am following the ES Definitive guide. I am trying to create a mapp

Re: Query Performance

2014-06-17 Thread ravimbhatt
Hi Binh, Did some tests and here are the findings: Moving to c3.4xlarge reduces time by 300 ms. So that takes overall 90th percentile down to ~1.5 seconds. CPU still in high 80s-90s. Making all queries filtered and removing script from 2nd queries' 2nd aggregation reduced CPU footprint (hig

Re: Boost field does not work..

2014-06-17 Thread Ivan Brusic
How do you know that the search is not working? Can you post an example query and perhaps an example explanation? If you are searching against the all field, you can set include_in_all to false for that field. You are better off not searching a field instead of trying to set a boost. Cheers, Iva

Re: Type Ahead feature for contact list

2014-06-17 Thread Itamar Syn-Hershko
Take a look here: http://www.elasticsearch.org/blog/you-complete-me/ -- Itamar Syn-Hershko http://code972.com | @synhershko Freelance Developer & Consultant Author of RavenDB in Action On Tue, Jun 17, 2014 at 8:03 PM, Omi wrote

Type Ahead feature for contact list

2014-06-17 Thread Omi
Hello All I am quite new for elasticsearch and reading elasticsearch related documents from few days. I am creating a contact list search for my application, where contacts are stored in format. I am facing a problem while searching the name using java client. for example few contacts in m

Re: node failures

2014-06-17 Thread Kireet Reddy
As soon as we restarted indexing, we saw a lot of merge activity and the deleted documents percentage went to around 25%. Does indexing activity trigger merges? Currently, there is not much merge activity, but some indices still have high deleted document counts. E.g. we have one index with coun

Re: better places to store es.nodes and es.port in ES Hive integration?

2014-06-17 Thread Jinyuan Zhou
I will check the value. However, it has problem only when I use both es.mapping.id and 'dynamic/mult resource wirtes' feature. used separately they are fine. Jinyuan (Jack) Zhou On Tue, Jun 17, 2014 at 6:25 AM, Costin Leau wrote: > Most likely the some of your data contains some invalid entrie

cross_fields with decompound words

2014-06-17 Thread Bernhardt Scherer
Hi there, I have a question concerning the decompounding of the search term. Use case: - Search is a multi match search on "name" and "category" - cross_fields is used: each of the search terms need to be in one of the searched fields - There is a product named "holzspiralbohrer" - There is a p

Re: Shard failure when scrolling - invalid results, but no error reported

2014-06-17 Thread mooky
With a bit of cunning use of the debugger, I managed to get the stacktrace that was lost. It appears that maybe the ElasticsearchIntegrationTest environment is the cause... This looks like a bug? java.lang.AssertionError at org.elasticsearch.common.util.BigArrays$LongArrayWrapper.get(BigArrays.

Proper parsing of String values like 1m, 1q HOUR etc.

2014-06-17 Thread Thomas
Hi, I was wondering whether there is a proper Utility class to parse the given values and get the duration in milliseconds probably for values such as 1m (which means 1 minute) 1q (which means 1 quarter) etc. I have found that elasticsearch utilizes class TimeValue but it only parses up to wee

Shard failure when scrolling - invalid results, but no error reported

2014-06-17 Thread mooky
I have been having some problem with a failing test (using the ElasticsearchIntegrationTest) that was testing scrolling. It took quite a while to notice that in my response was an indication I was getting a shard failure (my search response was OK, but the response included shard failures). I s

Re: Query Performance

2014-06-17 Thread ravimbhatt
Hi Binh, thanks for helping. My record size for 1st query is 4 fields. 3 of them integers and a date. so the _source is not big enough to raise concerns. I will anyways try your suggestion and report any improvements here. For the 2nd query: i have 15gb of RAM. only 20% of which gets utilise

Re: Swap indexes?

2014-06-17 Thread 'Binh Ly' via elasticsearch
Not sure I fully understand, but you might be interested in snapshot/restore: http://www.elasticsearch.org/blog/introducing-snapshot-restore/ -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving em

Re: Cannot Increase Write TPS in Elasticsearch by adding more nodes

2014-06-17 Thread Georgi Ivanov
I don't know how you are doing the indexing . Are you using bulk request or .. ? Bulk insert can greatly increase indexing speed. You can also check node client. It should have better indexing speed because it will be 1 hop operation, compared to two hop with transport client. (assuming Java A

Re: Query Performance

2014-06-17 Thread ravimbhatt
Hi Georgi, Thanks for your response. I clear the caches before each test i.e. a test for 5000 unique ids. During the test period, cache size reaches 2.5-3 gb for filter cache and 120+ mb for field cache. The response time (90th percentile) for query 1 is about 85-100 milliseconds. The max i s

Re: Query Performance

2014-06-17 Thread 'Binh Ly' via elasticsearch
For the first query, since you don't care about the _score, move the bool query into a filter. If you only need field1 and field2 and your _source is big, might be able to save some network payload using source filtering only for those 2 fields. For the second query, if you have a lot RAM and s

Re: Elasticsearch support for Java 1.8?

2014-06-17 Thread Chris Neal
Thanks very much guys! Chris On Tue, Jun 17, 2014 at 9:01 AM, joergpra...@gmail.com < joergpra...@gmail.com> wrote: > Scripting issues were due to MVEL, but with MVEL 2.2.0.Final, this has > been fixed in ES. > > So yes, you can run ES on Java 8 JVM. > > Jörg > > > On Tue, Jun 17, 2014 at 3:58

Re: Problem setting up cluster with NAT address

2014-06-17 Thread pmartins
Hi, Thanks for the reply. The firewall on the node is off, and he can't comunicate with himself. The problem is: vm-motisqaapp02 has the local address 172.16.3.81 with the NAT 10.10.1.135. But, with the current data center definitions, it can't solve the 10.10.1.135 doesn't recognizing itself.

Re: Share a document across multiple indices

2014-06-17 Thread Georgi Ivanov
Will aliases help you in this case ? For example : index1 : [doc1] index2 : [doc2] Create an alias "Docs" for index1 and index2 The run queries against the alias? On Monday, June 16, 2014 3:51:45 AM UTC+2, Martin Angers wrote: > > Hi, > > I'm wondering if this is a supported scenario in El

Re: Garbage collector logs long passes

2014-06-17 Thread 'Binh Ly' via elasticsearch
You likely want to find out whats taking up your heap. The biggest consumer of heap is fielddata. This will tell you what is in your fielddata and you can track it back to your code to see where you are using these fields: curl localhost:9200/_nodes/stats/indices/fielddata/*?pretty -- You rece

Re: Swap indexes?

2014-06-17 Thread Georgi Ivanov
Tribe node may be ? http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-tribe.html#modules-tribe On Tuesday, June 17, 2014 10:31:00 AM UTC+2, Lee Gee wrote: > > Is it possible to have one ES instance create an index and then have a > second instance use that created ind

Re: Query Performance

2014-06-17 Thread Georgi Ivanov
Does the response time improve when caches are full ? Can you try query without sort and see of things get better ? I found that sorting in ES is not good idea sometimes. Georgi On Monday, June 16, 2014 1:40:38 PM UTC+2, ravim...@gmail.com wrote: > > Hi All, > > I am trying to improve my ES q

Re: Elasticsearch support for Java 1.8?

2014-06-17 Thread joergpra...@gmail.com
Scripting issues were due to MVEL, but with MVEL 2.2.0.Final, this has been fixed in ES. So yes, you can run ES on Java 8 JVM. Jörg On Tue, Jun 17, 2014 at 3:58 PM, Georgi Ivanov wrote: > As far as I know , ES will work just fine with java 1.8, > except script support. > > I read some article

Re: Problem setting up cluster with NAT address

2014-06-17 Thread Georgi Ivanov
Doesn't sound like elasticsearch issue ... I would look to my FW rules On Tuesday, June 17, 2014 2:17:20 PM UTC+2, pmartins wrote: > > Hi, > > I'm having some problems setting up a 1.2.1 ES cluster. I have two nodes, > each one in a different data center/network. > > One of the nodes is behi

Re: Elasticsearch support for Java 1.8?

2014-06-17 Thread Georgi Ivanov
As far as I know , ES will work just fine with java 1.8, except script support. I read some articles on the Internet that scripting support is broken with java 1.8 But I would love to hear someone who actually tried :) On Tuesday, June 17, 2014 3:19:37 PM UTC+2, Chris Neal wrote: > > Hi, > > I

Re: ElasticSearch - search statistic - like google analytics

2014-06-17 Thread Jacob Dalgaard
Hello Mark Thank you for your reply. Then I will look into this approch. Regards. Jacob Den tirsdag den 17. juni 2014 14.06.15 UTC+2 skrev Mark Walkom: > ES doesn't store this natively, you'd have to put something in-between the > user and ES to capture and collate this information. > > Your L

Re: reverse_nested aggregation facing troubles when applied to array of nested objects

2014-06-17 Thread Adrian Luna
If not possible. Is there any other way to aggregate by several fields? Or do I need to make 2 different aggregations and then merge them in my application? El martes, 17 de junio de 2014 15:11:26 UTC+2, Adrian Luna escribió: > > Ok, just realized something. The problem wasn't related to this. B

Re: reverse_nested aggregation facing troubles when applied to array of nested objects

2014-06-17 Thread Adrian Luna
If not possible. Is there any other way to aggregate by several fields? El martes, 17 de junio de 2014 15:11:26 UTC+2, Adrian Luna escribió: > > Ok, just realized something. The problem wasn't related to this. But in > order to use the 1.2 version (which first expose this reverse_nested > functi

Re: better places to store es.nodes and es.port in ES Hive integration?

2014-06-17 Thread Costin Leau
Most likely the some of your data contains some invalid entries which result in an invalid JSON payload being sent to ES. Check your ID values and/or keep an eye on issue #217 which aims to provide more human-friendly messages for the user. Cheers. https://github.com/elasticsearch/elasticsearc

Elasticsearch support for Java 1.8?

2014-06-17 Thread Chris Neal
Hi, I saw this blog post from April stating java 1.7u55 as being safe for Elasticsearch, but I didn't see anything about Java 1.8 support. Just wondering if it was :) http://www.elasticsearch.org/blog/java-1-7u55-safe-use-elasticsearch-lucene/ Thanks! Chris -- You received this message becaus

Re: reverse_nested aggregation facing troubles when applied to array of nested objects

2014-06-17 Thread Adrian Luna
Ok, just realized something. The problem wasn't related to this. But in order to use the 1.2 version (which first expose this reverse_nested functionallity), something seem to change from the 1.1 version I was using before. Something I usually did before is aggregation by several fields using t

Re: Index template requires settings object even if its value is empty

2014-06-17 Thread Brian
By the way, I got a little ahead of myself in the previous post. In particular: "settings" : { "index.mapping.ignore_malformed" : true*,* *"index.query.default_field" : "message"* }, Apparently, when added the setting above in red, and then removed the following option from my ES 1.2.1 star

Get X word before and after search word

2014-06-17 Thread Petr Janský
Hello, I'm trying to find way how to get words/terms around search word eg let's have a document with text "The best search engine is ElasticSearch". I will search for "best" and get info that word "search" is xtime the next one after search words. Thx Petr -- You received this message becau

reverse_nested aggregation facing troubles when applied to array of nested objects

2014-06-17 Thread Adrian Luna
I have an issue where my mapping includes an array of nested objects. Let's imagine something simplified like this: { "properties":{ "datetime":{"type":"date"}, "tags":{"type":"object","properties":{ "object_of_type_a":{"type":"nested","properties":{"##SOME F

Problem setting up cluster with NAT address

2014-06-17 Thread pmartins
Hi, I'm having some problems setting up a 1.2.1 ES cluster. I have two nodes, each one in a different data center/network. One of the nodes is behind a NAT address, so I set network.publish_host to de NAT address. Both nodes connect to each other without problems. The issue is when the node behi

Re: ElasticSearch - search statistic - like google analytics

2014-06-17 Thread Mark Walkom
ES doesn't store this natively, you'd have to put something in-between the user and ES to capture and collate this information. Your LS idea seems like a good one to solve it. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.

Re: Garbage collector logs long passes

2014-06-17 Thread Mark Walkom
Upgrade to a newer version of ES, also upgrade java, and if you can, increase your heap. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 17 June 2014 21:00, Kevin Qi wrote: > *Hi,* > *We are running Elasticsearch 0

Garbage collector logs long passes

2014-06-17 Thread Kevin Qi
*Hi,* *We are running Elasticsearch 0.90.7 on Linux sever (1 node cluster).* *From time to time, Elasticsearch stop responding and the issue looks related to the Garbage Collector. The log file is shown blow:* *[2014-06-16 09:35:48,563][WARN ][monitor.jvm ] [node01] [gc][ConcurrentM

Re: River between embedded Elasticsearch and embedded Neo4j

2014-06-17 Thread Flavio Graf
Hi Jimmy, interested in updating ES index when Neo4j changes (automatic). Did you find a solution to your problem? Cheers On Friday, March 7, 2014 11:24:06 PM UTC+1, Jimmy Reeves wrote: > > I am currently using a river between Neo4j and ES in my project, > Configuring rivers for standalone datas

ElasticSearch - search statistic - like google analytics

2014-06-17 Thread Jacob Dalgaard
Hello I am looking into using ElasticSearch as a search engine for one of the projects I am working on. There is still one thing which I need to find an answer for, and I hope someone inhere can help. The customer want to be able to see some search statistic, like google analytics. Most searched

Re: Query Performance

2014-06-17 Thread ravimbhatt
Hello All, Any help one this please? Thanks! Ravi On Monday, 16 June 2014 12:40:38 UTC+1, ravim...@gmail.com wrote: > > Hi All, > > I am trying to improve my ES query performance. The goal is to get > response times for 3 related queries under a second!. In my test i have > seen 90th percen

Re: better places to store es.nodes and es.port in ES Hive integration?

2014-06-17 Thread Jinyuan Zhou
sure, I was able to run follwoing command against my remote es cluster. hive -i init.hive -f search.hql. Below is the contents of init.hive, search.hql and data file in hdfs /user/cloudera/hivework/foobar/foobar.data I replaced value for es.nodes with fake name. Other than that, it should ran w

Re: exclude some documents (and category filter combination) for some queries

2014-06-17 Thread Srinivasan Ramaswamy
Hi Ivan Thanks for your reply. Yeah, I do understand that currently elasticsearch returns the whole nested doc. Can you help me how can i get the negative query with multiple categories working ? Thanks Srini On Fri, Jun 13, 2014 at 10:58 AM, Ivan Brusic wrote: > Currently not possible. Elast

Re: Update single field of a document

2014-06-17 Thread Aditya Tripathi
Thanks Mark, I will start a new thread on this with better description of the problem. On Sun, Jun 15, 2014 at 3:30 PM, Mark Walkom wrote: > The thread you are quoting here is nearly 4 years old, it might be better > if you start a new thread as it's possible the info contained in this will > b

Re: Swap indexes?

2014-06-17 Thread Mark Walkom
Instance as in cluster, or node? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 17 June 2014 18:31, Lee Gee wrote: > Is it possible to have one ES instance create an index and then have a > second instance use tha

Re: Sorting on timestamps from multiple fields

2014-06-17 Thread Jurian Sluiman
Thanks for the response :) I was now testing it out with the _timestamp field which I need to set manually for each item, but copy_to seems even better. Thanks for the insights! -- Jurian On Thursday, June 12, 2014 5:28:49 PM UTC+2, Jörg Prante wrote: > > If you have two (or more) date fields t

Re: After upgrade to elastic search 1.2.1 getting org.elasticsearch.transport.RemoteTransportException: Failed to deserialize response of type [org.elasticsearch.action.admin.cluster.node.info.NodesIn

2014-06-17 Thread Martin Forssen
I have also encountered this, did the debugging and created an issue: https://github.com/elasticsearch/elasticsearch/issues/6325 -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it,

Swap indexes?

2014-06-17 Thread Lee Gee
Is it possible to have one ES instance create an index and then have a second instance use that created index, without downtime? tia lee -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails

version 1.2.1 has_child query with function_score can not access child's numeric field value

2014-06-17 Thread fiefdx yang
curl -XPOST 'localhost:9200/products/' -d '{ "index" : { "number_of_shards" : 4, "number_of_replicas" : 1 } }' echo "" curl -XPOST localhost:9200/products/product/_mapping -d '{ "product":{ "properties" : { "property1" : {"type" : "string"} } } }' echo "" curl -XPOST localhost:9200/products/off

No handler found for uri when creating a mapping

2014-06-17 Thread Abhishek Mukherjee
Hi, I am following the ES Definitive guide. I am trying to create a mapping for an index and type as follows. curl -XPUT '192.168.1.103:9200/nxtxnlogs/transaction/' -d ' "mappings" : { "_default_" : { "properties" : { "txn_id" : { "type" : "long" }, "logged_at" : { "type"

Re: Accessing Search Templates via Rest

2014-06-17 Thread Sebastian Gräser
Thank you very much : ) good to know! Am Montag, 16. Juni 2014 15:46:43 UTC+2 schrieb Alexander Reelsen: > > Hey, > > no, this is not yet possible, but this will be added sooner or later as > the search template API should behave like any other API. > > > --Alex > > > On Fri, Jun 13, 2014 at 9:51

Re: Kibana chart data view understanding

2014-06-17 Thread Mark Walkom
Where have you gotten so far with KB? Try this; 1. Create a new blank dashboard from the default homepage 2. Configure that (top right) to point to the index and your timestamp fied then save that 3. On the main dashboard page add a new row, then save 4. Add a new panel This is wh

Re: Percollation limits

2014-06-17 Thread Maciej Dziardziel
Thanks for reply. I did some early testing and I am getting about 0.7-1.4s to get results, (that's without any filtering yet), which is still within acceptable range for me. I'd still like to hear about people experience with it. It seems this is very rarely used feature. On Monday, June 16,

Re: Creating a browse interface from ES

2014-06-17 Thread joergpra...@gmail.com
If you can use the sort key of the term (internal java collation key or ICU collation key) instead of absolute position number, there is no longer the need to reindex. One advantage is that you can adjust the sort key to the requirements (in Germany we have complex sort requirements that are not co

Re: Elasticsearch field mapping, dynamic_templates

2014-06-17 Thread sirkubax
*Hi Alex, That's more or less what I did:* curl -XGET localhost:9200/_template?pretty > template_all edit template_all and put it back: curl -XPUT localhost:9200/_template/* -d @template_all * By ES is 1.0.1, I've seen that there is major change in templates in ES 1.2. Do you thin

Re: Elastic Search and consistency

2014-06-17 Thread shikhar
On Fri, Jun 13, 2014 at 12:11 PM, shikhar wrote: > I take this back, I understand the ES model better now. So although the > write-consistency-level check is only applied before the write is about > to be issued, with sync replication the client can only get an ack if it > succeded on the primary