High availability multiple data center / crash recovery

2014-05-20 Thread Yann Barraud
Hi, Does anyone figured out how to get a working Elasticsearch installation with 2 data centers in 2 different zones ? How do you get consistency ? Is it an active/active configuration ? How do you manage network outages ? I heard geoclustering is not a good idea. So if I have an

Re: High availability multiple data center / crash recovery

2014-05-26 Thread Yann Barraud
, Yann Barraud 2014-05-23 11:14 GMT+02:00 Florentin Zorca goo...@zorca.de: Hi Yann, we at AutoScout24 (http://www.autoscout24.de) have 3 independent clusters in two data centers, fed with the same data and updated with around the same frequency. The source of the data (an Oracle Database

Java API : Transport client not complaining when no cluster is on

2013-12-30 Thread Yann Barraud
Hi, Can anyone tell me why my Elasticsearch Transport Client does not complain when not finding a cluster ? Code here : https://github.com/YannBrrd/json-import/blob/master/src/main/java/org/yaba/curbside/ESInjector.java#L92 Thanks. Regards, Yann -- You received this message because you are

Re: Not part of cluster

2013-12-30 Thread Yann Barraud
Hi, Do we have an option to be notified if we are not connected to a cluster ? Thanks. Le vendredi 14 octobre 2011 14:09:04 UTC+2, kimchy a écrit : When happens is that you use the TransportClient, and connect to a node that does not have the same cluster name as the TransportClient. You

Re: Java API : Transport client not complaining when no cluster is on

2013-12-30 Thread Yann Barraud
Yes. In the end Shay told me to use conectedNodes from the client API. Code avalable at github https://github.com/YannBrrd/json-import/blob/master/src/main/java/org/yaba/curbside/ESInjector.java#L95 Cordialement, Yann Barraud 2013/12/30 joergpra...@gmail.com joergpra...@gmail.com

Re: Not part of cluster

2013-12-30 Thread Yann Barraud
Hi, I also opened an issue after talking to Shay https://github.com/elasticsearch/elasticsearch/issues/4569 Cordialement, Yann Barraud 2013/12/30 joergpra...@gmail.com joergpra...@gmail.com After client.addTransportAddress(...), you can check if client.connectedNodes() is not null

Filtered indices aliases and filters size

2014-01-23 Thread Yann Barraud
Hi, Is there a known limit on terms filters size, or somehow a performance issue on specifying tens or a few hundreds of terms within a terms filter while defining a filtered alias on an index. http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-terms-filter.html

[Hadoop] Any goos tut to start with ?

2014-02-19 Thread Yann Barraud
Hi everyone, Do you have a good pointer to a tut to start playing with ES Hadoop ? Using Hortonworks VM for example ? Thanks. Cheers, Yann -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving

Re: Migrating to new cluster

2014-02-19 Thread Yann Barraud
Hi, If I get you well, you'll face an issue. Renaming oldcluster will make it forget previous indexes. (Take a look at data you'll find a dir named oldcluster). The step you're missing is to backup data fro oldcluster Then shtudown, rename Then restore... Or even shutdown and restore on new

Re: [Hadoop] Any goos tut to start with ?

2014-02-24 Thread Yann Barraud
] http://www.elasticsearch.org/videos/search-and-analytics-with-hadoop-and-elasticsearch/ On 19/02/2014 5:11 PM, Yann Barraud wrote: Hi everyone, Do you have a good pointer to a tut to start playing with ES Hadoop ? Using Hortonworks VM for example ? Thanks. Cheers

[Hadoop] Cannot discover Elasticsearch version exception

2014-02-24 Thread Yann Barraud
Hi, I'm going my way using Hortonworks Sandbox Elasticsearch Hadoop. I can't have Hive request Elasticsearch. Seems it attemps connecting to ES through hostname while I provided IP adress in Hive query... I found a workaround setting up /etc/hosts in snadbox, but can't figure out why it

Re: [Hadoop] Any goos tut to start with ?

2014-02-25 Thread Yann Barraud
Hi Costin, I did not see the video. It's a good starting point. I 'm not a big fan of videos though. I might reproduce it using Hortonworks sandbox. Cordialement, Yann Barraud 2014-02-24 13:35 GMT+01:00 Costin Leau costin.l...@gmail.com: Have you looked at the video? It does exactly

[Hadoop] New tutorial submitted

2014-02-26 Thread Yann Barraud
Hi, I'm glad to inform I publish a new tutorial to integrate ES + Hortonworks sandbox. https://github.com/hortonworks/hadoop-tutorials/pull/9 Cheers, Yann -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and

Re: unable to write data to elasticsearch using hadoop PIG

2014-03-05 Thread Yann Barraud
Hi, Is your ES instance known by your Hadoop cluster (/etc/hosts) ? It does not even seems to read in it. Cheers, Yann Le mercredi 5 mars 2014 06:32:55 UTC+1, siva mannem a écrit : I installed ES(at the location /usr/lib/elasticsearch/) on our gateway server and i am able to run some

Re: elasticsearch with hadoop and pig

2014-03-05 Thread Yann Barraud
Hi, I poublished this one last week. https://github.com/hortonworks/hadoop-tutorials/blob/master/Community/T07_Elasticsearch_Hadoop_Integration.md Le mardi 4 mars 2014 15:56:25 UTC+1, sriv...@gmail.com a écrit : I am doing a poc project using elasticsearch-hadoop and using pig to create

ES as a primary database

2014-11-17 Thread Yann Barraud
Hi, I've been speaking recently with various persons about using Es as a primary database. Here are the main blockers I heard of : - problems with data corruption. Is it still real for 1.4 version ? - data not being available immediately (because of indexing, which is normal) Do