ES as a primary database

2014-11-17 Thread Yann Barraud
Hi, I've been speaking recently with various persons about using Es as a primary database. Here are the main blockers I heard of : - problems with data corruption. Is it still real for 1.4 version ? - data not being available immediately (because of indexing, which is normal) Do

Re: High availability multiple data center / crash recovery

2014-05-26 Thread Yann Barraud
, Yann Barraud 2014-05-23 11:14 GMT+02:00 Florentin Zorca goo...@zorca.de: Hi Yann, we at AutoScout24 (http://www.autoscout24.de) have 3 independent clusters in two data centers, fed with the same data and updated with around the same frequency. The source of the data (an Oracle Database

High availability multiple data center / crash recovery

2014-05-20 Thread Yann Barraud
Hi, Does anyone figured out how to get a working Elasticsearch installation with 2 data centers in 2 different zones ? How do you get consistency ? Is it an active/active configuration ? How do you manage network outages ? I heard geoclustering is not a good idea. So if I have an

Re: unable to write data to elasticsearch using hadoop PIG

2014-03-05 Thread Yann Barraud
Hi, Is your ES instance known by your Hadoop cluster (/etc/hosts) ? It does not even seems to read in it. Cheers, Yann Le mercredi 5 mars 2014 06:32:55 UTC+1, siva mannem a écrit : I installed ES(at the location /usr/lib/elasticsearch/) on our gateway server and i am able to run some

Re: elasticsearch with hadoop and pig

2014-03-05 Thread Yann Barraud
Hi, I poublished this one last week. https://github.com/hortonworks/hadoop-tutorials/blob/master/Community/T07_Elasticsearch_Hadoop_Integration.md Le mardi 4 mars 2014 15:56:25 UTC+1, sriv...@gmail.com a écrit : I am doing a poc project using elasticsearch-hadoop and using pig to create

[Hadoop] New tutorial submitted

2014-02-26 Thread Yann Barraud
Hi, I'm glad to inform I publish a new tutorial to integrate ES + Hortonworks sandbox. https://github.com/hortonworks/hadoop-tutorials/pull/9 Cheers, Yann -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and

Re: [Hadoop] Any goos tut to start with ?

2014-02-25 Thread Yann Barraud
Hi Costin, I did not see the video. It's a good starting point. I 'm not a big fan of videos though. I might reproduce it using Hortonworks sandbox. Cordialement, Yann Barraud 2014-02-24 13:35 GMT+01:00 Costin Leau costin.l...@gmail.com: Have you looked at the video? It does exactly

Re: [Hadoop] Any goos tut to start with ?

2014-02-24 Thread Yann Barraud
] http://www.elasticsearch.org/videos/search-and-analytics-with-hadoop-and-elasticsearch/ On 19/02/2014 5:11 PM, Yann Barraud wrote: Hi everyone, Do you have a good pointer to a tut to start playing with ES Hadoop ? Using Hortonworks VM for example ? Thanks. Cheers

[Hadoop] Cannot discover Elasticsearch version exception

2014-02-24 Thread Yann Barraud
Hi, I'm going my way using Hortonworks Sandbox Elasticsearch Hadoop. I can't have Hive request Elasticsearch. Seems it attemps connecting to ES through hostname while I provided IP adress in Hive query... I found a workaround setting up /etc/hosts in snadbox, but can't figure out why it

[Hadoop] Any goos tut to start with ?

2014-02-19 Thread Yann Barraud
Hi everyone, Do you have a good pointer to a tut to start playing with ES Hadoop ? Using Hortonworks VM for example ? Thanks. Cheers, Yann -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving

Re: Migrating to new cluster

2014-02-19 Thread Yann Barraud
Hi, If I get you well, you'll face an issue. Renaming oldcluster will make it forget previous indexes. (Take a look at data you'll find a dir named oldcluster). The step you're missing is to backup data fro oldcluster Then shtudown, rename Then restore... Or even shutdown and restore on new

Filtered indices aliases and filters size

2014-01-23 Thread Yann Barraud
Hi, Is there a known limit on terms filters size, or somehow a performance issue on specifying tens or a few hundreds of terms within a terms filter while defining a filtered alias on an index. http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-terms-filter.html

Java API : Transport client not complaining when no cluster is on

2013-12-30 Thread Yann Barraud
Hi, Can anyone tell me why my Elasticsearch Transport Client does not complain when not finding a cluster ? Code here : https://github.com/YannBrrd/json-import/blob/master/src/main/java/org/yaba/curbside/ESInjector.java#L92 Thanks. Regards, Yann -- You received this message because you are

Re: Not part of cluster

2013-12-30 Thread Yann Barraud
Hi, Do we have an option to be notified if we are not connected to a cluster ? Thanks. Le vendredi 14 octobre 2011 14:09:04 UTC+2, kimchy a écrit : When happens is that you use the TransportClient, and connect to a node that does not have the same cluster name as the TransportClient. You

Re: Java API : Transport client not complaining when no cluster is on

2013-12-30 Thread Yann Barraud
Yes. In the end Shay told me to use conectedNodes from the client API. Code avalable at github https://github.com/YannBrrd/json-import/blob/master/src/main/java/org/yaba/curbside/ESInjector.java#L95 Cordialement, Yann Barraud 2013/12/30 joergpra...@gmail.com joergpra...@gmail.com

Re: Not part of cluster

2013-12-30 Thread Yann Barraud
Hi, I also opened an issue after talking to Shay https://github.com/elasticsearch/elasticsearch/issues/4569 Cordialement, Yann Barraud 2013/12/30 joergpra...@gmail.com joergpra...@gmail.com After client.addTransportAddress(...), you can check if client.connectedNodes() is not null