Re: Synchronizing Hive metastores across clusters

2016-01-21 Thread Elliot West
gt; > On Thu, Dec 17, 2015 at 11:22 AM, Eugene Koifman >> > wrote: >> >> Metastore supports MetaStoreEventListener and MetaStorePreEventListener >> >> which may be useful here >> >> >> >> Eugene >> >> >> >> From: Ell

Re: Synchronizing Hive metastores across clusters

2015-12-18 Thread Elliot West
ation) > > > > > > Thanks, > > > > -Sushanth > > > > On Thu, Dec 17, 2015 at 11:22 AM, Eugene Koifman > > wrote: > >> Metastore supports MetaStoreEventListener and MetaStorePreEventListener > >> which may be useful here > >> > >>

RE: Synchronizing Hive metastores across clusters

2015-12-17 Thread Mich Talebzadeh
or SAP replication server. HTH, Mich From: Mich Talebzadeh [mailto:m...@peridale.co.uk <mailto:m...@peridale.co.uk> ] Sent: 17 December 2015 16:47 To: user@hive.apache.org <mailto:user@hive.apache.org> Subject: RE: Synchronizing Hive metastores across clusters Are

Re: Synchronizing Hive metastores across clusters

2015-12-17 Thread Sushanth Sowmyan
17, 2015 at 11:22 AM, Eugene Koifman > wrote: >> Metastore supports MetaStoreEventListener and MetaStorePreEventListener >> which may be useful here >> >> Eugene >> >> From: Elliot West >> Reply-To: "user@hive.apache.org" >> Date: Thursday, December

Re: Synchronizing Hive metastores across clusters

2015-12-17 Thread Sushanth Sowmyan
r@hive.apache.org" > Date: Thursday, December 17, 2015 at 8:21 AM > To: "user@hive.apache.org" > Subject: Synchronizing Hive metastores across clusters > > Hello, > > I'm thinking about the steps required to repeatedly push Hive datasets out > from a traditi

Re: Synchronizing Hive metastores across clusters

2015-12-17 Thread Eugene Koifman
7, 2015 at 8:21 AM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Synchronizing Hive metastores across clusters Hello, I'm thinking about the steps required to repeatedly push Hive datasets out from a traditional Hadoop c

Re: Synchronizing Hive metastores across clusters

2015-12-17 Thread Jörn Franke
Hive has the export/import commands, alternatively Falcon+oozie > On 17 Dec 2015, at 17:21, Elliot West wrote: > > Hello, > > I'm thinking about the steps required to repeatedly push Hive datasets out > from a traditional Hadoop cluster into a parallel cloud based cluster. This > is not a one

Re: Synchronizing Hive metastores across clusters

2015-12-17 Thread Elliot West
> > *From:* Mich Talebzadeh [mailto:m...@peridale.co.uk] > *Sent:* 17 December 2015 16:47 > *To:* user@hive.apache.org > *Subject:* RE: Synchronizing Hive metastores across clusters > > > > Are both clusters in active/active mode or the cloud based cluster is > standby?

Re: Synchronizing Hive metastores across clusters

2015-12-17 Thread Elliot West
server. > > > > HTH, > > > > Mich > > > > *From:* Mich Talebzadeh [mailto:m...@peridale.co.uk] > *Sent:* 17 December 2015 16:47 > *To:* user@hive.apache.org > *Subject:* RE: Synchronizing Hive metastores across clusters > > > > Are both clusters

RE: Synchronizing Hive metastores across clusters

2015-12-17 Thread Mich Talebzadeh
, Mich From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: 17 December 2015 16:47 To: user@hive.apache.org Subject: RE: Synchronizing Hive metastores across clusters Are both clusters in active/active mode or the cloud based cluster is standby? From: Elliot West [mailto:tea

RE: Synchronizing Hive metastores across clusters

2015-12-17 Thread Mich Talebzadeh
Are both clusters in active/active mode or the cloud based cluster is standby? From: Elliot West [mailto:tea...@gmail.com] Sent: 17 December 2015 16:21 To: user@hive.apache.org Subject: Synchronizing Hive metastores across clusters Hello, I'm thinking about the steps requir

Synchronizing Hive metastores across clusters

2015-12-17 Thread Elliot West
Hello, I'm thinking about the steps required to repeatedly push Hive datasets out from a traditional Hadoop cluster into a parallel cloud based cluster. This is not a one off, it needs to be a constantly running sync process. As new tables and partitions are added in one cluster, they need to be s