Hive packaging and the standalone metastore

2018-01-24 Thread Alan Gates
In HIVE-17983 I have been working on packaing and start/stop scripts for the standalone metastore. One question this brings up is how Hive will be released now, with or without the metastore. I can see two options: 1) We continue to ship the metastore with Hive. Not only does this mean the meta

Re: Hive packaging and the standalone metastore

2018-01-24 Thread Mithun RK
#1 is preferable, IMHO. On Wed, Jan 24, 2018 at 12:16 PM Alan Gates wrote: > In HIVE-17983 I have been working on packaing and start/stop scripts for > the standalone metastore. One question this brings up is how Hive will be > released now, with or without the metastore. I can see two options

Re: Hive packaging and the standalone metastore

2018-01-25 Thread Alexander Kolbasov
Alan, While continuing shipping HMS with Hive makes sense (at least for a while), what do you think about somehow separating lib/bin directories created in the distro so Hive and metastore have a separate set of bin/lib dirs? - Alex On Wed, Jan 24, 2018 at 12:16 PM, Alan Gates wrote: > In HIVE

Re: Hive packaging and the standalone metastore

2018-01-26 Thread Vihang Karajgaonkar
I think its important to keep supporting "hive --service metastore" for backwards compatibility. I also think it would be great to have some separation in the lib/bin if possible so that it is easier for someone who downloads Hive but just wants to deploy a standalone-metastore to identify which ja

Re: Hive packaging and the standalone metastore

2018-01-26 Thread Alan Gates
I’m not seeing the value of moving the jars to a different path. If someone just wants to run the metastore it will be possible to download it alone. I’m afraid moving things around will break some script somewhere that we won’t think to test. Alan. On Fri, Jan 26, 2018 at 10:10 AM, Vihang Kara

Re: Hive packaging and the standalone metastore

2018-01-26 Thread Alexander Kolbasov
My concern is that usually the scripts just include all the jars in the lib directory to the classpath. So for metastore they'll include a bunch of extra jars in undefined order, so as metastore evolves and starts using different versions of some jars we'll run in weird jar conflicts. If you think

Re: Hive packaging and the standalone metastore

2018-01-26 Thread Vihang Karajgaonkar
Oh, may be I misunderstood then. Are you suggesting that hive binaries will include metastore and there would also be another tar file which only includes metastore and its dependencies? So if someone just wants to install metastore they can just download metastore tar ball. For hive, since it come

Re: Hive packaging and the standalone metastore

2018-01-26 Thread Alan Gates
On Fri, Jan 26, 2018 at 11:09 AM, Vihang Karajgaonkar wrote: > Oh, may be I misunderstood then. Are you suggesting that hive binaries will > include metastore and there would also be another tar file which only > includes metastore and its dependencies? So if someone just wants to > install metas