[GitHub] bigtop pull request #348: BIGTOP-3015: hadoop-spark bundle correction

[jamesbeedy]

GitHub user jamesbeedy opened a pull request:

https://github.com/apache/bigtop/pull/348

BIGTOP-3015: hadoop-spark bundle correction

This change removes the "hadoop-plugin" charm from the "hadoop-spark" 
bundles and tests as it isn't needed in the bundle.

Fixes: https://issues.apache.org/jira/browse/BIGTOP-3015

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jamesbeedy/bigtop 3015_fix_hadoop_spark_bundle

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/348.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #348


commit 42745c4fc96c244ba691b5f1fc4fcc5ec4bbcc5b
Author: jamesbeedy <jamesbeedy@...>
Date:   2018-03-21T17:43:29Z

remove references to "client" from hadoop-spark bundle

Fixes: https://issues.apache.org/jira/browse/BIGTOP-3015




---

[GitHub] bigtop pull request #344: BIGTOP-3007: add properties to hive-site.xml for z...

[jamesbeedy]

Github user jamesbeedy commented on a diff in the pull request:

https://github.com/apache/bigtop/pull/344#discussion_r172086152
  
--- Diff: 
bigtop-packages/src/charm/hive/layer-hive/lib/charms/layer/bigtop_hive.py ---
@@ -36,31 +36,45 @@ def install(self, hbase=None):
 # Prep config
 roles = ['hive-client', 'hive-metastore', 'hive-server2']
 metastore = "thrift://{}:9083".format(hookenv.unit_private_ip())
-if hbase:
-roles.append('hive-hbase')
-hb_connect = "{}:{}".format(hbase['host'], 
hbase['master_port'])
-zk_connect = hbase['zk_connect']
-else:
-hb_connect = ""
-zk_connect = ""
--- End diff --

@kwmonroe totally, nice catch. I'll set those bits appropriately.


---

[GitHub] bigtop pull request #344: BIGTOP-3007

[jamesbeedy]

GitHub user jamesbeedy opened a pull request:

https://github.com/apache/bigtop/pull/344

BIGTOP-3007

In support of hiveserver2 table lock, hive config needs to expose the 
properties:
* hive.support.concurrency
* hive.zookeeper.quorum

Added hive.zookeeper.quorum and hive.support.concurrency in support of
hiveserver2 table lock.

Add vars to init.pp.

Add zookeeper interface and corresponding reactive bits.

Modified install function in lib to facilitate zk_hosts.

Update deployment_matrix.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jamesbeedy/bigtop hive_config_add_zookeeper

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/bigtop/pull/344.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #344


commit 8e7350573ff8500fd7b68a3902421e4ee601a22b
Author: jamesbeedy <jamesbeedy@...>
Date:   2018-02-27T17:19:06Z

Add hive configuration properties in support of hiveserver2

In support of hiveserver2 table lock, hive config needs to expose the 
properties:
* hive.support.concurrency
* hive.zookeeper.quorum

Added hive.zookeeper.quorum and hive.support.concurrency in support of
hiveserver2 table lock.

Add vars to init.pp.

Add zookeeper interface and corresponding reactive bits.

Modified install function in lib to facilitate zk_hosts.

Update deployment_matrix.




---