Ottomata has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391028 )
Change subject: Install spark2 on Hadoop workers for use with Oozie
......................................................................
Install spark2 on Hadoop workers for use with Oozie
Bug: T158334
Change-Id: I965a34e4c6fa7b84ea57943f4928e1aabdec91de
---
M modules/role/manifests/analytics_cluster/hadoop/worker.pp
1 file changed, 3 insertions(+), 0 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/28/391028/1
diff --git a/modules/role/manifests/analytics_cluster/hadoop/worker.pp
b/modules/role/manifests/analytics_cluster/hadoop/worker.pp
index feef748..f6ebab8 100644
--- a/modules/role/manifests/analytics_cluster/hadoop/worker.pp
+++ b/modules/role/manifests/analytics_cluster/hadoop/worker.pp
@@ -106,6 +106,9 @@
# in order load Spark Python dependencies.
include ::cdh::spark
+ # Spark 2 is manually packaged by us, it is not part of CDH.
+ require_package('spark2')
+
# sqoop needs to be on worker nodes if Oozie is to
# launch sqoop jobs.
include ::cdh::sqoop
--
To view, visit https://gerrit.wikimedia.org/r/391028
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I965a34e4c6fa7b84ea57943f4928e1aabdec91de
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ottomata <ao...@wikimedia.org>
_______________________________________________
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
