[MediaWiki-commits] [Gerrit] operations/puppet[production]: profile::hadoop::worker: install spark2 package after Hive c...

2018-01-19 Thread Elukey (Code Review) 
Elukey has submitted this change and it was merged. ( 
https://gerrit.wikimedia.org/r/405263 )

Change subject: profile::hadoop::worker: install spark2 package after Hive 
config
..


profile::hadoop::worker: install spark2 package after Hive config

While testing a new hadoop node in labs we noticed that spark2-shell
wasn't working due to the absence of the following symlink:

/etc/spark/conf/hive-site.xml -> 
/etc/hive/conf.analytics-hadoop-labs/hive-site.xml

The symlink is done by the spark2 package, that needs to be installed
after include ::profile::hive::client, not before.

Bug: T166248
Change-Id: I4a4dcf072ef5224f3b1b506c8d562e40de1cc540
---
M modules/profile/manifests/hadoop/worker.pp
1 file changed, 7 insertions(+), 1 deletion(-)

Approvals:
  Elukey: Looks good to me, approved
  jenkins-bot: Verified



diff --git a/modules/profile/manifests/hadoop/worker.pp 
b/modules/profile/manifests/hadoop/worker.pp
index 7f32ff1..d0f2a6b 100644
--- a/modules/profile/manifests/hadoop/worker.pp
+++ b/modules/profile/manifests/hadoop/worker.pp
@@ -48,7 +48,13 @@
 class { '::cdh::spark': }
 
 # Spark 2 is manually packaged by us, it is not part of CDH.
-require_package('spark2')
+# The deb package creates as post-install step a symlink like
+# /etc/spark/conf/hive-site.xml -> /etc/hive/conf.analytics/hive-site.xml
+# This package needs to be installed after the deploy of the Hive 
configuration.
+# (should be guaranteed by the puppet evaluation order).
+package { 'spark2':
+ensure => present,
+}
 
 # sqoop needs to be on worker nodes if Oozie is to
 # launch sqoop jobs.

-- 
To view, visit https://gerrit.wikimedia.org/r/405263
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: merged
Gerrit-Change-Id: I4a4dcf072ef5224f3b1b506c8d562e40de1cc540
Gerrit-PatchSet: 2
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Elukey 
Gerrit-Reviewer: Elukey 
Gerrit-Reviewer: Ottomata 
Gerrit-Reviewer: jenkins-bot <>

___
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits

[MediaWiki-commits] [Gerrit] operations/puppet[production]: profile::hadoop::worker: install spark2 package after Hive c...

2018-01-19 Thread Elukey (Code Review) 
Elukey has uploaded a new change for review. ( 
https://gerrit.wikimedia.org/r/405263 )

Change subject: profile::hadoop::worker: install spark2 package after Hive 
config
..

profile::hadoop::worker: install spark2 package after Hive config

While testing a new hadoop node in labs we noticed that spark2-shell
wasn't working due to the absence of the following symlink:

/etc/spark/conf/hive-site.xml -> 
/etc/hive/conf.analytics-hadoop-labs/hive-site.xml

The symlink is done by the spark2 package, that needs to be installed
after include ::profile::hive::client, not before.

Bug: T166248
Change-Id: I4a4dcf072ef5224f3b1b506c8d562e40de1cc540
---
M modules/profile/manifests/hadoop/worker.pp
1 file changed, 7 insertions(+), 1 deletion(-)


  git pull ssh://gerrit.wikimedia.org:29418/operations/puppet 
refs/changes/63/405263/1

diff --git a/modules/profile/manifests/hadoop/worker.pp 
b/modules/profile/manifests/hadoop/worker.pp
index 7f32ff1..d0f2a6b 100644
--- a/modules/profile/manifests/hadoop/worker.pp
+++ b/modules/profile/manifests/hadoop/worker.pp
@@ -48,7 +48,13 @@
 class { '::cdh::spark': }
 
 # Spark 2 is manually packaged by us, it is not part of CDH.
-require_package('spark2')
+# The deb package creates as post-install step a symlink like
+# /etc/spark/conf/hive-site.xml -> /etc/hive/conf.analytics/hive-site.xml
+# This package needs to be installed after the deploy of the Hive 
configuration.
+# (should be guaranteed by the puppet evaluation order).
+package { 'spark2':
+ensure => present,
+}
 
 # sqoop needs to be on worker nodes if Oozie is to
 # launch sqoop jobs.

-- 
To view, visit https://gerrit.wikimedia.org/r/405263
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: I4a4dcf072ef5224f3b1b506c8d562e40de1cc540
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Elukey 

___
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits