Joal has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/402041 )
Change subject: Update oozie mediacounts archive job
......................................................................
Update oozie mediacounts archive job
Add the seeting asllowing for hive to decide on the number of reducers
for the jobs instead of using 1 by default.
Change-Id: Ia42746932ef96779814bbd46815bde40b153389b
---
M oozie/mediacounts/archive/workflow.xml
1 file changed, 5 insertions(+), 1 deletion(-)
git pull ssh://gerrit.wikimedia.org:29418/analytics/refinery
refs/changes/41/402041/1
diff --git a/oozie/mediacounts/archive/workflow.xml
b/oozie/mediacounts/archive/workflow.xml
index 1c0b11d..389c89a 100644
--- a/oozie/mediacounts/archive/workflow.xml
+++ b/oozie/mediacounts/archive/workflow.xml
@@ -103,7 +103,11 @@
<name>oozie.launcher.mapreduce.map.memory.mb</name>
<value>${oozie_launcher_memory}</value>
</property>
-
+ <!--Let hive decide on the number of reducers -->
+ <property>
+ <name>mapred.reduce.tasks</name>
+ <value>-1</value>
+ </property>
<property>
<name>mapreduce.job.queuename</name>
<value>${queue_name}</value>
--
To view, visit https://gerrit.wikimedia.org/r/402041
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ia42746932ef96779814bbd46815bde40b153389b
Gerrit-PatchSet: 1
Gerrit-Project: analytics/refinery
Gerrit-Branch: master
Gerrit-Owner: Joal <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
