DCausse has uploaded a new change for review. https://gerrit.wikimedia.org/r/256954
Change subject: Use snappy for mediawiki avro logs ...................................................................... Use snappy for mediawiki avro logs Change-Id: I91c047ff38011f009d6144295ccbd12a253986bd --- M modules/camus/templates/mediawiki.erb 1 file changed, 3 insertions(+), 5 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/54/256954/1 diff --git a/modules/camus/templates/mediawiki.erb b/modules/camus/templates/mediawiki.erb index 2504da4..f0365b1 100644 --- a/modules/camus/templates/mediawiki.erb +++ b/modules/camus/templates/mediawiki.erb @@ -102,8 +102,6 @@ # WMF relies on the relevant Hadoop properties for this, # not Camus' custom properties. -# i.e. mapreduce.output.compression* properties -# # configure output compression for deflate or snappy. Defaults to deflate. -# etl.output.codec=deflate -# etl.deflate.level=6 -# #etl.output.codec=snappy +# But AvroRecordWriterProvider ignores hadoop properties +# so we must force to snappy with a camus property +etl.output.codec=snappy -- To view, visit https://gerrit.wikimedia.org/r/256954 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I91c047ff38011f009d6144295ccbd12a253986bd Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: DCausse <[email protected]> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
