Ottomata has uploaded a new change for review.
https://gerrit.wikimedia.org/r/159383
Change subject: Set up sampled-1000 output for kafkatee on analytics1003
......................................................................
Set up sampled-1000 output for kafkatee on analytics1003
This change makes kafktee consume from all 4 webrequest topics.
Qchris asked me to do start doing this while he was away on vacation,
so that he could verify these logs when he got back.
Change-Id: I1727d0540dd340c74461a6210d5162c6190af476
---
M manifests/role/analytics/kafkatee.pp
M manifests/site.pp
2 files changed, 15 insertions(+), 1 deletion(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/83/159383/1
diff --git a/manifests/role/analytics/kafkatee.pp
b/manifests/role/analytics/kafkatee.pp
index 62059f9..5d5b9d5 100644
--- a/manifests/role/analytics/kafkatee.pp
+++ b/manifests/role/analytics/kafkatee.pp
@@ -95,6 +95,20 @@
}
}
+# == Class role::analytics::kafkatee::webrequest::sampled inherits
role::analytics::kafkatee::webrequest
+# Sets up kafkatee to consume from all 4 webrequest topics output
+# to a file with no filtering, but with 1/1000 requests sampled.
+#
+class role::analytics::kafkatee::webrequest::sampled inherits
role::analytics::kafkatee::webrequest {
+ include role::analytics::kafkatee::input::webrequest
+
+ ::kafkatee::output { 'sampled-1000':
+ destination => "${webrequest_log_directory}/sampled-1000.tsv.log",
+ sample => 1000,
+ }
+}
+
+
# == role::analytics::kafkatee::webstatscollector
# We want to run webstatscollector via kafkatee for testing.
# Some of the production (role::logging::webstatscollector)
diff --git a/manifests/site.pp b/manifests/site.pp
index 1377ba7..01f43b7 100644
--- a/manifests/site.pp
+++ b/manifests/site.pp
@@ -93,7 +93,7 @@
include role::analytics
include role::analytics::kafkatee::webrequest::mobile
-
+ include role::analytics::kafkatee::webrequest::sampled
include role::analytics::kafkatee::webrequest::webstatscollector
}
--
To view, visit https://gerrit.wikimedia.org/r/159383
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I1727d0540dd340c74461a6210d5162c6190af476
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ottomata <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
