Ottomata has submitted this change and it was merged. Change subject: Correct app session metrics README and jar version ......................................................................
Correct app session metrics README and jar version Bug: T117615 Change-Id: Idbf5b29cd01965e0da98e790d072b9f94f3345d0 --- M oozie/mobile_apps/session_metrics/README.md M oozie/mobile_apps/session_metrics/bundle.properties 2 files changed, 17 insertions(+), 6 deletions(-) Approvals: Ottomata: Verified; Looks good to me, approved diff --git a/oozie/mobile_apps/session_metrics/README.md b/oozie/mobile_apps/session_metrics/README.md index eb38b7d..47adf21 100644 --- a/oozie/mobile_apps/session_metrics/README.md +++ b/oozie/mobile_apps/session_metrics/README.md @@ -1,17 +1,28 @@ Oozie job to schedule app session metrics reports. The reports are -set to be generated every 7 days for the last 30 days of data. +set to be generated every 7 days. There are 2 kinds of reports: + +- Global: Considers all sessions for the last 30 days of data. +- By OS: Considers the last 7 days of data and splits the sessions + by OS family (Android, iOS). The oozie workflow launches a spark action that runs the AppSessionMetrics scala job in analytics-refinery-source/refinery-job here - https://phabricator.wikimedia.org/diffusion/ANRS/ -Example command for running the coordinator on command line: +Example command for running the bundle on command line: oozie job -run \ - -config coordinator.properties \ + -config bundle.properties \ -D refinery_directory=hdfs://analytics-hadoop/user/madhuvishy/refinery \ -D spark_job_jar=hdfs://analytics-hadoop/user/madhuvishy/source/refinery-job-0.0.12-SNAPSHOT.jar \ -D output_directory=hdfs://analytics-hadoop/user/madhuvishy/session_metrics -The results of this job is stored at output_directory/session_metrics.tsv. It's also exposed as -a hive external table - see refinery/hive/mobile_apps/create_mobile_apps_session_metrics_table.hql \ No newline at end of file +The results of this job are stored at + +- {output_directory}/session_metrics/session_metrics.tsv (global) +- {output_directory}/session_metrics_by_os/session_metrics.tsv (by OS) + +They're also exposed as hive external tables. See: + +- refinery/hive/mobile_apps/create_mobile_apps_session_metrics_table.hql +- refinery/hive/mobile_apps/create_mobile_apps_session_metrics_by_os_table.hql diff --git a/oozie/mobile_apps/session_metrics/bundle.properties b/oozie/mobile_apps/session_metrics/bundle.properties index 63b7da0..2c67ab4 100644 --- a/oozie/mobile_apps/session_metrics/bundle.properties +++ b/oozie/mobile_apps/session_metrics/bundle.properties @@ -49,7 +49,7 @@ spark_master = yarn spark_deploy = cluster spark_assembly_jar = ${name_node}/user/spark/share/lib/spark-assembly.jar -spark_job_jar = ${artifacts_directory}/org/wikimedia/analytics/refinery/refinery-job-0.0.14.jar +spark_job_jar = ${artifacts_directory}/org/wikimedia/analytics/refinery/refinery-job-0.0.26.jar spark_job_class = org.wikimedia.analytics.refinery.job.AppSessionMetrics spark_job_name = app_session_metrics spark_number_executors = 32 -- To view, visit https://gerrit.wikimedia.org/r/267996 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: Idbf5b29cd01965e0da98e790d072b9f94f3345d0 Gerrit-PatchSet: 2 Gerrit-Project: analytics/refinery Gerrit-Branch: master Gerrit-Owner: Mforns <mfo...@wikimedia.org> Gerrit-Reviewer: Ottomata <o...@wikimedia.org> _______________________________________________ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
