Joal has uploaded a new change for review. https://gerrit.wikimedia.org/r/325312
Change subject: Add mediawiki history spark jobs to refinery-job ...................................................................... Add mediawiki history spark jobs to refinery-job refinery-job has a new package mediawikihistory, containing subpackages for user history, page history and denormalized history (revisions, users and pages events). The launcher is MediawikiHistoryRunner in mediawikihistory package. Bug: T141548 Change-Id: Ib4edfec0bf3c531bf99ea997c7cd73d690c9a28b --- M .gitignore M pom.xml M refinery-job/pom.xml A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/MediawikiHistoryRunner.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/denormalized/DenormalizedKeys.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/denormalized/DenormalizedRevisionsBuilder.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/denormalized/DenormalizedRunner.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/denormalized/HistoryEvent.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/page/PageEvent.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/page/PageHistoryBuilder.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/page/PageHistoryDataExtractors.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/page/PageHistoryRunner.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/page/PageState.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/user/UserEvent.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/user/UserHistoryBuilder.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/user/UserHistoryDataExtractors.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/user/UserHistoryRunner.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/user/UserState.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/utils/PhpUnserializer.scala A refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/utils/SubgraphPartitioner.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/TestHelpers.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/denormalized/TestDenormalizedRevisionsBuilder.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/denormalized/TestDenormalizedRunner.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/denormalized/TestHistoryEventHelpers.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/page/TestPageHistoryBuilder.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/page/TestPageHistoryDataExtractors.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/page/TestPageHistoryHelpers.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/user/TestUserHistoryBuilder.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/user/TestUserHistoryDataExtractors.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/user/TestUserHistoryHelpers.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/utils/TestPhpUnserializer.scala A refinery-job/src/test/scala/org/wikimedia/analytics/refinery/job/mediawikihistory/utils/TestSubgraphPartitioner.scala 32 files changed, 6,609 insertions(+), 3 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/analytics/refinery/source refs/changes/12/325312/1 -- To view, visit https://gerrit.wikimedia.org/r/325312 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ib4edfec0bf3c531bf99ea997c7cd73d690c9a28b Gerrit-PatchSet: 1 Gerrit-Project: analytics/refinery/source Gerrit-Branch: master Gerrit-Owner: Joal <j...@wikimedia.org> Gerrit-Reviewer: Milimetric <dandree...@wikimedia.org> _______________________________________________ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
