See
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/78/display/redirect>
------------------------------------------
[...truncated 310.29 KB...]
*****
* Test: SUCCEED: UserScore successfully run on DirectRunners.
*****
*****
* Test: Running: HourlyTeamScore example on DirectRunner
*****
mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.complete.game.HourlyTeamScore
-Dexec.args="--tempLocation=gs://temp-storage-for-release-validation-tests/mobile-gaming/tmp
--output=java-hourlyteamscore-result.txt
--input=gs://temp-storage-for-release-validation-tests/mobile-gaming/5000_gaming_data.csv"
-Pdirect-runner
Using maven /home/jenkins/tools/maven/apache-maven-3.5.2
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
Mar 06, 2018 1:12:18 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-release-validation-tests/mobile-gaming/5000_gaming_data.csv
matched 1 files with total size 386400
Mar 06, 2018 1:12:18 AM org.apache.beam.sdk.io.FileBasedSource split
INFO: Splitting filepattern
gs://temp-storage-for-release-validation-tests/mobile-gaming/5000_gaming_data.csv
into bundles of size 96600 took 38 ms and produced 1 files and 4 bundles
Mar 06, 2018 1:12:24 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 56b18707-ef53-4e8f-be7b-e83632d54e74 for window
[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z) pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Mar 06, 2018 1:12:24 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer c5bd2387-a480-4e18-bd6b-0ae1a37e0d20 for window
[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z) pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Mar 06, 2018 1:12:24 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer d9497aab-3ed7-4298-96f3-a02c262f2ae4 for window
[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z) pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Mar 06, 2018 1:12:24 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/.temp-beam-2018-03-06_01-12-14-0/d9497aab-3ed7-4298-96f3-a02c262f2ae4
Mar 06, 2018 1:12:24 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/.temp-beam-2018-03-06_01-12-14-0/c5bd2387-a480-4e18-bd6b-0ae1a37e0d20
Mar 06, 2018 1:12:24 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/.temp-beam-2018-03-06_01-12-14-0/56b18707-ef53-4e8f-be7b-e83632d54e74
Mar 06, 2018 1:12:24 AM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 1 file results
Mar 06, 2018 1:12:24 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/.temp-beam-2018-03-06_01-12-14-0/d9497aab-3ed7-4298-96f3-a02c262f2ae4,
shard=2, window=[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z),
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-2-of-3
Mar 06, 2018 1:12:24 AM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 1 file results
Mar 06, 2018 1:12:24 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/.temp-beam-2018-03-06_01-12-14-0/56b18707-ef53-4e8f-be7b-e83632d54e74,
shard=0, window=[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z),
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-0-of-3
Mar 06, 2018 1:12:24 AM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 1 file results
Mar 06, 2018 1:12:24 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/.temp-beam-2018-03-06_01-12-14-0/c5bd2387-a480-4e18-bd6b-0ae1a37e0d20,
shard=1, window=[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z),
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-1-of-3
Mar 06, 2018 1:12:24 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/.temp-beam-2018-03-06_01-12-14-0/d9497aab-3ed7-4298-96f3-a02c262f2ae4
Mar 06, 2018 1:12:24 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/.temp-beam-2018-03-06_01-12-14-0/c5bd2387-a480-4e18-bd6b-0ae1a37e0d20
Mar 06, 2018 1:12:24 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/.temp-beam-2018-03-06_01-12-14-0/56b18707-ef53-4e8f-be7b-e83632d54e74
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.698 s
[INFO] Finished at: 2018-03-06T01:12:24Z
[INFO] Final Memory: 30M/798M
[INFO] ------------------------------------------------------------------------
grep AzureBilby java-hourlyteamscore-result.txt*
java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-2-of-3:window_start:
2015-11-16 16:00:00.000, total_score: 2788, team: AzureBilby
Verified total_score: 2788, team: AzureBilby
*****
* Test: SUCCEED: HourlyTeamScore successfully run on DirectRunners.
*****
*****
* Test: Running: LeaderBoard example on DirectRunner
*****
bq rm -f -t beam_postrelease_mobile_gaming.leaderboard_user
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
bq rm -f -t beam_postrelease_mobile_gaming.leaderboard_team
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
sleep 20
mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.complete.game.injector.Injector
-Dexec.args="apache-beam-testing java_mobile_gaming_topic none"
Using maven /home/jenkins/tools/maven/apache-maven-3.5.2
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
Injecting to topic: projects/apache-beam-testing/topics/java_mobile_gaming_topic
Starting Injector
[+(RubyBandicoot, num members: 6, starting at: 1520298756130, expires in: 24,
robot: null)]
[+(AmaranthKoala, num members: 9, starting at: 1520298756130, expires in: 28,
robot: null)]
[+(AliceBluePlatypus, num members: 17, starting at: 1520298756130, expires in:
28, robot: null)]
[+(AlmondWallaby, num members: 16, starting at: 1520298756131, expires in: 33,
robot: Robot-8)]
[+(AuburnEchidna, num members: 14, starting at: 1520298756131, expires in: 24,
robot: null)]
[+(AliceBlueEmu, num members: 17, starting at: 1520298756131, expires in: 23,
robot: Robot-16)]
[+(AuburnNumbat, num members: 19, starting at: 1520298756131, expires in: 33,
robot: Robot-19)]
[+(BarnRedKangaroo, num members: 9, starting at: 1520298756131, expires in: 33,
robot: Robot-10)]
[+(AmaranthAntechinus, num members: 12, starting at: 1520298756131, expires in:
20, robot: null)]
[+(AppleGreenAntechinus, num members: 7, starting at: 1520298756131, expires
in: 23, robot: null)]
[+(BarnRedKookaburra, num members: 12, starting at: 1520298756131, expires in:
21, robot: null)]
[+(AppleGreenKoala, num members: 7, starting at: 1520298756131, expires in: 24,
robot: null)]
[+(AuburnEmu, num members: 10, starting at: 1520298756131, expires in: 32,
robot: null)]
[+(AquaPlatypus, num members: 11, starting at: 1520298756132, expires in: 26,
robot: null)]
[+(RubyEmu, num members: 17, starting at: 1520298756132, expires in: 27, robot:
null)]
DELAY(384261, 1)
{timestamp_ms=1520298371000}
late data for:
user6_BarnRedKookaburra,BarnRedKookaburra,0,1520298371000,2018-03-05
17:12:36.135
mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.complete.game.LeaderBoard
-Dexec.args="--project=apache-beam-testing
--tempLocation=gs://temp-storage-for-release-validation-tests/mobile-gaming/tmp
--dataset=beam_postrelease_mobile_gaming
--topic=projects/apache-beam-testing/topics/java_mobile_gaming_topic
--output=gs://temp-storage-for-release-validation-tests/mobile-gaming/java-leaderboard-result.txt"
-Pdirect-runner
Using maven /home/jenkins/tools/maven/apache-maven-3.5.2
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
[WARNING]
java.lang.IllegalArgumentException: Argument '
' does not begin with '--'
at
org.apache.beam.sdk.repackaged.com.google.common.base.Preconditions.checkArgument
(Preconditions.java:191)
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseCommandLine
(PipelineOptionsFactory.java:1418)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$200
(PipelineOptionsFactory.java:110)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as
(PipelineOptionsFactory.java:294)
at org.apache.beam.examples.complete.game.LeaderBoard.main
(LeaderBoard.java:196)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
at java.lang.Thread.run (Thread.java:748)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.659 s
[INFO] Finished at: 2018-03-06T01:12:57Z
[INFO] Final Memory: 20M/359M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class. Argument '
[ERROR] ' does not begin with '--'
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-4938518670156135371-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
[WARNING]
java.lang.IllegalArgumentException: Argument '
' does not begin with '--'
at
org.apache.beam.sdk.repackaged.com.google.common.base.Preconditions.checkArgument
(Preconditions.java:191)
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseCommandLine
(PipelineOptionsFactory.java:1418)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$200
(PipelineOptionsFactory.java:110)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as
(PipelineOptionsFactory.java:294)
at org.apache.beam.examples.complete.game.LeaderBoard.main
(LeaderBoard.java:196)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
at java.lang.Thread.run (Thread.java:748)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.659 s
[INFO] Finished at: 2018-03-06T01:12:57Z
[INFO] Final Memory: 20M/359M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class. Argument '
[ERROR] ' does not begin with '--'
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] Failed command
:runners:direct-java:runMobileGamingJavaDirect FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 49s
2 actionable tasks: 2 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
