See
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/77/display/redirect>
------------------------------------------
[...truncated 309.87 KB...]
*****
* Test: SUCCEED: UserScore successfully run on DirectRunners.
*****
*****
* Test: Running: HourlyTeamScore example on DirectRunner
*****
mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.complete.game.HourlyTeamScore
-Dexec.args="--tempLocation=gs://temp-storage-for-release-validation-tests/mobile-gaming/tmp
--output=java-hourlyteamscore-result.txt
--input=gs://temp-storage-for-release-validation-tests/mobile-gaming/5000_gaming_data.csv"
-Pdirect-runner
Using maven /home/jenkins/tools/maven/apache-maven-3.5.2
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
Mar 06, 2018 12:32:08 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern
gs://temp-storage-for-release-validation-tests/mobile-gaming/5000_gaming_data.csv
matched 1 files with total size 386400
Mar 06, 2018 12:32:08 AM org.apache.beam.sdk.io.FileBasedSource split
INFO: Splitting filepattern
gs://temp-storage-for-release-validation-tests/mobile-gaming/5000_gaming_data.csv
into bundles of size 96600 took 61 ms and produced 1 files and 4 bundles
Mar 06, 2018 12:32:14 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 6b051a26-ed29-4bc1-914a-95241159f1be for window
[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z) pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Mar 06, 2018 12:32:14 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 75e363eb-17d4-4349-8d05-4ae2ae9a40f0 for window
[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z) pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Mar 06, 2018 12:32:14 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 10ad1f8d-bd1c-4924-996f-fe8fc7a98f09 for window
[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z) pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
Mar 06, 2018 12:32:14 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/.temp-beam-2018-03-06_00-32-06-0/75e363eb-17d4-4349-8d05-4ae2ae9a40f0
Mar 06, 2018 12:32:14 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/.temp-beam-2018-03-06_00-32-06-0/10ad1f8d-bd1c-4924-996f-fe8fc7a98f09
Mar 06, 2018 12:32:14 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/.temp-beam-2018-03-06_00-32-06-0/6b051a26-ed29-4bc1-914a-95241159f1be
Mar 06, 2018 12:32:15 AM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 1 file results
Mar 06, 2018 12:32:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/.temp-beam-2018-03-06_00-32-06-0/75e363eb-17d4-4349-8d05-4ae2ae9a40f0,
shard=0, window=[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z),
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-0-of-3
Mar 06, 2018 12:32:15 AM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 1 file results
Mar 06, 2018 12:32:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/.temp-beam-2018-03-06_00-32-06-0/6b051a26-ed29-4bc1-914a-95241159f1be,
shard=2, window=[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z),
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-2-of-3
Mar 06, 2018 12:32:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/.temp-beam-2018-03-06_00-32-06-0/6b051a26-ed29-4bc1-914a-95241159f1be
Mar 06, 2018 12:32:15 AM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 1 file results
Mar 06, 2018 12:32:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/.temp-beam-2018-03-06_00-32-06-0/10ad1f8d-bd1c-4924-996f-fe8fc7a98f09,
shard=1, window=[2015-11-17T00:00:00.000Z..2015-11-17T01:00:00.000Z),
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-1-of-3
Mar 06, 2018 12:32:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/.temp-beam-2018-03-06_00-32-06-0/75e363eb-17d4-4349-8d05-4ae2ae9a40f0
Mar 06, 2018 12:32:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/.temp-beam-2018-03-06_00-32-06-0/10ad1f8d-bd1c-4924-996f-fe8fc7a98f09
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15.072 s
[INFO] Finished at: 2018-03-06T00:32:15Z
[INFO] Final Memory: 32M/914M
[INFO] ------------------------------------------------------------------------
grep AzureBilby java-hourlyteamscore-result.txt*
java-hourlyteamscore-result.txt
-2015-11-16 16:00:00.000-2015-11-16 17:00:00.000-0-of-3:window_start:
2015-11-16 16:00:00.000, total_score: 2788, team: AzureBilby
Verified total_score: 2788, team: AzureBilby
*****
* Test: SUCCEED: HourlyTeamScore successfully run on DirectRunners.
*****
*****
* Test: Running: LeaderBoard example on DirectRunner
*****
bq rm -f -t beam_postrelease_mobile_gaming.leaderboard_user
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
bq rm -f -t beam_postrelease_mobile_gaming.leaderboard_team
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.complete.game.injector.Injector
-Dexec.args="apache-beam-testing java_mobile_gaming_topic none"
Using maven /home/jenkins/tools/maven/apache-maven-3.5.2
sleep 20
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
Injecting to topic: projects/apache-beam-testing/topics/java_mobile_gaming_topic
Starting Injector
[+(AlmondWallaby, num members: 17, starting at: 1520296343135, expires in: 25,
robot: null)]
[+(AmberNumbat, num members: 11, starting at: 1520296343135, expires in: 32,
robot: Robot-11)]
[+(AntiqueBrassDingo, num members: 19, starting at: 1520296343135, expires in:
34, robot: null)]
[+(AppleGreenAntechinus, num members: 5, starting at: 1520296343136, expires
in: 32, robot: Robot-7)]
[+(RubyWombat, num members: 10, starting at: 1520296343136, expires in: 33,
robot: null)]
[+(AlmondPossum, num members: 15, starting at: 1520296343136, expires in: 37,
robot: Robot-3)]
[+(ArmyGreenMarmot, num members: 18, starting at: 1520296343136, expires in:
30, robot: Robot-4)]
[+(BarnRedEmu, num members: 19, starting at: 1520296343136, expires in: 38,
robot: Robot-18)]
[+(MagentaQuokka, num members: 12, starting at: 1520296343136, expires in: 25,
robot: null)]
[+(AlmondDingo, num members: 10, starting at: 1520296343136, expires in: 23,
robot: Robot-16)]
[+(AquaQuokka, num members: 13, starting at: 1520296343137, expires in: 37,
robot: null)]
[+(AmethystPlatypus, num members: 9, starting at: 1520296343137, expires in:
24, robot: Robot-2)]
[+(AmethystEchidna, num members: 10, starting at: 1520296343137, expires in:
21, robot: null)]
[+(BattleshipGreyAntechinus, num members: 6, starting at: 1520296343137,
expires in: 38, robot: null)]
[+(ApricotCockatoo, num members: 16, starting at: 1520296343137, expires in:
35, robot: null)]
DELAY(595731, 1)
{timestamp_ms=1520295747000}
late data for:
user3_AmethystPlatypus,AmethystPlatypus,10,1520295747000,2018-03-05 16:32:23.142
mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.complete.game.LeaderBoard
-Dexec.args="--project=apache-beam-testing
--tempLocation=gs://temp-storage-for-release-validation-tests/mobile-gaming/tmp
--dataset=beam_postrelease_mobile_gaming
--topic=projects/apache-beam-testing/topics/java_mobile_gaming_topic
--output=gs://temp-storage-for-release-validation-tests/mobile-gaming/java-leaderboard-result.txt"
-Pdirect-runner
Using maven /home/jenkins/tools/maven/apache-maven-3.5.2
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
[WARNING]
java.lang.IllegalArgumentException: Argument '
' does not begin with '--'
at
org.apache.beam.sdk.repackaged.com.google.common.base.Preconditions.checkArgument
(Preconditions.java:191)
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseCommandLine
(PipelineOptionsFactory.java:1418)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$200
(PipelineOptionsFactory.java:110)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as
(PipelineOptionsFactory.java:294)
at org.apache.beam.examples.complete.game.LeaderBoard.main
(LeaderBoard.java:196)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
at java.lang.Thread.run (Thread.java:748)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.375 s
[INFO] Finished at: 2018-03-06T00:32:41Z
[INFO] Final Memory: 20M/366M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class. Argument '
[ERROR] ' does not begin with '--'
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building word-count-beam 0.1
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @
word-count-beam ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources,
i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory
/tmp/groovy-generated-9060743315487134585-tmpdir/word-count-beam/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @
word-count-beam ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- exec-maven-plugin:1.6.0:java (default-cli) @ word-count-beam ---
[WARNING]
java.lang.IllegalArgumentException: Argument '
' does not begin with '--'
at
org.apache.beam.sdk.repackaged.com.google.common.base.Preconditions.checkArgument
(Preconditions.java:191)
at org.apache.beam.sdk.options.PipelineOptionsFactory.parseCommandLine
(PipelineOptionsFactory.java:1418)
at org.apache.beam.sdk.options.PipelineOptionsFactory.access$200
(PipelineOptionsFactory.java:110)
at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as
(PipelineOptionsFactory.java:294)
at org.apache.beam.examples.complete.game.LeaderBoard.main
(LeaderBoard.java:196)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
at java.lang.Thread.run (Thread.java:748)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.375 s
[INFO] Finished at: 2018-03-06T00:32:41Z
[INFO] Final Memory: 20M/366M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:java
(default-cli) on project word-count-beam: An exception occured while executing
the Java class. Argument '
[ERROR] ' does not begin with '--'
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] Failed command
:runners:direct-java:runMobileGamingJavaDirect FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 34s
2 actionable tasks: 2 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
