See
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/174/display/redirect?page=changes>
Changes:
[mingmxu] update JavaDoc for BoundedWindow
[klk] Restore non-recursive globs in GcsUtil
[dhalperi] [BEAM-1702] Document how to use BigtableIO with local emulator
[klk] [BEAM-659] WindowFn#isCompatible should provide a meaningful reason
[kirpichov] Remove incorrect `Message` bound on writeAvros
[tgroh] Add ParDos
[kirpichov] Splits SplittableParDo into a core-construction part and a
KWI-related
[dhalperi] [BEAM-2318] Ensure that tables that don't exist are not created
[iemejia] [BEAM-2391] Clone Scan in HBaseReader
[lcwik] [BEAM-2252] Use pluginManagement instead of redefining
[altay] update dataflow python container
[klk] [BEAM-2164] Fix generate-sources.sh if directory contains space
[klk] Move snappy-java version to dependencyManagement
[kirpichov] Comply with byte limit for Datastore Commit.
[kirpichov] Make the large entities test neater.
[kirpichov] End-to-end test for large entity writes.
[lcwik] [BEAM-1345] Remove FileSystems.setDefaultConfigInWorkers since Dataflow
[lcwik] [BEAM-2293] Rename Top.{Largest,Smallest=>Natural,Reversed}
[lcwik] [BEAM-2253] Use resource transformer plugin to use versions defined in
[lcwik] [BEAM-2334] Fix OutOfMemoryError
[klk] Add TransformPayloadTranslatorRegistrar
[klk] Remove Pipeline reference from TransformHierarchy
[tgroh] Fix GroupAlsoByWindowEvaluatorFactory doc
[klk] Minor touch-ups to new BoundedWindow javadoc
[tgroh] Remove Unused DoFnInfo methods
[tgroh] Extract the Main Input PCollection in ParDos
[tgroh] Cleanup k8s scripts naming & don't create insecure svc by default
[altay] [BEAM-1999] Remove resolved todo from value providers
[altay] Update Dataflow BATCH_ENVIRONMENT_MAJOR_VERSION to 6
[tgroh] Add ReadTranslator
[tgroh] Include Additional PTransform inputs in Transform Nodes
[klk] Add WindowIntoTranslator
[klk] Fix compile error from bad merge
[altay] Comply with byte limit for Datastore Commit.
[dhalperi] Re-rename fat jar so that install doesn't install the bundled jar as
the
[tgroh] Revert "Include Additional PTransform inputs in Transform Nodes"
[robertwb] Automatically convert examples to use with syntax.
[klk] Move StepContext to top level
[klk] Remove StepContext.noteOutput
[klk] Rename BaseExecutionContext.StepContext to BaseStepContext
[klk] Move BaseStepContext to the top level
[klk] Remove extraneous ExecutionContext parameter to BaseStepContext
[klk] Implement StepContext directly in the DirectRunner
[klk] Remove writePCollectionViewData from the Beam codebase
[klk] Inline and delete BaseExecutionContext
[klk] Delete unused ExecutionContext
[klk] Remove unused StepContext name methods
[klk] Delete unused remnants in DirectExecutionContext
[klk] Delete unused BaseStepContext
[klk] Shorten excessive name in DirectExecutionContext
[klk] Revise StepContext javadoc
[klk] Remove unused pieces of DirectStepContext
[altay] Fix lint error in datastoreio_test
[chamikara] [BEAM-2338] Fix the limit counter in gcsio reads
[klk] Rename PCollections to PCollectionTranslation
[klk] Rename PTransforms to PTransformTranslation
[klk] Rename ParDos to ParDoTranslation
[klk] Rename WindowIntoTranslator to WindowIntoTranslation
[klk] Rename ReadTranslator to ReadTranslation
[klk] Rename Coders to CoderTranslation
[klk] Rename WindowingStrategies to WindowingStrategyTranslation
[klk] Rename Triggers to TriggerTranslation
[altay] upgrading python sdk dependencies
[klk] Do not ever shrink allowed lateness
[klk] Adds large key tests to GroupByKeyTest
[tgroh] Add CombineTranslation
[dhalperi] Initial implementation of SpannerIO.Write
[dhalperi] Minor style, compilation, javadoc fixups
[dhalperi] Fix spanner dependency management
[dhalperi] Delete SpannerCSVLoader
[dhalperi] Refine Spanner API tests
[dhalperi] SpannerIO.Write cleanup and style fixes
[robertwb] Automatically generate Python proto and grpc files.
[robertwb] Remove auto-generated proto and grpc files.
[robertwb] A couple of worker fixes.
[robertwb] Adding a snippet for metrics
[iemejia] Update maven-dependency-plugin to version 3.0.1
[klk] Make SdkComponents public for TransformPayloadTranslator
[klk] Centralize primitive URNs in PTransformTranslation class
[klk] Add URN for Splittable ProcessElement pseudo-primitive
[klk] Allow getting URN for class of transform via translator
[klk] Add registration for Read and WindowInto translators
[klk] Register ReadTranslator
[klk] Register WindowIntoTranslator
[klk] Add trivial FlattenTranslator to access URN
[klk] Add transform-analysis helpers to ReadTranslation
[klk] Add RawPTransform, which can just vend its URN and payload
[klk] URNs for DirectRunner TransformEvaluator and RootInputProvider
[robertwb] More robust gen_protos on jenkins.
[tgroh] Clarify that PTransform#expand shouldn't be called
[klk] Fixup CombineTranslation
[kirpichov] Cleanups in SimpleDoFnRunner and ParDoEvaluator
[kirpichov] Fixes pb2.py path in gitignore
[robertwb] Additional explicit file cleanup in gen_protos.
[lcwik] [BEAM-2354] Add a ReadStringsFromPubSub/WriteStringsToPubSub PTransform
[jbonofre] [BEAM-2276] Add windowing into default filename policy
[hepei.hp] fix FlinkAccumulatorCombiningStateWithContext read null accum bug
[tgroh] Visit a Transform Hierarchy in Topological Order
[tgroh] Update Apex Overrides
[tgroh] Roll-forward Include Additional PTransform inputs in Transform Nodes
[klk] Mark CombineFnWithContext StateSpecs internal
[klk] Allow translation to throw IOException
[klk] Flesh out TimerSpec and StateSpec in Runner API
[klk] Add case dispatch to StateSpec
[klk] Make Java serialized CombineFn URN public
[klk] Implement TimerSpec and StateSpec translation
[tgroh] Revert "Roll-forward Include Additional PTransform inputs in Transform
[tgroh] Revert "Visit a Transform Hierarchy in Topological Order"
[dhalperi] [BEAM-1542] SpannerIO sink updates
[robertwb] [BEAM-2366] Don't try to pickle gen_protos in tests.
[tgroh] Add Missing Space in DataflowMetrics
[dhalperi] [BEAM-2372] Only run Apache RAT at root pom.xml
[lcwik] [BEAM-2369] HadoopFileSystem: prevent NPE on match of non existing file
[robertwb] [BEAM-2365] Use the highest pickle protocol available.
[chamikara] Fix Python Dataflow execution errors due to #3223
[iemejia] Upgrade Avro dependency to version 1.8.2
[aljoscha.krettek] [BEAM-2380] Forward additional outputs to DoFnRunner in
Flink Batch
[aljoscha.krettek] Fix flushing of pushed-back data in Flink Runner on +Inf
watermark
[dhalperi] fix javadoc of View
[jbonofre] [BEAM-2379] Avoid reading projectId from environment variable in
tests.
[lcwik] [BEAM-1347] Remove the usage of a thread local on a potentially hot path
[kirpichov] [BEAM-2248] KafkaIO support to use start read time to set start
offset
[altay] Clean up pyc files before running tests
[lcwik] [BEAM-1544] Java cross-JDK version tests on Jenkins
[iemejia] Refactor HadoopInputFormatIO to use SerializableConfiguration from
[iemejia] Make SerializableConfiguration more robust by using Hadoop based
[dhalperi] [TRIVIAL] InstantCoder: stop boxing Longs unnecessarily
[tgroh] Reduce Prevalence of PValue in the DirectRunner
[dhalperi] Flink*DoFnFunction: fix check for single-output dofns
[dhalperi] Add RawUnion code to FlinkDoFnFunction
[jbonofre] [BEAM-2246] Use CLIENT_ACK instead of AUTO_ACK in JmsIO
[klk] Add WriteFilesPayload to Runner API well-known transforms
[klk] Make WriteFiles config publicly readable
[jbonofre] Rename class Logger object names to the standard convention 'LOG'
[lcwik] Rephrases messages on RetryHttpRequestInitializer
[altay] Add template examples to snippets.py
[klk] Add WriteFiles translation
[altay] fix python lint errors
[klk] Add GroupByKey translation
[davor] Fetch only relevant PR
[lcwik] [BEAM-1348] Add Runner API constructs to ProcessBundleDescriptor.
[robertwb] Unify Java and Python WindowingStrategy representations.
[robertwb] Add known window serialization for Java.
[robertwb] Ignore all proto generated files.
[robertwb] Increase dataflow worker version.
[davor] [BEAM-2378] support FULL OUTER JOIN
[klk] Add translation convenience for non-composites
[klk] Add TestStreamPayload to Runner API proto
[klk] Expose internal constructors for TestStream events
[klk] Add TestStream translation
[kirpichov] Bumps dataflow container version to 0530
[kirpichov] Removes unused PropertyNames
[kirpichov] Dead-letter support for BigQuery. Allow users to specify a retry
policy,
[klk] Allow the Distinct transform to deduplicate elements across panes
[aviemzur] [BEAM-2175] [BEAM-1115] Support for new State and Timer API in Spark
[aljoscha.krettek] Fix race condition when outputting pushed-back elements in
Flink Runner
[aljoscha.krettek] [BEAM-2401] Update Flink Runner to Flink 1.3.0
[hepei.hp] Flink runner: specify CheckpointingMode through PipelineOptions.
[hepei.hp] Flink runner: specify checkpointTimeout through PipelineOptions.
[owenzhang1990] Update against master changes
[owenzhang1990] Activate Gearpump local-validates-runner-tests in precommit
[owenzhang1990] Respect WindowFn#getOutputTime in gearpump-runner
[kirpichov] [BEAM-2406] Fix NullPointerException when writing an empty table
[tgroh] Remove the requirement to visit PCollectionViews in Dataflow
[kirpichov] Make batch loads repeatable across different invocations of the same
[lcwik] [BEAM-1347] Migrate to Runner API constructs within the Java SDK harness
[lcwik] [BEAM-1347] Add additional logging
[klk] Clarify javadoc on PTransformTranslation
[klk] Add CreatePCollectionView translation
[jbonofre] [BEAM-2276] Cleanups on the windowed DefaultFilenamePolicy
[aljoscha.krettek] [BEAM-1498] Use Flink-native side outputs
[aljoscha.krettek] Remove the FnOutputT parameter from DoFnOperator
[pei] Flink runner: support MapState in FlinkStateInternals.
[altay] Do not fail when gen_protos cannot be imported
[klk] Fix RawPTransform translation
[klk] Improve Splittable ParDo translation
[altay] Migrate Python tests to not depend on fix sharding for file output
[altay] soft-enable the use of streaming flag
[chamikara] [BEAM-2405] Write to BQ using the streaming API
[altay] Whitelist find for tox environments
[bchambers] Increase visibility of some Metrics methods
[davor] Generate a random table name. Assume Spanner database exists.
[altay] Fix imports in sdk_worker.
[altay] Fix the staging directory path in copying from GCS
[chamikara] [BEAM-2405] Override to sink interface in the batch dataflow BQ
[jbonofre] [BEAM-245] Add CassandraIO
[jbonofre] Sort IO by alphanumeric order
[lcwik] [BEAM-1231] Add missed "kind:bytes" to
[aljoscha.krettek] [BEAM-2407] Fix Flink CoderTyperSerializer ConfigSnapshot
[aljoscha.krettek] [BEAM-1779] Port UnboundedSourceWrapperTest to use Flink
operator test
[aljoscha.krettek] [BEAM-2408] Fix watermark emission in Flink
UnboundedSourceWrapper
[lcwik] [BEAM-2421] Swap to use an Impulse primitive + DoFn for Create when
[iemejia] Shutdown Flink Streaming Pipeline when reaching +Inf watermark
[ccy] Remove support for NativeSinks from the Python DirectRunner
[lcwik] Make BytesCoder to be a known type
[robertwb] Add coder info to pubsub io
[tgroh] Expand all PValues to component PCollections always
[lcwik] Avoid flakiness in data channel for empty streams.
[altay] Refine Python DirectRunner watermark advancement behavior
[altay] Raise entity limit per RPC to 9MB.
[klk] Add Runner API oriented PTransformMatchers for DirectRunner overrides
[klk] DirectRunner override matchers using Runner API
[robertwb] Use inner module for non-public coders.
[kirpichov] Implements HCatalogIO
[kirpichov] Slight debuggability improvements in BigtableIO
[chamikara] Move Runner API protos to portability/runners/api
[jbonofre] [BEAM-2410] Remove TransportClient from ElasticSearchIO to decouple
IO
[tgroh] Fix compile error occurs in some JDKs
[robertwb] Use beam.Map rather than beam.ParDo for PubSub encoding.
[tgroh] Visit a Transform Hierarchy in Topological Order
[tgroh] Roll-forward Include Additional PTransform inputs in Transform Nodes
[klk] Port ViewOverrideFactory to SDK-agnostic APIs
[klk] Port DirectGroupByKey to SDK-agnostic APIs
[klk] Port DirectRunner WriteFiles override to SDK-agnostic APIs
[klk] Port DirectRunner TestStream override to SDK-agnostic APIs
[owenzhang1990] Fix side input handling in DoFnFunction
------------------------------------------
[...truncated 1.50 MB...]
at
org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:158)
at
org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:81)
at
org.apache.maven.plugin.surefire.InPluginVMSurefireStarter.runSuitesInProcess(InPluginVMSurefireStarter.java:84)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1060)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:907)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:785)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at
org.jvnet.hudson.maven3.launcher.Maven33Launcher.main(Maven33Launcher.java:129)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:238)
at jenkins.maven3.agent.Maven33Main.launch(Maven33Main.java:176)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at hudson.maven.Maven3Builder.call(Maven3Builder.java:139)
at hudson.maven.Maven3Builder.call(Maven3Builder.java:70)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2017-06-12T17:24:51.241 [INFO]
2017-06-12T17:24:51.241 [INFO] Results:
2017-06-12T17:24:51.241 [INFO]
2017-06-12T17:24:51.241 [ERROR] Failures:
2017-06-12T17:24:51.244 [ERROR]
PAssertTest.testPAssertEqualsSingletonFalse:355
Expected: a string containing "The value was not equal to 44"
but: was null
2017-06-12T17:24:51.244 [ERROR]
PAssertTest.testPAssertEqualsSingletonFalseDefaultReasonString:373
Expected: a string containing "Create.Values/Read(CreateSource).out"
but: was null
2017-06-12T17:24:51.244 [ERROR]
FlattenTest.testFlattenPCollectionsThenParDo:122
ParDo(Identity)/ParMultiDo(Identity).out0:
Expected: iterable over ["To be, or not to be: that is the question: ",
"Whether 'tis nobler in the mind to suffer ", "The slings and arrows of
outrageous fortune, ", "Or to take arms against a sea of troubles, ", "And by
opposing end them? To die: to sleep; ", "No more; and by a sleep to say we end
", "The heart-ache and the thousand natural shocks ", "That flesh is heir to,
'tis a consummation ", "Devoutly to be wish'd. To die, to sleep; ", "To sleep:
perchance to dream: ay, there's the rub; ", "For in that sleep of death what
dreams may come ", "When we have shuffled off this mortal coil, ", "Must give
us pause: there's the respect ", "That makes calamity of so long life; ", "For
who would bear the whips and scorns of time, ", "The oppressor's wrong, the
proud man's contumely, ", "The pangs of despised love, the law's delay, ", "The
insolence of office and the spurns ", "That patient merit of the unworthy
takes, ", "When he himself might his quietus make ", "With a bare bodkin? who
would fardels bear, ", "To grunt and sweat under a weary life, ", "But that the
dread of something after death, ", "The undiscover'd country from whose bourn
", "No traveller returns, puzzles the will ", "And makes us rather bear those
ills we have ", "Than fly to others that we know not of? ", "Thus conscience
does make cowards of us all; ", "And thus the native hue of resolution ", "Is
sicklied o'er with the pale cast of thought, ", "And enterprises of great pith
and moment ", "With this regard their currents turn awry, ", "And lose the name
of action.--Soft you now! ", "The fair Ophelia! Nymph, in thy orisons ", "Be
all my sins remember'd.", "hi", "there", "bob!", "To be, or not to be: that is
the question: ", "Whether 'tis nobler in the mind to suffer ", "The slings and
arrows of outrageous fortune, ", "Or to take arms against a sea of troubles, ",
"And by opposing end them? To die: to sleep; ", "No more; and by a sleep to say
we end ", "The heart-ache and the thousand natural shocks ", "That flesh is
heir to, 'tis a consummation ", "Devoutly to be wish'd. To die, to sleep; ",
"To sleep: perchance to dream: ay, there's the rub; ", "For in that sleep of
death what dreams may come ", "When we have shuffled off this mortal coil, ",
"Must give us pause: there's the respect ", "That makes calamity of so long
life; ", "For who would bear the whips and scorns of time, ", "The oppressor's
wrong, the proud man's contumely, ", "The pangs of despised love, the law's
delay, ", "The insolence of office and the spurns ", "That patient merit of the
unworthy takes, ", "When he himself might his quietus make ", "With a bare
bodkin? who would fardels bear, ", "To grunt and sweat under a weary life, ",
"But that the dread of something after death, ", "The undiscover'd country from
whose bourn ", "No traveller returns, puzzles the will ", "And makes us rather
bear those ills we have ", "Than fly to others that we know not of? ", "Thus
conscience does make cowards of us all; ", "And thus the native hue of
resolution ", "Is sicklied o'er with the pale cast of thought, ", "And
enterprises of great pith and moment ", "With this regard their currents turn
awry, ", "And lose the name of action.--Soft you now! ", "The fair Ophelia!
Nymph, in thy orisons ", "Be all my sins remember'd."] in any order
but: No item matches: "To be, or not to be: that is the question: ",
"Whether 'tis nobler in the mind to suffer ", "The slings and arrows of
outrageous fortune, ", "Or to take arms against a sea of troubles, ", "And by
opposing end them? To die: to sleep; ", "No more; and by a sleep to say we end
", "The heart-ache and the thousand natural shocks ", "That flesh is heir to,
'tis a consummation ", "Devoutly to be wish'd. To die, to sleep; ", "To sleep:
perchance to dream: ay, there's the rub; ", "For in that sleep of death what
dreams may come ", "When we have shuffled off this mortal coil, ", "Must give
us pause: there's the respect ", "That makes calamity of so long life; ", "For
who would bear the whips and scorns of time, ", "The oppressor's wrong, the
proud man's contumely, ", "The pangs of despised love, the law's delay, ", "The
insolence of office and the spurns ", "That patient merit of the unworthy
takes, ", "When he himself might his quietus make ", "With a bare bodkin? who
would fardels bear, ", "To grunt and sweat under a weary life, ", "But that the
dread of something after death, ", "The undiscover'd country from whose bourn
", "No traveller returns, puzzles the will ", "And makes us rather bear those
ills we have ", "Than fly to others that we know not of? ", "Thus conscience
does make cowards of us all; ", "And thus the native hue of resolution ", "Is
sicklied o'er with the pale cast of thought, ", "And enterprises of great pith
and moment ", "With this regard their currents turn awry, ", "And lose the name
of action.--Soft you now! ", "The fair Ophelia! Nymph, in thy orisons ", "Be
all my sins remember'd." in ["Be all my sins remember'd.", "The fair Ophelia!
Nymph, in thy orisons ", "And lose the name of action.--Soft you now! ", "With
this regard their currents turn awry, ", "And enterprises of great pith and
moment ", "Is sicklied o'er with the pale cast of thought, ", "And thus the
native hue of resolution ", "Thus conscience does make cowards of us all; ",
"Than fly to others that we know not of? ", "And makes us rather bear those
ills we have ", "No traveller returns, puzzles the will ", "The undiscover'd
country from whose bourn ", "But that the dread of something after death, ",
"To grunt and sweat under a weary life, ", "With a bare bodkin? who would
fardels bear, ", "When he himself might his quietus make ", "That patient merit
of the unworthy takes, ", "The insolence of office and the spurns ", "The pangs
of despised love, the law's delay, ", "The oppressor's wrong, the proud man's
contumely, ", "For who would bear the whips and scorns of time, ", "That makes
calamity of so long life; ", "Must give us pause: there's the respect ", "When
we have shuffled off this mortal coil, ", "For in that sleep of death what
dreams may come ", "To sleep: perchance to dream: ay, there's the rub; ",
"Devoutly to be wish'd. To die, to sleep; ", "That flesh is heir to, 'tis a
consummation ", "The heart-ache and the thousand natural shocks ", "No more;
and by a sleep to say we end ", "And by opposing end them? To die: to sleep; ",
"Or to take arms against a sea of troubles, ", "The slings and arrows of
outrageous fortune, ", "Whether 'tis nobler in the mind to suffer ", "To be, or
not to be: that is the question: ", "bob!", "there", "hi"]
2017-06-12T17:24:51.245 [ERROR] KvSwapTest.testKvSwap:68
KvSwap/KvSwap/Map/ParMultiDo(Anonymous).out0:
Expected: iterable over [<KV{1, one}>, <KV{2, two}>, <KV{3, three}>, <KV{4,
four}>, <KV{4, dup}>, <KV{5, dup}>, <KV{null, null}>] in any order
but: No item matches: <KV{1, one}>, <KV{2, two}>, <KV{3, three}>, <KV{4,
four}>, <KV{4, dup}>, <KV{5, dup}>, <KV{null, null}> in []
2017-06-12T17:24:51.245 [ERROR] Errors:
2017-06-12T17:24:51.245 [ERROR] CountingSourceTest.testBoundedSource:92 »
NullPointer
2017-06-12T17:24:51.245 [ERROR]
CountingSourceTest.testBoundedSourceSplits:127 » NullPointer
2017-06-12T17:24:51.245 [ERROR] CountingSourceTest.testUnboundedSource:166 »
NullPointer
2017-06-12T17:24:51.245 [ERROR]
CountingSourceTest.testUnboundedSourceSplits:250 » NullPointer
2017-06-12T17:24:51.246 [ERROR]
CountingSourceTest.testUnboundedSourceTimestamps:192 » NullPointer
2017-06-12T17:24:51.246 [ERROR] GenerateSequenceTest.testBoundedInput:71 »
NullPointer
2017-06-12T17:24:51.246 [ERROR]
GenerateSequenceTest.testBoundedInputSubrange:100 » NullPointer
2017-06-12T17:24:51.246 [ERROR]
GenerateSequenceTest.testUnboundedInputTimestamps:160 » NullPointer
2017-06-12T17:24:51.246 [ERROR] PAssertTest.testIsEqualTo:309 » NullPointer
2017-06-12T17:24:51.246 [ERROR] PAssertTest.testNotEqualTo:339 » NullPointer
2017-06-12T17:24:51.247 [ERROR] PAssertTest.testWindowedIsEqualTo:328 »
NullPointer
2017-06-12T17:24:51.247 [ERROR]
ApproximateUniqueTest$ApproximateUniqueMiscTest.testApproximateUniqueWithSmallInput:313
» NullPointer
2017-06-12T17:24:51.247 [ERROR] CombineFnsTest.testComposedCombine:154 »
IllegalArgument expected one element ...
2017-06-12T17:24:51.247 [ERROR]
CombineFnsTest.testComposedCombineWithContext:216 » NullPointer
2017-06-12T17:24:51.247 [ERROR]
CombineTest.testAccumulatingCombine:464->runTestAccumulatingCombine:247 »
IllegalArgument
2017-06-12T17:24:51.247 [ERROR]
CombineTest.testAccumulatingCombineEmpty:470->runTestAccumulatingCombine:247 »
IllegalArgument
2017-06-12T17:24:51.247 [ERROR]
CombineTest.testBasicCombine:219->runTestBasicCombine:213 » IllegalArgument
ex...
2017-06-12T17:24:51.247 [ERROR]
CombineTest.testBasicCombineEmpty:227->runTestBasicCombine:213 » IllegalArgument
2017-06-12T17:24:51.248 [ERROR]
CombineTest.testCombineGloballyAsSingletonView:631 » NullPointer
2017-06-12T17:24:51.248 [ERROR]
CombineTest.testFixedWindowsCombineWithContext:306 » NullPointer
2017-06-12T17:24:51.248 [ERROR]
CombineTest.testGlobalCombineWithDefaultsAndTriggers:379 » IllegalArgument
exp...
2017-06-12T17:24:51.248 [ERROR]
CombineTest.testSessionsCombineWithContext:445 » NullPointer
2017-06-12T17:24:51.248 [ERROR]
CombineTest.testSimpleCombine:171->runTestSimpleCombine:135 » IllegalArgument
...
2017-06-12T17:24:51.248 [ERROR]
CombineTest.testSimpleCombineEmpty:193->runTestSimpleCombine:135 »
IllegalArgument
2017-06-12T17:24:51.248 [ERROR]
CombineTest.testSimpleCombineWithContext:178->runTestSimpleCombineWithContext:164
» NullPointer
2017-06-12T17:24:51.248 [ERROR]
CombineTest.testSimpleCombineWithContextEmpty:186->runTestSimpleCombineWithContext:164
» NullPointer
2017-06-12T17:24:51.249 [ERROR]
CombineTest.testSlidingWindowsCombineWithContext:346 » NullPointer
2017-06-12T17:24:51.249 [ERROR]
CombineTest.testWindowedCombineGloballyAsSingletonView:674 » NullPointer
2017-06-12T17:24:51.249 [ERROR] CountTest.testCountGloballyBasic:94 »
IllegalArgument expected one element but...
2017-06-12T17:24:51.249 [ERROR] CountTest.testCountGloballyEmpty:107 »
IllegalArgument expected one element bu...
2017-06-12T17:24:51.249 [ERROR] FlattenTest.testEmptyFlattenAsSideInput:211 »
IllegalArgument expected one ele...
2017-06-12T17:24:51.249 [ERROR]
ParDoTest.testMultiOutputParDoWithSideInputs:633 » NullPointer
2017-06-12T17:24:51.249 [ERROR]
ParDoTest.testMultiOutputParDoWithSideInputsIsCumulative:671 » NullPointer
2017-06-12T17:24:51.249 [ERROR] ParDoTest.testParDoWithSideInputs:561 »
NullPointer
2017-06-12T17:24:51.250 [ERROR]
ParDoTest.testParDoWithSideInputsIsCumulative:595 » NullPointer
2017-06-12T17:24:51.250 [ERROR]
ParDoTest.testSideInputsWithMultipleWindows:733 » NullPointer
2017-06-12T17:24:51.250 [ERROR] SampleTest$MiscTest.testSample:248 »
IllegalArgument expected one element but ...
2017-06-12T17:24:51.250 [ERROR] SampleTest$MiscTest.testSampleEmpty:261 »
IllegalArgument expected one element...
2017-06-12T17:24:51.250 [ERROR]
SampleTest$MiscTest.testSampleInsufficientElements:290 » IllegalArgument
expec...
2017-06-12T17:24:51.250 [ERROR]
SampleTest$MiscTest.testSampleMultiplicity:316 » IllegalArgument expected one
...
2017-06-12T17:24:51.250 [ERROR] SampleTest$MiscTest.testSampleZero:275 »
IllegalArgument expected one element ...
2017-06-12T17:24:51.250 [ERROR]
SampleTest$PickAnyTest.testPickAny:168->runPickAnyTest:162 » IllegalArgument
e...
2017-06-12T17:24:51.251 [ERROR]
SampleTest$PickAnyTest.testPickAny:168->runPickAnyTest:162 » IllegalArgument
e...
2017-06-12T17:24:51.251 [ERROR]
org.apache.beam.sdk.transforms.SampleTest$PickAnyTest.testPickAny[limit_1](org.apache.beam.sdk.transforms.SampleTest$PickAnyTest)
2017-06-12T17:24:51.251 [ERROR] Run 1:
SampleTest$PickAnyTest.testPickAny:168->runPickAnyTest:162 » IllegalArgument
e...
2017-06-12T17:24:51.251 [ERROR] Run 2:
SampleTest$PickAnyTest.testPickAny:168->runPickAnyTest:162 » IllegalArgument
e...
2017-06-12T17:24:51.251 [INFO]
2017-06-12T17:24:51.251 [ERROR]
SampleTest$PickAnyTest.testPickAny:168->runPickAnyTest:162 » IllegalArgument
e...
2017-06-12T17:24:51.251 [ERROR]
SampleTest$PickAnyTest.testPickAny:168->runPickAnyTest:162 » IllegalArgument
e...
2017-06-12T17:24:51.251 [ERROR]
SampleTest$PickAnyTest.testPickAny:168->runPickAnyTest:162 » IllegalArgument
e...
2017-06-12T17:24:51.251 [ERROR]
SampleTest$PickAnyTest.testPickAny:168->runPickAnyTest:162 » IllegalArgument
e...
2017-06-12T17:24:51.252 [ERROR] ViewTest.testCombinedMapSideInput:1153 »
IllegalArgument expected one element ...
2017-06-12T17:24:51.252 [ERROR] ViewTest.testEmptyIterableSideInput:416 »
IllegalArgument expected one element...
2017-06-12T17:24:51.252 [ERROR] ViewTest.testEmptyListSideInput:282 »
IllegalArgument expected one element but...
2017-06-12T17:24:51.252 [ERROR] ViewTest.testEmptyMapSideInput:1018 »
IllegalArgument expected one element but...
2017-06-12T17:24:51.252 [ERROR]
ViewTest.testEmptyMapSideInputWithNonDeterministicKeyCoder:1046 »
IllegalArgument
2017-06-12T17:24:51.252 [ERROR] ViewTest.testEmptyMultimapSideInput:712 »
IllegalArgument expected one element...
2017-06-12T17:24:51.252 [ERROR]
ViewTest.testEmptyMultimapSideInputWithNonDeterministicKeyCoder:742 »
IllegalArgument
2017-06-12T17:24:51.252 [ERROR] ViewTest.testIterableSideInput:352 »
IllegalArgument expected one element but ...
2017-06-12T17:24:51.253 [ERROR] ViewTest.testIterableSideInputIsImmutable:447
» IllegalArgument expected one e...
2017-06-12T17:24:51.253 [ERROR] ViewTest.testListSideInput:216 »
IllegalArgument expected one element but was:...
2017-06-12T17:24:51.253 [ERROR] ViewTest.testListSideInputIsImmutable:327 »
IllegalArgument expected one eleme...
2017-06-12T17:24:51.253 [ERROR] ViewTest.testMapAsEntrySetSideInput:844 »
IllegalArgument expected one element...
2017-06-12T17:24:51.253 [ERROR] ViewTest.testMapSideInput:815 »
IllegalArgument expected one element but was: ...
2017-06-12T17:24:51.253 [ERROR] ViewTest.testMapSideInputIsImmutable:1127 »
IllegalArgument expected one eleme...
2017-06-12T17:24:51.253 [ERROR]
ViewTest.testMapSideInputWithNonDeterministicKeyCoder:872 » IllegalArgument
ex...
2017-06-12T17:24:51.253 [ERROR] ViewTest.testMultimapAsEntrySetSideInput:505
» IllegalArgument expected one el...
2017-06-12T17:24:51.254 [ERROR] ViewTest.testMultimapSideInput:474 »
IllegalArgument expected one element but ...
2017-06-12T17:24:51.254 [ERROR] ViewTest.testMultimapSideInputIsImmutable:789
» IllegalArgument expected one e...
2017-06-12T17:24:51.254 [ERROR]
ViewTest.testMultimapSideInputWithNonDeterministicKeyCoder:565 » IllegalArgument
2017-06-12T17:24:51.254 [ERROR]
ViewTest.testSideInputWithNestedIterables:1320 » IllegalArgument expected one
...
2017-06-12T17:24:51.254 [ERROR] ViewTest.testSideInputWithNullDefault:1276 »
NullPointer
2017-06-12T17:24:51.254 [ERROR] ViewTest.testSingletonSideInput:111 »
NullPointer
2017-06-12T17:24:51.254 [ERROR] ViewTest.testWindowedIterableSideInput:391 »
IllegalArgument expected one elem...
2017-06-12T17:24:51.254 [ERROR] ViewTest.testWindowedListSideInput:256 »
IllegalArgument expected one element ...
2017-06-12T17:24:51.254 [ERROR]
ViewTest.testWindowedMapAsEntrySetSideInput:949 » IllegalArgument expected
one...
2017-06-12T17:24:51.255 [ERROR] ViewTest.testWindowedMapSideInput:909 »
IllegalArgument expected one element b...
2017-06-12T17:24:51.255 [ERROR]
ViewTest.testWindowedMapSideInputWithNonDeterministicKeyCoder:989 »
IllegalArgument
2017-06-12T17:24:51.255 [ERROR]
ViewTest.testWindowedMultimapAsEntrySetSideInput:645 » IllegalArgument
expecte...
2017-06-12T17:24:51.255 [ERROR] ViewTest.testWindowedMultimapSideInput:603 »
IllegalArgument expected one elem...
2017-06-12T17:24:51.255 [ERROR]
ViewTest.testWindowedMultimapSideInputWithNonDeterministicKeyCoder:684 »
IllegalArgument
2017-06-12T17:24:51.255 [ERROR]
ViewTest.testWindowedSideInputFixedToFixed:1185 » NullPointer
2017-06-12T17:24:51.255 [ERROR]
ViewTest.testWindowedSideInputFixedToFixedWithDefault:1247 » NullPointer
2017-06-12T17:24:51.255 [ERROR]
ViewTest.testWindowedSideInputFixedToGlobal:1217 » NullPointer
2017-06-12T17:24:51.256 [ERROR] ViewTest.testWindowedSingletonSideInput:141 »
NullPointer
2017-06-12T17:24:51.256 [ERROR] CoGroupByKeyTest.testCoGroupByKey:310 »
IllegalArgument expected one element b...
2017-06-12T17:24:51.256 [ERROR] CoGroupByKeyTest.testCoGroupByKeyGetOnly:146
» IllegalArgument expected one el...
2017-06-12T17:24:51.256 [INFO]
2017-06-12T17:24:51.256 [ERROR] Tests run: 224, Failures: 4, Errors: 84,
Skipped: 1
2017-06-12T17:24:51.256 [INFO]
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
2017-06-12T17:24:54.864 [INFO]
------------------------------------------------------------------------
2017-06-12T17:24:54.864 [INFO] Reactor Summary:
2017-06-12T17:24:54.864 [INFO]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: Parent
.............................. SUCCESS [01:14 min]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: SDKs :: Java :: Build Tools
......... SUCCESS [ 8.855 s]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: SDKs
................................ SUCCESS [ 1.208 s]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: SDKs :: Common
...................... SUCCESS [ 1.789 s]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: SDKs :: Common :: Runner API
........ SUCCESS [ 14.734 s]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: SDKs :: Common :: Fn API
............ SUCCESS [ 10.173 s]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: SDKs :: Java
........................ SUCCESS [ 1.290 s]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: SDKs :: Java :: Core
................ SUCCESS [01:30 min]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: Runners
............................. SUCCESS [ 1.498 s]
2017-06-12T17:24:54.864 [INFO] Apache Beam :: Runners :: Core Construction Java
... SUCCESS [ 11.854 s]
2017-06-12T17:24:54.865 [INFO] Apache Beam :: Runners :: Core Java
................ SUCCESS [ 29.567 s]
2017-06-12T17:24:54.865 [INFO] Apache Beam :: Runners :: Gearpump
................. FAILURE [23:15 min]
2017-06-12T17:24:54.865 [INFO]
------------------------------------------------------------------------
2017-06-12T17:24:54.865 [INFO] BUILD FAILURE
2017-06-12T17:24:54.865 [INFO]
------------------------------------------------------------------------
2017-06-12T17:24:54.865 [INFO] Total time: 27:52 min
2017-06-12T17:24:54.865 [INFO] Finished at: 2017-06-12T17:24:54+00:00
2017-06-12T17:24:56.059 [INFO] Final Memory: 340M/1978M
2017-06-12T17:24:56.059 [INFO]
------------------------------------------------------------------------
2017-06-12T17:24:56.116 [ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.20:test
(runnable-on-service-tests) on project beam-runners-gearpump: There are test
failures.
2017-06-12T17:24:56.116 [ERROR]
2017-06-12T17:24:56.116 [ERROR] Please refer to
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/ws/runners/gearpump/target/surefire-reports>
for the individual test results.
2017-06-12T17:24:56.116 [ERROR] Please refer to dump files (if any exist)
[date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream.
2017-06-12T17:24:56.116 [ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.20:test
(runnable-on-service-tests) on project beam-runners-gearpump: There are test
failures.
Please refer to
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/ws/runners/gearpump/target/surefire-reports>
for the individual test results.
Please refer to dump files (if any exist) [date]-jvmRun[N].dump,
[date].dumpstream and [date]-jvmRun[N].dumpstream.
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at
org.jvnet.hudson.maven3.launcher.Maven33Launcher.main(Maven33Launcher.java:129)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:238)
at jenkins.maven3.agent.Maven33Main.launch(Maven33Main.java:176)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at hudson.maven.Maven3Builder.call(Maven3Builder.java:139)
at hudson.maven.Maven3Builder.call(Maven3Builder.java:70)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.maven.plugin.MojoFailureException: There are test
failures.
Please refer to
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/ws/runners/gearpump/target/surefire-reports>
for the individual test results.
Please refer to dump files (if any exist) [date]-jvmRun[N].dump,
[date].dumpstream and [date]-jvmRun[N].dumpstream.
at
org.apache.maven.plugin.surefire.SurefireHelper.throwException(SurefireHelper.java:204)
at
org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:98)
at
org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:334)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:937)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:785)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 31 more
2017-06-12T17:24:56.118 [ERROR]
2017-06-12T17:24:56.118 [ERROR] Re-run Maven using the -X switch to enable full
debug logging.
2017-06-12T17:24:56.118 [ERROR]
2017-06-12T17:24:56.118 [ERROR] For more information about the errors and
possible solutions, please read the following articles:
2017-06-12T17:24:56.118 [ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
2017-06-12T17:24:56.118 [ERROR]
2017-06-12T17:24:56.118 [ERROR] After correcting the problems, you can resume
the build with the command
2017-06-12T17:24:56.118 [ERROR] mvn <goals> -rf :beam-runners-gearpump
channel stopped
Not sending mail to unregistered user c...@google.com
Not sending mail to unregistered user owenzhang1...@gmail.com
Not sending mail to unregistered user ming...@ebay.com
Not sending mail to unregistered user kirpic...@google.com
Not sending mail to unregistered user k...@google.com
Not sending mail to unregistered user aljoscha.kret...@gmail.com
Not sending mail to unregistered user hepei...@alibaba-inc.com
