[ https://issues.apache.org/jira/browse/BEAM-8830?focusedWorklogId=354403&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-354403 ]
ASF GitHub Bot logged work on BEAM-8830: ---------------------------------------- Author: ASF GitHub Bot Created on: 05/Dec/19 15:52 Start Date: 05/Dec/19 15:52 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #10293: [BEAM-8830] Fix flatten in the new spark runner URL: https://github.com/apache/beam/pull/10293#issuecomment-562189718 Some ValidatesRunner tests started to fail even if they passed before ``` 16:24:54 > Task :runners:spark:validatesStructuredStreamingRunnerBatch 16:39:08 16:39:08 org.apache.beam.sdk.transforms.SplittableDoFnTest > testPairWithIndexWindowedTimestampedBounded FAILED 16:39:08 java.lang.RuntimeException at SplittableDoFnTest.java:220 16:39:08 Caused by: org.apache.spark.SparkException 16:39:08 16:39:08 org.apache.beam.sdk.transforms.SplittableDoFnTest > testPairWithIndexBasicBounded FAILED 16:39:08 java.lang.IllegalStateException at SplittableDoFnTest.java:153 16:39:08 16:39:08 org.apache.beam.sdk.transforms.SplittableDoFnTest > testOutputAfterCheckpointBounded FAILED 16:39:08 java.lang.IllegalStateException at SplittableDoFnTest.java:311 16:39:08 16:39:08 org.apache.beam.sdk.transforms.SplittableDoFnTest > testAdditionalOutputBounded FAILED 16:39:08 java.lang.IllegalStateException at SplittableDoFnTest.java:637 16:39:36 16:39:36 179 tests completed, 4 failed, 1 skipped ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 354403) Time Spent: 2h 40m (was: 2.5h) > fix Flatten tests in Spark Structured Streaming runner > ------------------------------------------------------ > > Key: BEAM-8830 > URL: https://issues.apache.org/jira/browse/BEAM-8830 > Project: Beam > Issue Type: Bug > Components: runner-spark > Reporter: Etienne Chauchot > Assignee: Etienne Chauchot > Priority: Major > Labels: structured-streaming > Time Spent: 2h 40m > Remaining Estimate: 0h > > 'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput' > 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmpty' > > 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo' -- This message was sent by Atlassian Jira (v8.3.4#803005)