[
https://issues.apache.org/jira/browse/BEAM-8830?focusedWorklogId=354403&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-354403
]
ASF GitHub Bot logged work on BEAM-8830:
----------------------------------------
Author: ASF GitHub Bot
Created on: 05/Dec/19 15:52
Start Date: 05/Dec/19 15:52
Worklog Time Spent: 10m
Work Description: aromanenko-dev commented on issue #10293: [BEAM-8830]
Fix flatten in the new spark runner
URL: https://github.com/apache/beam/pull/10293#issuecomment-562189718
Some ValidatesRunner tests started to fail even if they passed before
```
16:24:54 > Task :runners:spark:validatesStructuredStreamingRunnerBatch
16:39:08
16:39:08 org.apache.beam.sdk.transforms.SplittableDoFnTest >
testPairWithIndexWindowedTimestampedBounded FAILED
16:39:08 java.lang.RuntimeException at SplittableDoFnTest.java:220
16:39:08 Caused by: org.apache.spark.SparkException
16:39:08
16:39:08 org.apache.beam.sdk.transforms.SplittableDoFnTest >
testPairWithIndexBasicBounded FAILED
16:39:08 java.lang.IllegalStateException at SplittableDoFnTest.java:153
16:39:08
16:39:08 org.apache.beam.sdk.transforms.SplittableDoFnTest >
testOutputAfterCheckpointBounded FAILED
16:39:08 java.lang.IllegalStateException at SplittableDoFnTest.java:311
16:39:08
16:39:08 org.apache.beam.sdk.transforms.SplittableDoFnTest >
testAdditionalOutputBounded FAILED
16:39:08 java.lang.IllegalStateException at SplittableDoFnTest.java:637
16:39:36
16:39:36 179 tests completed, 4 failed, 1 skipped
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 354403)
Time Spent: 2h 40m (was: 2.5h)
> fix Flatten tests in Spark Structured Streaming runner
> ------------------------------------------------------
>
> Key: BEAM-8830
> URL: https://issues.apache.org/jira/browse/BEAM-8830
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Reporter: Etienne Chauchot
> Assignee: Etienne Chauchot
> Priority: Major
> Labels: structured-streaming
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> 'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput'
> 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmpty'
>
> 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo'
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
