[
https://issues.apache.org/jira/browse/BEAM-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anonymous updated BEAM-10784:
-----------------------------
Status: Triage Needed (was: Open)
> Spark portable streaming: failing window-related tests
> -------------------------------------------------------
>
> Key: BEAM-10784
> URL: https://issues.apache.org/jira/browse/BEAM-10784
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Reporter: Anna Qin
> Priority: P3
> Labels: portability-spark
>
> When running validatesPortableRunnerStreaming on Spark, the following tests
> fail. They all seem to be related to windowing. The underlying issue may have
> to do with incorrect handling of watermarks (they may not be getting held
> back properly).
> Fails from timeout:
> PAssertTest. testWindowedContainsInAnyOrder
> PAssertTest. testWindowedSerializablePredicate
> WindowTest. testNoWindowFnDoesNotReassignWindows
> Fails from incorrect assertion:
> CombineTest$BasicTests. testHotKeyCombining
> Fails from empty assertion ("Expected: iterable with items [*] in any order
> but: no item matches: * in []"):
> CombineTest$WindowingTests. testFixedWindowsCombine
> CombineTest$WindowingTests. testSessionsCombine
> ReshuffleTest. testReshuffleAfterFixedWindowsAndGroupByKey
> ReshuffleTest. testReshuffleAfterSessionsAndGroupByKey
> ReshuffleTest. testReshuffleAfterSlidingWindowsAndGroupByKey
> CoGroupByKeyTest. testCoGroupByKeyWithWindowing
> WindowingTest. testMergingWindowing
> WindowingTest. testNonPartitioningWindowing
> WindowingTest. testPartitioningWindowing
> WindowingTest. testWindowPreservation
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
