[
https://issues.apache.org/jira/browse/BEAM-8938?focusedWorklogId=362934&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-362934
]
ASF GitHub Bot logged work on BEAM-8938:
----------------------------------------
Author: ASF GitHub Bot
Created on: 24/Dec/19 08:34
Start Date: 24/Dec/19 08:34
Worklog Time Spent: 10m
Work Description: iemejia commented on issue #10342: [BEAM-8938] Skip
timeouting tests
URL: https://github.com/apache/beam/pull/10342#issuecomment-568693379
+1 to Robert's suggestion can you please exclude the tests only for Dataflow
because this seems to be Dataflow specific issue. We exclude individual
methods in the Spark runner like this
https://github.com/apache/beam/blob/614386be99d6d97f01ffa137d11a58c99877ce54/runners/spark/build.gradle#L207-L220).
Please add the new assigned JIRA as a doc there too.
This will work for the Java tests, for the Python ones I suppose there
should be a similar way to do it.
CC @kamilwu since he seems to be now in charge of this ticket.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 362934)
Time Spent: 1.5h (was: 1h 20m)
> Tests end up leaving stale Dataflow jobs in apache-beam-testing project and
> exhaust GCP resources
> -------------------------------------------------------------------------------------------------
>
> Key: BEAM-8938
> URL: https://issues.apache.org/jira/browse/BEAM-8938
> Project: Beam
> Issue Type: Bug
> Components: testing
> Reporter: Lukasz Gajowy
> Assignee: Kamil Wasilewski
> Priority: Blocker
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Some tests (I'm not sure if this is the exhaustive list but they seem to
> appear in the dataflow console repeatedly) that seem to not be killed and eat
> our resources:
> -
> [test_reshuffle_preserves_timestamps|https://github.com/apache/beam/blob/719b8cc5e51dcd3e98425ecae5ec246657d46eca/sdks/python/apache_beam/transforms/util_test.py#L487]
> (spotted multiple times in the dataflow console) (Python SDK)
> -
> [test_flatten_same_pcollections|https://github.com/apache/beam/blob/44d456830442e5f13b7fd3bd684695e2b69e2c0d/sdks/python/apache_beam/transforms/ptransform_test.py#L596]
> (Python SDK)
> -
> [testPairWithIndexWindowedTimestampedBounded|https://github.com/apache/beam/blob/c2f0d282337f3ae0196a7717712396a5a41fdde1/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/SplittableDoFnTest.java#L158]
> (Java SDK)
> -
> [testPairWithIndexBasicBounded|https://github.com/apache/beam/blob/c2f0d282337f3ae0196a7717712396a5a41fdde1/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/SplittableDoFnTest.java#L125]
> (Java SDK)
>
> Temporary solution is to ignore them. Real solution requires greater
> investigation.
> Please see the devlist thread for more context:
> [https://lists.apache.org/thread.html/01eb33ae9c05d12bb0698f91adc0021662fdfe2978cfdfde28dc56b2%40%3Cdev.beam.apache.org%3E]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
