[
https://issues.apache.org/jira/browse/BEAM-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390022#comment-16390022
]
Chamikara Jayalath commented on BEAM-3798:
------------------------------------------
Do you have the Dataflow job ID of a job that passes with transient errors ?
(couldn't find this from Jenkins logs)
> Performance tests flaky due to Dataflow transient errors
> --------------------------------------------------------
>
> Key: BEAM-3798
> URL: https://issues.apache.org/jira/browse/BEAM-3798
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Reporter: Łukasz Gajowy
> Assignee: Thomas Groh
> Priority: Major
>
> Performance tests are flaky due to transient errors that happened during data
> processing (eg. SocketTimeoutException while connecting to DB). Currently
> exceptions that happen on Dataflow runner but are retried successfully, fail
> the test regardless of the final job state (giving a false-negative result).
> Possible solution for batch scenarios:
> We could "rethrow" exceptions that happened due to transient errors *only* if
> the job status is other than DONE.
> Possible solution for streaming scenarios:
> (don't know yet)
> [Link to discussion on dev list
> |https://lists.apache.org/thread.html/e480f8181913dc81d2d4cd1430557a646537473ccf29fe6390229098@%3Cdev.beam.apache.org%3E]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
