[ https://issues.apache.org/jira/browse/BEAM-6318?focusedWorklogId=185461&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185461 ]
ASF GitHub Bot logged work on BEAM-6318: ---------------------------------------- Author: ASF GitHub Bot Created on: 15/Jan/19 22:38 Start Date: 15/Jan/19 22:38 Worklog Time Spent: 10m Work Description: tvalentyn commented on pull request #7519: [BEAM-6318] Increase the amount of pip download retries to 10 from a default 5 URL: https://github.com/apache/beam/pull/7519 In BEAM-6318 we suspect that Beam test suites sometimes become flaky during PyPi outages, and we are exploring adding retries as a mitigation. This PR increases the number of retries used by `pip` from 5(default) to 10. In `pip`, retries happen with a back-off. I verified on a VM without internet access that with 10 retries `pip` attempts to download a package throughout 4 minutes, while first 5 attempts happen within 5 seconds. If pip retry mechanism proves not sufficient to mitigate BEAM-6318, we can issue multiple calls to `pip`, also with a back-off. ------------------------ Post-Commit Tests Status (on master branch) ------------------------------------------------------------------------------------------------ Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | --- | --- | --- | --- Java | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/) Python | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/) | --- | --- | --- ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 185461) Time Spent: 10m Remaining Estimate: 0h > beam-sdks-python:setupVirtualenv pluggy flaky > --------------------------------------------- > > Key: BEAM-6318 > URL: https://issues.apache.org/jira/browse/BEAM-6318 > Project: Beam > Issue Type: Bug > Components: sdk-py-core > Reporter: Andrew Pilloud > Assignee: Valentyn Tymofieiev > Priority: Major > Fix For: 2.11.0 > > Time Spent: 10m > Remaining Estimate: 0h > > https://builds.apache.org/job/beam_PreCommit_Python_Cron/752/ > {code} > 16:00:43 Collecting pluggy<1.0,>=0.3.0 (from tox==3.0.0) > 16:00:43 Could not find a version that satisfies the requirement > pluggy<1.0,>=0.3.0 (from tox==3.0.0) (from versions: ) > 16:00:43 No matching distribution found for pluggy<1.0,>=0.3.0 (from > tox==3.0.0) > 16:00:46 > 16:00:46 > Task :beam-sdks-python:setupVirtualenv FAILED > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)