Thanks for taking a look Yifan. Yes, it appears this was an intermittent issue.
For beam_PostCommit_Python_VR_Flink we are left with: * beam15 docker errors * segmentation faults * "Execution failed for task ':beam-sdks-python:createProcessWorker'" - which should not even execute since we are using Docker On Mon, Oct 22, 2018 at 10:50 PM Yifan Zou <yifan...@google.com> wrote: > I'm not able to reproduce that error in Beam6 (#459 > <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/459/>, #460 > <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/460/>), it > probably due to some outage of Debian [1]. The image was successfully > built, but the test failed in other reasons. > And indeed, the beam_PostCommit_Python_VR_Flink is very flaky. > > Yifan > > [1] https://github.com/docker-library/python/issues/241 > > On Mon, Oct 22, 2018 at 5:39 PM Thomas Weise <t...@apache.org> wrote: > >> Looks like we have more container build related errors. >> >> This is from beam6 - >> https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink_PR/44/ >> >> Reading package lists... >> [91mW: The repository 'http://deb.debian.org/debian stretch Release' >> does not have a Release file. >> >> W: The repository 'http://deb.debian.org/debian stretch-updates Release' >> does not have a Release file. >> E: Failed to fetch >> http://deb.debian.org/debian/dists/stretch/main/binary-amd64/Packages 404 >> Not Found >> E: Failed to fetch >> http://deb.debian.org/debian/dists/stretch-updates/main/binary-amd64/Packages >> 404 Not Found >> E: Some index files failed to download. They have been ignored, or old ones >> used instead. >> >> >> On Mon, Oct 22, 2018 at 2:54 PM Ankur Goenka <goe...@google.com> wrote: >> >>> Thanks Yifan! >>> >>> On Mon, Oct 22, 2018 at 2:53 PM Yifan Zou <yifan...@google.com> wrote: >>> >>>> So, looks like none of us have the permissions. I filed INFRA-17167 >>>> <https://issues.apache.org/jira/browse/INFRA-17167> to the Infra team >>>> to restart the docker on the beam15. >>>> >>>> Thanks. >>>> Yifan >>>> >>>> On Mon, Oct 22, 2018 at 9:20 AM Scott Wegner <sc...@apache.org> wrote: >>>> >>>>> I've seen the docker issue pop-up on website pre-commits as well: >>>>> https://issues.apache.org/jira/browse/BEAM-5783. There were also on >>>>> beam15. >>>>> >>>>> When I searched around the internet I found lots of instances of the >>>>> same error; it seems to be some unreliability in the guts of Docker [1]. >>>>> Perhaps restarting the VM or docker daemon could help. Does anybody have >>>>> permissions to log on and try it? >>>>> >>>>> [1] https://github.com/moby/moby/issues/31849#issuecomment-320236354 >>>>> >>>>> On Sun, Oct 21, 2018 at 7:13 PM Thomas Weise <t...@apache.org> wrote: >>>>> >>>>>> There are two issues with >>>>>> https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ >>>>>> currently: >>>>>> >>>>>> 1) The mentioned issue with docker on beam15 - Jason, can you >>>>>> possibly advise how to deal with it? >>>>>> >>>>>> 2) Frequent failure due to "Segmentation fault (core dumped)", as >>>>>> exhibited by >>>>>> https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/449/consoleText >>>>>> >>>>>> The Gradle scan is here: >>>>>> >>>>>> >>>>>> https://scans.gradle.com/s/ebhxs4l65cow4/failure?openFailures=WzBd&openStackTraces=WzEse31d#top=0 >>>>>> >>>>>> There are multiple of those in sequence on beam13 >>>>>> >>>>>> Some more comments: https://issues.apache.org/jira/browse/BEAM-5467 >>>>>> >>>>>> Any help to further investigate or fix would be appreciated! >>>>>> >>>>>> Thanks, >>>>>> Thomas >>>>>> >>>>>> >>>>>> >>>>>> On Fri, Oct 19, 2018 at 4:51 PM Yifan Zou <yifan...@google.com> >>>>>> wrote: >>>>>> >>>>>>> I got "Failed to restart docker.service: Interactive authentication >>>>>>> required" while trying to restart the docker on beam15. >>>>>>> Does anyone have the permission to do that? Or, we need to ask >>>>>>> Apache Infra for help. >>>>>>> >>>>>>> Thanks. >>>>>>> Yifan >>>>>>> >>>>>>> On Fri, Oct 19, 2018 at 2:51 PM Ankur Goenka <goe...@google.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi, >>>>>>>> >>>>>>>> Can we restart docker as it seems to have fixed the issue for >>>>>>>> others https://github.com/moby/moby/issues/31849 ? >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Ankur >>>>>>>> >>>>>>>> On Fri, Oct 19, 2018 at 1:11 PM Yifan Zou <yifan...@google.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> The docker has been installed on all Jenkins VMs. The image build >>>>>>>>> process was interrupted by a grpc connection issue. >>>>>>>>> >>>>>>>>> *11:02:12* Starting process 'command 'docker''. Working directory: >>>>>>>>> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_VR_Flink/src/sdks/python/container/build/docker >>>>>>>>> Command: docker build --no-cache -t >>>>>>>>> jenkins-docker-apache.bintray.io/beam/python:latest .*11:02:12* >>>>>>>>> Successfully started process 'command 'docker''*11:02:12* Sending >>>>>>>>> build context to Docker daemon 17.65MB >>>>>>>>> *11:02:12* Step 1/9 : FROM python:2-stretch*11:02:12* ---> >>>>>>>>> 3c43a5d4034a*11:02:12* Step 2/9 : MAINTAINER "Apache Beam >>>>>>>>> <dev@beam.apache.org>"*11:02:12* ---> Running in >>>>>>>>> f86bad9aef9c*11:02:12* ---> 610a5dec907e*11:02:12* Removing >>>>>>>>> intermediate container f86bad9aef9c*11:02:12* Step 3/9 : RUN apt-get >>>>>>>>> update && apt-get install -y libsnappy-dev >>>>>>>>> libyaml-dev && rm -rf /var/lib/apt/lists/**11:02:12* ---> >>>>>>>>> Running in 5e9b67be03f9*11:02:12* grpc: the connection is unavailable >>>>>>>>> >>>>>>>>> >>>>>>>>> - Yifan >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Fri, Oct 19, 2018 at 12:45 PM Ankur Goenka <goe...@google.com> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Hi, >>>>>>>>>> >>>>>>>>>> Flink Validates Runner test cases are failing on Beam 15 because >>>>>>>>>> docker is not installed. >>>>>>>>>> Failing tasks >>>>>>>>>> https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/buildTimeTrend >>>>>>>>>> Can we install docker on all the machines as the Portable >>>>>>>>>> Validates Runner tests need it. >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Ankur >>>>>>>>>> >>>>>>>>> >>>>> >>>>> -- >>>>> >>>>> >>>>> >>>>> >>>>> Got feedback? tinyurl.com/swegner-feedback >>>>> >>>>
