I managed to recreate one of the issues with this command: ~/src/beam/sdks/python$ \rm -r .eggs/ && for i in $(seq 2); do echo "python setup.py -q nosetests --tests apache_beam.pipeline_test:DoFnTest.test_incomparable_default &" | sh ; done
This reliably gives me: OSError: [Errno 17] File exists: '/usr/local/google/home/ehudm/src/beam/sdks/python/.eggs/pytest_runner-5.2-py2.7.egg' If I remove this line from setup.py the error is gone: setup_requires=['pytest_runner'], On Tue, Nov 26, 2019 at 2:54 PM Chad Dombrova <chad...@gmail.com> wrote: > Thanks for looking into this. It seems like it might be something to do > with data that is cached on the Jenkins slaves between runs, which may be > what prevents this from showing up locally? > > If your theory about setuptools is correct, and it sounds likely, we > should be able to lock down the version, which we should definitely be > doing for all of our dependencies. > > -chad > > > > On Tue, Nov 26, 2019 at 1:33 PM Ahmet Altay <al...@google.com> wrote: > >> I tried to debug but did not make much progress. I cannot reproduce >> locally, however all python precommits and postcommits are failing. >> >> One guess is, setuptools released a new version that does not support >> eggs a few days ago, that might be the cause ( >> https://github.com/pypa/setuptools/blob/master/CHANGES.rst) but that >> should have reproduced locally. >> Maybe something is wrong with the jenkins machines, and we could perhaps >> bring them to a clean state. >> >> I suspected this being related to pytest somehow (as the first 4 JIRAs >> had pytest in the error line) but the error Chad saw is different. >> >> +Valentyn Tymofieiev <valen...@google.com> and +Yifan Zou >> <yifan...@google.com> could you help with looking into this? >> >> >> Ahmet >> >> >> >> On Tue, Nov 26, 2019 at 9:14 AM Luke Cwik <lc...@google.com> wrote: >> >>> I also started to see this on PRs that I'm reviewing. >>> BEAM-8793, BEAM-8653, BEAM-8631, BEAM-8249 mention issues with setup.py and >>> egg_info but this looks different then all of those so I filed BEAM-8831. >>> >>> >>> On Mon, Nov 25, 2019 at 10:27 PM Chad Dombrova <chad...@gmail.com> >>> wrote: >>> >>>> Actually, it looks like I'm getting the same error on multiple PRs: >>>> https://scans.gradle.com/s/ihfmrxr7evslw >>>> >>>> >>>> >>>> >>>> On Mon, Nov 25, 2019 at 10:26 PM Chad Dombrova <chad...@gmail.com> >>>> wrote: >>>> >>>>> Hi all, >>>>> The cython tests started failing on one of my PRs which were >>>>> succeeding before. The error is one that I've never seen before >>>>> (separated onto different lines to make it easier to read): >>>>> >>>>> Caused by: org.gradle.api.GradleException: >>>>> Could not copy file >>>>> '/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit@2 >>>>> /src/sdks/python/.eggs/simplegeneric-0.8.1-py2.7.egg' >>>>> to >>>>> '/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_Commit@2 >>>>> /src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/.eggs/simplegeneric-0.8.1-py2.7.egg'. >>>>> >>>>> Followed immediately by an error about could not create a directory of >>>>> the same name. Here's the gradle scan: >>>>> >>>>> >>>>> https://scans.gradle.com/s/ihfmrxr7evslw/failure?openFailures=WzFd&openStackTraces=WzZd#top=0 >>>>> >>>>> Any ideas? >>>>> >>>>> -chad >>>>> >>>>> >>>>> >>>>> >>>>>
smime.p7s
Description: S/MIME Cryptographic Signature
