Thank you Hannah! BTW, the fix is https://github.com/apache/beam/pull/9588. Since this affects release, https://github.com/apache/beam/pull/9595 will be cherry-picked to release branch.
On Mon, Sep 16, 2019 at 9:47 PM Hannah Jiang <hannahji...@google.com> wrote: > The fix is merged. I tested with PRs which used to fail and the failures > are fixed now. > Please rerun the test if your PR is affected. > > On Mon, Sep 16, 2019 at 6:16 PM Mark Liu <mark...@google.com> wrote: > >> Thanks for letting me know. I'll keep tracking on this issue since it's a >> release blocker. Please update here/jira if you have any progress. >> >> Mark >> >> On Mon, Sep 16, 2019 at 5:04 PM Hannah Jiang <hannahji...@google.com> >> wrote: >> >>> For issue with flink image, I re-opened a ticket which is currently >>> blocking release.(BEAM-8165) >>> >>> On Mon, Sep 16, 2019 at 5:00 PM Ahmet Altay <al...@google.com> wrote: >>> >>>> >>>> >>>> On Mon, Sep 16, 2019 at 2:07 PM Kyle Weaver <kcwea...@google.com> >>>> wrote: >>>> >>>>> The original issue ("GetJobMetrics is unimplemented") is still >>>>> probably hiding under the docker issue, so I filed >>>>> https://issues.apache.org/jira/browse/BEAM-8245 for it >>>>> >>>> >>>> Thank you. Who should be assigned to this issue? >>>> >>>> If metrics are not supported in all runners, should we update tests to >>>> make this metrics checks optional? >>>> >>>> >>>>> >>>>> Kyle Weaver | Software Engineer | github.com/ibzib | >>>>> kcwea...@google.com >>>>> >>>>> >>>>> On Mon, Sep 16, 2019 at 1:14 PM Hannah Jiang <hannahji...@google.com> >>>>> wrote: >>>>> >>>>>> If we try to create a flink image from master branch, it will create >>>>>> *apachebeam/flink-job-server*, while the code is expecting >>>>>> *jenkins-docker-apache.bintray.io/beam/flink-job-server:latest >>>>>> <http://jenkins-docker-apache.bintray.io/beam/flink-job-server:latest>* >>>>>> . >>>>>> This should be introduced when we cut 2.16.0 branch, I will >>>>>> investigate more to see how to fix it. >>>>>> >>>>> >>>> Do we need a release blocking JIRA for this? >>>> >>>> /cc +Mark Liu <mark...@google.com> >>>> >>>> >>>>> >>>>>> On Mon, Sep 16, 2019 at 1:00 PM Lukasz Cwik <lc...@google.com> wrote: >>>>>> >>>>>>> I'm also being impacted by this on my PR[1]. I found BEAM-6316[2] >>>>>>> that has a similar error but it was resolved Dec 2018. >>>>>>> >>>>>>> 1: https://github.com/apache/beam/pull/9583 >>>>>>> 2: https://issues.apache.org/jira/browse/BEAM-6316 >>>>>>> >>>>>>> On Mon, Sep 16, 2019 at 12:43 PM Ning Kang <ni...@google.com> wrote: >>>>>>> >>>>>>>> A new check renders clearer message: >>>>>>>> >>>>>>>> Unable to find image ' >>>>>>>> jenkins-docker-apache.bintray.io/beam/flink-job-server:latest' >>>>>>>> locally >>>>>>>> docker: Error response from daemon: unknown: Repo 'apache' was not >>>>>>>> found. >>>>>>>> See 'docker run --help'. >>>>>>>> ERROR:root:Starting job service with ['docker', 'run', '-v', >>>>>>>> u'/usr/bin/docker:/bin/docker', '-v', >>>>>>>> '/var/run/docker.sock:/var/run/docker.sock', '--network=host', ' >>>>>>>> jenkins-docker-apache.bintray.io/beam/flink-job-server:latest', >>>>>>>> '--job-host', 'localhost', '--job-port', '45687', '--artifact-port', >>>>>>>> '39407', '--expansion-port', '43893'] >>>>>>>> ERROR:root:Error bringing up job service >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Mon, Sep 16, 2019 at 12:39 PM Ning Kang <ni...@google.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> To Ahmet, these are warnings, I'm not able to identify the errors >>>>>>>>> yet. >>>>>>>>> >>>>>>>>> Thanks everyone! I'm watching the Jira now. >>>>>>>>> >>>>>>>>> On Mon, Sep 16, 2019 at 12:07 PM Chad Dombrova <chad...@gmail.com> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Ning, if you're having trouble making sense of the preCommit >>>>>>>>>> errors, you may be interested in this Jira: >>>>>>>>>> https://issues.apache.org/jira/browse/BEAM-8213# >>>>>>>>>> >>>>>>>>>> On Mon, Sep 16, 2019 at 12:02 PM Kyle Weaver <kcwea...@google.com> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Python 2 isn't the reason the test is failing, that's just a >>>>>>>>>>> warning. The actual error is at the very end of the log (it looks >>>>>>>>>>> familiar >>>>>>>>>>> to me, though I don't see a JIRA for it): >>>>>>>>>>> >>>>>>>>>>> <_Rendezvous of RPC that terminated with: >>>>>>>>>>> status = StatusCode.UNIMPLEMENTED >>>>>>>>>>> details = "Method >>>>>>>>>>> org.apache.beam.model.job_management.v1.JobService/GetJobMetrics is >>>>>>>>>>> unimplemented" >>>>>>>>>>> debug_error_string = >>>>>>>>>>> "{"created":"@1568424715.449291418","description":"Error received >>>>>>>>>>> from peer >>>>>>>>>>> ipv4:127.0.0.1:46117","file":"src/core/lib/surface/call.cc","file_line":1052,"grpc_message":"Method >>>>>>>>>>> org.apache.beam.model.job_management.v1.JobService/GetJobMetrics is >>>>>>>>>>> unimplemented","grpc_status":12}" >>>>>>>>>>> > >>>>>>>>>>> >>>>>>>>>>> Kyle Weaver | Software Engineer | github.com/ibzib | >>>>>>>>>>> kcwea...@google.com >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Mon, Sep 16, 2019 at 11:34 AM Ning Kang <kawai...@gmail.com> >>>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi! I've been seeing some errors during "Python PreCommit". >>>>>>>>>>>> I'm seeing "UserWarning: You are using Apache Beam with Python >>>>>>>>>>>> 2. New releases of Apache Beam will soon support Python 3 only. >>>>>>>>>>>> 'You are >>>>>>>>>>>> using Apache Beam with Python 2. '" >>>>>>>>>>>> Is there any plan to remove py2 tests from the pre-commit check >>>>>>>>>>>> once we stop supporting Python2? >>>>>>>>>>>> The scan link is: >>>>>>>>>>>> https://scans.gradle.com/s/vujoeo62uyfpi/console-log?task=:sdks:python:test-suites:portable:py2:portableWordCountBatch >>>>>>>>>>>> >>>>>>>>>>>> Thanks! >>>>>>>>>>>> >>>>>>>>>>>> Ning. >>>>>>>>>>>> >>>>>>>>>>>>