Hi Xander, Are you using Mac? The option --net=host doesn't work on Mac[1]. Could you try to see if the command `docker run -p 8099:8099 -p 8098:8098 -p 8097:8097 apachebeam/flink1.9_job_server:latest` works?
[1] https://forums.docker.com/t/should-docker-run-net-host-work/14215/28 Best, Jincheng ------------- Twitter: https://twitter.com/sunjincheng121 ------------- Xander Song <iamuuriw...@gmail.com> 于2020年2月9日周日 上午11:52写道： > Do you have any suggestions for addressing this issue? I am unsure of what > to try next. > > On Fri, Feb 7, 2020 at 5:55 PM Ankur Goenka <goe...@google.com> wrote: > >> That seems to be a problem. >> >> When I try the command, I get >> >> $ telnet localhost 8099 >> Trying ::1... >> Connected to localhost. >> Escape character is '^]'. >> �^CConnection closed by foreign host. >> >> On Fri, Feb 7, 2020 at 5:34 PM Xander Song <iamuuriw...@gmail.com> wrote: >> >>> Thanks for the response. After entering telnet localhost 8099, I receive >>> >>> Trying ::1... >>> >>> telnet: connect to address ::1: Connection refused >>> >>> Trying 127.0.0.1... >>> >>> telnet: connect to address 127.0.0.1: Connection refused >>> >>> telnet: Unable to connect to remote host >>> >>> >>> On Fri, Feb 7, 2020 at 11:41 AM Ankur Goenka <goe...@google.com> wrote: >>> >>>> Seems that pipeline submission from sdk is not able to reach the job >>>> server which was started in docker. >>>> >>>> Can you try running "telnet localhost 8099" to make sure that pipeline >>>> submission can reach the job server. >>>> >>>> On Thu, Feb 6, 2020 at 8:16 PM Xander Song <iamuuriw...@gmail.com> >>>> wrote: >>>> >>>>> I am having difficulty following the Python guide for running Beam on >>>>> Flink <https://beam.apache.org/documentation/runners/flink/>. I >>>>> created a virtual environment with Apache Beam installed, then I started >>>>> up >>>>> the JobService Docker container with >>>>> >>>>> docker run --net=host apachebeam/flink1.9_job_server:latest >>>>> >>>>> >>>>> I receive the following message confirming that the container is >>>>> running. >>>>> >>>>> >>>>> [main] INFO >>>>> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver - >>>>> ArtifactStagingService started on localhost:8098 >>>>> >>>>> [main] INFO >>>>> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver - Java >>>>> ExpansionService started on localhost:8097 >>>>> >>>>> [main] INFO >>>>> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver - >>>>> JobService started on localhost:8099 >>>>> >>>>> >>>>> In another terminal, I execute a Beam script called >>>>> test_beam_local_flink.py based on the example. >>>>> >>>>> >>>>> from __future__ import print_function >>>>> import apache_beamfrom apache_beam.options.pipeline_options import >>>>> PipelineOptions >>>>> >>>>> data = [1,2,3] >>>>> >>>>> options = PipelineOptions([ >>>>> "--runner=PortableRunner", >>>>> "--job_endpoint=localhost:8099", >>>>> "--environment_type=LOOPBACK"]) >>>>> with apache_beam.Pipeline(options=options) as p: >>>>> video_collection = ( >>>>> p | apache_beam.Create(data) >>>>> | apache_beam.Map(lambda x: x + 1) >>>>> | apache_beam.Map(lambda x: print(x)) >>>>> ) >>>>> print('Done') >>>>> >>>>> After a wait, I get the following traceback. >>>>> >>>>> /Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/__init__.py:84: >>>>> UserWarning: You are using Apache Beam with Python 2. New releases of >>>>> Apache Beam will soon support Python 3 only. >>>>> >>>>> 'You are using Apache Beam with Python 2. ' >>>>> >>>>> Traceback (most recent call last): >>>>> >>>>> File "test_beam_local_flink.py", line 18, in <module> >>>>> >>>>> | apache_beam.Map(lambda x: print(x)) >>>>> >>>>> File >>>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/pipeline.py", >>>>> line 481, in __exit__ >>>>> >>>>> self.run().wait_until_finish() >>>>> >>>>> File >>>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/pipeline.py", >>>>> line 461, in run >>>>> >>>>> self._options).run(False) >>>>> >>>>> File >>>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/pipeline.py", >>>>> line 474, in run >>>>> >>>>> return self.runner.run_pipeline(self, self._options) >>>>> >>>>> File >>>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py", >>>>> line 220, in run_pipeline >>>>> >>>>> job_service = self.create_job_service(options) >>>>> >>>>> File >>>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py", >>>>> line 136, in create_job_service >>>>> >>>>> return server.start() >>>>> >>>>> File >>>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/runners/portability/job_server.py", >>>>> line 59, in start >>>>> >>>>> grpc.channel_ready_future(channel).result(timeout=self._timeout) >>>>> >>>>> File >>>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/grpc/_utilities.py", >>>>> line 140, in result >>>>> >>>>> self._block(timeout) >>>>> >>>>> File >>>>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/grpc/_utilities.py", >>>>> line 86, in _block >>>>> >>>>> raise grpc.FutureTimeoutError() >>>>> >>>>> grpc.FutureTimeoutError >>>>> >>>>> >>>>> >>>>> Any help is greatly appreciated. >>>>> >>>>>
