That seems to be a problem. When I try the command, I get
$ telnet localhost 8099 Trying ::1... Connected to localhost. Escape character is '^]'. �^CConnection closed by foreign host. On Fri, Feb 7, 2020 at 5:34 PM Xander Song <iamuuriw...@gmail.com> wrote: > Thanks for the response. After entering telnet localhost 8099, I receive > > Trying ::1... > > telnet: connect to address ::1: Connection refused > > Trying 127.0.0.1... > > telnet: connect to address 127.0.0.1: Connection refused > > telnet: Unable to connect to remote host > > > On Fri, Feb 7, 2020 at 11:41 AM Ankur Goenka <goe...@google.com> wrote: > >> Seems that pipeline submission from sdk is not able to reach the job >> server which was started in docker. >> >> Can you try running "telnet localhost 8099" to make sure that pipeline >> submission can reach the job server. >> >> On Thu, Feb 6, 2020 at 8:16 PM Xander Song <iamuuriw...@gmail.com> wrote: >> >>> I am having difficulty following the Python guide for running Beam on >>> Flink <https://beam.apache.org/documentation/runners/flink/>. I created >>> a virtual environment with Apache Beam installed, then I started up the >>> JobService Docker container with >>> >>> docker run --net=host apachebeam/flink1.9_job_server:latest >>> >>> >>> I receive the following message confirming that the container is running. >>> >>> >>> [main] INFO >>> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver - >>> ArtifactStagingService started on localhost:8098 >>> >>> [main] INFO >>> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver - Java >>> ExpansionService started on localhost:8097 >>> >>> [main] INFO >>> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver - >>> JobService started on localhost:8099 >>> >>> >>> In another terminal, I execute a Beam script called >>> test_beam_local_flink.py based on the example. >>> >>> >>> from __future__ import print_function >>> import apache_beamfrom apache_beam.options.pipeline_options import >>> PipelineOptions >>> >>> data = [1,2,3] >>> >>> options = PipelineOptions([ >>> "--runner=PortableRunner", >>> "--job_endpoint=localhost:8099", >>> "--environment_type=LOOPBACK"]) >>> with apache_beam.Pipeline(options=options) as p: >>> video_collection = ( >>> p | apache_beam.Create(data) >>> | apache_beam.Map(lambda x: x + 1) >>> | apache_beam.Map(lambda x: print(x)) >>> ) >>> print('Done') >>> >>> After a wait, I get the following traceback. >>> >>> /Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/__init__.py:84: >>> UserWarning: You are using Apache Beam with Python 2. New releases of >>> Apache Beam will soon support Python 3 only. >>> >>> 'You are using Apache Beam with Python 2. ' >>> >>> Traceback (most recent call last): >>> >>> File "test_beam_local_flink.py", line 18, in <module> >>> >>> | apache_beam.Map(lambda x: print(x)) >>> >>> File >>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/pipeline.py", >>> line 481, in __exit__ >>> >>> self.run().wait_until_finish() >>> >>> File >>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/pipeline.py", >>> line 461, in run >>> >>> self._options).run(False) >>> >>> File >>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/pipeline.py", >>> line 474, in run >>> >>> return self.runner.run_pipeline(self, self._options) >>> >>> File >>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py", >>> line 220, in run_pipeline >>> >>> job_service = self.create_job_service(options) >>> >>> File >>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py", >>> line 136, in create_job_service >>> >>> return server.start() >>> >>> File >>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/apache_beam/runners/portability/job_server.py", >>> line 59, in start >>> >>> grpc.channel_ready_future(channel).result(timeout=self._timeout) >>> >>> File >>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/grpc/_utilities.py", >>> line 140, in result >>> >>> self._block(timeout) >>> >>> File >>> "/Users/xander/Projects/flink-test/env2/lib/python2.7/site-packages/grpc/_utilities.py", >>> line 86, in _block >>> >>> raise grpc.FutureTimeoutError() >>> >>> grpc.FutureTimeoutError >>> >>> >>> >>> Any help is greatly appreciated. >>> >>>
