I think beam is a fantastic software . Its a great pleasure contributing.
Thanks,
Yu
On Fri, Sep 27, 2019 at 9:09 AM Robert Bradshaw wrote:
> https://issues.apache.org/jira/browse/BEAM-8312 should help with this. In
> summary, I would say that portable beam-on-Flink is basically feature
> compl
https://issues.apache.org/jira/browse/BEAM-8312 should help with this. In
summary, I would say that portable beam-on-Flink is basically feature
complete, but we're still smoothing out some of the ease-of-use issues. And
feedback like this really helps, so thanks!
On Tue, Sep 24, 2019 at 8:10 PM Yu
I needed little adjustment with the pipeline option to work it out.
Pipeline option required 'job_endpoint' when using manual start up of job
server using jar file.
=
options = PipelineOptions([
"--runner=Portab
Ankur.
Thank you for the comment.
Manual start up with job server looks more solid.
Setting TMPDIR then using Flink Runner sounded bit hacky .
Thanks,
Yu
On Tue, Sep 24, 2019 at 2:06 PM Ankur Goenka wrote:
> Flink job server does not have artifacts-dir option yet.
> We have a PR to add it htt
Flink job server does not have artifacts-dir option yet.
We have a PR to add it https://github.com/apache/beam/pull/9648
However, for now you can do a few manual steps to achieve this.
Start Job server.
1. Download
https://repo.maven.apache.org/maven2/org/apache/beam/beam-runners-flink-1.8-job-s
Kyle.
Thank you for the assistance.
Looks like "--artifacts-dir" is not parsed. Below is the DEBUG log of the
pipline.
WARNING:root:Discarding unparseable args: ['--flink_version=1.8',
'--flink_master_url=ip-172-31-12-113.ap-nor
The relevant configuration flag for the job server is `--artifacts-dir`.
@Robert Bradshaw I added this info to the log
message: https://github.com/apache/beam/pull/9646
Kyle Weaver | Software Engineer | github.com/ibzib | kcwea...@google.com
On Mon, Sep 23, 2019 at 11:36 AM Robert Bradshaw
wr
You need to set your artifact directory to point to a
distributed filesystem that's also accessible to the workers (when starting
up the job server).
On Mon, Sep 23, 2019 at 5:43 AM Yu Watanabe wrote:
> Hello.
>
> I am working on flink runner (2.15.0) and would like to ask question about
> how t
Hello.
I am working on flink runner (2.15.0) and would like to ask question about
how to solve my error.
Currently , I have a remote cluster deployed as below . (please see slide1)
All master and worker nodes are installed on different server from apache
beam.
https://drive.google.com/file/d/1vB
