problem running flink using remote environment

2016-08-17 Thread Baswaraj Kasture
I am using flink 1.1.1. I am trying to run flink streaming program (kafka as source). It works perfectly when I use StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); But, problem is when I use one of the following to create env. StreamExecutionEnvironment env

How to share text file across tasks at run time in flink.

2016-08-20 Thread Baswaraj Kasture
Am running Flink standalone cluster. I have text file that need to be shared across tasks when i submit my application. in other words , put this text file in class path of running tasks. How can we achieve this with flink ? In spark, spark-submit has --jars option that puts all the files specif

Re: How to share text file across tasks at run time in flink.

2016-08-23 Thread Baswaraj Kasture
riable > <https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/index.html#broadcast-variables> > for > your task. > If you are using the DataStream one, then there is no proper support for > that. > > Thanks, > Kostas > > On Aug 20, 2016, at 12:33 PM, Baswara

Re: How to share text file across tasks at run time in flink.

2016-08-24 Thread Baswaraj Kasture
ok into this whether it is a common use case and how to > implement > > it in Flink. > > > > [1] http://storm.apache.org/releases/2.0.0-SNAPSHOT/ > distcache-blobstore.html > > > > > > - Jark Wu > > > > 在 2016年8月23日,下午9:45,Lohith Samaga M 写道: