Re: Is that possible for flink to dynamically read and change configuration?

2017-07-24 Thread ZalaCheung
> On Jul 24, 2017, at 22:06, ZalaCheung <gzzhangdesh...@corp.netease.com> wrote: > > Hi Chesnay, > > Thank you very much. Now I tried to ignore the default value of ListState and > Try to use the CoFlatmap function with managed state. But what surprised me > is that it see

Re: Is that possible for flink to dynamically read and change configuration?

2017-07-24 Thread ZalaCheung
mentation, only the ValueStateDescriptor has a > defaultValue constructor argument. > > Regards, > Chesnay > > On 24.07.2017 14:56, ZalaCheung wrote: >> Hi Martin, >> >> Thanks for your advice. That’s really helpful. I am using the push scenario. >> I

Re: Is that possible for flink to dynamically read and change configuration?

2017-07-24 Thread ZalaCheung
slidesharecdn.com/flinkstreambasics-160909223620/95/apache-flink-training-datastream-api-basics-34-638.jpg?cb=1497888680>. > > Hope that gives u some ideas, > M > > > On Mon, Jul 24, 2017 at 12:16 PM, ZalaCheung <gzzhangdesh...@corp.netease.com > <mailto:gzzhangd

Is that possible for flink to dynamically read and change configuration?

2017-07-24 Thread ZalaCheung
Hi all, I am now trying to implement a anomaly detection algorithm on Flink, which is actually implement a Map operator to do anomaly detection based on timeseries. At first I want to read configuration(like which kafka source host to read datastream from and which sink address to write data

cannot use ElasticsearchSink in Flink1.3.0

2017-07-20 Thread ZalaCheung
Hi all, I am using Flink 1.3.0 and following instructions here to add elasticsearch as a sink. https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/connectors/elasticsearch.html I

Read configuration instead of hard code

2017-07-13 Thread ZalaCheung
Hi all, I use Kafka as the source of my data stream. Instead of specifying the host and topic of Kafka directly in code, is that possible to read the configuration including Kakfa info from somewhere else like file or database? Desheng Zhang E-mail: gzzhangdesh...@corp.netease.com;

Re: How to maintain variable for each map operator

2017-07-13 Thread ZalaCheung
nction to RichMapFunction to be able > to declare and use states. > > Best, > Kurt > > On Thu, Jul 13, 2017 at 2:22 PM, ZalaCheung <gzzhangdesh...@corp.netease.com > <mailto:gzzhangdesh...@corp.netease.com>> wrote: > Hi Kurt, > > Thanks! Your link

Re: How to maintain variable for each map operator

2017-07-13 Thread ZalaCheung
> <https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/stream/state.html> > > Best, > Kurt > > On Thu, Jul 13, 2017 at 1:14 PM, ZalaCheung <gzzhangdesh...@corp.netease.com > <mailto:gzzhangdesh...@corp.netease.com>> wrote: > Hi all, > &

Question about Checkpoint

2017-06-26 Thread ZalaCheung
Hi Flink Community, I am new to Flink and now looking at checkpoint of Flink. After reading the document, I am still confused. Here is scene: I have a datastream finally flow to a database sink. I will update one of the field in database based on the incomming stream. I have now complete a