About the blob client and blob server authentication

2017-02-22 Thread Zhangrucong
Hi: I find the the flink issue 2425. https://github.com/apache/flink/pull/2425 This issue will do the authentication by using security cookie between the blob client and blob server! In my opinion, to use the SASL digest-md5 is much more authority. what do you think? BTW, when this issue is me

re: Does Flink cluster security works in Flink 1.1.4 release?

2017-01-08 Thread Zhangrucong
...@apache.org] 发送时间: 2017年1月6日 18:04 收件人: user@flink.apache.org<mailto:user@flink.apache.org> 抄送: Zhangrucong; Robert Metzger 主题: Re: Does Flink cluster security works in Flink 1.1.4 release? I think you can also use Kerberos in the standalone mode in 1.1.x, but is is more tricky - you nee

re: Does Flink cluster security works in Flink 1.1.4 release?

2017-01-05 Thread Zhangrucong
1.2 release. Greetings, Stephan On Wed, Jan 4, 2017 at 7:25 AM, Zhangrucong mailto:zhangruc...@huawei.com>> wrote: Hi: Now I use Flink 1.1.4 release in standalone cluster model. I want to do the Kerberos authentication between Flink CLI and the Jobmanager. But in the flink-conf.

Does Flink cluster security works in Flink 1.1.4 release?

2017-01-03 Thread Zhangrucong
Hi: Now I use Flink 1.1.4 release in standalone cluster model. I want to do the Kerberos authentication between Flink CLI and the Jobmanager. But in the flink-conf.yaml, there is no Flink cluster security configuration. Does the Kerberos authentication works in Flink 1.1.4 release? Thanks in

re: About Sliding window

2016-10-12 Thread Zhangrucong
Hi Kostas: Thanks for your answer. So in your previous figure (yesterday) when e3 arrives, also e2 should be included in the result, right? --zhangrucong: In Oct 11 email, e2 is coming at 9:02, e3 is coming at 9:07, and the aging time is 5 mins. So When e3 coming, e2 is aged. E2 is not in

re: About Sliding window

2016-10-12 Thread Zhangrucong
the result. At 9:08 e4 is coming, aged e2, store e4, we count e3 and e4, and send the result. I think I need a certain duration window. Thank you very much! 发件人: Kostas Kloudas [mailto:k.klou...@data-artisans.com] 发送时间: 2016年10月12日 21:11 收件人: Zhangrucong 抄送: user@flink.apache.org 主题: Re

re: About Sliding window

2016-10-11 Thread Zhangrucong
: 2016年10月11日 19:38 收件人: user@flink.apache.org 主题: Re: About Sliding window Hi Zhangrucong, Sliding windows only support time-based slide. So your use-case is not supported out-of-the-box. But, if you describe a bit more what you want to do, we may be able to find a way together to do your job using

About Sliding window

2016-10-11 Thread Zhangrucong
Hello everyone: Now, I am want to use DataStream sliding window API. I look at the API and I have a question, dose the sliding time window support sliding by every incoming event? Thanks in advance!

About flink stream table API

2016-04-27 Thread Zhangrucong
Hello everybody: I want to learn the flink stream API. The stream sql is the same with calcite? In the flowing link, the examples of table api are dataset, where I can see the detail introduction of streaming table API. https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/l

About flink stream table API

2016-04-26 Thread Zhangrucong
Hello: I want to learn the flink stream API. The stream sql is the same with calcite? In the flowing link, the examples of table api are dataset, where I can see the detail introduction of streaming table API. https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/libs/table.

re: Flink HA mode

2015-09-08 Thread Zhangrucong
In order to discover new JM,I think must use ZK. ZK has the ability to find a new node or the content of node changed. First JM must create node in ZK, and write IP and port in node. TMs watch this node. When TMs find the node content change, TMs reconnect the new JM. Thanks. 发件人: Emmanuel [mai

Question about exactly-once

2015-09-07 Thread Zhangrucong
Dear Sir: I am a beginner of Flink and very interested in “Exactly-once” Recovery Mechanism. I have a question about processing sequence problem of tuples. For example, in Fig 1, process unit A runs JOIN, and the size of sliding window is 4. At the beginning, the state of sliding windows is show

About exactly once question?

2015-08-27 Thread Zhangrucong
Hi: The document said Flink can guarantee processing each tuple exactly-once, but I can not understand how it works. For example, In Fig 1, C is running between snapshot n-1 and snapshot n(snapshot n hasn't been generated). After snapshot n-1, C has processed tuple x1, x2, x3 and alread

答复: How to understand slot?

2015-08-18 Thread Zhangrucong
Hi stephan, Thanks a lot for answering. 3) For sources, Flink picks a random TaskManager (splits are then assigned locality aware to the sources). For all tasks after sources, Flink tries to co-locate them with their input(s), unless they have so many inputs that co-location makes no difference

How to understand slot?

2015-08-18 Thread Zhangrucong
When I read the schedule code in job manager. I have flowing questions: 1、 How to decide a job vertex to deploy in a shared slot? What is the benefit deploy vertexes in a shared slot? 2、 How to decide a task manager has how many slots? 3、 If there are many task managers, when allocate a ne