State access in RichAsyncFunction

2018-10-18 Thread shimin yang
Hi all, Regarding to the RichAsyncFunction, why we cannot access the state through runtime context like other operators? Best, Shimin Yang

回复:[DISCUSS] Improve broadcast serialization

2018-10-18 Thread Zhijiang(wangzhijiang999)
I agree with the additional thoughts of a), b) and c). In all the current implementations of ChannelSelector, the selector channels are either one or all, so it makes sense for change the interface as you suggested if we will not extend other selectors for partial channels in future. And the si

回复:Sharing state between subtasks

2018-10-18 Thread Zhijiang(wangzhijiang999)
Not yet. We only have some initial thoughts and have not worked on it yet. We will update the progress in this discussion if have. Best, Zhijiang -- 发件人:Aljoscha Krettek 发送时间:2018年10月18日(星期四) 17:53 收件人:dev ; Zhijiang(wangzhijiang999

Re: [VOTE] Release 1.5.5, release candidate #1

2018-10-18 Thread Fabian Hueske
Hi, I checked the following things: * no dependencies added or changed since Flink 1.5.4 * compiling the source distribution without tests succeeds * compiling the source distribution with tests fails (see exception appended below). When I restart the compilation, it goes past flink-hbase but fai

Re: [VOTE] Release 1.6.2, release candidate #1

2018-10-18 Thread Fabian Hueske
Hi, Thanks Chesnay for preparing the RC1 for Flink 1.6.2. I checked a few things, but there seem to be some issues with the release candidate. * no dependencies added or changed since Flink 1.6.1 * building the source distribution without tests succeeds, however, a second build fails due to gene

Re: [DISCUSS] [Contributing] (3) - Review Tooling

2018-10-18 Thread jincheng sun
Sounds good! @Fabian Hueske Fabian Hueske 于2018年10月18日周四 下午4:24写道: > Hi, > > I opened a PR to extend the PR description template [1]. > > @jincheng sun , I'd suggest to start a separate > discussion about a template for Jira ticket. Let's try to keep this thread > focused on the tooling to sup

[jira] [Created] (FLINK-10605) Upgrade AvroSerializer snapshot to implement new TypeSerializerSnapshot interface

2018-10-18 Thread Igal Shilman (JIRA)
Igal Shilman created FLINK-10605: Summary: Upgrade AvroSerializer snapshot to implement new TypeSerializerSnapshot interface Key: FLINK-10605 URL: https://issues.apache.org/jira/browse/FLINK-10605 Pro

[jira] [Created] (FLINK-10604) Add Remainder math function supported in Table API and SQL

2018-10-18 Thread Max (JIRA)
Max created FLINK-10604: --- Summary: Add Remainder math function supported in Table API and SQL Key: FLINK-10604 URL: https://issues.apache.org/jira/browse/FLINK-10604 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-10603) Reduce kafka test duration

2018-10-18 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-10603: Summary: Reduce kafka test duration Key: FLINK-10603 URL: https://issues.apache.org/jira/browse/FLINK-10603 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10602) Run MetricFetcher in metrics ActorSystem

2018-10-18 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-10602: - Summary: Run MetricFetcher in metrics ActorSystem Key: FLINK-10602 URL: https://issues.apache.org/jira/browse/FLINK-10602 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-10601) Make user home dir consistent with Flink default filesystem

2018-10-18 Thread Paul Lin (JIRA)
Paul Lin created FLINK-10601: Summary: Make user home dir consistent with Flink default filesystem Key: FLINK-10601 URL: https://issues.apache.org/jira/browse/FLINK-10601 Project: Flink Issue Ty

[VOTE] Release 1.6.2, release candidate #1

2018-10-18 Thread Chesnay Schepler
Hi everyone, Please review and vote on the release candidate #1 for the version 1.6.2, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

[VOTE] Release 1.5.5, release candidate #1

2018-10-18 Thread Chesnay Schepler
Hi everyone, Please review and vote on the release candidate #1 for the version 1.5.5, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Re: Sharing state between subtasks

2018-10-18 Thread Aljoscha Krettek
Hi Zhijiang, do you already have working code or a design doc for the second approach? Best, Aljoscha > On 18. Oct 2018, at 08:42, Zhijiang(wangzhijiang999) > wrote: > > Just noticed this discussion from @Till Rohrmann's weekly community update > and I want to share some thoughts from our ex

Re: [DISCUSS] Improve broadcast serialization

2018-10-18 Thread Piotr Nowojski
Hey, I also think that 3rd option is the most promising, however logic of “dirty” channels might be causing some overheads. I was also thinking about other option: 5. In case of ‘emit’ called on BroadcastRecordWriter, we could write it to common/shared BufferBuilder, but somehow marked it as t

[jira] [Created] (FLINK-10600) Provide End-to-end test cases for modern Kafka connectors

2018-10-18 Thread vinoyang (JIRA)
vinoyang created FLINK-10600: Summary: Provide End-to-end test cases for modern Kafka connectors Key: FLINK-10600 URL: https://issues.apache.org/jira/browse/FLINK-10600 Project: Flink Issue Type:

[jira] [Created] (FLINK-10599) Provide documentation for the modern kafka connector

2018-10-18 Thread vinoyang (JIRA)
vinoyang created FLINK-10599: Summary: Provide documentation for the modern kafka connector Key: FLINK-10599 URL: https://issues.apache.org/jira/browse/FLINK-10599 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-10598) Maintain modern Kafka connector

2018-10-18 Thread vinoyang (JIRA)
vinoyang created FLINK-10598: Summary: Maintain modern Kafka connector Key: FLINK-10598 URL: https://issues.apache.org/jira/browse/FLINK-10598 Project: Flink Issue Type: Task Components

Re: [DISCUSS] [Contributing] (2) - Review Steps

2018-10-18 Thread Till Rohrmann
Thanks a lot for merging and publishing the new review guidelines Fabian! Cheers, Till On Thu, Oct 18, 2018 at 10:22 AM Fabian Hueske wrote: > Hi, > > I merged the PR. > The review process is documented at [1]. > > Best, Fabian > > [1] https://flink.apache.org/reviewing-prs.html > > Am Mi., 10.

Re: [DISCUSS] [Contributing] (3) - Review Tooling

2018-10-18 Thread Fabian Hueske
Hi, I opened a PR to extend the PR description template [1]. @jincheng sun , I'd suggest to start a separate discussion about a template for Jira ticket. Let's try to keep this thread focused on the tooling to support the review process. Thanks, Fabian [1] https://github.com/apache/flink/pull/6

[jira] [Created] (FLINK-10597) Enable UDFs support in MATCH_RECOGNIZE

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10597: Summary: Enable UDFs support in MATCH_RECOGNIZE Key: FLINK-10597 URL: https://issues.apache.org/jira/browse/FLINK-10597 Project: Flink Issue Type: Su

[jira] [Created] (FLINK-10596) Add access to timerService in IterativeCondition and Pattern(Flat)SelectFunction

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10596: Summary: Add access to timerService in IterativeCondition and Pattern(Flat)SelectFunction Key: FLINK-10596 URL: https://issues.apache.org/jira/browse/FLINK-10596

Re: [DISCUSS] [Contributing] (2) - Review Steps

2018-10-18 Thread Fabian Hueske
Hi, I merged the PR. The review process is documented at [1]. Best, Fabian [1] https://flink.apache.org/reviewing-prs.html Am Mi., 10. Okt. 2018 um 17:48 Uhr schrieb Fabian Hueske : > Hi all, > > I opened a PR [1] to add the PR review guide to the Flink website. > > Cheers, Fabian > > [1] http

[jira] [Created] (FLINK-10595) Support patterns that can produce empty matches

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10595: Summary: Support patterns that can produce empty matches Key: FLINK-10595 URL: https://issues.apache.org/jira/browse/FLINK-10595 Project: Flink Issue

[jira] [Created] (FLINK-10594) Support SUBSETS

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10594: Summary: Support SUBSETS Key: FLINK-10594 URL: https://issues.apache.org/jira/browse/FLINK-10594 Project: Flink Issue Type: Sub-task Compon

[jira] [Created] (FLINK-10593) Add support for ALL ROWS PER MATCH

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10593: Summary: Add support for ALL ROWS PER MATCH Key: FLINK-10593 URL: https://issues.apache.org/jira/browse/FLINK-10593 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-10592) Support exclusions in patterns

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10592: Summary: Support exclusions in patterns Key: FLINK-10592 URL: https://issues.apache.org/jira/browse/FLINK-10592 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10591) Add functions to return TimeIndicators from MATCH_RECOGNIZE

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10591: Summary: Add functions to return TimeIndicators from MATCH_RECOGNIZE Key: FLINK-10591 URL: https://issues.apache.org/jira/browse/FLINK-10591 Project: Flink

[jira] [Created] (FLINK-10590) Optional quantifier is discarded from first element of group pattern

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10590: Summary: Optional quantifier is discarded from first element of group pattern Key: FLINK-10590 URL: https://issues.apache.org/jira/browse/FLINK-10590 Project:

[jira] [Created] (FLINK-10589) Group patterns should support greedy quantifiers

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10589: Summary: Group patterns should support greedy quantifiers Key: FLINK-10589 URL: https://issues.apache.org/jira/browse/FLINK-10589 Project: Flink Issu

[jira] [Created] (FLINK-10588) Support reusing same variable in Pattern

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10588: Summary: Support reusing same variable in Pattern Key: FLINK-10588 URL: https://issues.apache.org/jira/browse/FLINK-10588 Project: Flink Issue Type:

[jira] [Created] (FLINK-10587) Improve support of greedy/reluctant quantifiers

2018-10-18 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-10587: Summary: Improve support of greedy/reluctant quantifiers Key: FLINK-10587 URL: https://issues.apache.org/jira/browse/FLINK-10587 Project: Flink Issue