Re: [ANNOUNCE] Zili Chen becomes a Flink committer

2019-09-12 Thread Zili Chen
Thanks a lot everyone for the warm welcome. Happy Mid-autumn Festival! Best, tison. Leonard Xu 于2019年9月12日周四 上午11:05写道: > Congratulations Zili Chen ! ! > > Best, > Leonard Xu > > On 2019年9月12日, at 上午11:02, Yun Tang wrote: > > > > Congratulations Zili > > > > Best > > Yun Tang > >

Re: Checkpoint metrics.

2019-09-12 Thread Stephan Ewen
Hi Jamie! Did you mean to attach a screenshot? If yes, you need to share that through a different channel, the mailing list does not support attachments, unfortunately. Seth is right how the time is measured. One important bit to add to the interpretation: - For non-source tasks, the time

Re: [DISCUSS] Use Java's Duration instead of Flink's Time

2019-09-12 Thread Stephan Ewen
I would deprecate "org.apache.flink.api.common.time.Time" only if we have alternative methods for the window api. If users can only write code by using a deprecated class, that would not be a good experience. Otherwise sound good. Best, Stephan On Thu, Sep 12, 2019 at 11:23 AM Zili Chen

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-12 Thread Oytun Tez
Hi Zhu, We are using custom restart strategy like this: environment.setRestartStrategy(failureRateRestart(2, Time.minutes(1), Time.minutes(10))); --- Oytun Tez *M O T A W O R D* The World's Fastest Human Translation Platform. oy...@motaword.com — www.motaword.com On Thu, Sep 12, 2019 at

[jira] [Created] (FLINK-14072) Add a third-party maven repository for flink-shaded .

2019-09-12 Thread Jeff Yang (Jira)
Jeff Yang created FLINK-14072: - Summary: Add a third-party maven repository for flink-shaded . Key: FLINK-14072 URL: https://issues.apache.org/jira/browse/FLINK-14072 Project: Flink Issue Type:

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-12 Thread Zhu Zhu
Thanks Oytun for the reply! Sorry for not have stated it clearly. When saying "customized RestartStrategy", we mean that users implement an *org.apache.flink.runtime.executiongraph.restart.RestartStrategy* by themselves and use it by configuring like "restart-strategy:

[jira] [Created] (FLINK-14071) [for Documents Improvement] Add explicit path where jars files should be put for pyflink development

2019-09-12 Thread Xu Yang (Jira)
Xu Yang created FLINK-14071: --- Summary: [for Documents Improvement] Add explicit path where jars files should be put for pyflink development Key: FLINK-14071 URL: https://issues.apache.org/jira/browse/FLINK-14071

[jira] [Created] (FLINK-14070) Use TimeUtils to parse duration configs

2019-09-12 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14070: --- Summary: Use TimeUtils to parse duration configs Key: FLINK-14070 URL: https://issues.apache.org/jira/browse/FLINK-14070 Project: Flink Issue Type: Improvement

[SURVEY] How many people are using customized RestartStrategy(s)

2019-09-12 Thread Zhu Zhu
Hi everyone, I wanted to reach out to you and ask how many of you are using a customized RestartStrategy[1] in production jobs. We are currently developing the new Flink scheduler[2] which interacts with restart strategies in a different way. We have to re-design the interfaces for the new

[jira] [Created] (FLINK-14069) Enable TimeUtils to parse all time units labels supported by scala Duration

2019-09-12 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14069: --- Summary: Enable TimeUtils to parse all time units labels supported by scala Duration Key: FLINK-14069 URL: https://issues.apache.org/jira/browse/FLINK-14069 Project: Flink

Re: [DISCUSS] FLIP-64: Support for Temporary Objects in Table module

2019-09-12 Thread Zhenghua Gao
Thanks david for pushing this forward. I have one concern about temporary objects and non-persistent catalog(e.g., GenericInMemoryCatalog). In SQL, temporary objects exist at the session level. They are only visible to the session in which they were created and are automatically dropped when that

Re: [DISCUSS] Use Java's Duration instead of Flink's Time

2019-09-12 Thread Zili Chen
Hi, I've given it a try to switch to Java's Duration for all runtime Java code. Generally, most of its usages are for @RpcTimeout and testing timeout. However, do a clean work without touch public interface possibly introduce bridge codes convert runtime Java Duration to Flink's Time. I don't

[jira] [Created] (FLINK-14068) Use Java's Duration instead of Flink's Time

2019-09-12 Thread TisonKun (Jira)
TisonKun created FLINK-14068: Summary: Use Java's Duration instead of Flink's Time Key: FLINK-14068 URL: https://issues.apache.org/jira/browse/FLINK-14068 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-14067) Decouple PlanExecutor from JSON plan generation

2019-09-12 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-14067: Summary: Decouple PlanExecutor from JSON plan generation Key: FLINK-14067 URL: https://issues.apache.org/jira/browse/FLINK-14067 Project: Flink

Re: [DISCUSS] FLIP-56: Dynamic Slot Allocation

2019-09-12 Thread Xintong Song
Added implementation steps for this FLIP on the wiki page [1]. Thank you~ Xintong Song [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-56%3A+Dynamic+Slot+Allocation On Tue, Aug 20, 2019 at 3:43 PM Xintong Song wrote: > @Zili > > As far as I know, Timo is drafting a FLIP that

Re: Interested in contributing and looking for good first issues

2019-09-12 Thread Zili Chen
Hi Anoop, Welcome to the Flick community. Although we don't maintain a list of starter issues so far, it would be helpful if you provide more information about which topic you are interested in. Flink servers stateful computations over data streams based on a series of layered concepts, such as

Re: Interested in contributing and looking for good first issues

2019-09-12 Thread Till Rohrmann
Hi Anoop, welcome to the Flink community. I think you've already read the right things in order to get started. As far as I know, the Flink community does not maintain a list of starter issues. Hence, I would recommend to take a look at the open issues and ask on issues which are interesting to

[jira] [Created] (FLINK-14066) bug of building pyflink in master and 1.9.0 version

2019-09-12 Thread Xu Yang (Jira)
Xu Yang created FLINK-14066: --- Summary: bug of building pyflink in master and 1.9.0 version Key: FLINK-14066 URL: https://issues.apache.org/jira/browse/FLINK-14066 Project: Flink Issue Type: Bug

Re: [DISCUSS] Contribute Pulsar Flink connector back to Flink

2019-09-12 Thread Stephan Ewen
Agreed, if we check in the old code, we should make it clear that it will be removed as soon as the FLIP-27 based version of the connector is there. We should not commit to maintaining the old version, that would be indeed too much overhead. On Thu, Sep 12, 2019 at 3:30 AM Becket Qin wrote: >

Re: Blink Planner HBaseUpsertTableSink Exception

2019-09-12 Thread LakeShen
Thank you , Jark . I have added the primary key in my flink sql before , and it throwed the * Primary key and unique key are not supported yet. *Now I know it ,thank you sincerely to reply me . Best wishes, LakeShen Jark Wu 于2019年9月12日周四 下午3:15写道: > Hi Lake, > > This is not a problem of

Re: Blink Planner HBaseUpsertTableSink Exception

2019-09-12 Thread Jark Wu
Hi Lake, This is not a problem of HBaseUpsertTableSink. This is because the query loses primary key (e.g. concat(key1, key2) will lose the primary key information [key1, key2] currently.), but the validation of inserting checks the upsert query should have a primary key. That’s why the exception

Blink Planner HBaseUpsertTableSink Exception

2019-09-12 Thread LakeShen
Hi community , when I create the hbase sink table in my flink ddl sql ,just like this: *create table sink_hbase_table(rowkey VARCHAR,cf row(kdt_it_count bigint )) with (xx);* and I run my flink task , it throws the exception like this :

[jira] [Created] (FLINK-14065) Log metric name when the metric fails on registration/unregistration

2019-09-12 Thread Zhilong Hong (Jira)
Zhilong Hong created FLINK-14065: Summary: Log metric name when the metric fails on registration/unregistration Key: FLINK-14065 URL: https://issues.apache.org/jira/browse/FLINK-14065 Project: Flink