Blink Planner HBaseUpsertTableSink Exception

Hi community , when I create the hbase sink table in my flink ddl sql ,just like this: *create table sink_hbase_table(rowkey VARCHAR,cf row(kdt_it_count bigint )) with (xx);* and I run my flink task , it throws the exception like this : *Up

[jira] [Created] (FLINK-14065) Log metric name when the metric fails on registration/unregistration

Zhilong Hong created FLINK-14065: Summary: Log metric name when the metric fails on registration/unregistration Key: FLINK-14065 URL: https://issues.apache.org/jira/browse/FLINK-14065 Project: Flink

Interested in contributing and looking for good first issues

Hello Flink Devs, I am interested in contributing to Apache Flink and I am looking for beginner friendly issues/tasks to hit the ground running. *Can somebody recommend good issues for first time contributors* ? Also, can somebody add me to JIRA project for Flink ? My JIRA username is anoophallur

[jira] [Created] (FLINK-14064) Support Project Push down to LookupableTableSource

hailong wang created FLINK-14064: Summary: Support Project Push down to LookupableTableSource Key: FLINK-14064 URL: https://issues.apache.org/jira/browse/FLINK-14064 Project: Flink Issue Type

Re: [DISCUSS] FLIP-63: Rework table partition support

Hi Jingsong, Thanks for explaining. It looks cool! Thanks, Biao /'bɪ.aʊ/ On Wed, 11 Sep 2019 at 11:37, JingsongLee wrote: > Hi biao, thanks for your feedbacks: > > Actually, the runtime source partition of runtime is similar to split, > which concerns data reading, parallelism and fault tole

Re: [DISCUSS] Features for Apache Flink 1.10

Thanks Gary for kicking off the discussion. +1 for the feature freeze time. Also thanks Gary and Yu Li for volunteering as the release manager. BTW, I'm working on refactoring of `CheckpointCoordinator` [1]. It would be great if it is included in 1.10. 1. https://issues.apache.org/jira/browse/FL

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili Thank you~ Xintong Song On Thu, Sep 12, 2019 at 11:03 AM Yun Tang wrote: > Congratulations Zili > > Best > Yun Tang > > From: Yun Gao > Sent: Thursday, September 12, 2019 10:12 > To: dev > Subject: Re: [ANNOUNCE] Zili Chen becomes a Fli

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili Chen ! ！ Best， Leonard Xu > On 2019年9月12日, at 上午11:02, Yun Tang wrote: > > Congratulations Zili > > Best > Yun Tang > > From: Yun Gao > > Sent: Thursday, September 12, 2019 10:12 > To: dev mailto:dev@fli

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili Best Yun Tang From: Yun Gao Sent: Thursday, September 12, 2019 10:12 To: dev Subject: Re: [ANNOUNCE] Zili Chen becomes a Flink committer Congratulations Zili! Best, Yun ---

[jira] [Created] (FLINK-14060) Set slot sharing groups according to pipelined regions

Xintong Song created FLINK-14060: Summary: Set slot sharing groups according to pipelined regions Key: FLINK-14060 URL: https://issues.apache.org/jira/browse/FLINK-14060 Project: Flink Issue

[jira] [Created] (FLINK-14063) Operators use fractions to decide how many managed memory to allocate

Xintong Song created FLINK-14063: Summary: Operators use fractions to decide how many managed memory to allocate Key: FLINK-14063 URL: https://issues.apache.org/jira/browse/FLINK-14063 Project: Flink

[jira] [Created] (FLINK-14062) Set managed memory fractions according to slot sharing groups

Xintong Song created FLINK-14062: Summary: Set managed memory fractions according to slot sharing groups Key: FLINK-14062 URL: https://issues.apache.org/jira/browse/FLINK-14062 Project: Flink

[jira] [Created] (FLINK-14061) Introduce managed memory fractions to StreamConfig

Xintong Song created FLINK-14061: Summary: Introduce managed memory fractions to StreamConfig Key: FLINK-14061 URL: https://issues.apache.org/jira/browse/FLINK-14061 Project: Flink Issue Type

[jira] [Created] (FLINK-14059) Introduce option allSourcesInSamePipelinedRegion in ExecutionConfig

Xintong Song created FLINK-14059: Summary: Introduce option allSourcesInSamePipelinedRegion in ExecutionConfig Key: FLINK-14059 URL: https://issues.apache.org/jira/browse/FLINK-14059 Project: Flink

[jira] [Created] (FLINK-14058) FLIP-53 Fine Grained Operator Resource Management

Xintong Song created FLINK-14058: Summary: FLIP-53 Fine Grained Operator Resource Management Key: FLINK-14058 URL: https://issues.apache.org/jira/browse/FLINK-14058 Project: Flink Issue Type:

Re: [VOTE] FLIP-53: Fine Grained Operator Resource Management

Thanks all for the votes. So far, we have - 3 binding +1 votes (Till, Andrey and Kurt) - 2 un-binding +1 votes (Zhu and Xintong) - No -1 votes There are 3 binding +1 votes and no -1 votes, and the voting time has past. According to the community bylaws, I'm glad to announce that FLIP-53

Re: [VOTE] FLIP-53: Fine Grained Operator Resource Management

+1 from my side. Thanks for bringing this up, Kurt. It's true that the accuracy loss of floating values could cause problems in some cases. And I would consider this as an implementation issue that can be discussed later in the PRs. Thank you~ Xintong Song On Sat, Sep 7, 2019 at 2:51 PM Kurt

[RESULT] [VOTE] Release 1.8.2, release candidate #1

I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 3 of which are binding: * jincheng (binding) * Kurt (binding) * Till (binding) * Dian * Jark There are no disapproving votes. Thanks everyone!

Re: [VOTE] Release 1.8.2, release candidate #1

+1 (non-binding) - checked/verified signatures and hashes - built from source, without Hadoop and using Scala 2.12 - checked that all POM files point to the same version - started a cluster; WebUI is accessible, submit example jobs, no suspicious log output - manually verified the diff pom files b

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili! Best, Yun -- From:Yangze Guo Send Time:2019 Sep. 12 (Thu.) 09:38 To:dev Subject:Re: [ANNOUNCE] Zili Chen becomes a Flink committer Congratulations! Best, Yangze Guo On Thu, Sep 12, 2019 at 9:

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili！ -- From:Becket Qin Send Time:2019年9月12日(星期四) 03:43 To:Paul Lam Cc:Rong Rong ; dev ; user Subject:Re: [ANNOUNCE] Zili Chen becomes a Flink committer Congrats, Zili! On Thu, Sep 12, 2019 at 9:39 AM Paul Lam wr

Re: [VOTE] FLIP-49: Unified Memory Configuration for TaskExecutors

True. It would be easier for the users to understand if JM and TM have corresponding config options. Maybe we can have another FLIP addressing this afterwards. Thank you~ Xintong Song On Mon, Sep 9, 2019 at 11:38 PM Stephan Ewen wrote: > One thing that I just came across: Some of these optio

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congrats, Zili! On Thu, Sep 12, 2019 at 9:39 AM Paul Lam wrote: > Congratulations Zili！ > > Best, > Paul Lam > > 在 2019年9月12日，09:34，Rong Rong 写道： > > Congratulations Zili! > > -- > Rong > > On Wed, Sep 11, 2019 at 6:26 PM Hequn Cheng wrote: > >> Congratulations! >> >> Best, Hequn >> >> On Thu,

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili！ Best, Paul Lam > 在 2019年9月12日，09:34，Rong Rong 写道： > > Congratulations Zili! > > -- > Rong > > On Wed, Sep 11, 2019 at 6:26 PM Hequn Cheng > wrote: > Congratulations! > > Best, Hequn > > On Thu, Sep 12, 2019 at 9:24 AM Jark Wu

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations! Best, Yangze Guo On Thu, Sep 12, 2019 at 9:35 AM Rong Rong wrote: > > Congratulations Zili! > > -- > Rong > > On Wed, Sep 11, 2019 at 6:26 PM Hequn Cheng wrote: > > > Congratulations! > > > > Best, Hequn > > > > On Thu, Sep 12, 2019 at 9:24 AM Jark Wu wrote: > > > >> Congratul

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili! -- Rong On Wed, Sep 11, 2019 at 6:26 PM Hequn Cheng wrote: > Congratulations! > > Best, Hequn > > On Thu, Sep 12, 2019 at 9:24 AM Jark Wu wrote: > >> Congratulations Zili! >> >> Best, >> Jark >> >> On Wed, 11 Sep 2019 at 23:06, wrote: >> >> > Congratulations, Zili. >> >

Re: [DISCUSS] Contribute Pulsar Flink connector back to Flink

Hi Stephan, Thanks for the volunteering to help. Yes, the overhead would just be review capacity. In fact, I am not worrying too much about the review capacity. That is just a one time cost. My concern is mainly about the long term burden. Assume we have new source interface ready in 1.10 with ne

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations! Best, Hequn On Thu, Sep 12, 2019 at 9:24 AM Jark Wu wrote: > Congratulations Zili! > > Best, > Jark > > On Wed, 11 Sep 2019 at 23:06, wrote: > > > Congratulations, Zili. > > > > > > > > Best, > > > > Xingcan > > > > > > > > *From:* SHI Xiaogang > > *Sent:* Wednesday, Septembe

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili! Best, Jark On Wed, 11 Sep 2019 at 23:06, wrote: > Congratulations, Zili. > > > > Best, > > Xingcan > > > > *From:* SHI Xiaogang > *Sent:* Wednesday, September 11, 2019 7:43 AM > *To:* Guowei Ma > *Cc:* Fabian Hueske ; Biao Liu ; > Oytun Tez ; bupt_ljy ; dev < > dev@flink

[jira] [Created] (FLINK-14057) Add Remove Other Timers to TimerService

Jesse Anderson created FLINK-14057: -- Summary: Add Remove Other Timers to TimerService Key: FLINK-14057 URL: https://issues.apache.org/jira/browse/FLINK-14057 Project: Flink Issue Type: Impro

Re: Checkpoint metrics.

Great timing, I just debugged this on Monday. E2e time is checkpoint coordinator to checkpoint coordinator, so it includes RPC to the source and RPC from the operator back for the JM. Seth > On Sep 11, 2019, at 6:17 PM, Jamie Grier wrote: > > Hey all, > > I need to make sense of this behav

Checkpoint metrics.

Hey all, I need to make sense of this behavior. Any help would be appreciated. Here’s an example of a set of Flink checkpoint metrics I don’t understand. This is the first operator in a job and as you can see the end-to-end time for the checkpoint is long, but it’s not explained by either sync,

[jira] [Created] (FLINK-14056) AtOm+Electron+TypedE-Mail

KORAY DURGUT created FLINK-14056: - Summary: AtOm+Electron+TypedE-Mail Key: FLINK-14056 URL: https://issues.apache.org/jira/browse/FLINK-14056 Project: Flink Issue Type: Bug Compone

[jira] [Created] (FLINK-14055) Add advanced function DDL syntax "USING JAR/FILE/ACHIVE"

Bowen Li created FLINK-14055: Summary: Add advanced function DDL syntax "USING JAR/FILE/ACHIVE" Key: FLINK-14055 URL: https://issues.apache.org/jira/browse/FLINK-14055 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

Hi, Thanks @Fabian @Dawid and everyone else for sharing your thoughts! First, I'd like to take Hive built-in functions out of this FLIP to keep our original scope and make it less controversial on a potential modular approach. I will remove Hive built-in functions from the google doc. Then the f

Re: instable checkpointing after migration to flink 1.8

Hi Bekir Changing the timer factory from HEAP to ROCKSDB would certainly help reduce your JVM heap usage. Since it would use RocksDB to store the timer state, you might come across performance regression as we need to poll timers from RocksDB instead of JVM heap. From our experience, 20 millio

[jira] [Created] (FLINK-14054) Enable checkpointing via job configuration

Jun Qin created FLINK-14054: --- Summary: Enable checkpointing via job configuration Key: FLINK-14054 URL: https://issues.apache.org/jira/browse/FLINK-14054 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

Hi Fabian, Thank you for your response. Regarding the temporary function, just wanted to clarify one thing: the 3-part identifier does not mean the user always has to provide the catalog & database explicitly. The same way user does not have to provide them in e.g. when creating permanent table, vi

RE: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations, Zili. Best, Xingcan From: SHI Xiaogang Sent: Wednesday, September 11, 2019 7:43 AM To: Guowei Ma Cc: Fabian Hueske ; Biao Liu ; Oytun Tez ; bupt_ljy ; dev ; user ; Till Rohrmann Subject: Re: [ANNOUNCE] Zili Chen becomes a Flink committer Congratulations! Rega

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

Hi all, I'd like to add my opinion on this topic as well ;-) In general, I think overriding built-in function with temp functions has a couple of benefits but also a few challenges: * Users can reimplement the behavior of a built-in functions of a different system, e.g., for backward compatibili

[jira] [Created] (FLINK-14053) blink planner dense_rank corner case bug

jackylau created FLINK-14053: Summary: blink planner dense_rank corner case bug Key: FLINK-14053 URL: https://issues.apache.org/jira/browse/FLINK-14053 Project: Flink Issue Type: Bug Co

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations! Regards, Xiaogang Guowei Ma 于2019年9月11日周三 下午7:07写道： > Congratulations Zili ! > > Best, > Guowei > > > Fabian Hueske 于2019年9月11日周三 下午7:02写道： > >> Congrats Zili Chen :-) >> >> Cheers, Fabian >> >> Am Mi., 11. Sept. 2019 um 12:48 Uhr schrieb Biao Liu > >: >> >>> Congrats Zili! >>

Re: instable checkpointing after migration to flink 1.8

Hi Yun, first of all, this reported problem looks like resolved for 2 days already, right after we changed the type and number of our nodes to give more heap to task managers and have more task-managers as well. Previously, our job was configured as parallelism 70, which was distributed to 14 task

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili ! Best, Guowei Fabian Hueske 于2019年9月11日周三 下午7:02写道： > Congrats Zili Chen :-) > > Cheers, Fabian > > Am Mi., 11. Sept. 2019 um 12:48 Uhr schrieb Biao Liu : > >> Congrats Zili! >> >> Thanks, >> Biao /'bɪ.aʊ/ >> >> >> >> On Wed, 11 Sep 2019 at 18:43, Oytun Tez wrote: >> >>>

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congrats Zili Chen :-) Cheers, Fabian Am Mi., 11. Sept. 2019 um 12:48 Uhr schrieb Biao Liu : > Congrats Zili! > > Thanks, > Biao /'bɪ.aʊ/ > > > > On Wed, 11 Sep 2019 at 18:43, Oytun Tez wrote: > >> Congratulations! >> >> --- >> Oytun Tez >> >> *M O T A W O R D* >> The World's Fastest Human Tran

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congrats Zili! Thanks, Biao /'bɪ.aʊ/ On Wed, 11 Sep 2019 at 18:43, Oytun Tez wrote: > Congratulations! > > --- > Oytun Tez > > *M O T A W O R D* > The World's Fastest Human Translation Platform. > oy...@motaword.com — www.motaword.com > > > On Wed, Sep 11, 2019 at 6:36 AM bupt_ljy wrote: > >

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili Chen! bupt_ljy 于2019年9月11日周三 下午6:36写道： > Congratulations! > > > Best, > > Jiayi Liao > > Original Message > *Sender:* Till Rohrmann > *Recipient:* dev; user > *Date:* Wednesday, Sep 11, 2019 17:22 > *Subject:* [ANNOUNCE] Zili Chen becomes a Flink committer > > Hi everyone,

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations! Best, Jiayi Liao Original Message Sender: Till Rohrmann Recipient: dev; user Date: Wednesday, Sep 11, 2019 17:22 Subject: [ANNOUNCE] Zili Chen becomes a Flink committer Hi everyone, I'm very happy to announce that Zili Chen (some of you might also know him as Tison Kun)

Re: [DISCUSS] Features for Apache Flink 1.10

Hi, Thanks for putting together the list! And I’m +1 for the suggested release timeline and also for Gary and Yu as the release managers. Best, Aljoscha On 9 Sep 2019, at 7:39, Yu Li wrote: Hi Xuefu, If I understand it correctly, the data type support work should be included in the "Table

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili! Thanks, Zhu Zhu Terry Wang 于2019年9月11日周三 下午5:34写道： > Congratulations! > > Best, > Terry Wang > > > > 在 2019年9月11日，下午5:28，Dian Fu 写道： > > Congratulations! > > 在 2019年9月11日，下午5:26，Jeff Zhang 写道： > > Congratulations Zili Chen! > > Wesley Peng 于2019年9月11日周三 下午5:25写道： > >> H

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations! Best, Terry Wang > 在 2019年9月11日，下午5:28，Dian Fu 写道： > > Congratulations! > >> 在 2019年9月11日，下午5:26，Jeff Zhang mailto:zjf...@gmail.com>> >> 写道： >> >> Congratulations Zili Chen! >> >> Wesley Peng mailto:wes...@thepeng.eu>> 于2019年9月11日周三 >> 下午5:25写道： >> Hi >> >> on 2019/9/1

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations! > 在 2019年9月11日，下午5:26，Jeff Zhang 写道： > > Congratulations Zili Chen! > > Wesley Peng mailto:wes...@thepeng.eu>> 于2019年9月11日周三 > 下午5:25写道： > Hi > > on 2019/9/11 17:22, Till Rohrmann wrote: > > I'm very happy to announce that Zili Chen (some of you might also know > > him as T

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

Congratulations Zili Chen! Best, Forward Till Rohrmann 于2019年9月11日周三 下午5:23写道： > Hi everyone, > > I'm very happy to announce that Zili Chen (some of you might also know him > as Tison Kun) accepted the offer of the Flink PMC to become a committer of > the Flink project. > > Zili Chen has been

[ANNOUNCE] Zili Chen becomes a Flink committer

Hi everyone, I'm very happy to announce that Zili Chen (some of you might also know him as Tison Kun) accepted the offer of the Flink PMC to become a committer of the Flink project. Zili Chen has been an active community member for almost 16 months now. He helped pushing the Flip-6 effort over th

Re: [DISCUSS] Flink client api enhancement for downstream project

+1 for creating a channel. Kostas On Wed, Sep 11, 2019 at 10:57 AM Zili Chen wrote: > > Hi Aljoscha, > > I'm OK to use the ASF slack. > > Best, > tison. > > > Jeff Zhang 于2019年9月11日周三 下午4:48写道： >> >> +1 for using slack for instant communication >> >> Aljoscha Krettek 于2019年9月11日周三 下午4:44写道： >>

[jira] [Created] (FLINK-14052) Generalize AkkaOptions to RpcOptions

Till Rohrmann created FLINK-14052: - Summary: Generalize AkkaOptions to RpcOptions Key: FLINK-14052 URL: https://issues.apache.org/jira/browse/FLINK-14052 Project: Flink Issue Type: Improvemen

Re: [DISCUSS] Flink client api enhancement for downstream project

Hi Aljoscha, I'm OK to use the ASF slack. Best, tison. Jeff Zhang 于2019年9月11日周三 下午4:48写道： > +1 for using slack for instant communication > > Aljoscha Krettek 于2019年9月11日周三 下午4:44写道： > >> Hi, >> >> We could try and use the ASF slack for this purpose, that would probably >> be easiest. See htt

Re: [DISCUSS] Flink client api enhancement for downstream project

+1 for using slack for instant communication Aljoscha Krettek 于2019年9月11日周三 下午4:44写道： > Hi, > > We could try and use the ASF slack for this purpose, that would probably > be easiest. See https://s.apache.org/slack-invite. We could create a > dedicated channel for our work and would still use the

Re: [DISCUSS] Flink client api enhancement for downstream project

Hi, We could try and use the ASF slack for this purpose, that would probably be easiest. See https://s.apache.org/slack-invite. We could create a dedicated channel for our work and would still use the open ASF infrastructure and people can have a look if they are interested because discussion w

Re: Call for approving Elasticsearch 7.x connector

Hi, Thanks for the heads up! I commented on the issue. Best, Aljoscha > On 9. Sep 2019, at 10:38, vino yang wrote: > > Hi guys, > > There is an issue about supporting Elasticsearch 7.x.[1] > Based on our validation and discussion. We found that Elasticsearch 7.x > does not guarantee API compa

[DISCUSS] Drop older versions of Kafka Connectors (0.9, 0.10) for Flink 1.10

Hi all! We still maintain connectors for Kafka 0.8 and 0.9 in Flink. I would suggest to drop those with Flink 1.10 and start supporting only Kafka 0.10 onwards. Are there any concerns about this, or still a significant number of users of these versions? Best, Stephan

[jira] [Created] (FLINK-14051) Deploy job cluster in attached mode

TisonKun created FLINK-14051: Summary: Deploy job cluster in attached mode Key: FLINK-14051 URL: https://issues.apache.org/jira/browse/FLINK-14051 Project: Flink Issue Type: Sub-task Co

[jira] [Created] (FLINK-14050) Refactor YarnClusterDescriptor inheritance

TisonKun created FLINK-14050: Summary: Refactor YarnClusterDescriptor inheritance Key: FLINK-14050 URL: https://issues.apache.org/jira/browse/FLINK-14050 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-14049) Update error message for failed partition updates to include task name

Stephan Ewen created FLINK-14049: Summary: Update error message for failed partition updates to include task name Key: FLINK-14049 URL: https://issues.apache.org/jira/browse/FLINK-14049 Project: Flink