Re: [Discuss][FLINK-8297]A solution for FLINK-8297 Timebased RocksDBListState

Hi Yun I think whether atomic increased number or timestamp, the key point is disperse the elements in the different keys. My point is how to design a useful key. For the atomic increased number, it will array the elements one by one but I think the key is useless. Because the max key is not the

Re: [Discuss][FLINK-8297]A solution for FLINK-8297 Timebased RocksDBListState

Hi Andrey, I think the mailing archive reformat my mail and confuse you. If the elements have the same processing time, the behavior of the them will same as the original RocksDBListState. So, it will involve the OOM issue. I think we can add an inner time shift to resolve it (only put limit count

[jira] [Created] (FLINK-12208) Introduce Sort / TemporalSort / SortLimit/ Limit operators for blink streaming runtime

Jing Zhang created FLINK-12208: -- Summary: Introduce Sort / TemporalSort / SortLimit/ Limit operators for blink streaming runtime Key: FLINK-12208 URL: https://issues.apache.org/jira/browse/FLINK-12208

Contributor permission Request

Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is tangshangwen ( https://issues.apache.org/jira/secure/ViewProfile.jspa?name=tangshangwen).

Re: [DISCUSS] Backtracking for failover regions

Thanks to Chesnay for bringing up this proposal. It's good news that we can have a applicable fine grained recovery for batch jobs soon. +1 for this proposal. Regards, Zhu Till Rohrmann 于2019年4月15日周一 下午5:57写道： > Thanks for summarizing the current state of Flip-1 and outlining the way to > move

Re: How can I use 1.9-SNAPSHOT Blink version for MapBundleFunction?

Replied in user mailing list. Best, Kurt On Mon, Apr 15, 2019 at 11:48 PM Felipe Gutierrez < felipe.o.gutier...@gmail.com> wrote: > Hi, > > I am trying to use the Blink implementation for "MapBundleFunction > < >

[jira] [Created] (FLINK-12206) cannot query nested fields using Flink SQL

Yu Yang created FLINK-12206: --- Summary: cannot query nested fields using Flink SQL Key: FLINK-12206 URL: https://issues.apache.org/jira/browse/FLINK-12206 Project: Flink Issue Type: Bug

Re: [DISCUSS] Apache Flink at Season of Docs

+Konstantin Knauf this is looking good, thanks for sharing! I also created a similar doc for Apache Airflow [1]. It is a bit messy, but it has questions from the application form that you can work with. Cheers, Aizhamal [1]

[jira] [Created] (FLINK-12205) Internal server error.,

Hobo Chen created FLINK-12205: - Summary: Internal server error., https://issues.apache.org/jira/browse/FLINK-12205 Project: Flink Issue Type: Bug Components: Examples Affects Versions: 1.8.0 Environment:

[jira] [Created] (FLINK-12204) Improve JDBCOutputFormat ClassCastException

Fabian Hueske created FLINK-12204: - Summary: Improve JDBCOutputFormat ClassCastException Key: FLINK-12204 URL: https://issues.apache.org/jira/browse/FLINK-12204 Project: Flink Issue Type:

[jira] [Created] (FLINK-12203) Refactor ResultPartitionManager to break tie with Task

Andrey Zagrebin created FLINK-12203: --- Summary: Refactor ResultPartitionManager to break tie with Task Key: FLINK-12203 URL: https://issues.apache.org/jira/browse/FLINK-12203 Project: Flink

How can I use 1.9-SNAPSHOT Blink version for MapBundleFunction?

Hi, I am trying to use the Blink implementation for "MapBundleFunction ". For some reason, my pom.xml

[jira] [Created] (FLINK-12202) Consider introducing batch metric register in NetworkEnviroment

Andrey Zagrebin created FLINK-12202: --- Summary: Consider introducing batch metric register in NetworkEnviroment Key: FLINK-12202 URL: https://issues.apache.org/jira/browse/FLINK-12202 Project: Flink

[jira] [Created] (FLINK-12201) Introduce InputGateWithMetrics in Task to increment in/out byte metrics

Andrey Zagrebin created FLINK-12201: --- Summary: Introduce InputGateWithMetrics in Task to increment in/out byte metrics Key: FLINK-12201 URL: https://issues.apache.org/jira/browse/FLINK-12201

[jira] [Created] (FLINK-12200) [Table API] Support UNNEST for MAP types

Artsem Semianenka created FLINK-12200: - Summary: [Table API] Support UNNEST for MAP types Key: FLINK-12200 URL: https://issues.apache.org/jira/browse/FLINK-12200 Project: Flink Issue

[jira] [Created] (FLINK-12199) Refactor IOMetrics to not distinguish between local/remote

Andrey Zagrebin created FLINK-12199: --- Summary: Refactor IOMetrics to not distinguish between local/remote Key: FLINK-12199 URL: https://issues.apache.org/jira/browse/FLINK-12199 Project: Flink

[jira] [Created] (FLINK-12198) Flink JDBC Connector: Update existing JDBCInputFormat to support setting auto-commit mode of DB connection

Konstantinos Papadopoulos created FLINK-12198: - Summary: Flink JDBC Connector: Update existing JDBCInputFormat to support setting auto-commit mode of DB connection Key: FLINK-12198 URL:

Re: [DISCUSS] A more restrictive JIRA workflow

I think this really depends on the contribution. Sometimes "triviality" means that people just want to fix a typo in some docs. For this, a hotfix PR is sufficient and does not need a JIRA issue. However, sometimes "triviality" is only trivial at first glance but introduces side effects. In

Re: [REMINDER] Please add entries for newly added dependencies to NOTICE file

I will add such a feature to the bot! On Mon, Mar 25, 2019 at 7:41 PM Stephan Ewen wrote: > +1 to an enhancement to the Flink bot as a simple first step. > > The first step could be as simple as adding a red warning message as a > comment to the PR whenever a PR touches a POM file. > That needs

[jira] [Created] (FLINK-12197) Avro row deser for Confluent binary format

eugen yushin created FLINK-12197: Summary: Avro row deser for Confluent binary format Key: FLINK-12197 URL: https://issues.apache.org/jira/browse/FLINK-12197 Project: Flink Issue Type: New

Re: [DISCUSS] A more restrictive JIRA workflow

Hi everyone, just my two cents: as a non-committer I appreciate a lightweight, frictionless process for trivial changes or small fixes without the need to approach a committer beforehand. If it takes 5 days, so that I can start with a triviality, I might not bother in the first place. So, in

Re: [jira] [Created] (FLINK-12196) FlinkKafkaProducerITCase#testRunOutOfProducersInThePool throws NPE

! Regards, Alex. Sent from my BlackBerry Passport.   Original Message   From: vinoyang (JIRA) Sent: Monday, April 15, 2019 4:08 PM To: dev@flink.apache.org Reply To: dev@flink.apache.org Subject: [jira] [Created] (FLINK-12196) FlinkKafkaProducerITCase#testRunOutOfProducersInThePool throws NPE

Re: [DISCUSS] A more restrictive JIRA workflow

@Robert thanks for pointing out and sorry for confusion. The correct text: +1 for option 1. I also do not mind option 2, after 1-2 contributions, any contributor could just ask the committer (who merged those contributions) about contributor permissions. Best, Andrey On Mon, Apr 15, 2019 at

[jira] [Created] (FLINK-12196) FlinkKafkaProducerITCase#testRunOutOfProducersInThePool throws NPE

vinoyang created FLINK-12196: Summary: FlinkKafkaProducerITCase#testRunOutOfProducersInThePool throws NPE Key: FLINK-12196 URL: https://issues.apache.org/jira/browse/FLINK-12196 Project: Flink

Re: [DISCUSS] Backtracking for failover regions

Thanks for summarizing the current state of Flip-1 and outlining the way to move forward with it Chesnay. I think we should implement the first version of the backtracking logic using the DataConsumptionException (FLINK-6227) to signal if an intermediate result partition has been lost. Moreover,

[jira] [Created] (FLINK-12195) Incorrect resource time setting causes flink to fail to submit

tangshangwen created FLINK-12195: Summary: Incorrect resource time setting causes flink to fail to submit Key: FLINK-12195 URL: https://issues.apache.org/jira/browse/FLINK-12195 Project: Flink

Re: [Discuss][FLINK-8297]A solution for FLINK-8297 Timebased RocksDBListState

Hi Faxian We also try to fix the single large list state problem in RocksDB and had a private solution by adding atomic increased number in the RocksDB's key bytes. We would keep the number in the checkpoint so that the order would not be broken after restoring from checkpoint. I think

Re: [DISCUSS] Create a Flink ecosystem website

Hey Daryl, thanks a lot for posting a link to this first prototype on the mailing list! I really like it! Becket: Our plan forward is that Congxian is implementing the backend for the website. He has already started with the work, but needs at least one more week. [Re-sending this email

Re: [DISCUSS] Apache Flink at Season of Docs

Hi all, I'm very happy to see this project happening! Thank you for the proposal Konstantin! One idea for the "related material": we could also link to talks or blog posts about concepts / monitoring / operations. Potential writers could feel overwhelmed by our demand for improvements, without

[jira] [Created] (FLINK-12194) Enable setting in DataStreamAllroundTestProgram

Gary Yao created FLINK-12194: Summary: Enable setting in DataStreamAllroundTestProgram Key: FLINK-12194 URL: https://issues.apache.org/jira/browse/FLINK-12194 Project: Flink Issue Type: New

Re: [Discuss][FLINK-8297]A solution for FLINK-8297 Timebased RocksDBListState

Hi Faxian, Thanks for thinking on this new approach. Here are my thoughts: - In case of event time, although, this approach changes semantics of original list state, it could be a good fit for certain use cases. The main advantage is that it is deterministic in event time. The list should end up

Re: contributor permission

Hi Francis, Welcome to the Flink community! I've given you contributor permissions for Jira. Best, Fabian Am Mo., 15. Apr. 2019 um 03:49 Uhr schrieb du francis < francisdu...@gmail.com>: > Hello Flink Community: > > My name is Francis Du ,I want to contribute to Apache Flink. > Would

Re: SQL CLI and JDBC

Hi, I don't have much experience with Calcite connectors. One potential problem might be fetching the results. The CLI client uses the DataSet.collect() method which collects all results from all TMs in the JM and (AFAIK) transfers it in a single RPC message back to the client. Hence, this only

Re: [PROGRESS-UPDATE] Redesign Flink Scheduling, introducing dedicated Scheduler Component

The new interface will be very helpful to extend the scheduling strategy. It also makes the scheduling and failover process much cleaner. Thanks Gary to bring up this proposal. I really like it. +1 for this proposal. Regards, Zhu zhijiang 于2019年4月15日周一 下午2:45写道： > Thanks for sharing the latest

[jira] [Created] (FLINK-12193) [Distributed Coordination] Send TM "can be released status" with RM heartbeat

Andrey Zagrebin created FLINK-12193: --- Summary: [Distributed Coordination] Send TM "can be released status" with RM heartbeat Key: FLINK-12193 URL: https://issues.apache.org/jira/browse/FLINK-12193

Re: [DISCUSS] A more restrictive JIRA workflow

Hello there, New to the community. Just thought you might want some inputs from new comers too. I prefer option 2, where you need to prove the ability and commitment with commits before contributor permission is assigned. Cheers, Feng Le lun. 15 avr. 2019 à 09:17, Robert Metzger a écrit : >

[jira] [Created] (FLINK-12192) Add support for generating optimized logical plan for grouping sets and distinct aggregate

godfrey he created FLINK-12192: -- Summary: Add support for generating optimized logical plan for grouping sets and distinct aggregate Key: FLINK-12192 URL: https://issues.apache.org/jira/browse/FLINK-12192

Re: [DISCUSS] Apache Flink at Season of Docs

Hi everyone, thanks @Aizhamal Nurmamat kyzy . As we only have one week left until the application deadline, I went ahead and created a document for the project ideas [1]. I have added the description for the "stream processing concepts" as well as the "deployment & operations documentation"

[jira] [Created] (FLINK-12191) Flink SVGs on "Material" page broken, render incorrectly on Firefox

Patrick Lucas created FLINK-12191: - Summary: Flink SVGs on "Material" page broken, render incorrectly on Firefox Key: FLINK-12191 URL: https://issues.apache.org/jira/browse/FLINK-12191 Project: Flink

[jira] [Created] (FLINK-12190) Fix NPE throwed by FlinkKinesisConsumerMigrationTest#writeSnapshot

vinoyang created FLINK-12190: Summary: Fix NPE throwed by FlinkKinesisConsumerMigrationTest#writeSnapshot Key: FLINK-12190 URL: https://issues.apache.org/jira/browse/FLINK-12190 Project: Flink

Re: [DISCUSS] A more restrictive JIRA workflow

@Andrey: You mention "option 2" two times, I guess one of the two uses of "option 2" contains a typo? On Wed, Apr 10, 2019 at 10:33 AM Andrey Zagrebin wrote: > Hi all, > > +1 for option 2. > > I also do not mind option 2, after 1-2 contributions, any contributor could > just ask the committer

[jira] [Created] (FLINK-12189) Fix bugs and typos in memory management related classes

Liya Fan created FLINK-12189: Summary: Fix bugs and typos in memory management related classes Key: FLINK-12189 URL: https://issues.apache.org/jira/browse/FLINK-12189 Project: Flink Issue Type:

Re: [PROGRESS-UPDATE] Redesign Flink Scheduling, introducing dedicated Scheduler Component

Thanks for sharing the latest updates for the scheduler refactoring Gary. It is really good to me and wish seeing the new interface ready soon. Best, Zhijiang -- From:Guowei Ma Send Time:2019年4月15日(星期一) 09:25 To:dev Subject:Re:

[jira] [Created] (FLINK-12188) Flink Deployment Docs to GCP is not updated for 2 years..

Chethan U created FLINK-12188: - Summary: Flink Deployment Docs to GCP is not updated for 2 years.. Key: FLINK-12188 URL: https://issues.apache.org/jira/browse/FLINK-12188 Project: Flink Issue