Re: [ANNOUNCE] Documentation now available at nightlies.apache.org

2021-11-04 Thread Yun Tang
Hi Chesnay, It seems that the redirection has not been completed. As old documentation hasn't updated for days, shall we add a waring on top of documentation, like current warning of "This documentation is for an out-of-date version of Apache Flink." to tell people to go to new location? Best

[jira] [Created] (FLINK-24782) Create 1.14 release branch for training repo

2021-11-04 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-24782: Summary: Create 1.14 release branch for training repo Key: FLINK-24782 URL: https://issues.apache.org/jira/browse/FLINK-24782 Project: Flink Issue Type:

[jira] [Created] (FLINK-24781) Port from string casting logic to CastRule

2021-11-04 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-24781: --- Summary: Port from string casting logic to CastRule Key: FLINK-24781 URL: https://issues.apache.org/jira/browse/FLINK-24781 Project: Flink

[jira] [Created] (FLINK-24780) Port time to time casting logic to CastRule

2021-11-04 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-24780: --- Summary: Port time to time casting logic to CastRule Key: FLINK-24780 URL: https://issues.apache.org/jira/browse/FLINK-24780 Project: Flink

[jira] [Created] (FLINK-24779) Port Numeric casting logic to CastRule

2021-11-04 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-24779: --- Summary: Port Numeric casting logic to CastRule Key: FLINK-24779 URL: https://issues.apache.org/jira/browse/FLINK-24779 Project: Flink Issue

[jira] [Created] (FLINK-24778) Add DataTypes#ROW(List)

2021-11-04 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-24778: --- Summary: Add DataTypes#ROW(List) Key: FLINK-24778 URL: https://issues.apache.org/jira/browse/FLINK-24778 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-24777) Processed (persisted) in-flight data description miss on Monitoring Checkpointing page

2021-11-04 Thread camilesing (Jira)
camilesing created FLINK-24777: -- Summary: Processed (persisted) in-flight data description miss on Monitoring Checkpointing page Key: FLINK-24777 URL: https://issues.apache.org/jira/browse/FLINK-24777

[jira] [Created] (FLINK-24776) Clarify DecodingFormat

2021-11-04 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-24776: --- Summary: Clarify DecodingFormat Key: FLINK-24776 URL: https://issues.apache.org/jira/browse/FLINK-24776 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-24775) Move JobStatus-related metrics out of ExecutionGraph

2021-11-04 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-24775: Summary: Move JobStatus-related metrics out of ExecutionGraph Key: FLINK-24775 URL: https://issues.apache.org/jira/browse/FLINK-24775 Project: Flink

[jira] [Created] (FLINK-24774) AdaptiveScheduler should inform job status listener of all state changes

2021-11-04 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-24774: Summary: AdaptiveScheduler should inform job status listener of all state changes Key: FLINK-24774 URL: https://issues.apache.org/jira/browse/FLINK-24774

[jira] [Created] (FLINK-24773) KafkaCommitter should fail on unknown Exception

2021-11-04 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-24773: --- Summary: KafkaCommitter should fail on unknown Exception Key: FLINK-24773 URL: https://issues.apache.org/jira/browse/FLINK-24773 Project: Flink Issue Type:

[jira] [Created] (FLINK-24772) Update user document for individual window table-valued function

2021-11-04 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-24772: -- Summary: Update user document for individual window table-valued function Key: FLINK-24772 URL: https://issues.apache.org/jira/browse/FLINK-24772 Project: Flink

[jira] [Created] (FLINK-24771) Update JDBC test dependencies to latest version

2021-11-04 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-24771: -- Summary: Update JDBC test dependencies to latest version Key: FLINK-24771 URL: https://issues.apache.org/jira/browse/FLINK-24771 Project: Flink Issue

[jira] [Created] (FLINK-24770) Remove error cause from JobStatusListener interface

2021-11-04 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-24770: Summary: Remove error cause from JobStatusListener interface Key: FLINK-24770 URL: https://issues.apache.org/jira/browse/FLINK-24770 Project: Flink

[jira] [Created] (FLINK-24769) FlameGraphs in 1.14 do not aggregate subtasks' stack traces anymore

2021-11-04 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-24769: --- Summary: FlameGraphs in 1.14 do not aggregate subtasks' stack traces anymore Key: FLINK-24769 URL: https://issues.apache.org/jira/browse/FLINK-24769 Project: Flink

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-04 Thread Yun Gao
Hi all, Very thanks for Fabian drafting the FLIP and the warm discussion! I'd like to complement some points based on the previous discussion: 1. Regarding the case of trans-checkpoints merging I agree with that all the options would not block the current checkpoint that producing the files to

[jira] [Created] (FLINK-24768) Upgrade Web Frontend to Angular v13 and NG-Zorro v13

2021-11-04 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-24768: -- Summary: Upgrade Web Frontend to Angular v13 and NG-Zorro v13 Key: FLINK-24768 URL: https://issues.apache.org/jira/browse/FLINK-24768 Project: Flink

[jira] [Created] (FLINK-24767) A keyBy following countWindow does not preserve order within the same partition

2021-11-04 Thread Lee Y S (Jira)
Lee Y S created FLINK-24767: --- Summary: A keyBy following countWindow does not preserve order within the same partition Key: FLINK-24767 URL: https://issues.apache.org/jira/browse/FLINK-24767 Project: Flink

[jira] [Created] (FLINK-24766) Ceiling/flooring dates to day return wrong resuls

2021-11-04 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-24766: --- Summary: Ceiling/flooring dates to day return wrong resuls Key: FLINK-24766 URL: https://issues.apache.org/jira/browse/FLINK-24766 Project: Flink

[jira] [Created] (FLINK-24765) Upgrade Kafka dependency

2021-11-04 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-24765: --- Summary: Upgrade Kafka dependency Key: FLINK-24765 URL: https://issues.apache.org/jira/browse/FLINK-24765 Project: Flink Issue Type: Improvement

Re: Contributor

2021-11-04 Thread Till Rohrmann
Hi Huwei, Welcome to the Flink community :-) There is no need for any JIRA permissions. If you want to get started, then I'd recommend reading the contribution guide [1] and then look for a ticket you like to work on. Once you've found one, then write on it so that a committer can assign you to

[jira] [Created] (FLINK-24764) pyflink/table/tests/test_udf.py hang on Azure

2021-11-04 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-24764: - Summary: pyflink/table/tests/test_udf.py hang on Azure Key: FLINK-24764 URL: https://issues.apache.org/jira/browse/FLINK-24764 Project: Flink Issue Type:

[jira] [Created] (FLINK-24763) ParquetFileSystemITCase.testLimitableBulkFormat failed on Azure

2021-11-04 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-24763: - Summary: ParquetFileSystemITCase.testLimitableBulkFormat failed on Azure Key: FLINK-24763 URL: https://issues.apache.org/jira/browse/FLINK-24763 Project: Flink

Contributor

2021-11-04 Thread ????????
Hi Guys, I want to contribute to Apache Flink. Would you please give me the permission as a contributor? My JIRA ID is huwei.

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-04 Thread Arvid Heise
> > Emitting records for downstream operators in or after > notifyCheckpointComplete no longer works after FLIP-147 when executing the > final checkpoint. The problem is that the final checkpoint happens after > the EOI and we would like to keep the property that you can terminate the > whole

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-04 Thread Till Rohrmann
Thanks for the detailed description Arvid. I might misunderstand things but one comment concerning: | We could even optimize the writer to only emit the committables after notifyCheckpointComplete as long as we retain them in the state of the writer. Emitting records for downstream operators in

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-04 Thread Arvid Heise
Hi folks, thanks for the lively discussion. Let me present my point of view on a couple of items: *Impact on checkpointing times* Currently, we send the committables of the writer downstream before the barrier is sent. That allows us to include all committables in the state of the committers,

[jira] [Created] (FLINK-24762) Remove agg function: INCR_SUM

2021-11-04 Thread Shuo Cheng (Jira)
Shuo Cheng created FLINK-24762: -- Summary: Remove agg function: INCR_SUM Key: FLINK-24762 URL: https://issues.apache.org/jira/browse/FLINK-24762 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-24761) Fix PartitionPruner code gen compile fail

2021-11-04 Thread tartarus (Jira)
tartarus created FLINK-24761: Summary: Fix PartitionPruner code gen compile fail Key: FLINK-24761 URL: https://issues.apache.org/jira/browse/FLINK-24761 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-189: SQL Client Usability Improvements

2021-11-04 Thread Sergey Nuyanzin
I've started a [VOTE] thread for this FLIP https://lists.apache.org/thread/f14jjhrscrdv7h6zw6h1k72nfx232qxs On Wed, Nov 3, 2021 at 2:59 PM Sergey Nuyanzin wrote: > Hi Timo, > > I completely agree it would be great if we can propagate Calcite parser > config in > the way you have described. As

[jira] [Created] (FLINK-24760) Update user document for batch window tvf

2021-11-04 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-24760: -- Summary: Update user document for batch window tvf Key: FLINK-24760 URL: https://issues.apache.org/jira/browse/FLINK-24760 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-04 Thread Guowei Ma
Hi, Very thanks Fabian for drafting this FLIP! It looks very good to me. I see currently most of us agree with option 2, but I personally feel that option 3 may be better :-) I have some small concerns for option 2 1. Developers understand that the cost is relatively high. The merging of small