[jira] [Created] (FLINK-21968) Calcite parser doesn't support to parse "-- test"

2021-03-24 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21968: - Summary: Calcite parser doesn't support to parse "-- test" Key: FLINK-21968 URL: https://issues.apache.org/jira/browse/FLINK-21968 Project: Flink Issue

Re: [DISCUSS]FLIP-150: Introduce Hybrid Source

2021-03-24 Thread Thomas Weise
Hi, As mentioned in my previous email, I had been working on a prototype for the hybrid source. You can find it at https://github.com/tweise/flink/pull/1 It contains: * Switching with configurable chain of sources * Fixed or dynamic start positions * Test with MockSource and FileSource The

[jira] [Created] (FLINK-21967) Add document on the operation of blocking result partition

2021-03-24 Thread Yun Gao (Jira)
Yun Gao created FLINK-21967: --- Summary: Add document on the operation of blocking result partition Key: FLINK-21967 URL: https://issues.apache.org/jira/browse/FLINK-21967 Project: Flink Issue Type:

[jira] [Created] (FLINK-21966) Support Kinesis connector in Python DataStream API.

2021-03-24 Thread Shuiqiang Chen (Jira)
Shuiqiang Chen created FLINK-21966: -- Summary: Support Kinesis connector in Python DataStream API. Key: FLINK-21966 URL: https://issues.apache.org/jira/browse/FLINK-21966 Project: Flink

[jira] [Created] (FLINK-21965) Surefire plugin seems to have failed

2021-03-24 Thread Matthias (Jira)
Matthias created FLINK-21965: Summary: Surefire plugin seems to have failed Key: FLINK-21965 URL: https://issues.apache.org/jira/browse/FLINK-21965 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21964) HA e2e test failed due to not enough resources being available

2021-03-24 Thread Matthias (Jira)
Matthias created FLINK-21964: Summary: HA e2e test failed due to not enough resources being available Key: FLINK-21964 URL: https://issues.apache.org/jira/browse/FLINK-21964 Project: Flink

[jira] [Created] (FLINK-21963) ReactiveModelITCase.testScaleDownOnTaskManagerLoss failed

2021-03-24 Thread Matthias (Jira)
Matthias created FLINK-21963: Summary: ReactiveModelITCase.testScaleDownOnTaskManagerLoss failed Key: FLINK-21963 URL: https://issues.apache.org/jira/browse/FLINK-21963 Project: Flink Issue

[jira] [Created] (FLINK-21962) SQL Group Windows do not work on Flink 1.11

2021-03-24 Thread Barak Ben-Nathan (Jira)
Barak Ben-Nathan created FLINK-21962: Summary: SQL Group Windows do not work on Flink 1.11 Key: FLINK-21962 URL: https://issues.apache.org/jira/browse/FLINK-21962 Project: Flink Issue

Re: [DISCUSS] Introducing Backpressure for connected streams

2021-03-24 Thread Robin KC
Thanks Pioter and Guowei for the inputs. I understand that this can lead to deadlocks and the right solution should be based on FLIP-27. Will look further into FLIP-27 for this. Thanks, Robin On Wed, Mar 24, 2021 at 2:21 PM Piotr Nowojski wrote: > Hi Robin, > > Flink has a functionality to

[jira] [Created] (FLINK-21961) Add JSON StateFun type to the Python SDK

2021-03-24 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-21961: Summary: Add JSON StateFun type to the Python SDK Key: FLINK-21961 URL: https://issues.apache.org/jira/browse/FLINK-21961 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-21960) Simplify module.yaml spec

2021-03-24 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-21960: Summary: Simplify module.yaml spec Key: FLINK-21960 URL: https://issues.apache.org/jira/browse/FLINK-21960 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-21959) Rename Kafka/Kinesis ingress/egress types.

2021-03-24 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-21959: Summary: Rename Kafka/Kinesis ingress/egress types. Key: FLINK-21959 URL: https://issues.apache.org/jira/browse/FLINK-21959 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-21958) Rename statefun-sdk to statefun-sdk-embedded

2021-03-24 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-21958: Summary: Rename statefun-sdk to statefun-sdk-embedded Key: FLINK-21958 URL: https://issues.apache.org/jira/browse/FLINK-21958 Project: Flink Issue Type:

[jira] [Created] (FLINK-21957) Rename statefun-python-sdk => statefun-sdk-python

2021-03-24 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-21957: Summary: Rename statefun-python-sdk => statefun-sdk-python Key: FLINK-21957 URL: https://issues.apache.org/jira/browse/FLINK-21957 Project: Flink Issue

[jira] [Created] (FLINK-21956) NPE in Kafka ingress when the key is missing

2021-03-24 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-21956: Summary: NPE in Kafka ingress when the key is missing Key: FLINK-21956 URL: https://issues.apache.org/jira/browse/FLINK-21956 Project: Flink Issue Type:

[jira] [Created] (FLINK-21955) Remove the old examples

2021-03-24 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-21955: Summary: Remove the old examples Key: FLINK-21955 URL: https://issues.apache.org/jira/browse/FLINK-21955 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-21954) JobMasterTest.testRestoringFromSavepoint fails with adaptive scheduler being enabled

2021-03-24 Thread Matthias (Jira)
Matthias created FLINK-21954: Summary: JobMasterTest.testRestoringFromSavepoint fails with adaptive scheduler being enabled Key: FLINK-21954 URL: https://issues.apache.org/jira/browse/FLINK-21954

[jira] [Created] (FLINK-21953) Add documentation on batch mode support of Python DataStream API

2021-03-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-21953: --- Summary: Add documentation on batch mode support of Python DataStream API Key: FLINK-21953 URL: https://issues.apache.org/jira/browse/FLINK-21953 Project: Flink

[jira] [Created] (FLINK-21952) Make all the "Connection reset by peer" exception wrapped as RemoteTransportException

2021-03-24 Thread Yun Gao (Jira)
Yun Gao created FLINK-21952: --- Summary: Make all the "Connection reset by peer" exception wrapped as RemoteTransportException Key: FLINK-21952 URL: https://issues.apache.org/jira/browse/FLINK-21952 Project:

[jira] [Created] (FLINK-21951) Fix wrong if condition in BufferReaderWriterUtil#writeBuffers

2021-03-24 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-21951: --- Summary: Fix wrong if condition in BufferReaderWriterUtil#writeBuffers Key: FLINK-21951 URL: https://issues.apache.org/jira/browse/FLINK-21951 Project: Flink

[jira] [Created] (FLINK-21950) DemultiplexingRecordDeserializerTest fail due to multiple memory freeing

2021-03-24 Thread Xintong Song (Jira)
Xintong Song created FLINK-21950: Summary: DemultiplexingRecordDeserializerTest fail due to multiple memory freeing Key: FLINK-21950 URL: https://issues.apache.org/jira/browse/FLINK-21950 Project:

Re: Flink job cannot find recover path after using entropy injection for s3 file systems

2021-03-24 Thread Till Rohrmann
There is indeed a ticket which tried to fix it for 1.11. release [1, 2]. Maybe the fix is not working properly. [1] https://issues.apache.org/jira/browse/FLINK-17359 [2] https://github.com/apache/flink/pull/11891 On Wed, Mar 24, 2021 at 12:08 PM Till Rohrmann wrote: > Thanks for looking into

Re: Flink job cannot find recover path after using entropy injection for s3 file systems

2021-03-24 Thread Till Rohrmann
Thanks for looking into this issue Chenqin. To me this looks like a bug in Flink. I am not entirely sure but somehow the wrapping order might have been changed when using files systems from the plugin system. Maybe Arvid knows about any changes in this area. I think we should open a JIRA ticket

[jira] [Created] (FLINK-21949) Support collect to array aggregate function

2021-03-24 Thread jiabao sun (Jira)
jiabao sun created FLINK-21949: -- Summary: Support collect to array aggregate function Key: FLINK-21949 URL: https://issues.apache.org/jira/browse/FLINK-21949 Project: Flink Issue Type:

Re: [VOTE] Apache Flink Jira Process (& Bot)

2021-03-24 Thread Konstantin Knauf
> When/how are labels removed? Manually by the user who updates the ticket, I'd propose for now. Doing this automatically might be possible, but will make the bot quite a bit more complex, I think. Let's say a ticket is labelled "stale-assigned" by the bot. Then the assignee might update and

Re: [VOTE] Apache Flink Jira Process (& Bot)

2021-03-24 Thread Chesnay Schepler
When/how are labels removed? On 3/24/2021 10:06 AM, Matthias Pohl wrote: Thanks Konstantin for working on this. The ideas we collected in [1] sound good. I'm looking forward to trying it out. +1 from my side. Best, Matthias [1]

[jira] [Created] (FLINK-21948) Show Watermarks in Human Friendly Format in the Web User Interface

2021-03-24 Thread Konstantin Knauf (Jira)
Konstantin Knauf created FLINK-21948: Summary: Show Watermarks in Human Friendly Format in the Web User Interface Key: FLINK-21948 URL: https://issues.apache.org/jira/browse/FLINK-21948 Project:

Re: [VOTE] Apache Flink Jira Process (& Bot)

2021-03-24 Thread Matthias Pohl
Thanks Konstantin for working on this. The ideas we collected in [1] sound good. I'm looking forward to trying it out. +1 from my side. Best, Matthias [1] https://lists.apache.org/thread.html/re7affbb1357ce4986a7770b0052c39c9a26ebd7cd0df3f15ed320781%40%3Cdev.flink.apache.org%3E On Wed, Mar 24,

[VOTE] Apache Flink Jira Process (& Bot)

2021-03-24 Thread Konstantin Knauf
Hi everyone, based on the discussion in [1], I would like to start a vote on the proposal as documented in [2]. The vote will last for at least 72 hours, and will be accepted by a consensus of active committers. Thanks, Konstantin [1]

[jira] [Created] (FLINK-21947) Support TIMESTAMP_LTZ type in CSV format

2021-03-24 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-21947: -- Summary: Support TIMESTAMP_LTZ type in CSV format Key: FLINK-21947 URL: https://issues.apache.org/jira/browse/FLINK-21947 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Introducing Backpressure for connected streams

2021-03-24 Thread Piotr Nowojski
Hi Robin, Flink has a functionality to block reading from an input. It's not documented, as it's not fully working in Streaming. Take a look at the `org.apache.flink.streaming.api.operators.InputSelectable` class and how it's being used (you have to implement your own operator to use it). It has

[jira] [Created] (FLINK-21946) FlinkRelMdUtil.numDistinctVals produces exceptional Double.NaN result when domainSize is in range(0,1)

2021-03-24 Thread lincoln lee (Jira)
lincoln lee created FLINK-21946: --- Summary: FlinkRelMdUtil.numDistinctVals produces exceptional Double.NaN result when domainSize is in range(0,1) Key: FLINK-21946 URL:

[jira] [Created] (FLINK-21945) Disable checkpointing of inflight data in pointwise connections for unaligned checkpoints

2021-03-24 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-21945: --- Summary: Disable checkpointing of inflight data in pointwise connections for unaligned checkpoints Key: FLINK-21945 URL: https://issues.apache.org/jira/browse/FLINK-21945

[jira] [Created] (FLINK-21944) AbstractArrowPythonAggregateFunctionOperator.dispose should consider whether arrowSerializer is null

2021-03-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-21944: --- Summary: AbstractArrowPythonAggregateFunctionOperator.dispose should consider whether arrowSerializer is null Key: FLINK-21944 URL: https://issues.apache.org/jira/browse/FLINK-21944

Re: [DISCUSS] Introducing Backpressure for connected streams

2021-03-24 Thread Guowei Ma
Hi Robin Thank you for bringing up this discussion. AFAIK there are many same requirements.But it might lead to a deadlock if we depend on pausing one input of two to align the watermark. After the FLIP-27 Flink would introduce some new mechanism for aligning the watermark of different sources

[jira] [Created] (FLINK-21943) Redundant checkNotNull

2021-03-24 Thread ZhangWei (Jira)
ZhangWei created FLINK-21943: Summary: Redundant checkNotNull Key: FLINK-21943 URL: https://issues.apache.org/jira/browse/FLINK-21943 Project: Flink Issue Type: Improvement Components: