[jira] [Commented] (FLINK-25859) Add documentation for DynamoDB Async Sink

2022-08-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17583106#comment-17583106 ] Zichen Liu commented on FLINK-25859: Hi [~Gusev], thanks again for contributing the

[jira] [Commented] (FLINK-27536) Rename method parameter in AsyncSinkWriter

2022-07-21 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17569350#comment-17569350 ] Zichen Liu commented on FLINK-27536: Hi [~DavidLiu001], awesome. [~dannycranmer] wou

[jira] [Commented] (FLINK-27537) Remove requirement for Async Sink's RequestEntryT to be serializable

2022-07-21 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17569349#comment-17569349 ] Zichen Liu commented on FLINK-27537: Hello [~DavidLiu001] Thank you for offering. I'

[jira] [Comment Edited] (FLINK-24370) [FLIP-171] Documentation for Generic AsyncSinkBase

2022-07-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568966#comment-17568966 ] Zichen Liu edited comment on FLINK-24370 at 7/20/22 10:20 AM:

[jira] [Comment Edited] (FLINK-24370) [FLIP-171] Documentation for Generic AsyncSinkBase

2022-07-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568966#comment-17568966 ] Zichen Liu edited comment on FLINK-24370 at 7/20/22 10:09 AM:

[jira] [Commented] (FLINK-24370) [FLIP-171] Documentation for Generic AsyncSinkBase

2022-07-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568966#comment-17568966 ] Zichen Liu commented on FLINK-24370: Done in linked PR#517 > [FLIP-171] Documentati

[jira] [Commented] (FLINK-28169) GlueSchemaRegistryJsonKinesisITCase fails on JDK11 due to NoSuchMethodError

2022-07-01 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561431#comment-17561431 ] Zichen Liu commented on FLINK-28169: Thanks [~martijnvisser] much appreciated.   >

[jira] [Commented] (FLINK-28169) GlueSchemaRegistryJsonKinesisITCase fails on JDK11 due to NoSuchMethodError

2022-06-30 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561112#comment-17561112 ] Zichen Liu commented on FLINK-28169: Thanks for assigning it to me [~martijnvisser]

[jira] [Commented] (FLINK-28169) GlueSchemaRegistryJsonKinesisITCase fails on JDK11 due to NoSuchMethodError

2022-06-30 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561036#comment-17561036 ] Zichen Liu commented on FLINK-28169: I have been coordinating with [~chalixar]  in t

[jira] [Commented] (FLINK-25735) Chinese Translation - Add documentation for KDS Async Sink

2022-06-27 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17559121#comment-17559121 ] Zichen Liu commented on FLINK-25735: Apologies again for the delay. Would [~martijnv

[jira] [Commented] (FLINK-25735) Chinese Translation - Add documentation for KDS Async Sink

2022-06-27 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17559107#comment-17559107 ] Zichen Liu commented on FLINK-25735: Hi Sorry for the late response, I have been off

[jira] [Commented] (FLINK-28148) Unable to load jar connector to a Python Table API app

2022-06-27 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17559081#comment-17559081 ] Zichen Liu commented on FLINK-28148: [~dianfu] [~hxbks2ks] Apologies for the late re

[jira] [Updated] (FLINK-28148) Unable to load jar connector to a Python Table API app

2022-06-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28148: --- Description: h2. Background User currently unable to build & install the latest PyFlink and then lo

[jira] [Updated] (FLINK-28148) Unable to load jar connector to a Python Table API app

2022-06-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28148: --- Description: h2. Background User currently unable to build & install the latest PyFlink and then lo

[jira] [Updated] (FLINK-28148) Unable to load jar connector to a Python Table API app

2022-06-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28148: --- Description: h2. Background User currently unable to build & install the latest PyFlink and then lo

[jira] [Updated] (FLINK-28148) Unable to load jar connector to a Python Table API app

2022-06-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28148: --- Description: h2. Background User currently unable to build & install the latest PyFlink and then lo

[jira] [Updated] (FLINK-28148) Unable to load jar connector to a Python Table API app

2022-06-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28148: --- Labels: connector jar python table-api (was: ) > Unable to load jar connector to a Python Table API

[jira] [Updated] (FLINK-28148) Unable to load jar connector to a Python Table API app

2022-06-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28148: --- Description: Reproduction steps: # Clone the latest Flink from the master branch. # Follow the Fli

[jira] [Updated] (FLINK-28148) Unable to load jar connector to a Python Table API app

2022-06-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28148: --- Description: Reproduction steps: # Clone the latest Flink from the master branch. # Follow the Fli

[jira] [Created] (FLINK-28148) Unable to load jar connector to a Python Table API app

2022-06-20 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-28148: -- Summary: Unable to load jar connector to a Python Table API app Key: FLINK-28148 URL: https://issues.apache.org/jira/browse/FLINK-28148 Project: Flink Issue Type

[jira] [Closed] (FLINK-27670) Python wrappers for Kinesis Sinks

2022-06-20 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu closed FLINK-27670. -- Resolution: Duplicate Completed in FLINK-21966 > Python wrappers for Kinesis Sinks >

[jira] [Created] (FLINK-28027) Initialise Async Sink maximum number of in flight messages to low number for rate limiting strategy

2022-06-13 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-28027: -- Summary: Initialise Async Sink maximum number of in flight messages to low number for rate limiting strategy Key: FLINK-28027 URL: https://issues.apache.org/jira/browse/FLINK-28027

[jira] [Updated] (FLINK-28007) Tests for AWS Connectors Using SDK v2 to use Synchronous Clients

2022-06-11 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28007: --- Labels: pull-request-available (was: ) > Tests for AWS Connectors Using SDK v2 to use Synchronous C

[jira] [Updated] (FLINK-28007) Tests for AWS Connectors Using SDK v2 to use Synchronous Clients

2022-06-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28007: --- Description: h3. Background The unit & integration tests for the aws connectors in the Flink reposi

[jira] [Updated] (FLINK-28007) Tests for AWS Connectors Using SDK v2 to use Synchronous Clients

2022-06-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28007: --- Labels: (was: pull-request-available) > Tests for AWS Connectors Using SDK v2 to use Synchronous C

[jira] [Updated] (FLINK-28007) Tests for AWS Connectors Using SDK v2 to use Synchronous Clients

2022-06-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28007: --- Component/s: Connectors / Common > Tests for AWS Connectors Using SDK v2 to use Synchronous Clients

[jira] [Updated] (FLINK-28007) Tests for AWS Connectors Using SDK v2 to use Synchronous Clients

2022-06-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28007: --- Affects Version/s: 1.15.0 1.15.1 1.15.2 > Tests for AW

[jira] [Created] (FLINK-28007) Tests for AWS Connectors Using SDK v2 to use Synchronous Clients

2022-06-10 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-28007: -- Summary: Tests for AWS Connectors Using SDK v2 to use Synchronous Clients Key: FLINK-28007 URL: https://issues.apache.org/jira/browse/FLINK-28007 Project: Flink

[jira] [Updated] (FLINK-28007) Tests for AWS Connectors Using SDK v2 to use Synchronous Clients

2022-06-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-28007: --- Priority: Minor (was: Major) > Tests for AWS Connectors Using SDK v2 to use Synchronous Clients > -

[jira] [Commented] (FLINK-27670) Python wrappers for Kinesis Sinks

2022-05-17 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538256#comment-17538256 ] Zichen Liu commented on FLINK-27670: This task is the Sink portion of the parent tas

[jira] [Created] (FLINK-27670) Python wrappers for Kinesis Sinks

2022-05-17 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-27670: -- Summary: Python wrappers for Kinesis Sinks Key: FLINK-27670 URL: https://issues.apache.org/jira/browse/FLINK-27670 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-27537) Remove requirement for Async Sink's RequestEntryT to be serializable

2022-05-06 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-27537: --- Description: Currently, in AsyncSinkBase and it's dependent classes, e.g. the sink writer, element

[jira] [Created] (FLINK-27537) Remove requirement for Async Sink's RequestEntryT to be serializable

2022-05-06 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-27537: -- Summary: Remove requirement for Async Sink's RequestEntryT to be serializable Key: FLINK-27537 URL: https://issues.apache.org/jira/browse/FLINK-27537 Project: Flink

[jira] [Created] (FLINK-27536) Rename method parameter in AsyncSinkWriter

2022-05-06 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-27536: -- Summary: Rename method parameter in AsyncSinkWriter Key: FLINK-27536 URL: https://issues.apache.org/jira/browse/FLINK-27536 Project: Flink Issue Type: Improvemen

[jira] [Created] (FLINK-27505) Add javadoc comments to AsyncSinkBase

2022-05-05 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-27505: -- Summary: Add javadoc comments to AsyncSinkBase Key: FLINK-27505 URL: https://issues.apache.org/jira/browse/FLINK-27505 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-26256) AWS SDK Async Event Loop Group Classloader Issue

2022-03-11 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505084#comment-17505084 ] Zichen Liu commented on FLINK-26256: Possible solutions: # Create a separate ELG pe

[jira] [Commented] (FLINK-24229) [FLIP-171] DynamoDB implementation of Async Sink

2022-03-11 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504939#comment-17504939 ] Zichen Liu commented on FLINK-24229: Would you mind elaborating a little on why the

[jira] [Commented] (FLINK-24229) [FLIP-171] DynamoDB implementation of Async Sink

2022-03-11 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504909#comment-17504909 ] Zichen Liu commented on FLINK-24229: Maybe [~arvid] ? > [FLIP-171] DynamoDB impleme

[jira] [Updated] (FLINK-26589) Update the logging level of Kinesis Streams and Firehose sinks

2022-03-11 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26589: --- Description: h2. Motivation During the normal course of the KDS and KDF's sink's operation, we will

[jira] [Updated] (FLINK-26589) Update the logging level of Kinesis Streams and Firehose sinks

2022-03-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26589: --- Description: h2. Motivation During the normal course of the KDS and KDF's sink's operation, we will

[jira] [Updated] (FLINK-26589) Update the logging level of Kinesis Streams and Firehose sinks

2022-03-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26589: --- Description: h2. Motivation During the normal course of the KDS and KDF's sink's operation, we will

[jira] [Updated] (FLINK-26589) Update the logging level of Kinesis Streams and Firehose sinks

2022-03-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26589: --- Issue Type: Improvement (was: Bug) > Update the logging level of Kinesis Streams and Firehose sinks

[jira] [Updated] (FLINK-26589) Update the logging level of Kinesis Streams and Firehose sinks

2022-03-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26589: --- Priority: Minor (was: Major) > Update the logging level of Kinesis Streams and Firehose sinks > ---

[jira] [Updated] (FLINK-26589) Update the logging level of Kinesis Streams and Firehose sinks

2022-03-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26589: --- Affects Version/s: 1.15.0 > Update the logging level of Kinesis Streams and Firehose sinks > ---

[jira] [Updated] (FLINK-26589) Update the logging level of Kinesis Streams and Firehose sinks

2022-03-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26589: --- Labels: (was: pull-request-available) > Update the logging level of Kinesis Streams and Firehose s

[jira] [Created] (FLINK-26589) Update the logging level of Kinesis Streams and Firehose sinks

2022-03-10 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-26589: -- Summary: Update the logging level of Kinesis Streams and Firehose sinks Key: FLINK-26589 URL: https://issues.apache.org/jira/browse/FLINK-26589 Project: Flink I

[jira] [Updated] (FLINK-26589) Update the logging level of Kinesis Streams and Firehose sinks

2022-03-10 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26589: --- Fix Version/s: (was: 1.15.0) > Update the logging level of Kinesis Streams and Firehose sinks >

[jira] [Updated] (FLINK-25736) Chinese Translation - Update documentation for Kinesis Table Api

2022-02-25 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25736: --- Fix Version/s: (was: 1.15.0) > Chinese Translation - Update documentation for Kinesis Table Api

[jira] [Updated] (FLINK-25737) Chinese Translation - Add documentation for Firehose Async Sink

2022-02-25 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25737: --- Fix Version/s: (was: 1.15.0) > Chinese Translation - Add documentation for Firehose Async Sink >

[jira] [Updated] (FLINK-25735) Chinese Translation - Add documentation for KDS Async Sink

2022-02-25 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25735: --- Fix Version/s: (was: 1.15.0) > Chinese Translation - Add documentation for KDS Async Sink >

[jira] [Updated] (FLINK-24278) [FLIP-171] Async Sink Base Sink Developer Guide for Documentation

2022-02-25 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-24278: --- Fix Version/s: (was: 1.15.0) > [FLIP-171] Async Sink Base Sink Developer Guide for Documentation

[jira] [Updated] (FLINK-25793) Fix high throughput rate of AsyncSinkWriter for throttled destination

2022-02-23 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25793: --- Summary: Fix high throughput rate of AsyncSinkWriter for throttled destination (was: Introduce rate

[jira] [Updated] (FLINK-26309) Add a polling strategy to determine whether Localstack test container has started

2022-02-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26309: --- Description: The localstack container is used to mock aws services so tests can hit a mock endpoint

[jira] [Created] (FLINK-26309) Add a polling strategy to determine whether Localstack test container has started

2022-02-22 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-26309: -- Summary: Add a polling strategy to determine whether Localstack test container has started Key: FLINK-26309 URL: https://issues.apache.org/jira/browse/FLINK-26309 Project

[jira] [Updated] (FLINK-26305) KinesisFirehoseSinkITCase writes duplicates to Localstack

2022-02-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26305: --- Labels: curiosity investigation (was: pull-request-available test-stability) > KinesisFirehoseSink

[jira] [Updated] (FLINK-26305) KinesisFirehoseSinkITCase writes duplicates to Localstack

2022-02-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26305: --- Priority: Minor (was: Major) > KinesisFirehoseSinkITCase writes duplicates to Localstack >

[jira] [Updated] (FLINK-26305) KinesisFirehoseSinkITCase writes duplicates to Localstack

2022-02-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26305: --- Description: The firehose sink is an at least once sink. But we only expect there to be duplicates

[jira] [Updated] (FLINK-26305) KinesisFirehoseSinkITCase writes duplicates to Localstack

2022-02-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26305: --- Issue Type: Technical Debt (was: Bug) > KinesisFirehoseSinkITCase writes duplicates to Localstack >

[jira] [Updated] (FLINK-26305) KinesisFirehoseSinkITCase writes duplicates to Localstack

2022-02-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26305: --- Affects Version/s: (was: 1.15.0) > KinesisFirehoseSinkITCase writes duplicates to Localstack > -

[jira] [Updated] (FLINK-26305) KinesisFirehoseSinkITCase writes duplicates to Localstack

2022-02-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26305: --- Component/s: Connectors / Common (was: Connectors / Kinesis) > KinesisFirehoseS

[jira] [Created] (FLINK-26305) KinesisFirehoseSinkITCase writes duplicates to Localstack

2022-02-22 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-26305: -- Summary: KinesisFirehoseSinkITCase writes duplicates to Localstack Key: FLINK-26305 URL: https://issues.apache.org/jira/browse/FLINK-26305 Project: Flink Issue T

[jira] [Commented] (FLINK-26291) KinesisFirehoseSinkITCase failed on azure

2022-02-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17496085#comment-17496085 ] Zichen Liu commented on FLINK-26291: Hey [~gaoyunhaii]  How do you feel about this

[jira] [Updated] (FLINK-26300) KinesisFirehoseSinkITCase failed on azure IOException

2022-02-22 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-26300: --- Description: {code:java} 2022-02-21T18:54:53.9969213Z Feb 21 18:54:53 [ERROR] Picked up JAVA_TOOL_O

[jira] [Created] (FLINK-26300) KinesisFirehoseSinkITCase failed on azure IOException

2022-02-22 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-26300: -- Summary: KinesisFirehoseSinkITCase failed on azure IOException Key: FLINK-26300 URL: https://issues.apache.org/jira/browse/FLINK-26300 Project: Flink Issue Type:

[jira] [Updated] (FLINK-24370) [FLIP-171] Documentation for Generic AsyncSinkBase

2022-02-15 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-24370: --- Fix Version/s: (was: 1.15.0) > [FLIP-171] Documentation for Generic AsyncSinkBase >

[jira] [Closed] (FLINK-25944) Intermittent Failures on KDF AZP

2022-02-15 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu closed FLINK-25944. -- Resolution: Duplicate Appearance of this bug is caused by not closing AWS resources properly in FLINK

[jira] [Closed] (FLINK-24227) [FLIP-171] KDS implementation of Async Sink

2022-02-14 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu closed FLINK-24227. -- Resolution: Fixed Feature implemented, test coverage done and docs written. Only bugfixes remaining a

[jira] [Commented] (FLINK-26008) [FLIP-171] Update Kinesalite docker container reference

2022-02-08 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488970#comment-17488970 ] Zichen Liu commented on FLINK-26008: I'm afraid it seems latest is the only tag for

[jira] [Closed] (FLINK-25977) Close sink client and sink http client for KDS/KDF Sinks

2022-02-08 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu closed FLINK-25977. -- Release Note: Superseded by FLINK-26006 Resolution: Duplicate > Close sink client and sink http

[jira] [Updated] (FLINK-25976) Update the KDS and KDF Sink's defaults & update the docs

2022-02-08 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25976: --- Priority: Major (was: Minor) > Update the KDS and KDF Sink's defaults & update the docs > -

[jira] [Updated] (FLINK-25976) Update the KDS and KDF Sink's defaults & update the docs

2022-02-08 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25976: --- Issue Type: Bug (was: Improvement) > Update the KDS and KDF Sink's defaults & update the docs > ---

[jira] [Updated] (FLINK-25944) Intermittent Failures on KDF AZP

2022-02-08 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25944: --- Priority: Blocker (was: Critical) > Intermittent Failures on KDF AZP >

[jira] [Updated] (FLINK-25945) Intermittent Failures on KDF AZP 2

2022-02-08 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25945: --- Issue Type: Bug (was: New Feature) > Intermittent Failures on KDF AZP 2 > -

[jira] [Updated] (FLINK-25945) Intermittent Failures on KDF AZP 2

2022-02-08 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25945: --- Priority: Blocker (was: Major) > Intermittent Failures on KDF AZP 2 > -

[jira] [Updated] (FLINK-25976) Update the KDS and KDF Sink's defaults & update the docs

2022-02-07 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25976: --- Description: h2. Update: DEFAULT_MAX_IN_FLIGHT_REQUESTS=50   to match with the default threads in

[jira] [Created] (FLINK-25977) Close sink client and sink http client for KDS/KDF Sinks

2022-02-07 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-25977: -- Summary: Close sink client and sink http client for KDS/KDF Sinks Key: FLINK-25977 URL: https://issues.apache.org/jira/browse/FLINK-25977 Project: Flink Issue Ty

[jira] [Updated] (FLINK-25976) Update the KDS and KDF Sink's defaults & update the docs

2022-02-07 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25976: --- Issue Type: Improvement (was: Bug) > Update the KDS and KDF Sink's defaults & update the docs > ---

[jira] [Updated] (FLINK-25976) Update the KDS and KDF Sink's defaults & update the docs

2022-02-07 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25976: --- Description: h2. Update: DEFAULT_MAX_IN_FLIGHT_REQUESTS=50 to match with the default threads in th

[jira] [Updated] (FLINK-25976) Update the KDS and KDF Sink's defaults & update the docs

2022-02-07 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25976: --- Priority: Minor (was: Major) > Update the KDS and KDF Sink's defaults & update the docs > -

[jira] [Created] (FLINK-25976) Update the KDS and KDF Sink's defaults & update the docs

2022-02-07 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-25976: -- Summary: Update the KDS and KDF Sink's defaults & update the docs Key: FLINK-25976 URL: https://issues.apache.org/jira/browse/FLINK-25976 Project: Flink Issue Ty

[jira] [Commented] (FLINK-25944) Intermittent Failures on KDF AZP

2022-02-07 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488003#comment-17488003 ] Zichen Liu commented on FLINK-25944: Fix is coming out with https://github.com/apach

[jira] [Closed] (FLINK-25924) KDF Integration tests intermittently fails

2022-02-07 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu closed FLINK-25924. -- Release Note: Superseded by FLINK-25944 Resolution: Duplicate > KDF Integration tests intermitte

[jira] [Commented] (FLINK-25924) KDF Integration tests intermittently fails

2022-02-07 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488002#comment-17488002 ] Zichen Liu commented on FLINK-25924: Superseded by FLINK-25944 > KDF Integration te

[jira] [Updated] (FLINK-25944) Intermittent Failures on KDF AZP

2022-02-07 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25944: --- Priority: Critical (was: Major) > Intermittent Failures on KDF AZP > --

[jira] [Updated] (FLINK-25948) KDS / KDF Sink should call .close() to clean up resources

2022-02-03 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25948: --- Description: Add .close() BOTH the KDSAsyncClient and the underlying HTTPClient for BOTH KDS & KDF

[jira] [Created] (FLINK-25948) KDS / KDF Sink should call .close() to clean up resources

2022-02-03 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-25948: -- Summary: KDS / KDF Sink should call .close() to clean up resources Key: FLINK-25948 URL: https://issues.apache.org/jira/browse/FLINK-25948 Project: Flink Issue T

[jira] [Created] (FLINK-25945) Intermittent Failures on KDF AZP 2

2022-02-03 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-25945: -- Summary: Intermittent Failures on KDF AZP 2 Key: FLINK-25945 URL: https://issues.apache.org/jira/browse/FLINK-25945 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-25945) Intermittent Failures on KDF AZP 2

2022-02-03 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25945: --- Description: Problem: ci fails on [PR#18606|https://github.com/apache/flink/pull/18606] - unrelated

[jira] [Updated] (FLINK-25944) Intermittent Failures on KDF AZP

2022-02-03 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25944: --- Description: Problem: ci fails on [#18553|https://github.com/apache/flink/pull/18553] and issue is n

[jira] [Updated] (FLINK-25944) Intermittent Failures on KDF AZP

2022-02-03 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25944: --- Description: Problem: ci fails on #18553 and issue is not reproducible locally. Furthermore the fail

[jira] [Created] (FLINK-25944) Intermittent Failures on KDF AZP

2022-02-03 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-25944: -- Summary: Intermittent Failures on KDF AZP Key: FLINK-25944 URL: https://issues.apache.org/jira/browse/FLINK-25944 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-25943) New Kinesis, Firehose to provide a state serializer

2022-02-03 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25943: --- Description: AsyncSinkWriter implements snapshotState to write the pending request into state but n

[jira] [Created] (FLINK-25943) New Kinesis, Firehose to provide a state serializer

2022-02-03 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-25943: -- Summary: New Kinesis, Firehose to provide a state serializer Key: FLINK-25943 URL: https://issues.apache.org/jira/browse/FLINK-25943 Project: Flink Issue Type: N

[jira] [Commented] (FLINK-25922) KinesisFirehoseSinkITCase hangs on AZP

2022-02-02 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17485846#comment-17485846 ] Zichen Liu commented on FLINK-25922: I believe this is related to FLINK-25924, closi

[jira] [Updated] (FLINK-25924) KDF Integration tests intermittently fails

2022-02-02 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25924: --- Labels: pull-request-available test-stability (was: pull-request-available) > KDF Integration tests

[jira] [Updated] (FLINK-25924) KDF Integration tests intermittently fails

2022-02-02 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25924: --- Affects Version/s: 1.15.0 > KDF Integration tests intermittently fails > ---

[jira] [Updated] (FLINK-25924) KDF Integration tests intermittently fails

2022-02-02 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25924: --- Description: Intermittent failures introduced as part of merge (PR#18314: [FLINK-24228[connectors/f

[jira] [Updated] (FLINK-25924) KDF Integration tests intermittently fails

2022-02-02 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25924: --- Component/s: Connectors / Common (was: Connectors / Kinesis) > KDF Integration

[jira] [Updated] (FLINK-25924) KDF Integration tests intermittently fails

2022-02-02 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25924: --- Description: Intermittent failures introduced as part of merge (PR#18314: [FLINK-24228[connectors/f

[jira] [Updated] (FLINK-25924) KDF Integration tests intermittently fails

2022-02-02 Thread Zichen Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zichen Liu updated FLINK-25924: --- Description: intermittent failures introduced as part of our merge yesterday (PR#18314:  [[FLINK-242

  1   2   >