[jira] [Updated] (FLINK-26555) Missing close in FileSystemJobResultStore

2022-03-31 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-26555: -- Attachment: image-2022-03-31-16-39-44-189.png > Missing close in FileSystemJobResultStore > --

[jira] [Updated] (FLINK-26555) Missing close in FileSystemJobResultStore

2022-03-31 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-26555: -- Attachment: image-2022-03-31-16-42-56-530.png > Missing close in FileSystemJobResultStore > --

[jira] [Updated] (FLINK-26555) Missing close in FileSystemJobResultStore

2022-03-31 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-26555: -- Attachment: image-2022-03-31-16-43-56-322.png > Missing close in FileSystemJobResultStore > --

[jira] [Commented] (FLINK-26555) Missing close in FileSystemJobResultStore

2022-03-31 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515188#comment-17515188 ] Yuxin Tan commented on FLINK-26555: --- [~mapohl] , hello, about the issue, we encountere

[jira] [Updated] (FLINK-26555) Missing close in FileSystemJobResultStore

2022-03-31 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-26555: -- Attachment: (was: image-2022-03-31-16-42-56-530.png) > Missing close in FileSystemJobResultStore >

[jira] [Updated] (FLINK-26555) Missing close in FileSystemJobResultStore

2022-03-31 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-26555: -- Attachment: (was: image-2022-03-31-16-39-44-189.png) > Missing close in FileSystemJobResultStore >

[jira] [Commented] (FLINK-24954) Reset read buffer request timeout on buffer recycling for sort-shuffle

2021-11-26 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17449442#comment-17449442 ] Yuxin Tan commented on FLINK-24954: --- Thanks [~kevin.cyj] for assigning the issue to me

[jira] [Commented] (FLINK-22096) ServerTransportErrorHandlingTest.testRemoteClose fail

2021-12-13 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17458237#comment-17458237 ] Yuxin Tan commented on FLINK-22096: --- Added 2 PRs for the branches of release-1.13 and

[jira] [Commented] (FLINK-30627) Refactor FileSystemTableSink to use FileSink instead of StreamingFileSink

2023-02-10 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686995#comment-17686995 ] Yuxin Tan commented on FLINK-30627: --- [~martijnvisser], hi, Martijn, May I take a look

[jira] (FLINK-30627) Refactor FileSystemTableSink to use FileSink instead of StreamingFileSink

2023-02-10 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30627 ] Yuxin Tan deleted comment on FLINK-30627: --- was (Author: tanyuxin): [~martijnvisser], hi, Martijn, May I take a look at the issue? And I will prepare a PR recently. > Refactor FileSystemTable

[jira] [Commented] (FLINK-30627) Refactor FileSystemTableSink to use FileSink instead of StreamingFileSink

2023-02-12 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687680#comment-17687680 ] Yuxin Tan commented on FLINK-30627: --- [~martijnvisser] Sorry that I underestimated the

[jira] [Commented] (FLINK-30983) the security.ssl.algorithms configuration does not take effect in rest ssl

2023-02-14 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17688842#comment-17688842 ] Yuxin Tan commented on FLINK-30983: --- [~lyssg] Hi, I will take a look at the issue. >

[jira] [Created] (FLINK-31314) Hybrid

2023-03-03 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31314: - Summary: Hybrid Key: FLINK-31314 URL: https://issues.apache.org/jira/browse/FLINK-31314 Project: Flink Issue Type: Improvement Reporter: Yuxin Tan

[jira] [Updated] (FLINK-31314) Hybrid Shuffle may not release result partitions when running multiple jobs in a session cluster

2023-03-03 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31314: -- Issue Type: Bug (was: Improvement) Summary: Hybrid Shuffle may not release result partitions wh

[jira] [Updated] (FLINK-31314) Hybrid Shuffle may not release result partitions when running multiple jobs in a session cluster

2023-03-03 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31314: -- Description: When I test jobs in a session cluster, I found many result partitions belonging to the f

[jira] [Assigned] (FLINK-31314) Hybrid Shuffle may not release result partitions when running multiple jobs in a session cluster

2023-03-03 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan reassigned FLINK-31314: - Assignee: Yuxin Tan > Hybrid Shuffle may not release result partitions when running multiple jo

[jira] [Created] (FLINK-31396) Occasional inaccurate timeout time calculation with System.nanotime in batch read buffer pool

2023-03-10 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31396: - Summary: Occasional inaccurate timeout time calculation with System.nanotime in batch read buffer pool Key: FLINK-31396 URL: https://issues.apache.org/jira/browse/FLINK-31396

[jira] [Assigned] (FLINK-31396) Occasional inaccurate timeout time calculation with System.nanotime in batch read buffer pool

2023-03-10 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan reassigned FLINK-31396: - Assignee: Yuxin Tan > Occasional inaccurate timeout time calculation with System.nanotime in ba

[jira] [Updated] (FLINK-31396) Occasional inaccurate timeout time calculation with System.nanotime in batch read buffer pool

2023-03-10 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31396: -- Affects Version/s: 1.18.0 > Occasional inaccurate timeout time calculation with System.nanotime in bat

[jira] [Updated] (FLINK-31396) Occasional inaccurate timeout time calculation with System.nanotime in batch read buffer pool

2023-03-10 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31396: -- Priority: Minor (was: Major) > Occasional inaccurate timeout time calculation with System.nanotime in

[jira] [Commented] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-13 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699556#comment-17699556 ] Yuxin Tan commented on FLINK-31418: --- I think https://issues.apache.org/jira/browse/FLI

[jira] [Comment Edited] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-13 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699556#comment-17699556 ] Yuxin Tan edited comment on FLINK-31418 at 3/13/23 10:42 AM: -

[jira] [Comment Edited] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-13 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699556#comment-17699556 ] Yuxin Tan edited comment on FLINK-31418 at 3/13/23 10:43 AM: -

[jira] [Commented] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-13 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699930#comment-17699930 ] Yuxin Tan commented on FLINK-31418: --- I have created a PR for master and 1.17, could yo

[jira] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-14 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418 ] Yuxin Tan deleted comment on FLINK-31418: --- was (Author: tanyuxin): I have created a PR for master and 1.17, could you help take a look? [~kevin.cyj] > SortMergeResultPartitionReadSchedulerTes

[jira] [Commented] (FLINK-27710) Improve logs to better display Execution

2023-03-16 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17701041#comment-17701041 ] Yuxin Tan commented on FLINK-27710: --- [~zhuzh], I saw you have marked this as "Deprecat

[jira] [Commented] (FLINK-27592) WebUI - Status CANCELING not showing in overview

2023-03-16 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17701045#comment-17701045 ] Yuxin Tan commented on FLINK-27592: --- [~peter.schrott], I can not reproduce this in my

[jira] [Commented] (FLINK-34424) BoundedBlockingSubpartitionWriteReadTest#testRead10ConsumersConcurrent times out

2024-02-19 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818615#comment-17818615 ] Yuxin Tan commented on FLINK-34424: --- [~mapohl] [~pnowojski] Sorry for the late reply.

[jira] [Created] (FLINK-34544) The release check bug in tiered memory manager of hybrid shuffle

2024-02-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-34544: - Summary: The release check bug in tiered memory manager of hybrid shuffle Key: FLINK-34544 URL: https://issues.apache.org/jira/browse/FLINK-34544 Project: Flink I

[jira] [Updated] (FLINK-34544) The release check bug in tiered memory manager of hybrid shuffle

2024-02-28 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-34544: -- Affects Version/s: 1.20.0 (was: 1.19.0) > The release check bug in tiered m

[jira] [Updated] (FLINK-34544) Tiered result partition should be released with lock

2024-02-28 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-34544: -- Summary: Tiered result partition should be released with lock (was: The release check bug in tiered m

[jira] [Updated] (FLINK-34544) Tiered result partition should be released with lock

2024-02-28 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-34544: -- Description: When releasing `TieredResultPartition`, it is not protected by a lock, then it may thrown

[jira] [Updated] (FLINK-34544) Tiered result partition should be released with lock

2024-02-28 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-34544: -- Description: When releasing `TieredResultPartition`, it is not protected by a lock, then it may throw

[jira] [Updated] (FLINK-34544) Tiered result partition should be released with lock

2024-02-29 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-34544: -- Description: When releasing `TieredResultPartition`, it is not protected by a lock(just like SortMerge

[jira] [Updated] (FLINK-34544) Tiered result partition should be released with lock

2024-02-29 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-34544: -- Description: When releasing `TieredResultPartition`, it is not protected by a lock(just like SortMerge

[jira] [Updated] (FLINK-34544) Fix tiered result partition check state issue when finishing partition

2024-03-02 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-34544: -- Summary: Fix tiered result partition check state issue when finishing partition (was: Tiered result p

[jira] [Updated] (FLINK-34544) Fix tiered result partition check state issue when finishing partition

2024-03-02 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-34544: -- Description: When finishing (was: When releasing `TieredResultPartition`, it is not protected by a l

[jira] [Updated] (FLINK-34544) Fix tiered result partition check state issue when finishing partition

2024-03-02 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-34544: -- Description: When finishing the tiered result partition, it may throw a check state issue because the

[jira] [Commented] (FLINK-34544) Fix tiered result partition check state issue when finishing partition

2024-03-02 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822842#comment-17822842 ] Yuxin Tan commented on FLINK-34544: --- I noticed that the issue has been fixed by changi

[jira] [Closed] (FLINK-34544) Fix tiered result partition check state issue when finishing partition

2024-03-02 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan closed FLINK-34544. - Resolution: Fixed It is already fixed in https://issues.apache.org/jira/browse/FLINK-33743. > Fix tiere

[jira] (FLINK-34544) Fix tiered result partition check state issue when finishing partition

2024-03-02 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544 ] Yuxin Tan deleted comment on FLINK-34544: --- was (Author: tanyuxin): It is already fixed in https://issues.apache.org/jira/browse/FLINK-33743. > Fix tiered result partition check state issue whe

[jira] [Reopened] (FLINK-34544) Fix tiered result partition check state issue when finishing partition

2024-03-02 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan reopened FLINK-34544: --- > Fix tiered result partition check state issue when finishing partition > -

[jira] [Closed] (FLINK-34544) Fix tiered result partition check state issue when finishing partition

2024-03-02 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan closed FLINK-34544. - Resolution: Won't Fix > Fix tiered result partition check state issue when finishing partition > ---

[jira] [Commented] (FLINK-29329) Checkpoint can not be triggered if encountering OOM

2022-12-08 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644656#comment-17644656 ] Yuxin Tan commented on FLINK-29329: --- Never reproduce it again, close temporarily. If e

[jira] [Closed] (FLINK-29329) Checkpoint can not be triggered if encountering OOM

2022-12-08 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan closed FLINK-29329. - Resolution: Cannot Reproduce > Checkpoint can not be triggered if encountering OOM > ---

[jira] [Closed] (FLINK-31314) Hybrid Shuffle may not release result partitions when running multiple jobs in a session cluster

2023-06-18 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan closed FLINK-31314. - Resolution: Won't Fix > Hybrid Shuffle may not release result partitions when running multiple jobs > i

[jira] [Created] (FLINK-32425) Fix Opensearch Connector wrong empty doc link

2023-06-25 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32425: - Summary: Fix Opensearch Connector wrong empty doc link Key: FLINK-32425 URL: https://issues.apache.org/jira/browse/FLINK-32425 Project: Flink Issue Type: Bug

[jira] [Closed] (FLINK-32425) Fix Opensearch Connector wrong empty doc link

2023-06-25 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan closed FLINK-32425. - > Fix Opensearch Connector wrong empty doc link > - > >

[jira] [Resolved] (FLINK-32425) Fix Opensearch Connector wrong empty doc link

2023-06-25 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan resolved FLINK-32425. --- Resolution: Fixed > Fix Opensearch Connector wrong empty doc link >

[jira] [Commented] (FLINK-32505) Compilation error in ProducerMergedPartitionFileWriter

2023-06-30 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739251#comment-17739251 ] Yuxin Tan commented on FLINK-32505: --- [~mapohl] Thanks for the fix. > Compilation erro

[jira] [Created] (FLINK-32538) CI build failed because node is corrupted when compiling

2023-07-04 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32538: - Summary: CI build failed because node is corrupted when compiling Key: FLINK-32538 URL: https://issues.apache.org/jira/browse/FLINK-32538 Project: Flink Issue Type

[jira] [Updated] (FLINK-31635) Support writing records to the new tiered storage architecture

2023-07-04 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31635: -- Summary: Support writing records to the new tiered storage architecture (was: Support writing records

[jira] [Updated] (FLINK-31638) Downstream supports reading buffers from tiered storage

2023-07-04 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31638: -- Summary: Downstream supports reading buffers from tiered storage (was: Downstream supports reading bu

[jira] [Updated] (FLINK-31636) Upstream supports reading buffers from tiered storage

2023-07-04 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31636: -- Summary: Upstream supports reading buffers from tiered storage (was: Upstream supports reading buffer

[jira] [Updated] (FLINK-31639) Introduce tiered storage memory manager

2023-07-04 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31639: -- Summary: Introduce tiered storage memory manager (was: Introduce tiered store memory manager) > Intr

[jira] [Commented] (FLINK-30719) flink-runtime-web failed due to a corrupted

2023-07-05 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740080#comment-17740080 ] Yuxin Tan commented on FLINK-30719: --- [https://dev.azure.com/apache-flink/apache-flink/

[jira] [Created] (FLINK-32541) Fix the buffer leaking in buffer accumulators when a failover occurs

2023-07-05 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32541: - Summary: Fix the buffer leaking in buffer accumulators when a failover occurs Key: FLINK-32541 URL: https://issues.apache.org/jira/browse/FLINK-32541 Project: Flink

[jira] [Created] (FLINK-32549) Tiered storage memory manager supports ownership transfer for buffers

2023-07-06 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32549: - Summary: Tiered storage memory manager supports ownership transfer for buffers Key: FLINK-32549 URL: https://issues.apache.org/jira/browse/FLINK-32549 Project: Flink

[jira] [Updated] (FLINK-31643) Introduce the configurations for tiered storage

2023-07-06 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31643: -- Summary: Introduce the configurations for tiered storage (was: Introduce a temporary switch to enable

[jira] [Closed] (FLINK-31646) Introduce remote storage tier

2023-07-06 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan closed FLINK-31646. - Resolution: Done master(1.18) via 32044ddd358ba0954a841962d93cce4c4afe264a > Introduce remote storage t

[jira] [Updated] (FLINK-31646) Introduce remote storage tier

2023-07-06 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31646: -- Fix Version/s: 1.18.0 > Introduce remote storage tier > - > >

[jira] [Updated] (FLINK-32541) Fix the buffer leaking in buffer accumulators when a failover occurs

2023-07-06 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32541: -- Parent: (was: FLINK-31634) Issue Type: Bug (was: Sub-task) > Fix the buffer leaking in bu

[jira] [Updated] (FLINK-32549) Tiered storage memory manager supports ownership transfer for buffers

2023-07-06 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32549: -- Parent: (was: FLINK-31634) Issue Type: Bug (was: Sub-task) > Tiered storage memory manage

[jira] [Updated] (FLINK-32193) AWS connector removes the dependency on flink-shaded

2023-07-10 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32193: -- Fix Version/s: (was: aws-connector-4.2.0) > AWS connector removes the dependency on flink-shaded >

[jira] [Updated] (FLINK-32193) AWS connector removes the dependency on flink-shaded

2023-07-10 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32193: -- Affects Version/s: aws-connector-4.2.0 > AWS connector removes the dependency on flink-shaded > --

[jira] [Created] (FLINK-32576) ProducerMergedPartitionFileIndex supports spilling to file

2023-07-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32576: - Summary: ProducerMergedPartitionFileIndex supports spilling to file Key: FLINK-32576 URL: https://issues.apache.org/jira/browse/FLINK-32576 Project: Flink Issue Ty

[jira] [Updated] (FLINK-30331) Further improvement of production availability of hybrid shuffle

2023-07-11 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-30331: -- Issue Type: Bug (was: Improvement) > Further improvement of production availability of hybrid shuffle

[jira] [Updated] (FLINK-30331) Further improvement of production availability of hybrid shuffle

2023-07-11 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-30331: -- Issue Type: Improvement (was: Bug) > Further improvement of production availability of hybrid shuffle

[jira] [Closed] (FLINK-32549) Tiered storage memory manager supports ownership transfer for buffers

2023-07-11 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan closed FLINK-32549. - Fix Version/s: 1.18.0 Resolution: Fixed > Tiered storage memory manager supports ownership transf

[jira] [Created] (FLINK-32595) Kinesis connector doc show wrong deserialization schema version

2023-07-16 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32595: - Summary: Kinesis connector doc show wrong deserialization schema version Key: FLINK-32595 URL: https://issues.apache.org/jira/browse/FLINK-32595 Project: Flink Is

[jira] [Updated] (FLINK-32595) Kinesis connector doc show wrong deserialization schema version

2023-07-16 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32595: -- Attachment: image-2023-07-17-10-31-42-435.png > Kinesis connector doc show wrong deserialization schem

[jira] [Updated] (FLINK-32595) Kinesis connector doc show wrong deserialization schema version

2023-07-16 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32595: -- Attachment: image-2023-07-17-10-32-14-627.png > Kinesis connector doc show wrong deserialization schem

[jira] [Commented] (FLINK-32595) Kinesis connector doc show wrong deserialization schema version

2023-07-16 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17743598#comment-17743598 ] Yuxin Tan commented on FLINK-32595: --- I have tested the new version !image-2023-07-17

[jira] [Updated] (FLINK-32595) Kinesis connector doc show wrong deserialization schema version

2023-07-16 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32595: -- Description: [https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/kinesis/

[jira] [Comment Edited] (FLINK-32595) Kinesis connector doc show wrong deserialization schema version

2023-07-16 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17743598#comment-17743598 ] Yuxin Tan edited comment on FLINK-32595 at 7/17/23 2:58 AM:

[jira] [Updated] (FLINK-32595) Kinesis connector doc show wrong deserialization schema version

2023-07-16 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32595: -- Description: [https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/kinesis/

[jira] [Commented] (FLINK-32632) Run Kubernetes test is unstable on AZP

2023-07-20 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17745427#comment-17745427 ] Yuxin Tan commented on FLINK-32632: --- https://dev.azure.com/apache-flink/apache-flink/_

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-07-24 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: This introduces a new Hybrid Shuffle mode to support remote storage. The remote storage

[jira] [Closed] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-07-24 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan closed FLINK-31634. - Release Note: This introduces a new Hybrid Shuffle mode to support remote storage. The remote storage p

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-07-24 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: This introduces a new Hybrid Shuffle mode to support remote storage. The remote storage

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-07-24 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: This introduces a new Hybrid Shuffle mode to support remote storage. The remote storage

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-07-24 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: This introduces a new Hybrid Shuffle mode to support remote storage. The remote storage

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-07-24 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: This introduces a new Hybrid Shuffle mode to support remote storage. The remote storage

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-07-24 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: This introduces a new Hybrid Shuffle mode to support remote storage. The remote storage

[jira] [Created] (FLINK-32675) Add doc for the tiered storage of hybrid shuffle

2023-07-25 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32675: - Summary: Add doc for the tiered storage of hybrid shuffle Key: FLINK-32675 URL: https://issues.apache.org/jira/browse/FLINK-32675 Project: Flink Issue Type: Improv

[jira] [Updated] (FLINK-32675) Add doc for the tiered storage of hybrid shuffle

2023-07-25 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32675: -- Description: The new Hybrid Shuffle mode supporting remote storage (https://issues.apache.org/jira/bro

[jira] [Commented] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-07-25 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17747238#comment-17747238 ] Yuxin Tan commented on FLINK-31634: --- [~knaufk] Thanks for helping check the doc. I hav

[jira] [Assigned] (FLINK-32709) Modify segment size to improve memory utilization for Hybrid Shuffle

2023-07-27 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan reassigned FLINK-32709: - Assignee: Yuxin Tan > Modify segment size to improve memory utilization for Hybrid Shuffle > --

[jira] [Created] (FLINK-32709) Modify segment size to improve memory utilization for Hybrid Shuffle

2023-07-27 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32709: - Summary: Modify segment size to improve memory utilization for Hybrid Shuffle Key: FLINK-32709 URL: https://issues.apache.org/jira/browse/FLINK-32709 Project: Flink

[jira] [Updated] (FLINK-32709) Improve memory utilization for Hybrid Shuffle

2023-07-28 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32709: -- Summary: Improve memory utilization for Hybrid Shuffle (was: Modify segment size to improve memory ut

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: Hybrid Shuffle supports storing the shuffle data in remote storage. The remote storage p

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: Hybrid Shuffle supports storing the shuffle data in remote storage. The remote storage p

[jira] [Updated] (FLINK-32709) Fix the bug of low memory utilization for Hybrid Shuffle

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32709: -- Summary: Fix the bug of low memory utilization for Hybrid Shuffle (was: Improve memory utilization fo

[jira] [Created] (FLINK-30469) FLIP-266: Simplify network memory configurations for TaskManager

2022-12-20 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-30469: - Summary: FLIP-266: Simplify network memory configurations for TaskManager Key: FLINK-30469 URL: https://issues.apache.org/jira/browse/FLINK-30469 Project: Flink I

[jira] [Updated] (FLINK-30469) FLIP-266: Simplify network memory configurations for TaskManager

2022-12-20 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-30469: -- Description: When using Flink, users may encounter the following issues that affect usability. 1. The

[jira] [Updated] (FLINK-30469) FLIP-266: Simplify network memory configurations for TaskManager

2022-12-20 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-30469: -- Description: When using Flink, users may encounter the following issues that affect usability. 1. The

[jira] [Created] (FLINK-30471) Optimize the enriching network memory process in SsgNetworkMemoryCalculationUtils

2022-12-21 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-30471: - Summary: Optimize the enriching network memory process in SsgNetworkMemoryCalculationUtils Key: FLINK-30471 URL: https://issues.apache.org/jira/browse/FLINK-30471 Project:

[jira] [Created] (FLINK-30472) Modify the default value of the max network memory config option

2022-12-21 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-30472: - Summary: Modify the default value of the max network memory config option Key: FLINK-30472 URL: https://issues.apache.org/jira/browse/FLINK-30472 Project: Flink I

[jira] [Updated] (FLINK-30469) FLIP-266: Simplify network memory configurations for TaskManager

2022-12-21 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-30469: -- Fix Version/s: (was: 1.17.0) > FLIP-266: Simplify network memory configurations for TaskManager >

[jira] [Updated] (FLINK-30469) FLIP-266: Simplify network memory configurations for TaskManager

2022-12-21 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-30469: -- Fix Version/s: 1.17.0 > FLIP-266: Simplify network memory configurations for TaskManager > ---

  1   2   3   4   >