[jira] [Commented] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-10-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625383#comment-17625383 ] Xintong Song commented on FLINK-29572: -- You don't have to configure different ports for each task

[jira] [Closed] (FLINK-28769) Flink History Server show wrong name of batch jobs

2022-10-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28769. Resolution: Won't Fix Closing as we are no longer actively maintaining the deprecated DataSet

[jira] [Updated] (FLINK-28863) Snapshot result of RocksDB native savepoint should have empty shared-state

2022-10-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-28863: - Component/s: (was: Runtime / Checkpointing) > Snapshot result of RocksDB native savepoint

[jira] [Closed] (FLINK-28879) New File Sink s3 end-to-end test failed with Output hash mismatch

2022-10-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28879. Resolution: Cannot Reproduce This has never been reproduced since reported 2.5 months ago.

[jira] [Closed] (FLINK-29124) Redundant checkNotNull in cli Package

2022-10-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29124. Resolution: Not A Problem I don't think this is a valid issue. Not relying on the callers

[jira] [Commented] (FLINK-29125) Placeholder in Apache Flink Web Frontend to display some "tags" to distinguish between frontends of different clusters

2022-10-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17624917#comment-17624917 ] Xintong Song commented on FLINK-29125: -- [~junhan], would you have time to take a look at this? >

[jira] [Closed] (FLINK-29306) fail to check multiple flink-dist*.jar for config.sh

2022-10-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29306. Fix Version/s: 1.17.0 Resolution: Fixed master (1.17):

[jira] [Closed] (FLINK-29647) report stackoverflow when using kryo

2022-10-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29647. Resolution: Workaround Closing this for now as we are not upgrading kryo version right now. Feel

[jira] [Updated] (FLINK-29758) Serialization issue with enum

2022-10-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-29758: - Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile) Table SQL / API

[jira] [Assigned] (FLINK-29766) Speculative execution should also work in hybrid shuffle mode

2022-10-26 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29766: Assignee: Weijie Guo > Speculative execution should also work in hybrid shuffle mode >

[jira] [Assigned] (FLINK-29767) Adaptive batch scheduler supports hybrid shuffle

2022-10-26 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29767: Assignee: Weijie Guo > Adaptive batch scheduler supports hybrid shuffle >

[jira] [Commented] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-10-26 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17624813#comment-17624813 ] Xintong Song commented on FLINK-29572: -- bq. If this works, TM will report its address as

[jira] [Closed] (FLINK-29134) fetch metrics may cause oom(ThreadPool task pile up)

2022-10-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29134. Fix Version/s: 1.17.0 1.15.3 1.16.1 Resolution: Fixed

[jira] [Closed] (FLINK-29435) securityConfiguration supports dynamic configuration

2022-10-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29435. Fix Version/s: 1.17.0 Resolution: Done master (1.17):

[jira] [Comment Edited] (FLINK-28468) Creating benchmark channel in Apache Flink slack

2022-10-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623729#comment-17623729 ] Xintong Song edited comment on FLINK-28468 at 10/25/22 10:09 AM: - Thanks

[jira] [Closed] (FLINK-28468) Creating benchmark channel in Apache Flink slack

2022-10-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28468. Resolution: Done Thanks [~Yanfei Lei] for setting this up. The benchmark reports are not

[jira] [Assigned] (FLINK-28468) Creating benchmark channel in Apache Flink slack

2022-10-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28468: Assignee: Yanfei Lei (was: Anton Kalashnikov) > Creating benchmark channel in Apache

[jira] [Commented] (FLINK-28643) Job archive file contains too much Job json file on Flink HistoryServer

2022-10-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623710#comment-17623710 ] Xintong Song commented on FLINK-28643: -- That sounds like a nice improvement. Thanks [~dangshazi].

[jira] [Assigned] (FLINK-28643) Job archive file contains too much Job json file on Flink HistoryServer

2022-10-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28643: Assignee: LI Mingkun > Job archive file contains too much Job json file on Flink

[jira] [Commented] (FLINK-29481) Show JobType on WebUI

2022-10-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623706#comment-17623706 ] Xintong Song commented on FLINK-29481: -- Thanks, [~dangshazi]. You are assigned. Please go ahead. >

[jira] [Assigned] (FLINK-29481) Show JobType on WebUI

2022-10-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29481: Assignee: LI Mingkun > Show JobType on WebUI > - > >

[jira] [Closed] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29615. Fix Version/s: 1.17.0 1.16.1 Resolution: Fixed - master (1.17):

[jira] [Commented] (FLINK-29134) fetch metrics may cause oom(ThreadPool task pile up)

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620884#comment-17620884 ] Xintong Song commented on FLINK-29134: -- I think this can be fixed by checking whether the

[jira] [Assigned] (FLINK-29134) fetch metrics may cause oom(ThreadPool task pile up)

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29134: Assignee: Yuxin Tan > fetch metrics may cause oom(ThreadPool task pile up) >

[jira] [Commented] (FLINK-29234) Dead lock in DefaultLeaderElectionService

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620883#comment-17620883 ] Xintong Song commented on FLINK-29234: -- Looks like a valid bug to me. [~Weijie Guo], could you

[jira] [Assigned] (FLINK-29234) Dead lock in DefaultLeaderElectionService

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29234: Assignee: Weijie Guo > Dead lock in DefaultLeaderElectionService >

[jira] [Assigned] (FLINK-28102) Flink AkkaRpcSystemLoader fails when temporary directory is a symlink

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28102: Assignee: Weijie Guo > Flink AkkaRpcSystemLoader fails when temporary directory is a

[jira] [Updated] (FLINK-29328) 【Flink is having problems using the status expiration setting】

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-29328: - Component/s: Runtime / State Backends (was: API / DataStream) > 【Flink is

[jira] [Commented] (FLINK-29339) JobMasterPartitionTrackerImpl#requestShuffleDescriptorsFromResourceManager blocks main thread

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620842#comment-17620842 ] Xintong Song commented on FLINK-29339: -- Any updates on this? [~xuannan][~gaoyunhaii] >

[jira] [Closed] (FLINK-29698) Job Manager fails with FileAlreadyExistsException if java.io.tmpdir points to a symbolic link

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29698. Resolution: Duplicate Closing this for duplication. I also upgraded FLINK-28102 to Critical. >

[jira] [Updated] (FLINK-28102) Flink AkkaRpcSystemLoader fails when temporary directory is a symlink

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-28102: - Priority: Critical (was: Minor) > Flink AkkaRpcSystemLoader fails when temporary directory is

[jira] [Assigned] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29615: Assignee: Zhanghao Chen > MetricStore does not remove metrics of nonexistent subtasks

[jira] [Commented] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620796#comment-17620796 ] Xintong Song commented on FLINK-29615: -- Thanks for reporting and fixing this, [~Zhanghao Chen].

[jira] [Commented] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618658#comment-17618658 ] Xintong Song commented on FLINK-29572: -- [~gzkevinl], I probably haven't understand this service

[jira] [Commented] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618429#comment-17618429 ] Xintong Song commented on FLINK-29646: -- cc [~fsk119] > SQL Gateway should return a simpler error

[jira] [Commented] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618428#comment-17618428 ] Xintong Song commented on FLINK-29646: -- I agree that for this specific example, or maybe generalize

[jira] [Commented] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618406#comment-17618406 ] Xintong Song commented on FLINK-29646: -- Let me ask in this way: How do you know the last `caused

[jira] [Assigned] (FLINK-29640) Enhance the function configured by execution.shutdown-on-attached-exit by heartbeat between client and dispatcher

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29640: Assignee: Liu > Enhance the function configured by execution.shutdown-on-attached-exit

[jira] [Commented] (FLINK-29639) Add ResourceId in TransportException for debugging

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618393#comment-17618393 ] Xintong Song commented on FLINK-29639: -- Thanks, [~Jiangang]. You are assigned > Add ResourceId in

[jira] [Assigned] (FLINK-29641) SortMergeResultPartitionReadSchedulerTest.testCreateSubpartitionReader

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29641: Assignee: Weijie Guo >

[jira] [Assigned] (FLINK-29639) Add ResourceId in TransportException for debugging

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29639: Assignee: Liu > Add ResourceId in TransportException for debugging >

[jira] [Commented] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618387#comment-17618387 ] Xintong Song commented on FLINK-29646: -- That's probably worth-considering direction. It's quite

[jira] [Commented] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618377#comment-17618377 ] Xintong Song commented on FLINK-29646: -- First of all, the provided PR changes the default behavior

[jira] [Commented] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618373#comment-17618373 ] Xintong Song commented on FLINK-29572: -- [~gzkevinl], I'm still not entirely sure whether this is a

[jira] [Commented] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618365#comment-17618365 ] Xintong Song commented on FLINK-29646: -- I'm -1 for this change. Reporting the root-cause exception

[jira] [Assigned] (FLINK-29435) securityConfiguration supports dynamic configuration

2022-10-14 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29435: Assignee: Bo Cui > securityConfiguration supports dynamic configuration >

[jira] [Commented] (FLINK-29481) Show JobType on WebUI

2022-10-14 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617602#comment-17617602 ] Xintong Song commented on FLINK-29481: -- Hi [~dangshazi], I think this makes a good improvement.

[jira] [Commented] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-10-11 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616142#comment-17616142 ] Xintong Song commented on FLINK-29572: -- After looking into this a bit more, I think this might not

[jira] [Commented] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-10-10 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615420#comment-17615420 ] Xintong Song commented on FLINK-29572: -- I think this was introduced by FLINK-24474. In

[jira] [Updated] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-10-10 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-29572: - Issue Type: Bug (was: Improvement) > Flink Task Manager skip loopback interface for resource

[jira] [Commented] (FLINK-27721) Slack: set up archive

2022-10-10 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614992#comment-17614992 ] Xintong Song commented on FLINK-27721: -- This is awesome~! Thanks a lot, [~rmetzger]. I have only

[jira] [Closed] (FLINK-29460) HsResultPartitionTest.testRelease failed with AssertionFailedError

2022-09-29 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29460. Fix Version/s: 1.16.0 Resolution: Fixed - master (1.17):

[jira] [Closed] (FLINK-29431) Exceptions during job graph serialization lock up client

2022-09-28 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29431. Resolution: Fixed - master (1.17): 853ea452bff191fb0416017aeb5acd2046665996 - release-1.16:

[jira] [Closed] (FLINK-29425) Hybrid full spilling strategy triggering spilling frequently

2022-09-28 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29425. Fix Version/s: 1.16.0 Resolution: Fixed - master (1.17):

[jira] [Assigned] (FLINK-29431) Exceptions during job graph serialization lock up client

2022-09-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29431: Assignee: Weijie Guo > Exceptions during job graph serialization lock up client >

[jira] [Assigned] (FLINK-29425) Hybrid full spilling strategy triggering spilling frequently

2022-09-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29425: Assignee: Weijie Guo > Hybrid full spilling strategy triggering spilling frequently >

[jira] [Commented] (FLINK-25328) Improvement of reuse segments for join/agg/sort operators in TaskManager for flink olap queries

2022-09-20 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17607074#comment-17607074 ] Xintong Song commented on FLINK-25328: -- [~zjureel], I'll take a look asap. Btw, it seems the design

[jira] [Created] (FLINK-29344) Make Adaptive Scheduler supports Fine-Grained Resource Management

2022-09-19 Thread Xintong Song (Jira)
Xintong Song created FLINK-29344: Summary: Make Adaptive Scheduler supports Fine-Grained Resource Management Key: FLINK-29344 URL: https://issues.apache.org/jira/browse/FLINK-29344 Project: Flink

[jira] [Commented] (FLINK-29344) Make Adaptive Scheduler supports Fine-Grained Resource Management

2022-09-19 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17606860#comment-17606860 ] Xintong Song commented on FLINK-29344: -- cc [~donaschmi] [~rmetzger]  > Make Adaptive Scheduler

[jira] [Closed] (FLINK-29101) PipelinedRegionSchedulingStrategy benchmark shows performance degradation

2022-09-14 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29101. Resolution: Fixed - master (1.17): c0165a8a7e3ccc6e82df7a30c67497a10e281153 - release-1.16:

[jira] [Closed] (FLINK-28928) Add E2E test for hybrid shuffle mode

2022-09-14 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28928. Resolution: Fixed - master (1.17): 8de6f9208fc2780d9861941bad99f6e1f845540b - release-1.16:

[jira] [Closed] (FLINK-29238) Wrong index information will be obtained after the downstream failover in hybrid full mode

2022-09-13 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29238. Resolution: Fixed - master (1.17): 12dfe6abd66646c7473bbe353d7b5eb0cfd41130 - release-1.16:

[jira] [Assigned] (FLINK-29238) Wrong index information will be obtained after the downstream failover in hybrid full mode

2022-09-09 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29238: Assignee: Weijie Guo > Wrong index information will be obtained after the downstream

[jira] [Assigned] (FLINK-28928) Add E2E test for hybrid shuffle mode

2022-09-05 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28928: Assignee: Weijie Guo (was: Xintong Song) > Add E2E test for hybrid shuffle mode >

[jira] [Assigned] (FLINK-28928) Add E2E test for hybrid shuffle mode

2022-09-05 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28928: Assignee: Xintong Song > Add E2E test for hybrid shuffle mode >

[jira] [Assigned] (FLINK-28889) Hybrid shuffle writes multiple copies of broadcast data

2022-09-02 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28889: Assignee: Weijie Guo > Hybrid shuffle writes multiple copies of broadcast data >

[jira] [Updated] (FLINK-28889) Hybrid shuffle writes multiple copies of broadcast data

2022-09-02 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-28889: - Issue Type: Improvement (was: Bug) > Hybrid shuffle writes multiple copies of broadcast data >

[jira] [Updated] (FLINK-28889) Hybrid shuffle writes multiple copies of broadcast data

2022-09-02 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-28889: - Priority: Critical (was: Major) > Hybrid shuffle writes multiple copies of broadcast data >

[jira] [Updated] (FLINK-29101) PipelinedRegionSchedulingStrategy benchmark shows performance degradation

2022-09-02 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-29101: - Priority: Blocker (was: Major) > PipelinedRegionSchedulingStrategy benchmark shows performance

[jira] [Updated] (FLINK-28889) Hybrid shuffle writes multiple copies of broadcast data

2022-09-02 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-28889: - Fix Version/s: 1.17.0 (was: 1.16.0) > Hybrid shuffle writes multiple

[jira] [Closed] (FLINK-29053) Hybrid shuffle has concurrent modification of buffer when compression is enabled

2022-08-31 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29053. Resolution: Fixed master (1.16): 8b8245ba46b25c2617d91cff3d3a44b99879d9f2 > Hybrid shuffle has

[jira] [Closed] (FLINK-28974) Add doc for the API and Option of sql gateway rest endpoint

2022-08-31 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28974. Fix Version/s: 1.16.0 Resolution: Done master (1.16):

[jira] [Closed] (FLINK-28923) Release Testing: Verify flip-241 completed jobs information enhancement

2022-08-27 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28923. Resolution: Done > Release Testing: Verify flip-241 completed jobs information enhancement >

[jira] [Closed] (FLINK-29056) Throw PartitionNotFoundException if the partition file is not readable for hybrid shuffle.

2022-08-26 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29056. Resolution: Fixed master (1.16): c643a2953ba44b3b316ba52983932329dc0162e4 > Throw

[jira] [Assigned] (FLINK-29101) PipelinedRegionSchedulingStrategy benchmark shows performance degradation

2022-08-26 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29101: Assignee: Weijie Guo > PipelinedRegionSchedulingStrategy benchmark shows performance

[jira] [Assigned] (FLINK-29053) Hybrid shuffle has concurrent modification of buffer when compression is enabled

2022-08-22 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29053: Assignee: Weijie Guo > Hybrid shuffle has concurrent modification of buffer when

[jira] [Assigned] (FLINK-29056) Throw PartitionNotFoundException if the partition file is not readable for hybird shuffle.

2022-08-22 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29056: Assignee: Weijie Guo > Throw PartitionNotFoundException if the partition file is not

[jira] [Assigned] (FLINK-28923) Release Testing: Verify flip-241 completed jobs information enhancement

2022-08-22 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28923: Assignee: Weijie Guo > Release Testing: Verify flip-241 completed jobs information

[jira] [Closed] (FLINK-29034) HYBRID_FULL result partition type is not yet reConsumable

2022-08-19 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-29034. Resolution: Fixed master (1.16): f0a6c0cbd8313de8146c9c2610bb3db98bacaea0 > HYBRID_FULL result

[jira] [Assigned] (FLINK-28974) Add doc for the API and Option of sql gateway rest endpoint

2022-08-19 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28974: Assignee: Wencong Liu > Add doc for the API and Option of sql gateway rest endpoint >

[jira] [Assigned] (FLINK-29034) HYBRID_FULL result partition type is not yet reConsumable

2022-08-18 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-29034: Assignee: Weijie Guo > HYBRID_FULL result partition type is not yet reConsumable >

[jira] [Closed] (FLINK-28800) HsFileDataManager should avoid busy-loop when fileReader has not data to read

2022-08-18 Thread Xintong Song (Jira)

[jira] [Assigned] (FLINK-27773) Introduce the E2E tests for SQL Gateway

2022-08-18 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-27773: Assignee: Wencong Liu > Introduce the E2E tests for SQL Gateway >

[jira] [Assigned] (FLINK-28963) Add API compatibility test for sql gateway rest endpoint

2022-08-17 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28963: Assignee: Wencong Liu > Add API compatibility test for sql gateway rest endpoint >

[jira] [Closed] (FLINK-28925) Fix the concurrency problem in hybrid shuffle

2022-08-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28925. Resolution: Fixed master (1.16): 7ed817f2054a13c3e2754c37f7681d8fbdba4b41 > Fix the concurrency

[jira] [Closed] (FLINK-28888) The statistics of HsResultPartition are not updated correctly

2022-08-11 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-2. Resolution: Fixed master (1.16): e39fb24ecd77306b57130d01226608aea8ce5d96 > The statistics of

[jira] [Closed] (FLINK-28884) Downstream task may never be notified of data available in hybrid shuffle when number of credits is zero.

2022-08-11 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28884. Resolution: Fixed master (1.16): 0b5aa420180729d8792c5d6feecfeb14382f72ee > Downstream task may

[jira] [Created] (FLINK-28923) Release Testing: Verify flip-241 completed jobs information enhancement

2022-08-11 Thread Xintong Song (Jira)
Xintong Song created FLINK-28923: Summary: Release Testing: Verify flip-241 completed jobs information enhancement Key: FLINK-28923 URL: https://issues.apache.org/jira/browse/FLINK-28923 Project:

[jira] [Closed] (FLINK-28701) Minimize the explosion range during failover for hybrid shuffle

2022-08-09 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28701. Resolution: Fixed master (1.16): 56e91700ca56f5535f677314167b94b476eb6c3f > Minimize the

[jira] [Assigned] (FLINK-28888) The statistics of HsResultPartition are not updated correctly

2022-08-09 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-2: Assignee: Weijie Guo > The statistics of HsResultPartition are not updated correctly >

[jira] [Assigned] (FLINK-28884) Downstream task may never be notified of data available in hybrid shuffle when number of credits is zero.

2022-08-09 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-28884: Assignee: Weijie Guo > Downstream task may never be notified of data available in hybrid

[jira] [Closed] (FLINK-28785) Hybrid shuffle consumer thread and upstream thread may have dead lock

2022-08-09 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28785. Resolution: Fixed master (1.16): b442394c65b1e924c4b5710a9453e3c7eacf05b5 > Hybrid shuffle

[jira] [Closed] (FLINK-28164) Introduce utilities API for REST endpint

2022-08-08 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28164. Resolution: Done master (1.16): 41bde65874c24ab036a016d17eb5f1ec09d6f819 > Introduce utilities

[jira] [Closed] (FLINK-28163) Introduce the statement related API for REST endpoint

2022-08-08 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28163. Fix Version/s: 1.16.0 Resolution: Done master (1.16):

[jira] [Updated] (FLINK-28164) Introduce utilities API for REST endpint

2022-08-08 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-28164: - Fix Version/s: 1.16.0 > Introduce utilities API for REST endpint >

[jira] [Closed] (FLINK-28162) Introduce the operation related API for REST endpoint

2022-08-08 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28162. Fix Version/s: 1.16.0 Resolution: Done master (1.16):

[jira] [Closed] (FLINK-28799) Hybrid shuffle can't schedule graph contains blocking edge

2022-08-08 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28799. Resolution: Fixed master (1.16): 4deaf6edc152d06488f8738386b6a8b7544fe5e9 > Hybrid shuffle can't

[jira] [Commented] (FLINK-28713) Remove unused curator-test dependency from flink-test-utils

2022-08-08 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576562#comment-17576562 ] Xintong Song commented on FLINK-28713: -- Fix CI in master (1.16):

[jira] [Assigned] (FLINK-25586) ExecutionGraphInfoStore in session cluster should split failed and successful jobs

2022-08-07 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-25586: Assignee: Zhanghao Chen > ExecutionGraphInfoStore in session cluster should split failed

[jira] [Commented] (FLINK-25586) ExecutionGraphInfoStore in session cluster should split failed and successful jobs

2022-08-07 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576491#comment-17576491 ] Xintong Song commented on FLINK-25586: -- I think this would be a good feature to have. +1 for it.

<    4   5   6   7   8   9   10   11   12   13   >