Yingjie Cao created FLINK-14118:
---
Summary: Reduce the unnecessary flushing when there is no data
available for flush
Key: FLINK-14118
URL: https://issues.apache.org/jira/browse/FLINK-14118
Project: Flin
Yingjie Cao created FLINK-14139:
---
Summary: Fix potential memory leak of rest server when using
session/standalone cluster
Key: FLINK-14139
URL: https://issues.apache.org/jira/browse/FLINK-14139
Project:
Yingjie Cao created FLINK-14180:
---
Summary: Enable config of maximum capacity of
FileArchivedExecutionGraphStore.
Key: FLINK-14180
URL: https://issues.apache.org/jira/browse/FLINK-14180
Project: Flink
Yingjie Cao created FLINK-14185:
---
Summary: AbstractServerTest failed on Travis
Key: FLINK-14185
URL: https://issues.apache.org/jira/browse/FLINK-14185
Project: Flink
Issue Type: Bug
C
Yingjie Cao created FLINK-14845:
---
Summary: Introduce data compression to blocking shuffle.
Key: FLINK-14845
URL: https://issues.apache.org/jira/browse/FLINK-14845
Project: Flink
Issue Type: Imp
Yingjie Cao created FLINK-14872:
---
Summary: Potential deadlock for task reading from blocking
ResultPartition.
Key: FLINK-14872
URL: https://issues.apache.org/jira/browse/FLINK-14872
Project: Flink
Yingjie Cao created FLINK-15024:
---
Summary: System classloader memory leak after loading too many
codegen classes.
Key: FLINK-15024
URL: https://issues.apache.org/jira/browse/FLINK-15024
Project: Flink
Yingjie Cao created FLINK-15030:
---
Summary: Potential deadlock for bounded blocking ResultPartition.
Key: FLINK-15030
URL: https://issues.apache.org/jira/browse/FLINK-15030
Project: Flink
Issue
Yingjie Cao created FLINK-15140:
---
Summary: Shuffle data compression does not work with
BroadcastRecordWriter.
Key: FLINK-15140
URL: https://issues.apache.org/jira/browse/FLINK-15140
Project: Flink
Yingjie Cao created FLINK-15166:
---
Summary: Shuffle data compression wrongly decrease the buffer
reference count.
Key: FLINK-15166
URL: https://issues.apache.org/jira/browse/FLINK-15166
Project: Flink
Yingjie Cao created FLINK-12329:
---
Summary: Netty thread deadlock bug of the SpilledSubpartitionView
Key: FLINK-12329
URL: https://issues.apache.org/jira/browse/FLINK-12329
Project: Flink
Issue
Yingjie Cao created FLINK-31386:
---
Summary: Fix the potential deadlock issue of blocking shuffle
Key: FLINK-31386
URL: https://issues.apache.org/jira/browse/FLINK-31386
Project: Flink
Issue Type
Yingjie Cao created FLINK-28373:
---
Summary: Read larger size of data sequentially for sort-shuffle
Key: FLINK-28373
URL: https://issues.apache.org/jira/browse/FLINK-28373
Project: Flink
Issue Ty
Yingjie Cao created FLINK-28374:
---
Summary: Some further improvements of sort-shuffle
Key: FLINK-28374
URL: https://issues.apache.org/jira/browse/FLINK-28374
Project: Flink
Issue Type: Improveme
Yingjie Cao created FLINK-28376:
---
Summary: Reduce the number of IO threads for sort-shuffle
Key: FLINK-28376
URL: https://issues.apache.org/jira/browse/FLINK-28376
Project: Flink
Issue Type: Su
Yingjie Cao created FLINK-28377:
---
Summary: Enable to request less number of data reading buffers for
sort-shuffle if there is no enough data
Key: FLINK-28377
URL: https://issues.apache.org/jira/browse/FLINK-28377
Yingjie Cao created FLINK-28378:
---
Summary: Use larger data reading buffer size for sort-shuffle
Key: FLINK-28378
URL: https://issues.apache.org/jira/browse/FLINK-28378
Project: Flink
Issue Type
Yingjie Cao created FLINK-28380:
---
Summary: Produce one intermediate dataset for multiple consumers
consuming the same data
Key: FLINK-28380
URL: https://issues.apache.org/jira/browse/FLINK-28380
Project
Yingjie Cao created FLINK-28382:
---
Summary: Introduce new compression algorithms of higher
compression ratio
Key: FLINK-28382
URL: https://issues.apache.org/jira/browse/FLINK-28382
Project: Flink
Yingjie Cao created FLINK-28512:
---
Summary: Select HashBasedDataBuffer and SortBasedDataBuffer
dynamically based on the number of network buffers can be allocated for
Key: FLINK-28512
URL: https://issues.apache.org/j
Yingjie Cao created FLINK-28514:
---
Summary: Remove data flush in SortMergeResultPartition
Key: FLINK-28514
URL: https://issues.apache.org/jira/browse/FLINK-28514
Project: Flink
Issue Type: Sub-t
Yingjie Cao created FLINK-28519:
---
Summary: Fix the bug that SortMergeResultPartitionReadScheduler
may not read data sequentially
Key: FLINK-28519
URL: https://issues.apache.org/jira/browse/FLINK-28519
P
Yingjie Cao created FLINK-28550:
---
Summary: Remove the unused field in SortMergeSubpartitionReader
Key: FLINK-28550
URL: https://issues.apache.org/jira/browse/FLINK-28550
Project: Flink
Issue Ty
Yingjie Cao created FLINK-28551:
---
Summary: Store the number of bytes instead of the number of
buffers in index entry for sort-shuffle
Key: FLINK-28551
URL: https://issues.apache.org/jira/browse/FLINK-28551
Yingjie Cao created FLINK-28556:
---
Summary: Extract header fields of Buffer into a BufferHeader class
for blocking shuffle file IO
Key: FLINK-28556
URL: https://issues.apache.org/jira/browse/FLINK-28556
Yingjie Cao created FLINK-28561:
---
Summary: Merge subpartition shuffle data read request for better
sequential IO
Key: FLINK-28561
URL: https://issues.apache.org/jira/browse/FLINK-28561
Project: Flink
Yingjie Cao created FLINK-28663:
---
Summary: Allow multiple downstream consumer job vertices sharing
the same intermediate dataset at scheduler side
Key: FLINK-28663
URL: https://issues.apache.org/jira/browse/FLINK-28
Yingjie Cao created FLINK-29299:
---
Summary: Fix the network memory size calculation issue in
fine-grained resource mode
Key: FLINK-29299
URL: https://issues.apache.org/jira/browse/FLINK-29299
Project: Fl
Yingjie Cao created FLINK-29351:
---
Summary: Enable input buffer floating for blocking shuffle
Key: FLINK-29351
URL: https://issues.apache.org/jira/browse/FLINK-29351
Project: Flink
Issue Type: I
Yingjie Cao created FLINK-11000:
---
Summary: Introduce Resource Blacklist Mechanism
Key: FLINK-11000
URL: https://issues.apache.org/jira/browse/FLINK-11000
Project: Flink
Issue Type: Improvement
Yingjie Cao created FLINK-11859:
---
Summary: Improve SpanningRecordSerializer performance by
serializing record length to serialization buffer directly
Key: FLINK-11859
URL: https://issues.apache.org/jira/browse/FLINK
Yingjie Cao created FLINK-15455:
---
Summary: Enable TCP connection reuse across multiple jobs.
Key: FLINK-15455
URL: https://issues.apache.org/jira/browse/FLINK-15455
Project: Flink
Issue Type: I
Yingjie Cao created FLINK-16298:
---
Summary:
GroupWindowTableAggregateITCase.testEventTimeTumblingWindow fails on Travis
Key: FLINK-16298
URL: https://issues.apache.org/jira/browse/FLINK-16298
Project: Fl
Yingjie Cao created FLINK-21777:
---
Summary: Replace the 4M data writing cache of sort-merge shuffle
with writev system call
Key: FLINK-21777
URL: https://issues.apache.org/jira/browse/FLINK-21777
Project
Yingjie Cao created FLINK-21778:
---
Summary: Use heap memory instead of direct memory as index entry
cache for sort-merge shuffle
Key: FLINK-21778
URL: https://issues.apache.org/jira/browse/FLINK-21778
Pr
Yingjie Cao created FLINK-21788:
---
Summary: Throw PartitionNotFoundException if the partition file
has been lost for blocking shuffle
Key: FLINK-21788
URL: https://issues.apache.org/jira/browse/FLINK-21788
Yingjie Cao created FLINK-21789:
---
Summary: Make FileChannelManagerImpl#getNextPathNum select data
directory fairly
Key: FLINK-21789
URL: https://issues.apache.org/jira/browse/FLINK-21789
Project: Flink
Yingjie Cao created FLINK-21790:
---
Summary: Shuffle data directories to make data directory section
of different TaskManagers fairer
Key: FLINK-21790
URL: https://issues.apache.org/jira/browse/FLINK-21790
Yingjie Cao created FLINK-21850:
---
Summary: Improve document and config description of sort-merge
blocking shuffle
Key: FLINK-21850
URL: https://issues.apache.org/jira/browse/FLINK-21850
Project: Flink
Yingjie Cao created FLINK-21857:
---
Summary: StackOverflow for large parallelism jobs when processing
EndOfChannelStateEvent
Key: FLINK-21857
URL: https://issues.apache.org/jira/browse/FLINK-21857
Project
Yingjie Cao created FLINK-21859:
---
Summary: Batch job fails due to "Could not mark slot
61a637e3977c58a0e6b73533c419297d active"
Key: FLINK-21859
URL: https://issues.apache.org/jira/browse/FLINK-21859
Pr
Yingjie Cao created FLINK-21951:
---
Summary: Fix wrong if condition in
BufferReaderWriterUtil#writeBuffers
Key: FLINK-21951
URL: https://issues.apache.org/jira/browse/FLINK-21951
Project: Flink
Yingjie Cao created FLINK-22127:
---
Summary: Enrich error message of read buffer request timeout
exception
Key: FLINK-22127
URL: https://issues.apache.org/jira/browse/FLINK-22127
Project: Flink
Yingjie Cao created FLINK-22153:
---
Summary: Manually test the sort-merge blocking shuffle
Key: FLINK-22153
URL: https://issues.apache.org/jira/browse/FLINK-22153
Project: Flink
Issue Type: Task
Yingjie Cao created FLINK-22156:
---
Summary: HiveDialectQueryITCase fails on Azure because of no
output for 900 seconds
Key: FLINK-22156
URL: https://issues.apache.org/jira/browse/FLINK-22156
Project: Fli
Yingjie Cao created FLINK-22305:
---
Summary: Increase the default value of
taskmanager.network.sort-shuffle.min-buffers
Key: FLINK-22305
URL: https://issues.apache.org/jira/browse/FLINK-22305
Project: Fli
Yingjie Cao created FLINK-22307:
---
Summary: Increase the data writing cache size of sort-merge
blocking shuffle
Key: FLINK-22307
URL: https://issues.apache.org/jira/browse/FLINK-22307
Project: Flink
Yingjie Cao created FLINK-22910:
---
Summary: ShuffleMaster enhancement for pluggable shuffle service
framework
Key: FLINK-22910
URL: https://issues.apache.org/jira/browse/FLINK-22910
Project: Flink
Yingjie Cao created FLINK-19297:
---
Summary: Make ResultPartitionWriter record-oriented
Key: FLINK-19297
URL: https://issues.apache.org/jira/browse/FLINK-19297
Project: Flink
Issue Type: Improvem
Yingjie Cao created FLINK-19299:
---
Summary: NettyShuffleEnvironmentBuilder#setBufferSize does not
take effect
Key: FLINK-19299
URL: https://issues.apache.org/jira/browse/FLINK-19299
Project: Flink
Yingjie Cao created FLINK-19302:
---
Summary: Flushing of BoundedBlockingResultPartition should finish
current BufferBuilder
Key: FLINK-19302
URL: https://issues.apache.org/jira/browse/FLINK-19302
Project:
Yingjie Cao created FLINK-19312:
---
Summary: Introduce BufferWritingResultPartition which wraps the
logic of writing buffers to ResultSubpartition
Key: FLINK-19312
URL: https://issues.apache.org/jira/browse/FLINK-1931
Yingjie Cao created FLINK-19320:
---
Summary: Remove clearBuffers from the public interfaces of
RecordWriter
Key: FLINK-19320
URL: https://issues.apache.org/jira/browse/FLINK-19320
Project: Flink
Yingjie Cao created FLINK-19323:
---
Summary: Small optimization of network layer record serialization
Key: FLINK-19323
URL: https://issues.apache.org/jira/browse/FLINK-19323
Project: Flink
Issue
Yingjie Cao created FLINK-19344:
---
Summary:
DispatcherResourceCleanupTest#testJobSubmissionUnderSameJobId is unstable on
Azure Pipeline
Key: FLINK-19344
URL: https://issues.apache.org/jira/browse/FLINK-19344
Yingjie Cao created FLINK-19582:
---
Summary: Introduce sort-merge based blocking shuffle to Flink
Key: FLINK-19582
URL: https://issues.apache.org/jira/browse/FLINK-19582
Project: Flink
Issue Type
Yingjie Cao created FLINK-19597:
---
Summary: Introduce SortBuffer and its implementation
PartitionSortedBuffer for sort-merge based blocking shuffle
Key: FLINK-19597
URL: https://issues.apache.org/jira/browse/FLINK-19
Yingjie Cao created FLINK-19600:
---
Summary: Introduce PartitionedFile and the corresponding
writer/reader for sort-merge based blocking shuffle
Key: FLINK-19600
URL: https://issues.apache.org/jira/browse/FLINK-19600
Yingjie Cao created FLINK-19601:
---
Summary: Introduce sort-merge based blocking result partition
SortMergeResultPartition and the corresponding subpartition reader
Key: FLINK-19601
URL: https://issues.apache.org/jira
Yingjie Cao created FLINK-19602:
---
Summary: Introduce new config options to enable sort-merge based
blocking shuffle
Key: FLINK-19602
URL: https://issues.apache.org/jira/browse/FLINK-19602
Project: Flink
Yingjie Cao created FLINK-19603:
---
Summary: Introduce shuffle data compression to sort-merge based
blocking shuffle
Key: FLINK-19603
URL: https://issues.apache.org/jira/browse/FLINK-19603
Project: Flink
Yingjie Cao created FLINK-19614:
---
Summary: Further optimization of sort-merge based blocking shuffle
Key: FLINK-19614
URL: https://issues.apache.org/jira/browse/FLINK-19614
Project: Flink
Issue
Yingjie Cao created FLINK-19938:
---
Summary: Implement shuffle data read scheduling for sort-merge
blocking shuffle
Key: FLINK-19938
URL: https://issues.apache.org/jira/browse/FLINK-19938
Project: Flink
Yingjie Cao created FLINK-19991:
---
Summary:
UnalignedCheckpointITCase#shouldPerformUnalignedCheckpointMassivelyParallel
fails on Azure Pipeline
Key: FLINK-19991
URL: https://issues.apache.org/jira/browse/FLINK-19991
Yingjie Cao created FLINK-20010:
---
Summary:
SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on
Azure Pipeline
Key: FLINK-20010
URL: https://issues.apache.org/jira/browse/FLINK-20010
Yingjie Cao created FLINK-20013:
---
Summary: BoundedBlockingSubpartition may leak network buffer if
task is failed or canceled
Key: FLINK-20013
URL: https://issues.apache.org/jira/browse/FLINK-20013
Proje
Yingjie Cao created FLINK-20740:
---
Summary: Use managed memory to avoid direct memory OOM error
Key: FLINK-20740
URL: https://issues.apache.org/jira/browse/FLINK-20740
Project: Flink
Issue Type:
Yingjie Cao created FLINK-20757:
---
Summary: Optimize data broadcast for sort-merge shuffle
Key: FLINK-20757
URL: https://issues.apache.org/jira/browse/FLINK-20757
Project: Flink
Issue Type: Sub-
Yingjie Cao created FLINK-20758:
---
Summary: Use region file mechanism for shuffle data reading before
we switch to managed memory
Key: FLINK-20758
URL: https://issues.apache.org/jira/browse/FLINK-20758
P
Yingjie Cao created FLINK-23214:
---
Summary: Make ShuffleMaster a cluster level shared service
Key: FLINK-23214
URL: https://issues.apache.org/jira/browse/FLINK-23214
Project: Flink
Issue Type: S
Yingjie Cao created FLINK-23249:
---
Summary: Introduce ShuffleMasterContext to ShuffleMaster
Key: FLINK-23249
URL: https://issues.apache.org/jira/browse/FLINK-23249
Project: Flink
Issue Type: Sub
Yingjie Cao created FLINK-23275:
---
Summary: Support to release cluster partitions stored externally
Key: FLINK-23275
URL: https://issues.apache.org/jira/browse/FLINK-23275
Project: Flink
Issue T
Yingjie Cao created FLINK-23724:
---
Summary: Network buffer leak when ResultPartition is released
(failover)
Key: FLINK-23724
URL: https://issues.apache.org/jira/browse/FLINK-23724
Project: Flink
Yingjie Cao created FLINK-24035:
---
Summary: Notify the buffer listeners when the local buffer pool
receives available notification from the global pool
Key: FLINK-24035
URL: https://issues.apache.org/jira/browse/FLIN
Yingjie Cao created FLINK-24898:
---
Summary: Some further improvements of sort-shuffle
Key: FLINK-24898
URL: https://issues.apache.org/jira/browse/FLINK-24898
Project: Flink
Issue Type: Bug
Yingjie Cao created FLINK-24899:
---
Summary: Enable data compression for blocking shuffle by default
Key: FLINK-24899
URL: https://issues.apache.org/jira/browse/FLINK-24899
Project: Flink
Issue T
Yingjie Cao created FLINK-24900:
---
Summary: Support to run multiple shuffle plugins in one session
cluster
Key: FLINK-24900
URL: https://issues.apache.org/jira/browse/FLINK-24900
Project: Flink
Yingjie Cao created FLINK-24901:
---
Summary: Some further improvements of the pluggable shuffle
framework
Key: FLINK-24901
URL: https://issues.apache.org/jira/browse/FLINK-24901
Project: Flink
I
Yingjie Cao created FLINK-24954:
---
Summary: Reset read buffer request timeout on buffer recycling for
sort-shuffle
Key: FLINK-24954
URL: https://issues.apache.org/jira/browse/FLINK-24954
Project: Flink
Yingjie Cao created FLINK-25606:
---
Summary: Requesting exclusive buffers timeout when recovering from
unaligned checkpoint under fine-grained resource mode
Key: FLINK-25606
URL: https://issues.apache.org/jira/browse/
Yingjie Cao created FLINK-25607:
---
Summary: Sorting by duration on Flink Web UI does not work
correctly
Key: FLINK-25607
URL: https://issues.apache.org/jira/browse/FLINK-25607
Project: Flink
Is
Yingjie Cao created FLINK-25636:
---
Summary: FLIP-199: Change some default config values of blocking
shuffle for better usability
Key: FLINK-25636
URL: https://issues.apache.org/jira/browse/FLINK-25636
Pr
Yingjie Cao created FLINK-25637:
---
Summary: Make sort-shuffle the default shuffle implementation for
batch jobs
Key: FLINK-25637
URL: https://issues.apache.org/jira/browse/FLINK-25637
Project: Flink
Yingjie Cao created FLINK-25638:
---
Summary: Increase the default write buffer size of sort-shuffle to
16M
Key: FLINK-25638
URL: https://issues.apache.org/jira/browse/FLINK-25638
Project: Flink
Yingjie Cao created FLINK-25639:
---
Summary: Increase the default read buffer size of sort-shuffle to
64M
Key: FLINK-25639
URL: https://issues.apache.org/jira/browse/FLINK-25639
Project: Flink
I
Yingjie Cao created FLINK-25640:
---
Summary: Enhance the document for blocking shuffle
Key: FLINK-25640
URL: https://issues.apache.org/jira/browse/FLINK-25640
Project: Flink
Issue Type: Sub-task
Yingjie Cao created FLINK-25653:
---
Summary: Move buffer recycle in SortMergeSubpartitionReader out of
lock to avoid deadlock
Key: FLINK-25653
URL: https://issues.apache.org/jira/browse/FLINK-25653
Projec
Yingjie Cao created FLINK-25654:
---
Summary: Remove the redundant lock in SortMergeResultPartition
Key: FLINK-25654
URL: https://issues.apache.org/jira/browse/FLINK-25654
Project: Flink
Issue Typ
Yingjie Cao created FLINK-25774:
---
Summary: Restrict the maximum number of buffers can be used per
result partition for blocking shuffle
Key: FLINK-25774
URL: https://issues.apache.org/jira/browse/FLINK-25774
Yingjie Cao created FLINK-25780:
---
Summary: Reduce the maximum number of data output buffers for
sort-shuffle
Key: FLINK-25780
URL: https://issues.apache.org/jira/browse/FLINK-25780
Project: Flink
Yingjie Cao created FLINK-25781:
---
Summary: Adjust the maximum number of buffers can be used per
result partition for shuffle data read
Key: FLINK-25781
URL: https://issues.apache.org/jira/browse/FLINK-25781
Yingjie Cao created FLINK-25786:
---
Summary: Adjust the generation of subpartition data storage order
for sort-shuffle from random shuffle to random shift
Key: FLINK-25786
URL: https://issues.apache.org/jira/browse/FL
Yingjie Cao created FLINK-25796:
---
Summary: Avoid record copy for result partition of sort-shuffle if
there are enough buffers for better performance
Key: FLINK-25796
URL: https://issues.apache.org/jira/browse/FLINK-
Yingjie Cao created FLINK-25860:
---
Summary: Move read buffer allocation and output file creation to
setup method for sort-shuffle result partition to avoid blocking main thread
Key: FLINK-25860
URL: https://issues.ap
Yingjie Cao created FLINK-25959:
---
Summary: Add a micro-benchmark for the sort-based blocking shuffle
Key: FLINK-25959
URL: https://issues.apache.org/jira/browse/FLINK-25959
Project: Flink
Issue
Yingjie Cao created FLINK-25960:
---
Summary: Distribute the data read buffers more fairly among result
partitions for sort-shuffle
Key: FLINK-25960
URL: https://issues.apache.org/jira/browse/FLINK-25960
P
Yingjie Cao created FLINK-26347:
---
Summary: Should use Flink system Classloader (AppClassloader) when
deserializing RPC message
Key: FLINK-26347
URL: https://issues.apache.org/jira/browse/FLINK-26347
Pro
Yingjie Cao created FLINK-17107:
---
Summary: CheckpointCoordinatorConfiguration#isExactlyOnce() is
inconsistent with StreamConfig#getCheckpointMode()
Key: FLINK-17107
URL: https://issues.apache.org/jira/browse/FLINK-1
Yingjie Cao created FLINK-17208:
---
Summary: Reduce redundant data available notification of
PipelinedSubpartition
Key: FLINK-17208
URL: https://issues.apache.org/jira/browse/FLINK-17208
Project: Flink
Yingjie Cao created FLINK-17299:
---
Summary: Add remote channel throughput benchmark
Key: FLINK-17299
URL: https://issues.apache.org/jira/browse/FLINK-17299
Project: Flink
Issue Type: Sub-task
1 - 100 of 109 matches
Mail list logo
