wuyi created SPARK-31017:
----------------------------
Summary: Test for shuffle requests packaging with different size
and numBlocks limit
Key: SPARK-31017
URL: https://issues.apache.org/jira/browse/SPARK-31017
Project: Spark
Issue Type: Test
Components: Spark Core, Tests
Affects Versions: 3.0.0
Reporter: wuyi
When packaging shuffle fetch requests in ShuffleBlockFetcherIterator, there are
two limitations: maxBytesInFlight and maxBlocksInFlightPerAddress. However, we
don’t have test cases to test them both, e.g. the size limitation is hit before
the numBlocks limitation.
We should add test cases in ShuffleBlockFetcherIteratorSuite to test:
# the size limitation is hit before the numBlocks limitation
# the numBlocks limitation is hit before the size limitation
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
