GitHub user manbuyun opened a pull request:
https://github.com/apache/spark/pull/21175
[SPARK-24107] ChunkedByteBuffer.writeFully method has not reset the limit
value
JIRA Issue:
https://issues.apache.org/jira/browse/SPARK-24107?jql=text%20~%20%22ChunkedByteBuffer%22
ChunkedByteBuffer.writeFully method has not reset the limit value. When
chunks larger than bufferWriteChunkSize, such as 80*1024*1024 larger than
config.BUFFER_WRITE_CHUNK_SIZE(64 * 1024 * 1024)ï¼only while once, will
lost 16*1024*1024 byte
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/manbuyun/spark bugfix-ChunkedByteBuffer
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21175.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21175
----
commit fae181433ca1eda6be0ad450223d73c6eb5f3f35
Author: WangJinhai02 <jinhai.wang02@...>
Date: 2018-04-26T14:43:44Z
restore bytes limit value
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
