[jira] Commented: (HADOOP-6768) RPC client can response more efficiently when sendParam() got IOException

[ https://issues.apache.org/jira/browse/HADOOP-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12874572#action_12874572 ] Xiao Kang commented on HADOOP-6768: --- Another case found for this issuse. In mapreduce t

[jira] Updated: (HADOOP-6768) RPC client can response more efficiently when sendParam() got IOException

[ https://issues.apache.org/jira/browse/HADOOP-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6768: -- Attachment: HADOOP-6768.patch patch attached. A. change org.apache.hadoop.ipc.Client 1. add call.set

[jira] Created: (HADOOP-6768) RPC client can response more efficiently when sendParam() got IOException

RPC client can response more efficiently when sendParam() got IOException - Key: HADOOP-6768 URL: https://issues.apache.org/jira/browse/HADOOP-6768 Project: Hadoop Common

[jira] Commented: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

[ https://issues.apache.org/jira/browse/HADOOP-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12855353#action_12855353 ] Xiao Kang commented on HADOOP-6683: --- This patch does not add any new function and he tes

[jira] Updated: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

[ https://issues.apache.org/jira/browse/HADOOP-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6683: -- Release Note: Improve the buffer utilization of ZlibCompressor to avoid invoking a JNI per write reque

[jira] Commented: (HADOOP-6687) user object in the subject in UGI should be reused in case of a relogin.

[ https://issues.apache.org/jira/browse/HADOOP-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854325#action_12854325 ] Xiao Kang commented on HADOOP-6687: --- Which revision is the patch against? Since no such

[jira] Commented: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

[ https://issues.apache.org/jira/browse/HADOOP-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854316#action_12854316 ] Xiao Kang commented on HADOOP-6683: --- A comparision test was performed on a 1.8GB web log

[jira] Updated: (HADOOP-6663) BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file

[ https://issues.apache.org/jira/browse/HADOOP-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6663: -- Release Note: Fix EOF exception in BlockDecompressorStream when decompressing previous compressed empt

[jira] Updated: (HADOOP-6663) BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file

[ https://issues.apache.org/jira/browse/HADOOP-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6663: -- Attachment: BlockDecompressorStream.java.patch Thank you for your advice. New patch attached with ap

[jira] Updated: (HADOOP-6662) hadoop zlib compression does not fully utilize the buffer

[ https://issues.apache.org/jira/browse/HADOOP-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6662: -- Resolution: Duplicate Status: Resolved (was: Patch Available) Duplicated with HADOOP-6683. >

[jira] Updated: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

[ https://issues.apache.org/jira/browse/HADOOP-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6683: -- Attachment: ZlibCompressor.java.patch Patch attached. > the first optimization: ZlibCompressor does n

[jira] Commented: (HADOOP-4196) Possible performance enhancement in Hadoop compress module

[ https://issues.apache.org/jira/browse/HADOOP-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853692#action_12853692 ] Xiao Kang commented on HADOOP-4196: --- Thank you. Sub task HADOOP-6683 created. > Possibl

[jira] Created: (HADOOP-6683) the first optimization: ZlibCompressor does not fully utilize the buffer

the first optimization: ZlibCompressor does not fully utilize the buffer Key: HADOOP-6683 URL: https://issues.apache.org/jira/browse/HADOOP-6683 Project: Hadoop Common

[jira] Commented: (HADOOP-6672) BytesWritable.write(buf) use much more CPU in writeInt() then write(buf)

[ https://issues.apache.org/jira/browse/HADOOP-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853155#action_12853155 ] Xiao Kang commented on HADOOP-6672: --- The profiling data is got from a internal version c

[jira] Updated: (HADOOP-6663) BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file

[ https://issues.apache.org/jira/browse/HADOOP-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6663: -- Attachment: BlockDecompressorStream.java.patch New patch attached, including test case. > BlockDecomp

[jira] Commented: (HADOOP-6672) BytesWritable.write(buf) use much more CPU in writeInt() then write(buf)

[ https://issues.apache.org/jira/browse/HADOOP-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852833#action_12852833 ] Xiao Kang commented on HADOOP-6672: --- Sun JDK's implementation of writeInt() writeLong()

[jira] Commented: (HADOOP-6672) BytesWritable.write(buf) use much more CPU in writeInt() then write(buf)

[ https://issues.apache.org/jira/browse/HADOOP-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852829#action_12852829 ] Xiao Kang commented on HADOOP-6672: --- Compring two screenshots as following: 1. In scree

[jira] Updated: (HADOOP-6672) BytesWritable.write(buf) use much more CPU in writeInt() then write(buf)

[ https://issues.apache.org/jira/browse/HADOOP-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6672: -- Attachment: screenshot-2.jpg screenshot-2 after aplying the patch > BytesWritable.write(buf) use much

[jira] Updated: (HADOOP-6672) BytesWritable.write(buf) use much more CPU in writeInt() then write(buf)

[ https://issues.apache.org/jira/browse/HADOOP-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6672: -- Attachment: BytesWritable.java.patch Patch attached. Transfer int to a four bytes buffer ints and use

[jira] Commented: (HADOOP-4196) Possible performance enhancement in Hadoop compress module

[ https://issues.apache.org/jira/browse/HADOOP-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852715#action_12852715 ] Xiao Kang commented on HADOOP-4196: --- Thanks Hong Tang for noticing duplication of anothe

[jira] Updated: (HADOOP-6672) BytesWritable.write(buf) use much more CPU in writeInt() then write(buf)

[ https://issues.apache.org/jira/browse/HADOOP-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6672: -- Attachment: screenshot-1.jpg A YJP screenshot attached. comparing as following: BytesWritable.write(

[jira] Created: (HADOOP-6672) BytesWritable.write(buf) use much more CPU in writeInt() then write(buf)

BytesWritable.write(buf) use much more CPU in writeInt() then write(buf) Key: HADOOP-6672 URL: https://issues.apache.org/jira/browse/HADOOP-6672 Project: Hadoop Common

[jira] Updated: (HADOOP-6662) hadoop zlib compression does not fully utilize the buffer

[ https://issues.apache.org/jira/browse/HADOOP-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6662: -- Status: Patch Available (was: Reopened) > hadoop zlib compression does not fully utilize the buffer >

[jira] Reopened: (HADOOP-6662) hadoop zlib compression does not fully utilize the buffer

[ https://issues.apache.org/jira/browse/HADOOP-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang reopened HADOOP-6662: --- Thanks for Hong Tang. Patch is not attached in HADOOP-4196 and the issue is still unresolved in release

[jira] Updated: (HADOOP-6662) hadoop zlib compression does not fully utilize the buffer

[ https://issues.apache.org/jira/browse/HADOOP-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6662: -- Attachment: ZlibCompressor.patch Patch attached. needsInput() check the uncompressedDirectBuf, if it

[jira] Commented: (HADOOP-6662) hadoop zlib compression does not fully utilize the buffer

[ https://issues.apache.org/jira/browse/HADOOP-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851277#action_12851277 ] Xiao Kang commented on HADOOP-6662: --- Thank you for your notice! However no patch attache

[jira] Updated: (HADOOP-6663) BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file

[ https://issues.apache.org/jira/browse/HADOOP-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Kang updated HADOOP-6663: -- Attachment: BlockDecompressorStream.patch Patch attached. Return -1 to indicate EOF when reading a 0

[jira] Commented: (HADOOP-6663) BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file

[ https://issues.apache.org/jira/browse/HADOOP-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12850835#action_12850835 ] Xiao Kang commented on HADOOP-6663: --- The EOF exception caused as follow: BlockCompresso

[jira] Created: (HADOOP-6663) BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file

BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file Key: HADOOP-6663 URL: https://issues.apache.org/jira/browse/HADOOP-66

[jira] Created: (HADOOP-6662) hadoop zlib compression does not fully utilize the buffer

hadoop zlib compression does not fully utilize the buffer - Key: HADOOP-6662 URL: https://issues.apache.org/jira/browse/HADOOP-6662 Project: Hadoop Common Issue Type: Improvement