[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938599#comment-14938599 ] Hudson commented on HDFS-8719: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #465 (See

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938406#comment-14938406 ] Hudson commented on HDFS-8719: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2408 (See [htt

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938029#comment-14938029 ] Hudson commented on HDFS-8719: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #439 (See [htt

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937810#comment-14937810 ] Hudson commented on HDFS-8719: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #473 (See [htt

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937553#comment-14937553 ] Hudson commented on HDFS-8719: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1203 (See [https://

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937305#comment-14937305 ] Hudson commented on HDFS-8719: -- FAILURE: Integrated in Hadoop-trunk-Commit #8548 (See [https:

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-09-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937108#comment-14937108 ] Hudson commented on HDFS-8719: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2379 (See [https://

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-09 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620109#comment-14620109 ] Li Bo commented on HDFS-8719: - Thanks [~jingzhao] and [~walter.k.su]! > Erasure Coding: clien

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620073#comment-14620073 ] Walter Su commented on HDFS-8719: - bq. Do we also need to update the current writeChunk fun

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620019#comment-14620019 ] Hadoop QA commented on HDFS-8719: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619376#comment-14619376 ] Jing Zhao commented on HDFS-8719: - Looks like switching streamer and refreshing {{chunksPer

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618543#comment-14618543 ] Hadoop QA commented on HDFS-8719: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618445#comment-14618445 ] Hadoop QA commented on HDFS-8719: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618364#comment-14618364 ] Walter Su commented on HDFS-8719: - revision of my previous comment: 02 patch does adjustCh

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618363#comment-14618363 ] Walter Su commented on HDFS-8719: - 02 patch does adjustChunkBoundary() every time before sw

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618249#comment-14618249 ] Li Bo commented on HDFS-8719: - Yes, when to start a parity cell, the {{streamer}} used in {{ad

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618170#comment-14618170 ] Walter Su commented on HDFS-8719: - bq. If the last packet is not full, it will be enqueued

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618144#comment-14618144 ] Li Bo commented on HDFS-8719: - Thanks Walter for the review. {{remainingBytes}} will be not 1 b

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618107#comment-14618107 ] Walter Su commented on HDFS-8719: - Sorry, the number of unnecessary packets should be (64k/

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-07 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618091#comment-14618091 ] Walter Su commented on HDFS-8719: - It happens when writing last stripe of full filled block

[jira] [Commented] (HDFS-8719) Erasure Coding: client generates too many small packets when writing parity data

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14617909#comment-14617909 ] Hadoop QA commented on HDFS-8719: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo