[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-24 Thread Tsz Wo Nicholas Sze (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo Nicholas Sze updated HDFS-8382:
--
Priority: Minor  (was: Major)
Hadoop Flags: Reviewed

+1 patch looks good.

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
Priority: Minor
 Attachments: HDFS-8382-HDFS-7285-v1.patch, 
 HDFS-8382-HDFS-7285-v2.patch, HDFS-8382-HDFS-7285-v3.patch, 
 HDFS-8382-HDFS-7285-v4.patch, HDFS-8382-HDFS-7285-v5.patch, 
 HDFS-8382-HDFS-7285-v6.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-22 Thread Kai Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-8382:

Attachment: HDFS-8382-HDFS-7285-v6.patch

Updated the patch addressing findbug issues.

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
 Attachments: HDFS-8382-HDFS-7285-v1.patch, 
 HDFS-8382-HDFS-7285-v2.patch, HDFS-8382-HDFS-7285-v3.patch, 
 HDFS-8382-HDFS-7285-v4.patch, HDFS-8382-HDFS-7285-v5.patch, 
 HDFS-8382-HDFS-7285-v6.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-21 Thread Kai Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-8382:

Attachment: HDFS-8382-HDFS-7285-v4.patch

Uploaded a new patch addressing above comments. Pending on HADOOP-11847.

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
 Attachments: HDFS-8382-HDFS-7285-v1.patch, 
 HDFS-8382-HDFS-7285-v2.patch, HDFS-8382-HDFS-7285-v3.patch, 
 HDFS-8382-HDFS-7285-v4.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-21 Thread Kai Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-8382:

Status: Patch Available  (was: In Progress)

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
 Attachments: HDFS-8382-HDFS-7285-v1.patch, 
 HDFS-8382-HDFS-7285-v2.patch, HDFS-8382-HDFS-7285-v3.patch, 
 HDFS-8382-HDFS-7285-v4.patch, HDFS-8382-HDFS-7285-v5.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-21 Thread Kai Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-8382:

Attachment: HDFS-8382-HDFS-7285-v5.patch

Updated the patch rebased with the branch, not relying on HADOOP-11847 any more 
since it's a little bit late, as suggested by Vinay. Relevant tests passed 
locally. Thanks.

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
 Attachments: HDFS-8382-HDFS-7285-v1.patch, 
 HDFS-8382-HDFS-7285-v2.patch, HDFS-8382-HDFS-7285-v3.patch, 
 HDFS-8382-HDFS-7285-v4.patch, HDFS-8382-HDFS-7285-v5.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-20 Thread Kai Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-8382:

Attachment: HDFS-8382-HDFS-7285-v3.patch

Updated the patch also removing {{initialize}} method per the suggestion.

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
 Attachments: HDFS-8382-HDFS-7285-v1.patch, 
 HDFS-8382-HDFS-7285-v2.patch, HDFS-8382-HDFS-7285-v3.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-20 Thread Kai Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-8382:

Status: Open  (was: Patch Available)

The patch pending on HADOOP-11847.

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
 Attachments: HDFS-8382-HDFS-7285-v1.patch, 
 HDFS-8382-HDFS-7285-v2.patch, HDFS-8382-HDFS-7285-v3.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-17 Thread Kai Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-8382:

Status: Patch Available  (was: In Progress)

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
 Attachments: HDFS-8382-HDFS-7285-v1.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-17 Thread Kai Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-8382:

Attachment: HDFS-8382-HDFS-7285-v2.patch

Rebased.

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
 Attachments: HDFS-8382-HDFS-7285-v1.patch, 
 HDFS-8382-HDFS-7285-v2.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-14 Thread Kai Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-8382:

Attachment: HDFS-8382-HDFS-7285-v1.patch

Uploaded a patch based on HADOOP-11938.

 Remove chunkSize parameter from initialize method of raw erasure coder
 --

 Key: HDFS-8382
 URL: https://issues.apache.org/jira/browse/HDFS-8382
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Kai Zheng
Assignee: Kai Zheng
 Attachments: HDFS-8382-HDFS-7285-v1.patch


 Per discussion in HDFS-8347, we need to support encoding/decoding variable 
 width units data instead of predefined fixed width like {{chunkSize}}. Have 
 this issue to remove chunkSize in the general raw erasure coder API. Specific 
 coder will support fixed chunkSize using hard-coded or specific schema 
 customizing way if necessary, like HitchHiker coder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)