[jira] [Commented] (HDFS-8136) Client gets and uses EC schema when reads and writes a stripping file

2015-04-16 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499158#comment-14499158 ] Li Bo commented on HDFS-8136: - The patch looks good to me. If the variables are set as

[jira] [Updated] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-15 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8120: Attachment: HDFS-8120.006.patch patch 006 fix bug in patch 003 and using {{StripeBlockUtil}} in

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-15 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495963#comment-14495963 ] Li Bo commented on HDFS-8120: - I think Jing's idea is a good method to solve the problem. I

[jira] [Updated] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-15 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8120: Attachment: HDFS-8120.007.patch Erasure coding: created util class to analyze striped block groups

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493774#comment-14493774 ] Li Bo commented on HDFS-8120: - hi, Zhe, I update branch code and find it failed to build. The

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495614#comment-14495614 ] Li Bo commented on HDFS-7889: - hi, Zhe, please see my following explanation of the related

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495584#comment-14495584 ] Li Bo commented on HDFS-8120: - bq. the DFSStripedOutputStream should not allocate a new block

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495568#comment-14495568 ] Li Bo commented on HDFS-8120: - When completing a block group, NN will check if the replications

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

2015-04-13 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493550#comment-14493550 ] Li Bo commented on HDFS-7613: - Thanks Walter for the work on this sub task. Please see my

[jira] [Work started] (HDFS-8015) Erasure Coding: local and remote block writer for coding work in DataNode

2015-04-13 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8015 started by Li Bo. --- Erasure Coding: local and remote block writer for coding work in DataNode

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-13 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491963#comment-14491963 ] Li Bo commented on HDFS-8120: - Thanks Zhe for the bug fixing. Does {{cellsInStripe}} mean the

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-09 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487041#comment-14487041 ] Li Bo commented on HDFS-7889: - Changes in patch 010: check file length in unit test; check if

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-09 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-010.patch Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-07 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482890#comment-14482890 ] Li Bo commented on HDFS-7889: - hi, Zhe Thanks for your review and update of patch. 1.

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-008.patch Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394178#comment-14394178 ] Li Bo commented on HDFS-7889: - Patch 008 fix problems mentioned above. Currently I have not

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394134#comment-14394134 ] Li Bo commented on HDFS-7889: - OK, I will upload a new patch later Subclass DFSOutputStream

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-02 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-007.patch Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-02 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392394#comment-14392394 ] Li Bo commented on HDFS-7889: - In patch 007, we will not pad zero-bytes to incomplete stripe

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-02 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392385#comment-14392385 ] Li Bo commented on HDFS-7889: - Thanks for Vinayakumar’s careful review. bq. I didn't understand

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391932#comment-14391932 ] Li Bo commented on HDFS-7888: - The changes also look good to me. Thanks for the review of Zhe,

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-31 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388090#comment-14388090 ] Li Bo commented on HDFS-7889: - hi, Zhe {{stripedBlocks[i]}} is an instance of

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-31 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389983#comment-14389983 ] Li Bo commented on HDFS-7888: - That's a very good improvement of the patch. I will also update

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-31 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-006.patch Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-31 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389987#comment-14389987 ] Li Bo commented on HDFS-7889: - Patch 006 removes {{getStreamer()}} and switches streamer in

[jira] [Updated] (HDFS-7786) Handle slow writers for DFSStripedOutputStream

2015-03-31 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7786: Summary: Handle slow writers for DFSStripedOutputStream (was: Handle slow writers for DFSOutputStream when there're

[jira] [Updated] (HDFS-7786) Handle slow writers for DFSStripedOutputStream

2015-03-31 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7786: Description: The streamers in DFSStripedOutputStream may have different write speed. We need to consider and handle

[jira] [Updated] (HDFS-7786) Handle slow writers for DFSStripedOutputStream

2015-03-31 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7786: Description: The streamers in DFSStripedOutputStream may have different write speed. We need to consider and handle

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-30 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386476#comment-14386476 ] Li Bo commented on HDFS-7889: - Thanks for Zhe’s review and update of the patch. bq. we can

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-30 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-004.patch Subclass DFSOutputStream to support writing striping layout files

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-30 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7888: Attachment: HDFS-7888-001.patch Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-30 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388056#comment-14388056 ] Li Bo commented on HDFS-7888: - HDFS-7888-trunk-001.patch fixes the two problems. Change

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-30 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7888: Status: Patch Available (was: Open) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-30 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387999#comment-14387999 ] Li Bo commented on HDFS-7889: - Thanks for Zhe's review. Changes irrelevant to subclassing have

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-30 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7888: Attachment: HDFS-7888-trunk-001.patch Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-30 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-005.patch Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-30 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387979#comment-14387979 ] Li Bo commented on HDFS-7888: - About patch 001 : 1. Change some fields and methods from private

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-26 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-001.patch Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-26 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381648#comment-14381648 ] Li Bo commented on HDFS-7888: - hi Nicholas I have just uploaded a patch to HDFS-7889. If you

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-03-26 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381653#comment-14381653 ] Li Bo commented on HDFS-7729: - hi, Zhe I have just uploaded a patch to HDFS-7889 and add a unit

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-26 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Status: Patch Available (was: Open) Subclass DFSOutputStream to support writing striping layout files

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-26 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-002.patch fix several problems in Zhe's comments Subclass DFSOutputStream to support writing

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-26 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383282#comment-14383282 ] Li Bo commented on HDFS-7889: - Thanks Zhe’s careful review. bq. Isn’t currentPacket always null

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-26 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Status: In Progress (was: Patch Available) Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-7344) Erasure Coding worker and support in DataNode

2015-03-25 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379428#comment-14379428 ] Li Bo commented on HDFS-7344: - Hi Nicholas, Thanks for the heads up on this task. Once after

[jira] [Commented] (HDFS-7782) Read a striping layout file from client side

2015-03-23 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375609#comment-14375609 ] Li Bo commented on HDFS-7782: - Thanks for the work on striped reading, Zhe! Logics: 1.

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-23 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377149#comment-14377149 ] Li Bo commented on HDFS-7854: - {{TestStartup}},{{TestDatanodeManager}} pass locally,

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-23 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377138#comment-14377138 ] Li Bo commented on HDFS-7854: - hi, Jing, thanks for your careful review and improvement of the

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-006.patch Separate class DataStreamer out of DFSOutputStream

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371090#comment-14371090 ] Li Bo commented on HDFS-7854: - The failure of {{TestTracing#testWriteTraceHooks}} seems caused

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-19 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-005.patch Separate class DataStreamer out of DFSOutputStream

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-16 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-004-duplicate3.patch The findbugsWarnings's url cannot be opened, trigger Jenkins again.

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-16 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-004-duplicate2.patch trigger again Separate class DataStreamer out of DFSOutputStream

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-13 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359991#comment-14359991 ] Li Bo commented on HDFS-7854: - Patch 004 includes several changes advised by Jing. Function

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-13 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360084#comment-14360084 ] Li Bo commented on HDFS-7854: - It seems jenkins has some problems. Patch 004 works well on my

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-12 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358357#comment-14358357 ] Li Bo commented on HDFS-7854: - hi, Jing we may encounter some problems in your way of handling

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-12 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358368#comment-14358368 ] Li Bo commented on HDFS-7854: - If we want dataQueue in DataStreamer, we can provide

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-12 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-004.patch Separate class DataStreamer out of DFSOutputStream

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-11 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358081#comment-14358081 ] Li Bo commented on HDFS-7854: - Thanks for Jing's careful review. I will upload a new patch

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-10 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354728#comment-14354728 ] Li Bo commented on HDFS-7854: - hi, Jing. I download the code from trunk and still find the

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-09 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352629#comment-14352629 ] Li Bo commented on HDFS-7854: - {{TestByteArrayManager}} passes on my local machine,

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-08 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-003.patch Patch 003 fixes one javac warning. Two findBugs warnings seem already existing

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-06 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-002.patch Separate class DataStreamer out of DFSOutputStream

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-05 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349796#comment-14349796 ] Li Bo commented on HDFS-7855: - Great! Separate class Packet from DFSOutputStream

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-05 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349798#comment-14349798 ] Li Bo commented on HDFS-7855: - And thanks Jing , Zhe and Kai for the review. Separate class

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-05 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Status: Patch Available (was: Open) Separate class DataStreamer out of DFSOutputStream

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348012#comment-14348012 ] Li Bo commented on HDFS-7855: - hi, Zhe. I run {{TestFileLengthOnClusterRestart}} locally and it

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348026#comment-14348026 ] Li Bo commented on HDFS-7855: - Right, if we modify DFSPacket's constructor we can make

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348066#comment-14348066 ] Li Bo commented on HDFS-7729: - hi, Zhe, I will check this problem soon. This JIRA has been

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: Patch Available (was: In Progress) Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Attachment: HDFS-7855-006.patch Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: In Progress (was: Patch Available) Separate class Packet from DFSOutputStream

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348004#comment-14348004 ] Li Bo commented on HDFS-7855: - Thanks for your carefully review. One question is that

[jira] [Created] (HDFS-7888) Change DataStream/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-04 Thread Li Bo (JIRA)
Li Bo created HDFS-7888: --- Summary: Change DataStream/DFSOutputStream/DFSPacket for convenience of subclassing Key: HDFS-7888 URL: https://issues.apache.org/jira/browse/HDFS-7888 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348288#comment-14348288 ] Li Bo commented on HDFS-7855: - Sorry for forgetting checking this final variable. Patch 007 is

[jira] [Created] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-03-04 Thread Li Bo (JIRA)
Li Bo created HDFS-7889: --- Summary: Subclass DFSOutputStream to support writing striping layout files Key: HDFS-7889 URL: https://issues.apache.org/jira/browse/HDFS-7889 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7888: Description: HDFS-7793 refactors class {{DFSOutputStream}} on trunk which makes {{DFSOutputStream}} a class without

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7888: Summary: Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing (was: Change

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348266#comment-14348266 ] Li Bo commented on HDFS-7888: - This JIRA can be a part of HDFS-7889. One reason to create this

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Attachment: HDFS-7855-007.patch Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-001.patch Separate class DataStreamer out of DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-02 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Attachment: HDFS-7855-004.patch Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-02 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: In Progress (was: Patch Available) Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-02 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: Patch Available (was: In Progress) Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-02 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: In Progress (was: Patch Available) Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-02 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Attachment: HDFS-7855-005.patch Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-02 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: Patch Available (was: In Progress) Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-01 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: Patch Available (was: In Progress) Separate class Packet from DFSOutputStream

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-01 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342626#comment-14342626 ] Li Bo commented on HDFS-7855: - hi, Kai patch-003 renames class Packet to DFSPacket and remove

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-01 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Attachment: HDFS-7855-003.patch Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-01 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: In Progress (was: Patch Available) Separate class Packet from DFSOutputStream

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-03-01 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342779#comment-14342779 ] Li Bo commented on HDFS-7855: - I check the test results and console output carefully and don't

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-27 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341261#comment-14341261 ] Li Bo commented on HDFS-7855: - This patch just adds a new class which has not been used by any

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-27 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Attachment: HDFS-7855-002.patch Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-27 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: In Progress (was: Patch Available) Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-27 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: Patch Available (was: In Progress) Separate class Packet from DFSOutputStream

[jira] [Commented] (HDFS-7793) Refactor DFSOutputStream separating DataStreamer out

2015-02-27 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339964#comment-14339964 ] Li Bo commented on HDFS-7793: - Because the patch is very large, I split this task into three

[jira] [Created] (HDFS-7856) DFSOutputStream using outer independent class DataStreamer and Packet

2015-02-26 Thread Li Bo (JIRA)
Li Bo created HDFS-7856: --- Summary: DFSOutputStream using outer independent class DataStreamer and Packet Key: HDFS-7856 URL: https://issues.apache.org/jira/browse/HDFS-7856 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-26 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Attachment: HDFS-7855-001.patch Separate class Packet from DFSOutputStream

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-26 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7855: Status: Patch Available (was: Open) Separate class Packet from DFSOutputStream

<    1   2   3   4   >