[
https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7793:
Attachment: HDFS-7793-002.patch
patch 002: fix bugs of appending files
Refactor DFSOutputStream separating
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14338169#comment-14338169
]
Li Bo commented on HDFS-7729:
-
hi, [~jingzhao] and [~zhz] , I come back today and a new
Li Bo created HDFS-7855:
---
Summary: Separate class Packet from DFSOutputStream
Key: HDFS-7855
URL: https://issues.apache.org/jira/browse/HDFS-7855
Project: Hadoop HDFS
Issue Type: Sub-task
Li Bo created HDFS-7854:
---
Summary: Separate class DataStreamer out of DFSOutputStream
Key: HDFS-7854
URL: https://issues.apache.org/jira/browse/HDFS-7854
Project: Hadoop HDFS
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo reassigned HDFS-7854:
---
Assignee: Li Bo
Separate class DataStreamer out of DFSOutputStream
[
https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320050#comment-14320050
]
Li Bo commented on HDFS-7793:
-
For patch 001: I split {{DFSOutputStream}} into 3 classes,
[
https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7793:
Attachment: HDFS-7793-001.patch
Refactor DFSOutputStream separating DataStreamer out
Li Bo created HDFS-7786:
---
Summary: Handle failures and slow writers for DFSOutputStream when
there're multiple data streamers
Key: HDFS-7786
URL: https://issues.apache.org/jira/browse/HDFS-7786
Project: Hadoop
[
https://issues.apache.org/jira/browse/HDFS-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319634#comment-14319634
]
Li Bo commented on HDFS-7793:
-
Great! Thanks for helping me and I will go on working on your
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319537#comment-14319537
]
Li Bo commented on HDFS-7729:
-
At first my idea is using a block writer to receive bytes and
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319546#comment-14319546
]
Li Bo commented on HDFS-7729:
-
Thanks [~zhz] , [~drankye], [~jingzhao], [~umamaheswararao]
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7729:
Attachment: HDFS-7729-008.patch
Add logic to DFSOutputStream to support writing a file in striping layout
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318157#comment-14318157
]
Li Bo commented on HDFS-7729:
-
patch 008: use JRSRawEncoder to encode buffers because
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318144#comment-14318144
]
Li Bo commented on HDFS-7729:
-
Sorry for replying late.
1. Give simple handling of slow
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318149#comment-14318149
]
Li Bo commented on HDFS-7729:
-
Thanks for your careful review.
1.the variable
[
https://issues.apache.org/jira/browse/HDFS-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo reassigned HDFS-7781:
---
Assignee: Li Bo
Use block erasure coder in client stripping
---
Li Bo created HDFS-7781:
---
Summary: Use block erasure coder in client stripping
Key: HDFS-7781
URL: https://issues.apache.org/jira/browse/HDFS-7781
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7781:
Fix Version/s: HDFS-EC
Use block erasure coder in client stripping
---
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317494#comment-14317494
]
Li Bo commented on HDFS-7729:
-
Thanks [~zhz] for the more review.
Thanks [~jingzhao] in advance
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7729:
Attachment: HDFS-7729-006.patch
add multiple block group test cases, fix bugs. Now all cases in
Li Bo created HDFS-7783:
---
Summary: Support appending to a striping layout file
Key: HDFS-7783
URL: https://issues.apache.org/jira/browse/HDFS-7783
Project: Hadoop HDFS
Issue Type: Sub-task
Affects
Li Bo created HDFS-7782:
---
Summary: Read a striping layout file from client side
Key: HDFS-7782
URL: https://issues.apache.org/jira/browse/HDFS-7782
Project: Hadoop HDFS
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7729:
Attachment: HDFS-7729-004.patch
Fix a bug when using DFSOutputStream in non-striping layout
Add logic to
Li Bo created HDFS-7762:
---
Summary: Add more unit tests to TestDFSOutputStream
Key: HDFS-7762
URL: https://issues.apache.org/jira/browse/HDFS-7762
Project: Hadoop HDFS
Issue Type: Test
[
https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313655#comment-14313655
]
Li Bo commented on HDFS-7545:
-
Hi, Zhe, I notice you have just submitted a patch of HDFS-7652.
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7729:
Attachment: HDFS-7729-003.patch
Add logic to DFSOutputStream to support writing a file in striping layout
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312114#comment-14312114
]
Li Bo commented on HDFS-7729:
-
Just upload 003 patch.
In order to make the unit tests pass, you
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7729:
Attachment: HDFS-7729-002.patch
Add logic to DFSOutputStream to support writing a file in striping layout
[
https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303119#comment-14303119
]
Li Bo commented on HDFS-7545:
-
Hi, Zhe thanks for your careful review, and I learn a lot about
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303066#comment-14303066
]
Li Bo commented on HDFS-7729:
-
Because HDFS-7417 and HDFS-7418 are still in progress, so I
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7729:
Attachment: HDFS-7729-001.patch
This patch has not considered appending data to an existing striping layout
file. A
[
https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7729:
Attachment: Codec-tmp.patch
Add logic to DFSOutputStream to support writing a file in striping layout
[
https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7545:
Attachment: HDFS-7545-001-DFSOutputStream.patch
Data striping support in HDFS client
[
https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301164#comment-14301164
]
Li Bo commented on HDFS-7545:
-
HDFS-7545-001-DFSOutputStream.patch has not implemented stripe
Li Bo created HDFS-7729:
---
Summary: Add logic to DFSOutputStream to support writing a file in
striping layout
Key: HDFS-7729
URL: https://issues.apache.org/jira/browse/HDFS-7729
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291701#comment-14291701
]
Li Bo commented on HDFS-7678:
-
This code has not synced with Codec and Namenode code, so I use
Li Bo created HDFS-7678:
---
Summary: Block group reader with decode functionality
Key: HDFS-7678
URL: https://issues.apache.org/jira/browse/HDFS-7678
Project: Hadoop HDFS
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7678:
Attachment: BlockGroupReader.patch
Block group reader with decode functionality
Li Bo created HDFS-7679:
---
Summary: EC encode/decode framework
Key: HDFS-7679
URL: https://issues.apache.org/jira/browse/HDFS-7679
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Li Bo
[
https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7679:
Attachment: ECEncodeDecodeFramework.patch
EC encode/decode framework
--
[
https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7679:
Assignee: Li Bo
EC encode/decode framework
--
Key: HDFS-7679
[
https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291712#comment-14291712
]
Li Bo commented on HDFS-7679:
-
The first patch shows the idea of EC encode/decode framework.
[
https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291736#comment-14291736
]
Li Bo commented on HDFS-7545:
-
hi, Zhe
Thanks for your patch. I think writing blocks is more
[
https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7545:
Attachment: clientStriping.patch
Data striping support in HDFS client
[
https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291742#comment-14291742
]
Li Bo commented on HDFS-7545:
-
The patch is based on HDFS-7679 and HDFS-7678. Zhe's patch is
[
https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291744#comment-14291744
]
Li Bo commented on HDFS-7545:
-
DFSStripeInputStream is base on DFSInputStream. If directly
[
https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289262#comment-14289262
]
Li Bo commented on HDFS-7653:
-
Hi, Zhe , thanks for your comments.
1. BlockReader
[
https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289209#comment-14289209
]
Li Bo commented on HDFS-7653:
-
Thanks for your comments.
I think we probably should separate
[
https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7653:
Remaining Estimate: (was: 336h)
Original Estimate: (was: 336h)
Block Readers and Writers used in both
[
https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286851#comment-14286851
]
Li Bo commented on HDFS-7653:
-
This patch includes block readers and writers that will be used
Li Bo created HDFS-7653:
---
Summary: Block Readers and Writers used in both client side and
datanode side
Key: HDFS-7653
URL: https://issues.apache.org/jira/browse/HDFS-7653
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7653:
Attachment: BlockReadersWriters.patch
This patch includes block readers and writers that will be used by client and
[
https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273239#comment-14273239
]
Li Bo commented on HDFS-7344:
-
Thanks Zhe for your comments.
Yes, you're right, we'd better
[
https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270367#comment-14270367
]
Li Bo commented on HDFS-7344:
-
Thanks for your advice. I will use patch files in the following
[
https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14269237#comment-14269237
]
Li Bo commented on HDFS-7344:
-
Attachment is the datanode side code only considering
[
https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7344:
Attachment: hdfs-ec-datanode.0108.zip
add changes of ECWorker.java
Erasure Coding worker and support in DataNode
[
https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HDFS-7344 started by Li Bo.
---
Erasure Coding worker and support in DataNode
-
[
https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HDFS-7344 stopped by Li Bo.
---
Erasure Coding worker and support in DataNode
-
[
https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Bo updated HDFS-7344:
Attachment: HDFS ECWorker Design.pdf
This is the first draft of low level design doc base on HDFS-7285 and we're
301 - 359 of 359 matches
Mail list logo
