Repository: hadoop
Updated Branches:
refs/heads/branch-2 151f6d6dc -> 343effa2c
HADOOP-11988. Fix typo in the document for hadoop fs -find. Contributed by
Kengo Seki.
(cherry picked from commit cab0dadbd878c84e3d94154b4fd1ae3b10f49f93)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/
Repository: hadoop
Updated Branches:
refs/heads/trunk e453989a5 -> cab0dadbd
HADOOP-11988. Fix typo in the document for hadoop fs -find. Contributed by
Kengo Seki.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cab0dad
HDFS-8364. Erasure coding: fix some minor bugs in EC CLI (Contributed by Walter
Su)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/04acb479
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/04acb479
Diff: http://git
HDFS-8372. Erasure coding: compute storage type quotas for striped files, to be
consistent with HDFS-8327. Contributed by Zhe Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cd36107b
Tree: http://git-wip-us.apache.or
HDFS-7348. Erasure Coding: DataNode reconstruct striped blocks. Contributed by
Yi Liu.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ff30164c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ff30164c
Diff: http://
Addendum fix in hdfs-default.xml.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/be0d89cc
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/be0d89cc
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/be0d89cc
HDFS-8355. Erasure Coding: Refactor BlockInfo and BlockInfoUnderConstruction.
Contributed by Tsz Wo Nicholas Sze.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7e957a15
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/
HDFS-7936. Erasure coding: resolving conflicts in the branch when merging trunk
changes (this commit is for HDFS-8327 and HDFS-8357). Contributed by Zhe Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0fcdbabf
Tree:
Merge HDFS-8394 from trunk: Move getAdditionalBlock() and related
functionalities into a separate class.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f3466727
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f346
Revert mistakenly committing of HADOOP-11920 patch
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ecf1f4e8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ecf1f4e8
Diff: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-8368. Erasure Coding: DFS opening a non-existent file need to be handled
properly. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a5749e58
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-8230. Erasure Coding: Ignore DatanodeProtocol#DNA_ERASURE_CODING_RECOVERY
commands from standbynode if any (Contributed by Vinayakumar B)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5aa275c8
Tree: http://git-wip-us
HDFS-8363. Erasure Coding: DFSStripedInputStream#seekToNewSource. (yliu)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b5730d01
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b5730d01
Diff: http://git-wip-us.apac
HDFS-8136. Client gets and uses EC schema when reads and writes a stripping
file. Contributed by Kai Sasaki
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/11a17e66
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1
HDFS-7678. Erasure coding: DFSInputStream with decode functionality (pread).
Contributed by Zhe Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c25537b0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c25537
HDFS-8334. Erasure coding: rename DFSStripedInputStream related test classes.
Contributed by Zhe Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f91394f6
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f9139
HDFS-8156. Add/implement necessary APIs even we just have the system default
schema. Contributed by Kai Zheng.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d24efdf7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tre
HDFS-8212. DistributedFileSystem.createErasureCodingZone should pass schema in
FileSystemLinkResolver. Contributed by Tsz Wo Nicholas Sze.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e58d4cb2
Tree: http://git-wip-us.apa
HDFS-8188. Erasure coding: refactor client-related code to sync with HDFS-8082
and HDFS-8169. Contributed by Zhe Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5b5d1c9a
Tree: http://git-wip-us.apache.org/repos/asf/h
HDFS-8183. Erasure Coding: Improve DFSStripedOutputStream closing of
datastreamer threads. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/375721c8
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-8195. Erasure coding: Fix file quota change when we complete/commit the
striped blocks. Contributed by Takuya Fukudome.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0f2be3d5
Tree: http://git-wip-us.apache.org/repos/
HDFS-8235. Erasure Coding: Create DFSStripedInputStream in DFSClient#open.
Contributed by Kai Sasaki.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f0d05348
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f0d0534
HADOOP-11566 Add tests and fix for erasure coders to recover erased parity
units. Contributed by Kai Zheng
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/091de4b7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/09
HDFS-8272. Erasure Coding: simplify the retry logic in DFSStripedInputStream
(stateful read). Contributed by Jing Zhao
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/da2a33f0
Tree: http://git-wip-us.apache.org/repos/asf/ha
HDFS-8033. Erasure coding: stateful (non-positional) read from files in striped
layout. Contributed by Zhe Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d8417a50
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/
HDFS-7672. Handle write failure for stripping blocks and refactor the existing
code in DFSStripedOutputStream and StripedDataStreamer.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/af74bae8
Tree: http://git-wip-us.apache.
HDFS-8223. Should calculate checksum for parity blocks in
DFSStripedOutputStream. Contributed by Yi Liu.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c9627f86
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c962
HDFS-8281. Erasure Coding: implement parallel stateful reading for striped
layout. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/67a22d24
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/
HDFS-8316. Erasure coding: refactor EC constants to be consistent with
HDFS-8249. Contributed by Zhe Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4bae0b1f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4
HDFS-8203. Erasure Coding: Seek and other Ops in DFSStripedInputStream.
Contributed by Yi Liu.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6f6ac390
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6f6ac390
Diff:
HDFS-8129. Erasure Coding: Maintain consistent naming for Erasure Coding
related classes - EC/ErasureCoding. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fa283446
Tree: http://git-wip-u
HDFS-8289. Erasure Coding: add ECSchema to HdfsFileStatus. Contributed by Yong
Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ce1905f0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ce1905f0
Diff: http://g
HDFS-8391. NN should consider current EC tasks handling count from DN while
assigning new tasks. Contributed by Uma Maheswara Rao G.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9c6364b4
Tree: http://git-wip-us.apache.or
HDFS-8024. Erasure Coding: ECworker frame, basics, bootstraping and
configuration. (Contributed by Uma Maheswara Rao G)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fbbfc564
Tree: http://git-wip-us.apache.org/repos/asf/h
HADOOP-11921. Enhance tests for erasure coders. Contributed by Kai Zheng
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/be86bf5f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/be86bf5f
Diff: http://git-wip-us.apac
HDFS-8190. StripedBlockUtil.getInternalBlockLength may have overflow error.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4ec2620f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4ec2620f
Diff: http://git-wip-us.a
HDFS-8282. Erasure coding: move striped reading logic to StripedBlockUtil.
Contributed by Zhe Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3e6161f0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3e6161f0
Repository: hadoop
Updated Branches:
refs/heads/HDFS-7285 0180ef08a -> f34667274 (forced update)
HDFS-8181. createErasureCodingZone sets retryCache state as false always
(Contributed by Uma Maheswara Rao G)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us
HDFS-8324. Add trace info to DFSClient#getErasureCodingZoneInfo(..).
Contributed by Vinayakumar B
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5e77bce4
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/5e77bce4
Di
Fix merge conflicts.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/27b23463
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/27b23463
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/27b23463
Branch: refs/
HADOOP-11938 Enhance ByteBuffer version encode/decode API of raw erasure coder.
Contributed by Kai Zheng
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/10a74829
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/10a7
HADOOP-11921. Enhance tests for erasure coders. Contributed by Kai Zheng
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9929c01b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9929c01b
Diff: http://git-wip-us.apac
HDFS-8233. Fix DFSStripedOutputStream#getCurrentBlockGroupBytes when the last
stripe is at the block group boundary. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/34f831e2
Tree: http://git-wip-us
HADOOP-11920. Refactor some codes for erasure coders. Contributed by Kai Zheng
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dd2144cb
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/dd2144cb
Diff: http://git-wip-u
HDFS-8308. Erasure Coding: NameNode may get blocked in waitForLoadingFSImage()
when loading editlog. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/aa49156a
Tree: http://git-wip-us.apache.org/repo
HDFS-8146. Protobuf changes for BlockECRecoveryCommand and its fields for
making it ready for transfer to DN (Contributed by Uma Maheswara Rao G)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dc40603b
Tree: http://git-wip
HDFS-8228. Erasure Coding: SequentialBlockGroupIdGenerator#nextValue may cause
block id conflicts. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f5c6ec66
Tree: http://git-wip-us.apache.org/repos/
HDFS-8189. ClientProtocol#createErasureCodingZone API was wrongly annotated as
Idempotent (Contributed by Vinayakumar B)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ebcc7884
Tree: http://git-wip-us.apache.org/repos/asf/
HDFS-8137. Send the EC schema to DataNode via EC encoding/recovering command.
Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0c8de162
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-8216. TestDFSStripedOutputStream should use BlockReaderTestUtil to create
BlockReader. Contributed by Tsz Wo Nicholas Sze.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c2d68afb
Tree: http://git-wip-us.apache.org/rep
HDFS-7949. WebImageViewer need support file size calculation with striped
blocks. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9581e9c0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/95
HDFS-8242. Erasure Coding: XML based end-to-end test for ECCli commands
(Contributed by Rakesh R)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9004be1a
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9004be1a
Di
Repository: hadoop
Updated Branches:
refs/heads/branch-2 802676e1b -> 151f6d6dc
refs/heads/trunk b0ad64408 -> e453989a5
HDFS-8157. Writes to RAM DISK reserve locked memory for block files. (Arpit
Agarwal)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us
HDFS-8157. Writes to RAM DISK reserve locked memory for block files. (Arpit
Agarwal)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/151f6d6d
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/151f6d6d
Diff: http://gi
54 matches
Mail list logo