For more details, see https://builds.apache.org/job/hadoop-trunk-win/450/
[Apr 25, 2018 10:50:52 PM] (omalley) HDFS-8456. Introduce
STORAGE_CONTAINER_SERVICE as a new NodeType.
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8614. OzoneHandler : Add Quota
Support. (Contributed by Anu
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8448. Create REST Interface for
Volumes. Contributed by Anu
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8637. OzoneHandler : Add Error Table.
(Contributed by Anu Engineer)
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8634. OzoneHandler: Add userAuth
Interface and Simple userAuth
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8644. OzoneHandler : Add volume
handler. (Contributed by Anu
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8654. OzoneHandler : Add ACL support.
(Contributed by Anu Engineer)
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8680. OzoneHandler : Add Local
StorageHandler support for volumes.
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8717. OzoneHandler : Add common
bucket objects. (Contributed by Anu
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8753. Ozone: Unify
StorageContainerConfiguration with
[Apr 25, 2018 10:51:00 PM] (omalley) HDFS-8695. OzoneHandler : Add Bucket REST
Interface. (aengineer)
[Apr 25, 2018 10:51:36 PM] (omalley) HDFS-8527. OzoneHandler: Integration of
REST interface and container
[Apr 25, 2018 10:51:39 PM] (omalley) HDFS-8757 : OzoneHandler : Add
localStorageHandler support for Buckets.
[Apr 25, 2018 10:51:39 PM] (omalley) HDFS-9834. OzoneHandler : Enable
MiniDFSCluster based testing for Ozone.
[Apr 25, 2018 10:51:39 PM] (omalley) HDFS-9845. OzoneHandler : Support List and
Info Volumes. Contributed by
[Apr 25, 2018 10:51:51 PM] (omalley) HDFS-9853. Ozone: Add container
definitions. Contributed by Anu
[Apr 25, 2018 10:51:53 PM] (omalley) HDFS-9848. Ozone: Add Ozone Client lib for
volume handling. Contributed
[Apr 25, 2018 10:51:53 PM] (omalley) HDFS-9907. Exclude Ozone
protobuf-generated classes from Findbugs
[Apr 25, 2018 10:51:53 PM] (omalley) HDFS-9873. Ozone: Add container transport
server. Contributed by Anu
[Apr 25, 2018 10:51:58 PM] (omalley) HDFS-9891. Ozone: Add container transport
client. Contributed by Anu
[Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9920. Stop tracking CHANGES.txt in
the HDFS-7240 feature branch.
[Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9916. OzoneHandler : Add Key handler.
Contributed by Anu Engineer.
[Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9916. OzoneHandler : Add Key handler.
Contributed by Anu Engineer.
[Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9925. Ozone: Add Ozone Client lib for
bucket handling. Contributed
[Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9926. ozone : Add volume commands to
CLI. Contributed by Anu
[Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9944. Ozone : Add container
dispatcher. Contributed by Anu
[Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9961. Ozone: Add buckets commands to
CLI. Contributed by Anu
[Apr 25, 2018 10:52:00 PM] (omalley) HDFS-10180. Ozone: Refactor container
Namespace. Contributed by Anu
[Apr 25, 2018 10:52:00 PM] (omalley) HDFS-9960. OzoneHandler : Add localstorage
support for keys. Contributed
[Apr 25, 2018 10:52:07 PM] (omalley) HDFS-10179. Ozone: Adding logging support.
Contributed by Anu Engineer.
[Apr 25, 2018 10:52:09 PM] (omalley) HDFS-10196. Ozone : Enable better error
reporting for failed commands in
[Apr 25, 2018 10:52:25 PM] (omalley) HDFS-10202. ozone : Add key commands to
CLI. Contributed by Anu
[Apr 25, 2018 10:52:33 PM] (omalley) HDFS-10195. Ozone: Add container
persistence. Contributed by Anu
[Apr 25, 2018 10:52:46 PM] (omalley) HDFS-8210. Ozone: Implement storage
container manager. Contributed by
[Apr 25, 2018 10:52:48 PM] (omalley) HDFS-10238. Ozone : Add chunk persistance.
Contributed by Anu Engineer.
[Apr 25, 2018 10:52:48 PM] (omalley) HDFS-10250. Ozone: Add key Persistence.
Contributed by Anu Engineer.
[Apr 25, 2018 10:52:56 PM] (omalley) HDFS-10268. Ozone: end-to-end integration
for create/get volumes,
[Apr 25, 2018 10:52:58 PM] (omalley) HDFS-10251. Ozone: Shutdown cleanly.
Contributed by Anu Engineer
[Apr 25, 2018 10:52:58 PM] (omalley) HDFS-10278. Ozone: Add paging support to
list Volumes. Contributed by
[Apr 25, 2018 10:53:05 PM] (omalley) HDFS-10232. Ozone: Make config key naming
consistent. Contributed by Anu
[Apr 25, 2018 10:53:07 PM] (omalley) HDFS-10349. Ozone: StorageContainerManager
fails to compile after merge
[Apr 25, 2018 10:53:07 PM] (omalley) HDFS-10351. Ozone: Optimize key writes to
chunks by providing a bulk
[Apr 25, 2018 10:53:12 PM] (omalley) HDFS-10361. Support starting
StorageContainerManager as a daemon.
[Apr 25, 2018 10:53:19 PM] (omalley) HDFS-10363. Ozone: Introduce new config
keys for SCM service endpoints.
[Apr 25, 2018 10:53:21 PM] (omalley) HDFS-10420. Fix Ozone unit tests to use
MiniOzoneCluster. Contributed by
[Apr 25, 2018 10:53:21 PM] (omalley) HDFS-10897. Ozone: SCM: Add NodeManager.
Contributed by Anu Engineer.
[Apr 25, 2018 10:53:21 PM] (omalley) HDFS-10932. Ozone: fix XceiverClient slow
shutdown. Contributed by Chen
[Apr 25, 2018 10:53:25 PM] (omalley) HDFS-10995. Ozone: Move ozone
XceiverClient to hdfs-client. Contributed
[Apr 25, 2018 10:53:27 PM] (omalley) Fixing merge conflicts due to HDFS-10637
[Apr 25, 2018 10:53:27 PM] (omalley) HDFS-10912. Ozone:SCM: Add chill mode
support to NodeManager.
[Apr 25, 2018 10:53:27 PM] (omalley) HDFS-11004. Ozone : move Chunk IO and
container protocol calls to
[Apr 25, 2018 10:53:32 PM] (omalley) HDFS-10938. Ozone:SCM: Add datanode
protocol. Contributed by Anu
[Apr 25, 2018 10:53:34 PM] (omalley) fix a build break due to merge
[Apr 25, 2018 10:53:34 PM] (omalley) HDFS-11001. Ozone:SCM: Add support for
registerNode in SCM. Contributed
[Apr 25, 2018 10:53:39 PM] (omalley) HDFS-11103. Ozone: Cleanup some
dependencies. Contributed by Anu
[Apr 25, 2018 10:53:43 PM] (omalley) HDFS-11127. Block Storage : add block
storage service protocol.
[Apr 25, 2018 10:53:49 PM] (omalley) HDFS-11130. Block Storage : Add storage
client to server protocol.
[Apr 25, 2018 10:53:50 PM] (omalley) HDFS-11081. Ozone:SCM: Add support for
registerNode in datanode.
[Apr 25, 2018 10:53:56 PM] (omalley) HDFS-11108. Ozone: use containers with the
state machine. Contributed by
[Apr 25, 2018 10:53:58 PM] (omalley) HDFS-11126. Ozone: Add small file support
RPC. Contributed by Anu
[Apr 25, 2018 10:53:58 PM] (omalley) HDFS-11133. Ozone: Add allocateContainer
RPC. Contributed by Anu
[Apr 25, 2018 10:53:58 PM] (omalley) HDFS-11138. Block Storage: add block
storage server. Contributed by Chen
[Apr 25, 2018 10:53:58 PM] (omalley) HDFS-11154. Block Storage: store server
state to persistent storage.
[Apr 25, 2018 10:54:03 PM] (omalley) HDFS-11463. Ozone: Add metrics for
container operations and export over
[Apr 25, 2018 10:54:26 PM] (omalley) HDFS-11184. Ozone: SCM: Make SCM use
container protocol. Contributed by
[Apr 25, 2018 10:54:34 PM] (omalley) HDFS-11414. Ozone : move
StorageContainerLocation protocol to
[Apr 25, 2018 10:54:36 PM] (omalley) HDFS-11036. Ozone: reuse Xceiver
connection. Contributed by Chen Liang.
[Apr 25, 2018 10:54:36 PM] (omalley) HDFS-11473. Ozone : exclude cblock
protobuf files from findbugs check.
[Apr 25, 2018 10:54:36 PM] (omalley) HDFS-11474. Ozone: TestContainerMapping
needs to cleanup levelDB
[Apr 25, 2018 10:54:41 PM] (omalley) HDFS-11447. Ozone: SCM: Send node report
to SCM with
[Apr 25, 2018 10:54:42 PM] (omalley) HDFS-11425. Ozone: add client-facing
container APIs and container
[Apr 25, 2018 10:54:42 PM] (omalley) HDFS-11480. Ozone: TestEndpoint task
failure. Contributed by Xiaoyu Yao.
[Apr 25, 2018 10:54:42 PM] (omalley) HDFS-11484. Ozone: Fix flaky
TestNodeManager#testScmNodeReportUpdate.
[Apr 25, 2018 10:54:42 PM] (omalley) HDFS-11137. Ozone: SCM: Add negative tests
cases for
[Apr 25, 2018 10:54:56 PM] (omalley) HDFS-11158. Ozone:
TestDatanodeStateMachine is failing intermittently.
[Apr 25, 2018 10:54:56 PM] (omalley) HDFS-11451. Ozone: Add protobuf
definitions for container reports.
[Apr 25, 2018 10:54:56 PM] (omalley) HDFS-11424. Block Storage: add container
representation to meta data.
[Apr 25, 2018 10:54:56 PM] (omalley) HDFS-11509. Ozone: Fix TestEndpoint test
regression. Contributed by Anu
[Apr 25, 2018 10:55:06 PM] (omalley) HDFS-11196. Ozone: Improve logging and
error handling in the container
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-10928. Ozone:SCM: Support MXBean for
SCM and NodeManager.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11513. Ozone: Separate XceiverServer
and XceiverClient into
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11071. Ozone: SCM: Move SCM config
keys to ScmConfig. Contributed
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11469. Ozone: SCM: Container
allocation based on node report.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11491. Ozone: SCM: Add close
container RPC. Contributed by Anu
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11444. Ozone: Fix datanode ID
handling in MiniOzoneCluster.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11492. Ozone: Add the ability to
handle sendContainerReport
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11162. Block Storage: add command
line tool. Contributed by Chen
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11559. Ozone: MiniOzoneCluster prints
too many log messages by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11361. Block Storage: add cache
interface. Contributed by Chen
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11550. Ozone: Add a check to prevent
removing a container that has
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11355. Block Storage : Merge
configuration into ozone configuration
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11548. Ozone: SCM: Add node pool
management API. Contributed by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11537. Block Storage : add cache
layer. Contributed by Chen Liang.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11567. Ozone: SCM: Support update
container. Contributed by Weiwei
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11594. Ozone: close container should
call compactDB. Contributed by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11591. Block Storage: fix
TestCBlockServer test cleanup.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11519. Ozone: Implement
XceiverServerSpi and XceiverClientSpi using
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11564. Ozone: SCM: Add Comparable
Metric Support. Contributed by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11566. Ozone: Document missing
metrics for container operations.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11619. Ozone: Unit tests running
failed in Windows. Contributed by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11620. Ozone: Allocate container for
MiniOzone cluster fails
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11625. Ozone: Fix UT failures that
caused by hard coded datanode
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11006. Ozone: support setting chunk
size in streaming API.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11618. Block Storage: Add Support for
Direct I/O. Contributed by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11062. Ozone:SCM: Remove null
command. Contributed by Yuanbo Liu.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11635. Block Storage: Add metrics for
Container Flushes.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11642. Block Storage: fix
TestCBlockCLI and
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11569. Ozone: Implement listKey
function for KeyManager.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11582. Block Storage : add SCSI
target access daemon. Contributed
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11657. Ozone: Add unit test for
storage container metrics.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11631. Block Storage : allow cblock
server to be started from hdfs
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11581. Ozone: Support force delete a
container. Contributed by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11649. Ozone: SCM: CLI: Add shell
code placeholder classes.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11504. Ozone: SCM: Add Block APIs.
Contributed by Xiaoyu Yao.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11666. Ozone: Fix compile error due
to inconsistent package name.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11668. Ozone: misc improvements for
SCM CLI. Contributed by Weiwei
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11667. Block Storage:Handling
flushing of incomplete block id
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11627. Block Storage: Cblock cache
should register with flusher to
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11675. Ozone: SCM CLI: Implement
delete container command.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11728. Ozone: add the DB names to
OzoneConsts. Contributed by Chen
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11725. Ozone: Revise create container
CLI specification and
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11747. Ozone : need to fix
OZONE_SCM_DEFAULT_PORT. Contributed by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11712. Ozone: Reuse ObjectMapper
instance to improve the
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11698. Ozone: SCM: CLI: Add Debug
command. Contributed by Chen
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11759. Ozone : SCMNodeManager#close()
should also close node pool
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11761. Ozone: Get container report
should only report closed
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11716. Ozone: SCM: CLI: Revisit
delete container API. Contributed
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11756. Ozone : add DEBUG CLI support
of blockDB file. Contributed
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11680. Ozone: SCM CLI: Implement info
container command.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11783. Ozone: Fix spotbugs warnings.
Contributed by Weiwei Yang.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11798. Ozone: Correct description for
ozone.handler.type in
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11788. Ozone : add DEBUG CLI support
for nodepool db file.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11768. Ozone: KSM: Create Key Space
manager service. Contributed by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11802. Ozone : add DEBUG CLI support
for open container db file.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11811. Ozone: SCM: Support Delete
Block. Contributed by Xiaoyu Yao.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11805. Ensure LevelDB DBIterator is
closed. Contributed by Chen
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11815. CBlockManager#main should
join() after start() service.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11694. Block Storage: Add Support for
2 BlockIDBuffers and also for
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11650. Ozone: fix the consistently
timeout test
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11693. Ozone:Add archive support to
containers. Contributed by Anu
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11769. Ozone: KSM: Add createVolume
API. Contributed by Mukul Kumar
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11831. Ozone: Improve the way of
getting test file path in unit
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11824. Ozone: Fix javac warnings.
Contributed by Yiqun Lin.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11775. Ozone: KSM: add createBucket.
Contributed by Nandakumar
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11835. Block Storage: Overwrite of
blocks fails. Contributed by
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11843. Ozone: XceiverClientRatis
should implement
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11830. Ozone: Datanode needs to
re-register to SCM if SCM is
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11850. Ozone: Stack Overflow in
XceiverClientManager because of
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11860. Ozone: SCM:
SCMContainerPlacementCapacity#chooseNode
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11770. Ozone: KSM: Add
setVolumeProperty. Contributed by Mukul
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11727. Block Storage: Retry Blocks
should be requeued when cblock
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11859. Ozone: SCM: Separate
BlockLocationProtocol from
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11778. Ozone: KSM: add getBucketInfo.
Contributed by Nandakumar
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11846. Ozone: Fix Http connection
leaks in ozone clients.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11780. Ozone: KSM: Add putKey.
Contributed by Chen Liang.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11865. Ozone: Do not initialize Ratis
cluster during datanode
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11655. Ozone: CLI: Guarantees user
runs SCM commands has
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11853. Ozone: KSM: Add getKey.
Contributed by Chen Liang.
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11776. Ozone: KSM: add
SetBucketProperty. Contributed by Nandakumar
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11774. Ozone: KSM: add deleteVolume.
Contributed by Mukul Kumar
[Apr 26, 2018 12:34:18 PM] (omalley) HDFS-11903. Ozone: Cleaning up local
storage when closing
[Apr 26, 2018 12:35:59 PM] (omalley) HDFS-11894. Ozone: Cleanup imports.
Contributed by Weiwei Yang.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11597. Ozone: Add Ratis management
API. Contributed by Tsz Wo
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11913. Ozone:
TestKeySpaceManager#testDeleteVolume fails.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11796. Ozone: MiniOzoneCluster should
set "ozone.handler.type" key
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11771. Ozone: KSM: Add
checkVolumeAccess. Contributed by Mukul
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11781. Ozone: KSM: Add deleteKey.
Contributed by Yuanbo Liu.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11822. Block Storage: Fix
TestCBlockCLI, failing because of "
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11919. Ozone: SCM: TestNodeManager
takes too long to execute.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11887. Shared XceiverClient should be
closed if there is no open
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11568. Ozone: Create metadata path
automatically after null
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11926. Ozone: Implement a common
helper to return a range of KVs in
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11777. Ozone: KSM: add deleteBucket.
Contributed by Nandakumar
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11880. Ozone: KSM: Remove protobuf
formats from KSM wrappers.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11779. Ozone: KSM: add listBuckets.
Contributed by Weiwei Yang.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11952. Ozone: Fix
TestContainerSQLCli#testConvertContainerDB.
[Apr 26, 2018 12:36:04 PM] (omalley) HADOOP-14400. Fix warnings from spotbugs
in hadoop-tools. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11866. JournalNode Sync should be off
by default in
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11794. Add ec sub command -listCodec
to show currently supported ec
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11659.
TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11953. Remove Guava v21 usage from
HDFS-7240. Contributed by Xiaoyu
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11185. Ozone: remove disabled tests.
Contributed by Anu Engineer.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11958. Ozone: Ensure KSM is initiated
using ProtobufRpcEngine.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11845. Ozone: Output error when DN
handshakes with SCM. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11946. Ozone: Containers in different
datanodes are mapped to the
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11969. Block Storage: Convert
unnecessary info log levels to debug.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11977. Ozone: cannot enable test
debug/trace log. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11961. Ozone: Add start-ozone.sh to
quickly start ozone.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11962. Ozone: Add stop-ozone.sh
script. Contributed by Weiwei Yang.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11979. Ozone:
TestContainerPersistence never uses MiniOzoneCluster.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11782. Ozone: KSM: Add listKey.
Contributed by Yiqun Lin.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11963. Ozone: Documentation: Add
getting started page. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11585. Ozone: Support force update a
container. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11983. Ozone: Add documentation for
metrics in KSMMetrics to
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11963. Ozone: Documentation: Add
getting started page (addendum).
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11970. Ozone:
TestXceiverClientManager.testFreeByEviction fails
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11990. Ozone: Add all configurable
entries into ozone-default.xml.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12016. Ozone: SCM: Container metadata
are not loaded properly after
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12007. Ozone: Enable HttpServer2 for
SCM and KSM. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12018. Ozone: Misc: Add CBlocks
defaults to ozone-defaults.xml.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12031. Ozone: Rename OzoneClient to
OzoneRestClient. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12050. Ozone: StorageHandler:
Implementation of close for releasing
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12063. Ozone: Ozone shell: Multiple
RPC calls for put/get key.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11773. Ozone: KSM : add listVolumes.
Contributed by Weiwei Yang.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11955. Ozone: Set proper parameter
default values for listBuckets
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12002. Ozone : SCM cli misc
fixes/improvements. Contributed by Chen
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12030. Ozone: CLI: support infoKey
command. Contributed by Yiqun
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12047. Ozone: Add REST API
documentation. Contributed by Weiwei
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12023. Ozone: Test if all the
configuration keys are documented in
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12048. Ozone:TestOzoneContainerRatis
& TestRatisManager are failing
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12035. Ozone: listKey doesn't work
from ozone commandline.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12053. Ozone: ozone server should
create missing metadata directory
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12081. Ozone: Add infoKey REST API
document. Contributed by Weiwei
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12086. Ozone: Add the unit test for
KSMMetrics. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12076. Ozone: Review all cases where
we are returning
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12057. Ozone: OzoneClient:
Implementation of OzoneClient.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12080. Ozone: Fix UT failure in
TestOzoneConfigurationFields.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11679. Ozone: SCM CLI: Implement list
container command.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12037. Ozone: Improvement rest API
output format for better
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12105. Ozone: listVolumes doesn't
work from ozone commandline.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12129. Ozone: SCM http server is not
stopped with SCM#stop().
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12083. Ozone: KSM: previous key has
to be excluded from result in
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11493. Ozone: SCM: Add the ability to
handle container reports.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12123. Ozone: OzoneClient:
Abstraction of OzoneClient and default
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11989. Ozone: add TestKeysRatis,
TestBucketsRatis and
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12069. Ozone: Create a general
abstraction for metadata store.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12148. Ozone:
TestOzoneConfigurationFields is failing because
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12118. Ozone: Ozone shell: Add more
testing for volume shell
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12058. Ozone: OzoneClient:
OzoneClientImpl add getDetails calls.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11996. Ozone : add an UT to test
partial read of chunks.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12126. Ozone: Ozone shell: Add more
testing for bucket shell
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12071. Ozone: Corona: Implementation
of Corona. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12149. Ozone: RocksDB implementation
of ozone metadata store.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11936. Ozone: TestNodeManager times
out before it is able to find
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12127. Ozone: Ozone shell: Add more
testing for key shell commands.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12185. Ozone: Fix Leaking in
TestXceiverClientManager. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12181. Ozone: Fix
TestContainerReplicationManager by setting proper
[Apr 26, 2018 12:36:04 PM] (omalley) Revert "HDFS-12185. Ozone: Fix Leaking in
TestXceiverClientManager.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12175. Ozone: Fix Leaking in
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12185. Ozone: Fix Leaking in
TestXceiverClientManager. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12167. Ozone: Intermittent failure
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12187. Ozone : add support to DEBUG
CLI for ksm.db. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12115. Ozone: SCM: Add queryNode RPC
Call. Contributed by Anu
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12155. Ozone : add RocksDB support to
DEBUG CLI. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12192. Ozone: Fix the remaining
failure tests for Windows caused by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12170. Ozone: OzoneFileSystem: KSM
should maintain key creation
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12145. Ozone: OzoneFileSystem: Ozone
& KSM should support /
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12180. Ozone: Corona: Add stats and
progress bar to corona.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12059. Ozone: OzoneClient:
OzoneClientImpl Add setBucketProperty
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12183. Ozone: KSM : Use proper
defaults for block client address.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12195. Ozone: DeleteKey-1: KSM
replies delete key request
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11920. Ozone : add key partition.
Contributed by Chen Liang.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12034. Ozone: Web interface for KSM.
Contributed by Elek, Marton.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11984. Ozone: Ensures listKey lists
all required key fields.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11580. Ozone: Support asynchronus
client API for SCM and
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12247. Ozone: KeySpaceManager should
unregister KSMMetrics upon
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12178. Ozone: OzoneClient: Handling
SCM container creationFlag at
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11935. Ozone:
TestStorageContainerManager#testRpcPermission fails
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12246. Ozone: potential thread leaks.
Contributed by Weiwei Yang.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12163. Ozone: Reduce MiniOzoneCluster
handler thread count.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12231. Ozone: KSM: Add creation time
field in volume info.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12262. Ozone: KSM: Reduce default
handler thread count from 200.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12267. Ozone: XceiverClientManager
should not close the connection
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12259. Ozone: OzoneClient: Refactor
move ozone client from
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12274. Ozone: Corona: move corona
from test to tools package.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12196. Ozone: DeleteKey-2: Implement
block deleting service to
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12281. Ozone: Ozone-default.xml has 3
properties that do not match
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12005. Ozone: Web interface for SCM.
Contributed by Elek, Marton.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12230. Ozone: KSM: Add creation time
field in bucket info.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12298. Ozone: Block deletion service
floods the log when deleting
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12255. Block Storage: Cblock should
generated unique trace ID for
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12290. Block Storage: Change
dfs.cblock.jscsi.server.address
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12238. Ozone: Add valid trace ID
check in sendCommandAsync.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12305. Ozone: SCM: Add StateMachine
for pipeline/container.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12313. Ozone: SCM: move
container/pipeline StateMachine to the
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12159. Ozone: SCM: Add create
replication pipeline RPC. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12216. Ozone: TestKeys is failing
consistently. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12327. Ozone: support setting timeout
in background service.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12337. Ozone: Concurrent RocksDB open
calls fail because of "No
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11888. Ozone: SCM: use state machine
for open containers allocated
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12324. Ozone:
TestQueryNode#testStaleNodesCount is failing.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12283. Ozone: DeleteKey-5: Implement
SCM DeletedBlockLog.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12280. Ozone:
TestOzoneContainer#testCreateOzoneContainer fails.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12341. Ozone: maven dist compilation
fails with "Duplicate classes
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12275. Ozone: Corona: Support for
random validation of writes.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12282. Ozone: DeleteKey-4: Block
delete via HB between SCM and DN.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12365. Ozone: ListVolume displays
incorrect createdOn time when the
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12354. Ozone: Shuffle container list
for datanode
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12366. Ozone: Refactor KSM metadata
class names to avoid confusion.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12333. Ozone: Extend Datanode web
interface with SCM information.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11834. Ozone: Fix
TestArchive#testArchive. Contributed by Xiaoyu
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12382. Ozone: SCM: BlockManager
creates a new container for each
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12391. Ozone: TestKSMSQLCli is not
working as expected. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HADOOP-12077. Provide a multi-URI
replication Inode for ViewFs.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12199. Ozone: OzoneFileSystem:
OzoneFileystem initialization code.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12397. Ozone: KSM: multiple delete
methods in KSMMetadataManager.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12235. Ozone: DeleteKey-3: KSM SCM
block deletion message and ACK
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12370. Ozone: Implement TopN
container choosing policy for
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12389. Ozone: oz commandline list
calls should return valid JSON
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11676. Ozone: SCM CLI: Implement
close container command.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12423. Ozone: TopN container choosing
policy should ignore
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12019. Ozone: Misc : Make sure that
ozone-site.xml is in etc/hadoop
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12268. Ozone: Add metrics for pending
storage container requests.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12426. Ozone: BlockManager MBean
unregister failure upon shutdown.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12468. Ozone: fix hard coded version
in the Ozone GettingStarted
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12465. Ozone: fix a KeySpaceManager
startup message typo.
[Apr 26, 2018 12:36:04 PM] (omalley) Revert "HDFS-12268. Ozone: Add metrics for
pending storage container
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11612. Ozone: Cleanup Checkstyle
issues. Contributed by Shashikant
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11873. Ozone: Object store handler
supports reusing http client for
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12481. Ozone: Corona: Support for
variable key length in offline
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12385. Ozone: OzoneClient:
Refactoring OzoneClient API. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12256. Ozone : handle inactive
containers on DataNode. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12329. Ozone: Ratis: Readonly calls
in XceiverClientRatis should
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12489. Ozone:
OzoneRestClientException swallows exceptions which
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12466. Ozone: KSM: Make
ozone.ksm.address as mandatory property for
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12515. Ozone: mvn package compilation
fails on HDFS-7240.
[Apr 26, 2018 12:36:04 PM] (omalley) Revert "HDFS-12515. Ozone: mvn package
compilation fails on HDFS-7240.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12517. Ozone: mvn package is failing
with out skipshade.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11897. Ozone: KSM: Changing log level
for client calls in KSM.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12477. Ozone: Some minor text
improvement in SCM web UI.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12503. Ozone: some UX improvements to
oz_debug. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11563. Ozone: enforce
DependencyConvergence uniqueVersions.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12506. Ozone: ListBucket is too slow.
Contributed by Weiwei Yang.
[Apr 26, 2018 12:36:04 PM] (omalley) Block Storage: volume creation times out
while creating 3TB volume
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12205. Ozone: List Key on an empty
ozone bucket fails with command
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12524. Ozone: Record number of keys
scanned and hinted for
[Apr 26, 2018 12:36:04 PM] (omalley) Revert "Block Storage: volume creation
times out while creating 3TB
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12210. Block Storage: volume creation
times out while creating 3TB
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11614. Ozone: Cleanup javadoc issues.
Contributed by Mukul Kumar
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12017. Ozone: Container: Move IPC
port to 98xx range. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12454. Ozone : the sample
ozone-site.xml in OzoneGettingStarted
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12425. Ozone: OzoneFileSystem:
read/write/create/open/getFileInfo
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12525. Ozone: OzoneClient: Verify
bucket/volume name in create
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12501. Ozone: Cleanup javac issues.
Contributed by Yiqun Lin.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12469. Ozone: Create docker-compose
definition to easily test real
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12268. Ozone: Add metrics for pending
storage container requests.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12554. Ozone: Fix
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12540. Ozone: node status text
reported by SCM is a bit confusing.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12488. Ozone: OzoneRestClient timeout
is not configurable.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12511. Ozone: Add tags to config.
Contributed by Ajay Kumar.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12563. Ozone: Creation time wrongly
showed in OzoneRest.md.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12562. Ozone: Add ASF license to
docker files. Contributed by Mukul
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12551. Ozone: Documentation: Add
Ozone overview documentation.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12060. Ozone: OzoneClient: Add list
calls in RpcClient. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12568. Ozone: Cleanup the
ozone-default.xml. Contributed by Anu
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12471. Ozone: Reduce some KSM/SCM
deletion log messages from INFO
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12467. Ozone: SCM: NodeManager should
log when it comes out of
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12539. Ozone: refactor some functions
in KSMMetadataManagerImpl to
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12513. Ozone: Create UI page to show
Ozone configs by tag.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12387. Ozone: Support Ratis as a
first class replication mechanism.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12557. Ozone: Improve the formatting
of the RPC stats on web UI.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12602. Add Ozone config UI to KSM and
SCM index page. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12543. Ozone : allow create key
without specifying size.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12610. Ozone: OzoneClient: RpcClient
list calls throw NPE when
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12537. Ozone: Reduce key creation
overhead in Corona. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12598. Ozone: Fix 3 node ratis
replication in Ozone. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12609. Ozone: SCM: Refactoring of
chill mode logic in NodeManager.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12611. Ozone: SCM Cli: Use the
hostname of SCM server instead of
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12546. Ozone: DB listing operation
performance improvement.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12572. Ozone: OzoneFileSystem:
delete/list status/rename/mkdir
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12583. Ozone: Fix swallow exceptions
which makes hard to debug
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12631. Ozone:
ContainerStorageLocation#scmUsage should count only
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12593. Ozone: update Ratis to the
latest snapshot. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12608. Ozone: Remove Warnings when
building. Contributed by Bharat
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12475. Ozone: add documentation about
Datanode http address.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12519. Ozone: Lease Manager
framework. Contributed by Nandakumar.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12490. Ozone: OzoneClient: Add
creation/modification time
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12632. Ozone: OzoneFileSystem: Add
contract tests to
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12415. Ozone:
TestXceiverClientManager and TestAllocateContainer
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12411. Ozone: Add container usage
information to DN container
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12661. Ozone: Support optional
documentation link in KSM/SCM webui.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12585. Ozone: KSM UI: Add description
for configs in UI.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12656. Ozone: dozone: Use (proposed)
base image from HADOOP-14898.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12673. Ozone: Log elapsed time for
block deletion tasks.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12675. Ozone:
TestLeaseManager#testLeaseCallbackWithMultipleLeases
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12684. Ozone: SCMMXBean NodeCount is
overlapping with
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12692. Ozone: fix javadoc/unit test
for calling
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11468. Ozone: SCM: Add Node Metrics
for SCM. Contributed by Yiqun
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12702. Ozone: Add hugo to the dev
docker image. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12693. Ozone: Enable XFrame options
for KSM/SCM web ui. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12558. Ozone: Clarify the meaning of
[Apr 26, 2018 12:36:04 PM] (omalley) Revert "HDFS-12558. Ozone: Clarify the
meaning of
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12690. Ozone: generate swagger
descriptor for the Ozone REST Api.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12558. Ozone: Clarify the meaning of
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12680. Ozone: SCM: Lease support for
container creation.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12678. Ozone: Corona: Add statistical
information to json output.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12663. Ozone: OzoneClient: Remove
protobuf classes exposed to
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12521. Ozone: SCM should read all
Container info into memory when
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12718. Ozone: fix thread number
calculation in CBlockManager.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12697. Ozone services must stay
disabled in secure setup for alpha.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12750. Ozone: Fix
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12720. Ozone: Ratis options are not
passed from KSM Client protobuf
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12443. Ozone: Improve SCM block
deletion throttling algorithm.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12774. Ozone: OzoneClient: Moving
OzoneException from hadoop-hdfs
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12474. Ozone: SCM: Handling container
report with key count and
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12739. Add Support for SCM --init
command. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12549. Ozone: OzoneClient: Support
for REST protocol. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12758. Ozone: Correcting assertEquals
argument order in test cases.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12793. Ozone : TestSCMCli is failing
consistently. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12719. Ozone: Fix checkstyle, javac,
whitespace issues in HDFS-7240
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12796. SCM should not start if
Cluster Version file does not exist.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12756. Ozone: Add datanodeID to
heartbeat responses and container
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12798. Ozone: scm web: fix the node
status table. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12805. Ozone: Redundant characters
printed in exception log.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12500. Ozone: add logger for oz shell
commands and move error stack
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12830. Ozone:
TestOzoneRpcClient#testPutKeyRatisThreeNodes fails.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12759. Ozone: web: integrate
configuration reader page to the
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12731. Ozone: Fix inconsistent
default value in ozone settings.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12787. Ozone: SCM: Aggregate the
metrics from all the container
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12740. SCM should support a RPC to
share the cluster Id with KSM
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12786. Ozone: add port/service names
to the ksm/scm web ui.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12842. Ozone: SCM: During startup SCM
should check if the cluster
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12851. Ozone: Upgrade to latest ratis
build. Contributed by Mukul
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12807. Ozone: Expose RockDB stats via
JMX for Ozone metadata
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12864. Ozone: Turn off full synced
write in RocksDB MetadataStore.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12850. Ozone:
TestContainerPersistence#testListContainer fails
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12867. Ozone:
TestOzoneConfigurationFields fails consistently.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12876. Ozone: moving NodeType from
OzoneConsts to Ozone.proto.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12588. Use GenericOptionsParser for
scm and ksm daemon. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12898. Ozone: TestSCMCli#testHelp and
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12901. Ozone: SCM: Expose
StorageContainerManager#getScmId through
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12899. Ozone: SCM: BlockManagerImpl
close is called twice during
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12626. Ozone : delete open key
entries that will no longer be
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12000. Ozone: Container : Add key
versioning support-1. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12698. Ozone: Use time units in the
Ozone configuration values.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12890 . Ozone: XceiverClient should
have upper bound on async
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12751. Ozone: SCM: update container
allocated size to container db
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12795. Ozone: SCM: Support for
Container LifeCycleState
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12799. Ozone: SCM: Close containers:
extend SCMCommandResponseProto
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12741. Ozone: KSM: ADD support for
KSM --createObjectStore command.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12941. Ozone: ConfServlet does not
trim values during the
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12863. Ozone: Avoid
configuration.get() call for each container
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12869. Ozone: Service Discovery: RPC
endpoint in KSM for
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12908. Ozone: write chunk call fails
because of Metrics registry
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12958. Ozone: remove
setAllocatedBytes method in ContainerInfo.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12980. Ozone: SCM: Restructuring
container state transition and
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12870. Ozone: Service Discovery: REST
endpoint in KSM for
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12961. Ozone: Use relative resource
urls in KSM/SCM web ui.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12853. Ozone: Optimize chunk writes
for Ratis by avoiding double
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12871. Ozone: Service Discovery:
Adding REST server details in
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12966. Ozone: owner name should be
set properly when the container
[Apr 26, 2018 12:36:04 PM] (omalley) HFDS-13007. Ozone: Fix
TestKeySpaceManager#testKSMInitializationFailure.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12794. Ozone: Parallelize
ChunkOutputSream Writes to container.
[Apr 26, 2018 12:36:04 PM] (omalley) Revert "HDFS-12794. Ozone: Parallelize
ChunkOutputSream Writes to
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12843. Ozone: Client:
TestOzoneRpcClient#testPutKeyRatisThreeNodes
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13013. Fix closeContainer API with
the right container state
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13026. Ozone:
TestContainerPersistence is failing becaue of
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13012. TestOzoneConfigurationFields
fails due to missing configs in
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12940. Ozone: KSM:
TestKeySpaceManager#testExpiredOpenKey fails
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13024. Ozone: ContainerStateMachine
should synchronize operations
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12986. Ozone: Update ozone to latest
ratis snapshot build
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13017. Block Storage: implement
simple iscsi discovery in jscsi
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13018. Block Storage: make the iscsi
target addres configurable for
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12868. Ozone: Service Discovery API.
Contributed by Nanda Kumar.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12812. Ozone: dozone: initialize scm
and ksm directory on cluster
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13072. Ozone: DatanodeStateMachine:
Handling Uncaught Exception in
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12879. Ozone : add scm init command
to document. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13080. Ozone: Make finalhash in
ContainerInfo of
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12522. Ozone: Remove the Priority
Queues used in the Container
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13127. Fix TestContainerStateManager
and
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13116. Ozone: Refactor Pipeline to
have transport and container
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13022. Block Storage: Kubernetes
dynamic persistent volume
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12636. Ozone: OzoneFileSystem:
Implement seek functionality for rpc
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13133. Ozone: OzoneFileSystem:
Calling delete with non-existing
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13149. Ozone: Rename Corona to Freon.
Contributed by Anu Engineer.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12983. Block Storage: provide
docker-compose file for cblock
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13078. Ozone: Update Ratis on Ozone to
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13070. Ozone: SCM: Support for
container replica reconciliation -
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-11699. Ozone:SCM: Add support for
close containers in SCM.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-12965. Ozone: Documentation : Add ksm
-createObjectStore command
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13196. Ozone: dozone: make example
docker-compose files version
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13008. Ozone: Add DN container
open/close state to container
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13108. Ozone: OzoneFileSystem:
Simplified url schema for Ozone File
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13137. Ozone: Ozonefs read fails
because ChunkGroupInputStream#read
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13258. Ozone: restructure Hdsl/Ozone
code to separated maven
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13298. Ozone: Make ozone/hdsl/cblock
modules turned off by default.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13304. Document: update the new ozone
docker file location.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13298. Addendum: Ozone: Make
ozone/hdsl/cblock modules turned off
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13317. Ozone: docker-compose should
only be copied to hadoop-dist
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13319. Ozone:
start-ozone.sh/stop-ozone.sh fail because of
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13335. Ozone: remove
hdsl/cblock/ozone source code from the
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13343. Ozone: Provide docker based
acceptance testing on pseudo
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13340. Ozone: Fix false positive RAT
warning when project built
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13300. Ozone: Remove DatanodeID
dependency from HDSL and Ozone.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13368. Ozone:TestEndPoint tests are
failing consistently.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13341. Ozone: Move ozone specific
ServiceRuntimeInfo utility to the
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13391. Ozone: Make dependency of
internal sub-module scope as
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13320. Ozone: Support for
MicrobenchMarking Tool. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13316. Ozone: Update the ksm/scm CLI
usage info. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13309. Ozone: Improve error message
in case of missing nodes.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13405. Ozone: Rename HDSL to HDDS.
Contributed by Ajay Kumar, Elek
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13405. Addendum: Ozone: Rename HDSL
to HDDS. Contributed by Ajay
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13342. Ozone: Rename and fix ozone
CLI scripts. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13301. Ozone: Remove containerPort,
ratisPort and ozoneRestPort
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13395. Ozone: Plugins support in HDSL
Datanode Service. Contributed
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13324. Ozone: Remove InfoPort and
InfoSecurePort from
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13416. Ozone: TestNodeManager tests
fail. Contributed by Bharat
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13348. Ozone: Update IP and hostname
in Datanode from SCM's
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13415. Ozone: Remove cblock code from
HDFS-7240. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13425. Ozone: Clean-up of ozone
related change from
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13414. Ozone: Update existing Ozone
documentation according to the
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13413. Ozone: ClusterId and
DatanodeUuid should be marked mandatory
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13423. Ozone: Clean-up of ozone
related change from
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13197. Ozone: Fix
ConfServlet#getOzoneTags cmd. Contributed by Ajay
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13446. Ozone: Fix OzoneFileSystem
contract test failures.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13424. Ozone: Refactor
MiniOzoneClassicCluster. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13459. Ozone: Clean-up of ozone
related change from MiniDFSCluste.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13444. Ozone: Fix checkstyle issues
in HDFS-7240. Contributed by
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13407. Ozone: Use separated version
schema for Hdds/Ozone projects.
[Apr 26, 2018 12:36:04 PM] (omalley) HDFS-13422. Ozone: Fix whitespaces and
license issues in HDFS-7240
[Apr 26, 2018 8:52:17 PM] (omalley) HDFS-7240 git commit fixup
[Apr 26, 2018 8:54:40 PM] (omalley) YARN-8196. Updated documentation for
enabling YARN Service REST API.
[Apr 26, 2018 8:54:40 PM] (omalley) YARN-8183. Fix
ConcurrentModificationException inside
[Apr 26, 2018 8:54:40 PM] (omalley) HDFS-13484. RBF: Disable Nameservices from
the federation. Contributed
[Apr 26, 2018 8:54:40 PM] (omalley) HADOOP-15404. Remove multibyte characters
in DataNodeUsageReportUtil
[Apr 26, 2018 8:54:40 PM] (omalley) HADOOP-15402. Prevent double logout of
UGI's LoginContext
[Apr 26, 2018 8:54:40 PM] (omalley) YARN-8188. RM Nodes UI data table index for
sorting column need to be
[Apr 26, 2018 8:54:40 PM] (omalley) HDFS-13468. Add erasure coding metrics into
ReadStatistics. (Contributed
[Apr 26, 2018 8:54:40 PM] (omalley) HADOOP-15411. AuthenticationFilter should
use
[Apr 26, 2018 8:54:40 PM] (omalley) YARN-8193. YARN RM hangs abruptly (stops
allocating resources) when
[Apr 26, 2018 8:54:40 PM] (omalley) MAPREDUCE-7042. Killed MR job data does not
move to
[Apr 26, 2018 8:54:40 PM] (omalley) YARN-7939. Added support to upgrade a
component instance.
[Apr 26, 2018 8:54:40 PM] (omalley) YARN-8140. Improve log message when launch
cmd is ran for stopped yarn
[Apr 26, 2018 8:54:40 PM] (omalley) HDFS-13326. RBF: Improve the interfaces to
modify and view mount tables.
[Apr 26, 2018 11:17:32 PM] (eyang) YARN-8122. Added component health
monitoring for YARN service.
[Apr 27, 2018 2:38:15 AM] (yqlin) HDFS-13499. RBF: Show disabled name services
in the UI. Contributed by
[Apr 27, 2018 3:41:29 AM] (fabbri) HADOOP-13756
LocalMetadataStore#put(DirListingMetadata) should also put
[Apr 27, 2018 4:56:57 AM] (sunilg) YARN-8205. Application State is not updated
to ATS if AM launching is
[Apr 27, 2018 5:03:42 AM] (sunilg) YARN-8215. ATS v2 returns invalid
[Apr 27, 2018 5:12:30 AM] (sunilg) YARN-8004. Add unit tests for inter queue
preemption for dominant
[Apr 27, 2018 7:36:21 AM] (wwei) YARN-8152. Add chart in SLS to illustrate the
throughput of the
[Apr 27, 2018 10:21:37 AM] (aajisaka) HADOOP-14188. Remove the usage of
-1 overall
The following subsystems voted -1:
compile mvninstall unit
The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac
The following subsystems are considered long running:
(runtime bigger than 1h 00m 00s)
unit
Specific tests:
Failed junit tests :
hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec
hadoop.fs.contract.rawlocal.TestRawlocalContractAppend
hadoop.fs.TestFileUtil
hadoop.fs.TestFsShellCopy
hadoop.fs.TestFsShellList
hadoop.fs.TestLocalFileSystem
hadoop.fs.TestRawLocalFileSystemContract
hadoop.fs.TestSymlinkLocalFSFileContext
hadoop.fs.TestTrash
hadoop.http.TestHttpServer
hadoop.http.TestHttpServerLogs
hadoop.io.nativeio.TestNativeIO
hadoop.ipc.TestIPC
hadoop.ipc.TestSocketFactory
hadoop.metrics2.impl.TestStatsDMetrics
hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal
hadoop.security.TestSecurityUtil
hadoop.security.TestShellBasedUnixGroupsMapping
hadoop.security.token.TestDtUtilShell
hadoop.util.TestNativeCodeLoader
hadoop.util.TestNodeHealthScriptRunner
hadoop.util.TestWinUtils
hadoop.fs.TestResolveHdfsSymlink
hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy
hadoop.hdfs.crypto.TestHdfsCryptoStreams
hadoop.hdfs.qjournal.client.TestQuorumJournalManager
hadoop.hdfs.qjournal.server.TestJournalNode
hadoop.hdfs.qjournal.server.TestJournalNodeSync
hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
hadoop.hdfs.server.blockmanagement.TestPendingReconstruction
hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl
hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation
hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage
hadoop.hdfs.server.datanode.TestBlockRecovery
hadoop.hdfs.server.datanode.TestBlockScanner
hadoop.hdfs.server.datanode.TestDataNodeFaultInjector
hadoop.hdfs.server.datanode.TestDataNodeMetrics
hadoop.hdfs.server.datanode.TestDataNodeUUID
hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
hadoop.hdfs.server.datanode.TestDirectoryScanner
hadoop.hdfs.server.datanode.TestHSync
hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame
hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand
hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC
hadoop.hdfs.server.mover.TestMover
hadoop.hdfs.server.mover.TestStorageMover
hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
hadoop.hdfs.server.namenode.ha.TestDNFencing
hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
hadoop.hdfs.server.namenode.ha.TestHAAppend
hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
hadoop.hdfs.server.namenode.TestAddBlock
hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands
hadoop.hdfs.server.namenode.TestCheckpoint
hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
hadoop.hdfs.server.namenode.TestEditLogRace
hadoop.hdfs.server.namenode.TestFileTruncate
hadoop.hdfs.server.namenode.TestFsck
hadoop.hdfs.server.namenode.TestFSImage
hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
hadoop.hdfs.server.namenode.TestNameNodeMXBean
hadoop.hdfs.server.namenode.TestNestedEncryptionZones
hadoop.hdfs.server.namenode.TestQuotaByStorageType
hadoop.hdfs.server.namenode.TestReencryptionHandler
hadoop.hdfs.server.namenode.TestStartup
hadoop.hdfs.TestBlockStoragePolicy
hadoop.hdfs.TestDatanodeRegistration
hadoop.hdfs.TestDatanodeReport
hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs
hadoop.hdfs.TestDecommission
hadoop.hdfs.TestDFSOutputStream
hadoop.hdfs.TestDFSShell
hadoop.hdfs.TestDFSStripedInputStream
hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy
hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.TestErasureCodingExerciseAPIs
hadoop.hdfs.TestFetchImage
hadoop.hdfs.TestFileAppend
hadoop.hdfs.TestFileConcurrentReader
hadoop.hdfs.TestFileCreation
hadoop.hdfs.TestFileLengthOnClusterRestart
hadoop.hdfs.TestHDFSFileSystemContract
hadoop.hdfs.TestHDFSServerPorts
hadoop.hdfs.TestHDFSTrash
hadoop.hdfs.TestHFlush
hadoop.hdfs.TestLeaseRecovery
hadoop.hdfs.TestLeaseRecovery2
hadoop.hdfs.TestMaintenanceState
hadoop.hdfs.TestMiniDFSCluster
hadoop.hdfs.TestPread
hadoop.hdfs.TestQuota
hadoop.hdfs.TestReconstructStripedFile
hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy
hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy
hadoop.hdfs.TestSecureEncryptionZoneWithKMS
hadoop.hdfs.TestTrashWithSecureEncryptionZones
hadoop.hdfs.tools.TestDebugAdmin
hadoop.hdfs.tools.TestDFSAdmin
hadoop.hdfs.tools.TestDFSAdminWithHA
hadoop.hdfs.tools.TestGetConf
hadoop.hdfs.web.TestWebHDFS
hadoop.hdfs.web.TestWebHdfsUrl
hadoop.fs.http.client.TestHttpFSFileSystemLocalFileSystem
hadoop.fs.http.client.TestHttpFSFWithSWebhdfsFileSystem
hadoop.fs.http.client.TestHttpFSFWithWebhdfsFileSystem
hadoop.fs.http.client.TestHttpFSWithHttpFSFileSystem
hadoop.fs.http.server.TestHttpFSServer
hadoop.fs.http.server.TestHttpFSServerWebServer
hadoop.lib.service.hadoop.TestFileSystemAccessService
hadoop.test.TestHFSTestCase
hadoop.hdfs.nfs.nfs3.TestRpcProgramNfs3
hadoop.hdfs.nfs.nfs3.TestWrites
hadoop.yarn.api.resource.TestPlacementConstraintTransformations
hadoop.yarn.logaggregation.filecontroller.ifile.TestLogAggregationIndexFileController
hadoop.yarn.logaggregation.TestAggregatedLogFormat
hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch
hadoop.yarn.server.nodemanager.containermanager.linux.privileged.TestPrivilegedOperationExecutor
hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestCGroupsHandlerImpl
hadoop.yarn.server.nodemanager.containermanager.linux.runtime.TestDockerContainerRuntime
hadoop.yarn.server.nodemanager.containermanager.linux.runtime.TestJavaSandboxLinuxContainerRuntime
hadoop.yarn.server.nodemanager.containermanager.TestAuxServices
hadoop.yarn.server.nodemanager.containermanager.TestContainerManager
hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService
hadoop.yarn.server.nodemanager.TestContainerExecutor
hadoop.yarn.server.nodemanager.TestLocalDirsHandlerService
hadoop.yarn.server.nodemanager.TestNodeManagerResync
hadoop.yarn.server.nodemanager.TestNodeStatusUpdater
hadoop.yarn.server.webproxy.amfilter.TestAmFilter
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer
hadoop.yarn.server.timeline.security.TestTimelineAuthenticationFilterForV1
hadoop.yarn.server.resourcemanager.ahs.TestRMApplicationHistoryWriter
hadoop.yarn.server.resourcemanager.scheduler.capacity.conf.TestFSSchedulerConfigurationStore
hadoop.yarn.server.resourcemanager.scheduler.capacity.conf.TestLeveldbConfigurationStore
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler
hadoop.yarn.server.resourcemanager.scheduler.constraint.TestPlacementProcessor
hadoop.yarn.server.resourcemanager.scheduler.fair.TestAllocationFileLoaderService
hadoop.yarn.server.resourcemanager.TestResourceTrackerService
hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore
hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageSchema
hadoop.mapred.TestTaskProgressReporter
hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter
hadoop.mapreduce.lib.output.TestFileOutputCommitter
hadoop.mapreduce.v2.app.TestRuntimeEstimators
hadoop.mapred.TestJavaSerialization
hadoop.mapred.TestLocalJobSubmission
hadoop.mapred.TestMiniMRChildTask
hadoop.mapred.TestMRTimelineEventHandling
hadoop.mapreduce.v2.TestMRJobs
hadoop.mapreduce.v2.TestUberAM
hadoop.yarn.service.client.TestBuildExternalComponents
hadoop.yarn.service.client.TestServiceCLI
hadoop.yarn.service.client.TestServiceClient
hadoop.yarn.service.monitor.TestServiceMonitor
hadoop.yarn.service.providers.TestAbstractClientProvider
hadoop.yarn.service.TestServiceAM
hadoop.yarn.service.TestServiceManager
hadoop.yarn.service.TestYarnNativeServices
hadoop.mapred.nativetask.handlers.TestNativeCollectorOnlyHandler
hadoop.mapred.uploader.TestFrameworkUploader
hadoop.tools.TestHadoopArchiveLogs
hadoop.fs.azure.TestClientThrottlingAnalyzer
hadoop.ozone.TestMetadataStore
hadoop.utils.TestRocksDBStoreMBean
hadoop.hdds.scm.block.TestBlockManager
hadoop.hdds.scm.block.TestDeletedBlockLog
hadoop.hdds.scm.container.closer.TestContainerCloser
hadoop.hdds.scm.container.TestContainerMapping
hadoop.hdds.scm.node.TestContainerPlacement
hadoop.hdds.scm.node.TestNodeManager
hadoop.hdds.scm.node.TestSCMNodePoolManager
mvninstall:
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-mvninstall-root.txt
[824K]
compile:
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-compile-root.txt
[272K]
cc:
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-compile-root.txt
[272K]
javac:
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-compile-root.txt
[272K]
unit:
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
[352K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
[2.0M]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
[8.0K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt
[1.3M]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-nfs.txt
[16K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
[44K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
[196K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-web-proxy.txt
[12K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
[32K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
[124K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timeline-pluginstorage.txt
[12K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase-tests.txt
[12K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt
[8.0K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
[136K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-app.txt
[24K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
[112K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services_hadoop-yarn-services-core.txt
[168K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
[16K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-uploader.txt
[20K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-tools_hadoop-archive-logs.txt
[20K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-tools_hadoop-azure.txt
[12K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-hdds_common.txt
[68K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-hdds_server-scm.txt
[124K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-ozone_client.txt
[16K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-ozone_integration-test.txt
[12K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-ozone_objectstore-service.txt
[4.0K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-ozone_ozone-manager.txt
[4.0K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-ozone_tools.txt
[4.0K]
https://builds.apache.org/job/hadoop-trunk-win/450/artifact/out/patch-unit-hadoop-tools_hadoop-ozone.txt
[8.0K]
Powered by Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
