Merge branch 'trunk' into HDFS-12943
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e62a4cf8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e62a4cf8
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/e62a4cf
HDDS-933. Add documentation for genconf tool under Tools section. Contributed
by Dinesh Chitlangia.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/12c139d7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/12c139d7
HDFS-14160. [SBN read] ObserverReadInvocationHandler should implement
RpcInvocationHandler. Contributed by Konstantin V Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2753d6c9
Tree: http://git-wip-us.apache.org/re
HDDS-914. Add Grafana support to ozoneperf docker container. Contributed by
Dinesh Chitlangia.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/99b50612
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/99b50612
Diff:
Repository: hadoop
Updated Branches:
refs/heads/HDFS-12943 038bdbc83 -> 2753d6c93
HDDS-539. Ozone datanode command ignores the invalid options. Contributed by
Vinicius Higa Murakami.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/ha
HDDS-925. Rename ChunkGroupOutputStream to KeyOutputStream and
ChunkOutputStream to BlockOutputStream. Contributed by Shashikant Banerjee.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4ff1c46d
Tree: http://git-wip-us.apa
HDDS-911. Make TestOzoneManager unit tests independent. Contributed by Elek
Marton.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2f6bc250
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2f6bc250
Diff: http://git
HDDS-893. pipeline status is ALLOCATED in scmcli listPipelines command.
Contributed by Lokesh Jain.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cf571133
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/cf571133
YARN-9126. Fix container clean up for reinitialization.
Contributed by Chandni Singh
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e815fd9c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e815fd9c
Dif
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c7a5a443/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/TestAuxServices.java
---
YARN-9075. Add ability to register/remove auxiliary service without restart
node manager.
Contributed by Billie Rinaldi
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c7a5a443
Tree: http://git-wip-us.apache.or
HDDS-912. Update ozone to latest ratis snapshot build (0.4.0-3b0be02-SNAPSHOT).
Contributed by Lokesh Jain.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b51e9e43
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen
Jeliazkov.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c9d73437
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c9d73437
Diff: http://git-
;
-Mockito.doAnswer(a -> {
- Object[] arguments = a.getArguments();
- RpcHeaderProtos.RpcRequestHeaderProto.Builder header =
- (RpcHeaderProtos.RpcRequestHeaderProto.Builder) arguments[0];
- collectedHeaders.add(header);
- return a.callRealMethod();
-}).when(spiedAlignContext).
HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an
in-memory cache of recent edit transactions. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c81ac2ff
Tree: http://g
-Object[] arguments = a.getArguments();
-RpcHeaderProtos.RpcRequestHeaderProto.Builder header =
-(RpcHeaderProtos.RpcRequestHeaderProto.Builder) arguments[0];
-headers.add(header);
-return a.callRealMethod();
- }).when(spiedAlignContext).updateRequestState(Mockito.any());
-
-
HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed
by Konstantin Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0105d7f5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0105d7f5
HDFS-14138. [SBN read] Description errors in the comparison logic of
transaction ID. Contributed by xiangheng.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cae27961
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tre
HDFS-14094. [SBN read] Fix the order of logging arguments in
ObserverReadProxyProvider. Contributed by Ayush Saxena.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3bb92a1d
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
Repository: hadoop
Updated Branches:
refs/heads/HDFS-12943 f7072e070 -> bd2a59e50 (forced update)
HDFS-14166. Ls with -e option not giving the result in proper format.
Contributed by Shubham Dewan.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.o
HDFS-13946. Log longest FSN write/read lock held stack trace.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/feb2664a
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/feb2664a
Diff: http://git-wip-us.apache.org/repo
HDFS-14165. In NameNode UI under DataNode tab ,the Capacity column is
Non-Aligned. Contributed by Shubham Dewan.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d944d5ec
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDDS-921. Add JVM pause monitor to Ozone Daemons (OM, SCM and Datanodes).
Contributed by Bharat Viswanadham.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/26e4be70
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and
observer. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/091ad974
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-13925. Unit Test for transitioning between different states. Contributed
by Sherwood Zheng.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b6f20c36
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b6f20c36
Diff
HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8c491350
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8c49
HDFS-13665. [SBN read] Move RPC response serialization into
Server.doResponse(). Contributed by Plamen Jeliazkov.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e27708c2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-13961. [SBN read] TestObserverNode refactoring. Contributed by Konstantin
Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b5b9b777
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b5b9b777
Diff: http:/
HDFS-14016. [SBN read] ObserverReadProxyProvider should enable observer read by
default. Contributed by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1a9ba961
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-13782. ObserverReadProxyProvider should work with IPFailoverProxyProvider.
Contributed by Konstantin Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f9fc01cd
Tree: http://git-wip-us.apache.org/repos/asf/hadoop
HDFS-13523. Support observer nodes in MiniDFSCluster. Contributed by Konstantin
Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1c4265d7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1c4265d7
Diff: http:
HDFS-13851. Remove AlignmentContext from AbstractNNFailoverProxyProvider.
Contributed by Konstantin Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/25d8e39b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/
HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/eae0a5d5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/eae0a5d5
Diff: http://git-wip-us.a
d(Long.MAX_VALUE);
-}
- }).when(spiedAlignContext).updateRequestState(Mockito.any());
-
- GenericTestUtils.LogCapturer logCapturer =
- GenericTestUtils.LogCapturer.captureLogs(FSNamesystem.LOG);
-
- DFSTestUtil.writeFile(clearDfs, new Path("/testFile4"), "shv");
- logCapturer.sto
HDFS-14116. [SBN read] Fix class cast error in NNThroughputBenchmark with
ObserverReadProxyProvider. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c3efc299
Tree: http://git-wip-us.apache.org/repos/
HDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads.
Contributed by Konstantin V Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/bd2a59e5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/bd2
HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test,
documentation, remove unnecessary dummy sync, minors fixups. Contributed by
Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1e22f2b
HDFS-14146. [SBN read] Handle exceptions from and prevent handler threads from
blocking within internalQueueCall. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ef3e1929
Tree: http://git-wip-us.apa
HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to
support tailing edits via RPC. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/00e99c65
Tree: http://git-wip-us.apache.
HDFS-14120. [SBN read] ORFPP should also clone DT for the virtual IP.
Contributed by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/71cf66e2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/71cf66e2
Dif
HDFS-13789. Reduce logging frequency of
QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4c9baba0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/
HDFS-14154. [SBN read] Document dfs.ha.tail-edits.period in user guide.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c546b12e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c546b12e
Dif
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao
Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/64b7cf59
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/64b7cf59
Diff: http://git
HDFS-13578. [SBN read] Add ReadOnly annotation to methods in ClientProtocol.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a109f2b3
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a109f2b
HDFS-14131. [SBN read] Create user guide for Consistent Reads from Observer
feature. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2904aa38
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree
HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync.
Contributed by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d2e85b0b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/d2e85b0b
Diff
HDFS-14067. [SBN read] Allow manual failover between standby and observer.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cbc2f932
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/cbc2f932
D
HDFS-13779. [SBN read] Implement proper failover and observer failure handling
logic for for ObserverReadProxyProvider. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/aa42fb0d
Tree: http://git-w
HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fa855033
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/fa855
YARN 9108. Fix FederationIntercepter merge home and secondary allocate response
typo. Contributed by Abhishek Modi.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/657aa433
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-12975. [SBN read] Changes to the NameNode to support reads from standby.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3a78e5ff
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3a78e5f
HDFS-14035. NN status discovery does not leverage delegation token. Contributed
by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/652b2574
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/652b2574
Diff:
HDFS-13898. [SBN read] Throw retriable exception for getBlockLocations when
ObserverNameNode is in safemode. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b74a7dbf
Tree: http://git-wip-us.apache.o
HDFS-13791. Limit logging frequency of edit tail related statements.
Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a65bb97f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a65bb97f
Dif
Object[] arguments = a.getArguments();
+ RpcHeaderProtos.RpcRequestHeaderProto.Builder header =
+ (RpcHeaderProtos.RpcRequestHeaderProto.Builder) arguments[0];
+ collectedHeaders.add(header);
+ return a.callRealMethod();
+}).when(spiedAlignContext).updateRequestState(Mockito.any());
+
+DFSTestUtil.writeFile(dfs
HDFS-14017. [SBN read] ObserverReadProxyProviderWithIPFailover should work with
HA configuration. Contributed by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a3aab48d
Tree: http://git-wip-us.apache.org/repos/
HDFS-14160. [SBN read] ObserverReadInvocationHandler should implement
RpcInvocationHandler. Contributed by Konstantin V Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c9d77374
Tree: http://git-wip-us.apache.org/re
HDFS-14142. Move ipfailover config key out of HdfsClientConfigKeys. Contributed
by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b8ad6c85
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b8ad6c85
Diff:
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode
to serve edits via RPC. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/151c8ddb
Tree: http://git-wip-us.apache.org/
HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too
far behind. Contributed by Konstantin Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b73fb70f
Tree: http://git-wip-us.apache.org/repo
HDFS-14046. In-Maintenance ICON is missing in datanode info page. Contributed
by Ranith Sardar.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/686fcd4d
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/686fcd4d
Diff
HDFS-13749. [SBN read] Use getServiceStatus to discover observer namenodes.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/25b63e8d
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/25b63e8d
HDFS-13523. Support observer nodes in MiniDFSCluster. Contributed by Konstantin
Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1c4265d7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1c4265d7
Diff: http:
HDFS-14016. [SBN read] ObserverReadProxyProvider should enable observer read by
default. Contributed by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1a9ba961
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to
support tailing edits via RPC. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/00e99c65
Tree: http://git-wip-us.apache.
HDFS-14138. [SBN read] Description errors in the comparison logic of
transaction ID. Contributed by xiangheng.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cae27961
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tre
HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync.
Contributed by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d2e85b0b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/d2e85b0b
Diff
-Object[] arguments = a.getArguments();
-RpcHeaderProtos.RpcRequestHeaderProto.Builder header =
-(RpcHeaderProtos.RpcRequestHeaderProto.Builder) arguments[0];
-headers.add(header);
-return a.callRealMethod();
- }).when(spiedAlignContext).updateRequestState(Mockito.any());
-
-
HDFS-13898. [SBN read] Throw retriable exception for getBlockLocations when
ObserverNameNode is in safemode. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b74a7dbf
Tree: http://git-wip-us.apache.o
HDFS-14154. [SBN read] Document dfs.ha.tail-edits.period in user guide.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c546b12e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c546b12e
Dif
HDFS-14146. [SBN read] Handle exceptions from and prevent handler threads from
blocking within internalQueueCall. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ef3e1929
Tree: http://git-wip-us.apa
HDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads.
Contributed by Konstantin V Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/bd2a59e5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/bd2
HDFS-14094. [SBN read] Fix the order of logging arguments in
ObserverReadProxyProvider. Contributed by Ayush Saxena.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3bb92a1d
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-13665. [SBN read] Move RPC response serialization into
Server.doResponse(). Contributed by Plamen Jeliazkov.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e27708c2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-13925. Unit Test for transitioning between different states. Contributed
by Sherwood Zheng.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b6f20c36
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b6f20c36
Diff
HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed
by Konstantin Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0105d7f5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0105d7f5
HDFS-12975. [SBN read] Changes to the NameNode to support reads from standby.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3a78e5ff
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3a78e5f
HDFS-13578. [SBN read] Add ReadOnly annotation to methods in ClientProtocol.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a109f2b3
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a109f2b
HDFS-13789. Reduce logging frequency of
QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4c9baba0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode
to serve edits via RPC. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/151c8ddb
Tree: http://git-wip-us.apache.org/
HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fa855033
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/fa855
HDFS-14160. [SBN read] ObserverReadInvocationHandler should implement
RpcInvocationHandler. Contributed by Konstantin V Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c9d77374
Tree: http://git-wip-us.apache.org/re
en(spiedAlignContext).updateRequestState(Mockito.any());
-
- GenericTestUtils.LogCapturer logCapturer =
- GenericTestUtils.LogCapturer.captureLogs(FSNamesystem.LOG);
-
- DFSTestUtil.writeFile(clearDfs, new Path("/testFile4"), "shv");
- logCapturer.stopCapt
HDFS-14131. [SBN read] Create user guide for Consistent Reads from Observer
feature. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2904aa38
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree
HDFS-14035. NN status discovery does not leverage delegation token. Contributed
by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/652b2574
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/652b2574
Diff:
HDFS-14142. Move ipfailover config key out of HdfsClientConfigKeys. Contributed
by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b8ad6c85
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b8ad6c85
Diff:
HDFS-14116. [SBN read] Fix class cast error in NNThroughputBenchmark with
ObserverReadProxyProvider. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c3efc299
Tree: http://git-wip-us.apache.org/repos/
Object[] arguments = a.getArguments();
+ RpcHeaderProtos.RpcRequestHeaderProto.Builder header =
+ (RpcHeaderProtos.RpcRequestHeaderProto.Builder) arguments[0];
+ collectedHeaders.add(header);
+ return a.callRealMethod();
+}).when(spiedAlignContext).updateRequestState(Mockito.any());
+
+DFSTestUtil.writeFile(dfs
HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an
in-memory cache of recent edit transactions. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c81ac2ff
Tree: http://g
HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test,
documentation, remove unnecessary dummy sync, minors fixups. Contributed by
Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1e22f2b
;
-Mockito.doAnswer(a -> {
- Object[] arguments = a.getArguments();
- RpcHeaderProtos.RpcRequestHeaderProto.Builder header =
- (RpcHeaderProtos.RpcRequestHeaderProto.Builder) arguments[0];
- collectedHeaders.add(header);
- return a.callRealMethod();
-}).when(spiedAlignContext).upda
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen
Jeliazkov.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c9d73437
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c9d73437
Diff: http://git-
HDFS-13779. [SBN read] Implement proper failover and observer failure handling
logic for for ObserverReadProxyProvider. Contributed by Erik Krogen.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/aa42fb0d
Tree: http://git-w
HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8c491350
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8c49
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and
observer. Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/091ad974
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-13851. Remove AlignmentContext from AbstractNNFailoverProxyProvider.
Contributed by Konstantin Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/25d8e39b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/
HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too
far behind. Contributed by Konstantin Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b73fb70f
Tree: http://git-wip-us.apache.org/repo
HDFS-13782. ObserverReadProxyProvider should work with IPFailoverProxyProvider.
Contributed by Konstantin Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f9fc01cd
Tree: http://git-wip-us.apache.org/repos/asf/hadoop
HDFS-14067. [SBN read] Allow manual failover between standby and observer.
Contributed by Chao Sun.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cbc2f932
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/cbc2f932
D
HDFS-13961. [SBN read] TestObserverNode refactoring. Contributed by Konstantin
Shvachko.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b5b9b777
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b5b9b777
Diff: http:/
301 - 400 of 1447 matches
Mail list logo