Repository: hadoop
Updated Branches:
refs/heads/HDFS-10285 9e2cb0cef -> d35255d43
HDFS-13076: [SPS]: Resolve conflicts after rebasing HDFS-10285 branch to trunk.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/as
HDFS-11726. [SPS]: StoragePolicySatisfier should not select same storage type
as source and destination in same datanode. Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/015174a5
Tree: http://git-wip
HDFS-11965: [SPS]: Should give chance to satisfy the low redundant blocks
before removing the xattr. Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/16b58c82
Tree: http://git-wip-us.ap
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f26fca8b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeReconfigure.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/test
http://git-wip-us.apache.org/repos/asf/hadoop/blob/9202cac4/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/
HDFS-12911. [SPS]: Modularize the SPS code and expose necessary interfaces for
external/internal implementations. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2412c34e
Tree: http://git-
Repository: hadoop
Updated Branches:
refs/heads/HDFS-10285 aa59f4231 -> 9e2cb0cef (forced update)
HDFS-11338: [SPS]: Fix timeout issue in unit tests caused by longger NN down
time. Contributed by Wei Zhou and Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http:/
http://git-wip-us.apache.org/repos/asf/hadoop/blob/dbac/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestStoragePolicySatisfierWithStripedFile.java
--
diff --git
a/hadoop-hdfs-project/ha
HDFS-12225: [SPS]: Optimize extended attributes for tracking SPS movements.
Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/bcc32361
Tree: http://git-wip-us.apache.org/repos/asf/hadoop
HDFS-13057: [SPS]: Revisit configurations to make SPS service modes
internal/external/none. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/96fb1858
Tree: http://git-wip-us.apache.org/repos/asf/hado
http://git-wip-us.apache.org/repos/asf/hadoop/blob/dbac/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/s
HDFS-11966. [SPS] Correct the log in
BlockStorageMovementAttemptedItems#blockStorageMovementResultCheck. Contributed
by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b1d8dcce
Tree: http://git-wip-
http://git-wip-us.apache.org/repos/asf/hadoop/blob/2412c34e/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/s
HDFS-12141: [SPS]: Fix checkstyle warnings. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8d1e4913
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8d1e4913
Diff: http://git-wip-us.apache.o
HDFS-12570: [SPS]: Refactor Co-ordinator datanode logic to track the block
storage movements. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9202cac4
Tree: http://git-wip-us.apache.org/repos/asf/ha
HDFS-11334: [SPS]: NN switch and rescheduling movements can lead to have more
than one coordinator for same file blocks. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2d3e8acf
Tree: http://git-wip
HDFS-13110: [SPS]: Reduce the number of APIs in NamenodeProtocol used by
external satisfier. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8947d989
Tree: http://git-wip-us.apache.org/repos/asf/had
HDFS-13381 : [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier
file path. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9e2cb0ce
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-11264: [SPS]: Double checks to ensure that SPS/Mover are not running
together. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6b78e3f3
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/
HDFS-13077. [SPS]: Fix review comments of external storage policy satisfier.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/196903ca
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/196903c
HDFS-13165: [SPS]: Collects successfully moved block details via IBR.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/14e5b64f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/14e5b64f
Diff:
HDFS-11762. [SPS]: Empty files should be ignored in StoragePolicySatisfier.
Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/35a6fde9
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/35a6fde9
HDFS-12790: [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and
HDFS-11968 commits. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d1b810eb
Tree: http://git-wip-us.apache.org/repos/a
http://git-wip-us.apache.org/repos/asf/hadoop/blob/dbac/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/t
http://git-wip-us.apache.org/repos/asf/hadoop/blob/dbac/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfierWithStripedFile.java
--
diff --git
a/hadoop-hdfs-projec
http://git-wip-us.apache.org/repos/asf/hadoop/blob/dbac/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/sps/BlockStorageMovementNeeded.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/s
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8947d989/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/sps/ExternalSPSFileIDCollector.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/main/j
HDFS-13025. [SPS]: Implement a mechanism to scan the files for external SPS.
Contributed by Uma Maheswara Rao G.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/55d0b1d9
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-13033: [SPS]: Implement a mechanism to do file block movements for
external SPS. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/49ee352c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tre
http://git-wip-us.apache.org/repos/asf/hadoop/blob/9e2cb0ce/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/s
HDFS-13097: [SPS]: Fix the branch review comments(Part1). Contributed by
Surendra Singh.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f26fca8b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f26fca8b
Diff: http:
HDFS-12310: [SPS]: Provide an option to track the status of in progress
requests. Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6016d283
Tree: http://git-wip-us.apache.org/repos/asf/
HDFS-13075. [SPS]: Provide External Context implementation. Contributed by Uma
Maheswara Rao G.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e3272839
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e3272839
Diff
http://git-wip-us.apache.org/repos/asf/hadoop/blob/14e5b64f/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/sps/ExternalSPSBlockMoveTaskHandler.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/m
HDFS-13050: [SPS]: Create start/stop script to start external SPS process.
Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c8881895
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/
http://git-wip-us.apache.org/repos/asf/hadoop/blob/96fb1858/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfierWithStripedFile.java
--
diff --git
a/hadoop-hdfs-projec
HDFS-12982 : [SPS]: Reduce the locking and cleanup the Namesystem access.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8f4c8c15
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8f4c8c15
D
HDFS-13166: [SPS]: Implement caching mechanism to keep LIVE datanodes to
minimize costly getLiveDatanodeStorageReport() calls. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/60861a99
Tree: http://g
HDFS-12955: [SPS]: Move SPS classes to a separate package. Contributed by
Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dbac
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/dbac
Diff: http://git
HDFS-12556: [SPS] : Block movement analysis should be done in read lock.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ce8e9010
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ce8e9010
Diff: http://git-wip-us.apac
HDFS-11572. [SPS]: SPS should clean Xattrs when no blocks required to satisfy
for a file. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cda66ec3
Tree: http://git-wip-us.apache.org/repos/
HDFS-12152: [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to
improve thread cleanup time. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/771a1a45
Tree: http://git-wip-us.apache.org
HDFS-12291: [SPS]: Provide a mechanism to recursively iterate and satisfy
storage policy of all the files under the given dir. Contributed by Surendra
Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7c076d16
HDFS-12106: [SPS]: Improve storage policy satisfier configurations. Contributed
by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/82e10f52
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/82
HDFS-11670: [SPS]: Add CLI command for satisfy storage policy operations.
Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0542c87a
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-11695: [SPS]: Namenode failed to start while loading SPS xAttrs from the
edits log. Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8bfe547e
Tree: http://git-wip-us.apache.org/rep
http://git-wip-us.apache.org/repos/asf/hadoop/blob/9202cac4/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/t
HDFS-12146. [SPS]: Fix
TestStoragePolicySatisfierWithStripedFile#testSPSWhenFileHasLowRedundancyBlocks.
Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ecae2af7
Tree: http://git-wip-u
HDFS-11883: [SPS] : Handle NPE in BlockStorageMovementTracker when
dropSPSWork() called. Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/08a199fe
Tree: http://git-wip-us.apache.org/rep
HDFS-12214: [SPS]: Fix review comments of StoragePolicySatisfier feature.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a59eb621
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a59eb621
D
HDFS-11874. [SPS]: Document the SPS feature. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fc6d57fe
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/fc6d57fe
Diff: http://git-wip-
Repository: hadoop
Updated Branches:
refs/heads/trunk 3b637155a -> 71df8c27c
http://git-wip-us.apache.org/repos/asf/hadoop/blob/71df8c27/hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/states/NodeStateMap.java
HDDS-212. Introduce NodeStateManager to manage the state of Datanodes in SCM.
Contributed by Nanda kumar.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/71df8c27
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/71d
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 844538d66 -> 48addcdbb
HDFS-13528. RBF: If a directory exceeds quota limit then quota usage is not
refreshed for other mount entries. Contributed by Dibyendu Karmakar.
(cherry picked from commit 3b637155a47d2aa93284969a96208347a647083
Repository: hadoop
Updated Branches:
refs/heads/branch-2 3e177a1d6 -> 1a96293c6
HDFS-13528. RBF: If a directory exceeds quota limit then quota usage is not
refreshed for other mount entries. Contributed by Dibyendu Karmakar.
(cherry picked from commit 3b637155a47d2aa93284969a96208347a647083d)
Repository: hadoop
Updated Branches:
refs/heads/trunk 7ca4f0cef -> 3b637155a
HDFS-13528. RBF: If a directory exceeds quota limit then quota usage is not
refreshed for other mount entries. Contributed by Dibyendu Karmakar.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: ht
56 matches
Mail list logo