Repository: hadoop
Updated Branches:
refs/heads/HDFS-10285 83552dc0b -> ad0f6ba07
HDFS-13076: [SPS]: Addendum. Resolve conflicts after rebasing branch to trunk.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf
Repository: hadoop
Updated Branches:
refs/heads/trunk f354f47f9 -> e6873dfde
YARN-7300. DiskValidator is not used in LocalDirAllocator. (Szilard Nemeth via
Haibo Chen)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e68
Repository: hadoop
Updated Branches:
refs/heads/trunk b3b4d4ccb -> f354f47f9
YARN-6995. Improve use of ResourceNotFoundException in resource types code.
(Daniel Templeton and Szilard Nemeth via Haibo Chen)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1.1 [created] 23624c924
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 749fff577 -> 23624c924
MAPREDUCE-7118. Distributed cache conflicts breaks backwards compatability.
(Jason Lowe via wangda)
Change-Id: I89ab4852b4ad305fec19812e8931c59d96581376
(cherry picked from commit b3b4d4ccb53fdf8dacc66e912822b34
Repository: hadoop
Updated Branches:
refs/heads/trunk 256488475 -> b3b4d4ccb
MAPREDUCE-7118. Distributed cache conflicts breaks backwards compatability.
(Jason Lowe via wangda)
Change-Id: I89ab4852b4ad305fec19812e8931c59d96581376
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
C
Repository: hadoop
Updated Branches:
refs/heads/trunk 45d9568aa -> 256488475
YARN-8436. FSParentQueue: Comparison method violates its general contract.
(Wilfred Spiegelenburg via Haibo Chen)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repo
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 76b8beb28 -> 749fff577
refs/heads/trunk 5836e0a46 -> 45d9568aa
HADOOP-15547/ WASB: improve listStatus performance.
Contributed by Thomas Marquardt.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-u
HADOOP-15547/ WASB: improve listStatus performance.
Contributed by Thomas Marquardt.
(cherry picked from commit 749fff577ed9afb4ef8a54b8948f74be083cc620)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/45d9568a
Tree: http:/
HDFS-12790: [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and
HDFS-11968 commits. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9d5f3854
Tree: http://git-wip-us.apache.org/repos/a
http://git-wip-us.apache.org/repos/asf/hadoop/blob/67d37661/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/t
http://git-wip-us.apache.org/repos/asf/hadoop/blob/67d37661/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestStoragePolicySatisfierWithStripedFile.java
--
diff --git
a/hadoop-hdfs-project/ha
HDFS-11874. [SPS]: Document the SPS feature. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f4bc889b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f4bc889b
Diff: http://git-wip-
HDFS-13097: [SPS]: Fix the branch review comments(Part1). Contributed by
Surendra Singh.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4b9839c5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4b9839c5
Diff: http:
HDFS-11670: [SPS]: Add CLI command for satisfy storage policy operations.
Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9e745968
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-12955: [SPS]: Move SPS classes to a separate package. Contributed by
Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/67d37661
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/67d37661
Diff: http://git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/67d37661/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/sps/BlockStorageMovementNeeded.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/s
HDFS-13033: [SPS]: Implement a mechanism to do file block movements for
external SPS. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/941180d8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tre
http://git-wip-us.apache.org/repos/asf/hadoop/blob/67d37661/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/s
HDFS-12225: [SPS]: Optimize extended attributes for tracking SPS movements.
Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ecef680b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop
HDFS-12141: [SPS]: Fix checkstyle warnings. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e0e34f39
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e0e34f39
Diff: http://git-wip-us.apache.o
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f7e8b1c1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/
HDFS-13110: [SPS]: Reduce the number of APIs in NamenodeProtocol used by
external satisfier. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/69156394
Tree: http://git-wip-us.apache.org/repos/asf/had
HDFS-11966. [SPS] Correct the log in
BlockStorageMovementAttemptedItems#blockStorageMovementResultCheck. Contributed
by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9a27c91f
Tree: http://git-wip-
HDFS-13025. [SPS]: Implement a mechanism to scan the files for external SPS.
Contributed by Uma Maheswara Rao G.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/49cad268
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
HDFS-13076: [SPS]: Resolve conflicts after rebasing HDFS-10285 branch to trunk.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/83552dc0
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8355
HDFS-13381 : [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier
file path. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d3f163e8
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-12214: [SPS]: Fix review comments of StoragePolicySatisfier feature.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/98c040bb
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/98c040bb
D
http://git-wip-us.apache.org/repos/asf/hadoop/blob/4b9839c5/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeReconfigure.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/test
HDFS-13075. [SPS]: Provide External Context implementation. Contributed by Uma
Maheswara Rao G.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5255f969
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/5255f969
Diff
http://git-wip-us.apache.org/repos/asf/hadoop/blob/69156394/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/sps/ExternalSPSFileIDCollector.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/main/j
HDFS-11883: [SPS] : Handle NPE in BlockStorageMovementTracker when
dropSPSWork() called. Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c03b9a90
Tree: http://git-wip-us.apache.org/rep
HDFS-11762. [SPS]: Empty files should be ignored in StoragePolicySatisfier.
Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f3385bb6
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f3385bb6
HDFS-12310: [SPS]: Provide an option to track the status of in progress
requests. Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d3ddec1c
Tree: http://git-wip-us.apache.org/repos/asf/
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f7e8b1c1/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/t
HDFS-12146. [SPS]: Fix
TestStoragePolicySatisfierWithStripedFile#testSPSWhenFileHasLowRedundancyBlocks.
Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d2ba0a52
Tree: http://git-wip-u
HDFS-11572. [SPS]: SPS should clean Xattrs when no blocks required to satisfy
for a file. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8f3da78d
Tree: http://git-wip-us.apache.org/repos/
http://git-wip-us.apache.org/repos/asf/hadoop/blob/d3f163e8/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/s
http://git-wip-us.apache.org/repos/asf/hadoop/blob/67d37661/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfierWithStripedFile.java
--
diff --git
a/hadoop-hdfs-projec
HDFS-12570: [SPS]: Refactor Co-ordinator datanode logic to track the block
storage movements. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f7e8b1c1
Tree: http://git-wip-us.apache.org/repos/asf/ha
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8bc72521/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/sps/ExternalSPSBlockMoveTaskHandler.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/m
HDFS-12152: [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to
improve thread cleanup time. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dd8ddf06
Tree: http://git-wip-us.apache.org
HDFS-11726. [SPS]: StoragePolicySatisfier should not select same storage type
as source and destination in same datanode. Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3e845b87
Tree: http://git-wip
HDFS-11965: [SPS]: Should give chance to satisfy the low redundant blocks
before removing the xattr. Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/28508db4
Tree: http://git-wip-us.ap
HDFS-11695: [SPS]: Namenode failed to start while loading SPS xAttrs from the
edits log. Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/87befc94
Tree: http://git-wip-us.apache.org/rep
HDFS-13165: [SPS]: Collects successfully moved block details via IBR.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8bc72521
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8bc72521
Diff:
HDFS-13050: [SPS]: Create start/stop script to start external SPS process.
Contributed by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e5c0b053
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/
HDFS-12556: [SPS] : Block movement analysis should be done in read lock.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0324958e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0324958e
Diff: http://git-wip-us.apac
Repository: hadoop
Updated Branches:
refs/heads/HDFS-10285 b1afd1f24 -> 83552dc0b (forced update)
HDFS-11334: [SPS]: NN switch and rescheduling movements can lead to have more
than one coordinator for same file blocks. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/
http://git-wip-us.apache.org/repos/asf/hadoop/blob/7bf10385/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfier.java
--
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/s
HDFS-13077. [SPS]: Fix review comments of external storage policy satisfier.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e5603aef
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e5603ae
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8a2bbde9/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/sps/TestStoragePolicySatisfierWithStripedFile.java
--
diff --git
a/hadoop-hdfs-projec
HDFS-13166: [SPS]: Implement caching mechanism to keep LIVE datanodes to
minimize costly getLiveDatanodeStorageReport() calls. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6fed235a
Tree: http://g
HDFS-12911. [SPS]: Modularize the SPS code and expose necessary interfaces for
external/internal implementations. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7bf10385
Tree: http://git-
HDFS-13057: [SPS]: Revisit configurations to make SPS service modes
internal/external/none. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8a2bbde9
Tree: http://git-wip-us.apache.org/repos/asf/hado
HDFS-12291: [SPS]: Provide a mechanism to recursively iterate and satisfy
storage policy of all the files under the given dir. Contributed by Surendra
Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f837236f
HDFS-11264: [SPS]: Double checks to ensure that SPS/Mover are not running
together. Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/18c37092
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/
HDFS-12982 : [SPS]: Reduce the locking and cleanup the Namesystem access.
Contributed by Rakesh R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b25be2aa
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b25be2aa
D
HDFS-12106: [SPS]: Improve storage policy satisfier configurations. Contributed
by Surendra Singh Lilhore.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d27c53b3
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/d2
Repository: hadoop
Updated Branches:
refs/heads/branch-2.8 21aa980ee -> 4b1ee3685
HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled
reliably fails. Contributed by Weiwei Yang.
(cherry picked from commit ccf2db7fc2688d262df3309007cb12a4dfedc179)
Project: http://git-wip-
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 a147098c4 -> 76b8beb28
YARN-8501. Reduce complexity of RMWebServices getApps method.
Contributed by Szilard Nemeth
(cherry picked from commit 5836e0a46bf9793e0a61bb8ec46536f4a67d38d7)
Project: http://git-wip-us.apache.org/
Repository: hadoop
Updated Branches:
refs/heads/branch-2.9 cf6eeea58 -> 510287fa2
HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled
reliably fails. Contributed by Weiwei Yang.
(cherry picked from commit ccf2db7fc2688d262df3309007cb12a4dfedc179)
Project: http://git-wip-
Repository: hadoop
Updated Branches:
refs/heads/trunk ccf2db7fc -> 5836e0a46
YARN-8501. Reduce complexity of RMWebServices getApps method.
Contributed by Szilard Nemeth
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop
Repository: hadoop
Updated Branches:
refs/heads/branch-2 4c2ab2213 -> cf255dc01
HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled
reliably fails. Contributed by Weiwei Yang.
(cherry picked from commit ccf2db7fc2688d262df3309007cb12a4dfedc179)
Project: http://git-wip-us
Repository: hadoop
Updated Branches:
refs/heads/branch-3.0 177620897 -> 00ac5ba90
HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled
reliably fails. Contributed by Weiwei Yang.
(cherry picked from commit ccf2db7fc2688d262df3309007cb12a4dfedc179)
Project: http://git-wip-
Repository: hadoop
Updated Branches:
refs/heads/branch-3.1 a607c02f1 -> a147098c4
HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled
reliably fails. Contributed by Weiwei Yang.
(cherry picked from commit ccf2db7fc2688d262df3309007cb12a4dfedc179)
Project: http://git-wip-
Repository: hadoop
Updated Branches:
refs/heads/trunk ba1ab08fd -> ccf2db7fc
HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled
reliably fails. Contributed by Weiwei Yang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/re
67 matches
Mail list logo