Repository: hadoop
Updated Branches:
refs/heads/branch-2 85c0cb007 -> e5dc723d4
HDFS-8873. Allow the directoryScanner to be rate-limited (Daniel Templeton via
Colin P. McCabe)
(cherry picked from commit 7a3c381b39887a02e944fa98287afd0eb4db3560)
Project:
Repository: hadoop
Updated Branches:
refs/heads/trunk 7fe521b1d -> 7a3c381b3
HDFS-8873. Allow the directoryScanner to be rate-limited (Daniel Templeton via
Colin P. McCabe)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't
work in ATS / RM web ui. Contributed by Naganarasimha G R
(cherry picked from commit 3ff1ba2a7b00fdf06270d00b2193bde4b56b06b3)
(cherry picked from commit b6eb36dbdc1c75f412616426cc7599f485e9b86e)
Project:
YARN-3544. Got back AM logs link on the RM web UI for a completed app.
Contributed by Xuan Gong.
(cherry picked from commit 21bf2cdcb77f69abc906e6cd401a8fb221f250e9)
(cherry picked from commit c9ee316045b83b18cb068aa4de739a1f4b50f02a)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
YARN-4047. ClientRMService getApplications has high scheduler lock contention.
Contributed by Jason Lowe
(cherry picked from commit 7a445fcfabcf9c6aae219051f65d3f6cb8feb87c)
(cherry picked from commit 703fa1b141a98449746bd6fb3b144e74d964d1f5)
Project:
HDFS-7552. Change FsVolumeList toString() to fix
TestDataNodeVolumeFailureToleration (Liang Xie via Colin P. McCabe)
(cherry picked from commit a4876c130f1627e59ef055e586640d1933fc49af)
(cherry picked from commit 22f72c79462c424e47610470fd48e871887ac326)
Project:
Preparing for release 2.6.1: mvn versions:set -DnewVersion=2.6.1
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3462a00d
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3462a00d
Diff:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 e5dc723d4 -> b46e4ceaf
refs/heads/trunk 7a3c381b3 -> 861b52db2
HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid
(Contributed by nijel)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid
(Contributed by nijel)
(cherry picked from commit 861b52db242f238d7e36ad75c158025be959a696)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsDataOutputStream.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClientFaultInjector.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java
--
diff --git
Repository: hadoop
Updated Branches:
refs/heads/branch-2 94cbb6d16 -> 2dca55be0
HDFS-9087. Add some jitter to DataNode.checkDiskErrorThread (Elliott Clark via
Colin P. McCabe)
(cherry picked from commit 0b31c237f2622e256726fc5d7698f0f195dbdbc1)
Project:
Repository: hadoop
Updated Branches:
refs/heads/trunk bf37d3d80 -> 0b31c237f
HDFS-9087. Add some jitter to DataNode.checkDiskErrorThread (Elliott Clark via
Colin P. McCabe)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
YARN-3733. Fix DominantRC#compare() does not work as expected if cluster
resource is empty. (Rohith Sharmaks via wangda)
(cherry picked from commit ebd797c48fe236b404cf3a125ac9d1f7714e291e)
(cherry picked from commit 78d626fa892415023827e35ad549636e2a83275d)
Project:
YARN-2978. Fixed potential NPE while getting queue info. Contributed by Varun
Saxena
(cherry picked from commit dd57c2047bfd21910acc38c98153eedf1db75169)
(cherry picked from commit c61e8a7bfa7236e354f859a889083fab3d7ca9eb)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Preparing for 2.6.2 development: mvn versions:set -DnewVersion=2.6.2
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4cb7dbae
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4cb7dbae
Diff:
YARN-3098. Created common QueueCapacities class in Capacity Scheduler to track
capacities-by-labels of queues. Contributed by Wangda Tan
(cherry picked from commit 21d80b3dd90a8e33e51701887c8d9369ed4ab17d)
(cherry picked from commit c0b1311a93614becc4a255af48fb7b697d491b80)
Project:
HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite
loop. Contributed by Larry McCay.
(cherry picked from commit 860b8373c3a851386b8cd2d4265dd35e5aabc941)
(cherry picked from commit 33648268ce0f79bf51facafa3d151612e3d00ddb)
Project:
YARN-3999. RM hangs on draing events. Contributed by Jian He
(cherry picked from commit 3ae716fa696b87e849dae40225dc59fb5ed114cb)
(cherry picked from commit 2ebdf5bfcee9ede80681a5266df225885d830883)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
CHANGES.txt: Dropping YARN-3379 as only the refactor part of it exists in
branch-2.6.1.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4697d94c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4697d94c
Diff:
YARN-3092. Created a common ResourceUsage class to track labeled resource
usages in Capacity Scheduler. Contributed by Wangda Tan
(cherry picked from commit 6f9fe76918bbc79109653edc6cde85df05148ba3)
(cherry picked from commit 61b4116b4b3c0eec8f514f079debd88bc757b28e)
Project:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f1b35ffd/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/TestFifoScheduler.java
HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links
to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P.
McCabe)
(cherry picked from commit 7b424f938c3c306795d574792b086d84e4f06425)
(cherry picked from commit
Preparing for release 2.6.1: Posting release notes generated.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c86d9bd1
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c86d9bd1
Diff:
Set the release date for 2.6.1-RC1
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b4d876d8
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b4d876d8
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/b4d876d8
HDFS-7446. HDFS inotify should have the ability to determine what txid it has
read up to (cmccabe)
(cherry picked from commit 75a326aaff8c92349701d9b3473c3070b8c2be44)
(cherry picked from commit 06552a15d5172a2b0ad3d61aa7f9a849857385aa)
Project:
YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track
capacities-by-label. Contributed by Wangda Tan
(cherry picked from commit 18a594257e052e8f10a03e5594e6cc6901dc56be)
(cherry picked from commit 1be2d64aa6322909073cfaf7f2f2eb46e18d)
Project:
YARN-3740. Fixed the typo in the configuration name:
APPLICATION_HISTORY_PREFIX_MAX_APPS. Contributed by Xuan Gong.
(cherry picked from commit eb6bf91eeacf97afb4cefe590f75ba94f3187d2b)
(cherry picked from commit 68cddb894a95a1ee63291af162849a23cb4eeb5f)
Project:
YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when
activating applications. Contributed by Craig Welch
(cherry picked from commit c53420f58364b11fbda1dace7679d45534533382)
(cherry picked from commit 4931600030e13d9332d9a0e588487cb8684c667d)
Project:
Release process for 2.6.1: Set the release date for 2.6.1
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/41d19f47
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/41d19f47
Diff:
HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed.
(Kihwal Lee via yliu)
(cherry picked from commit 146db49f7ff0dec82cd51f366311030404b770d7)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when
state-store error occurs. Contributed by Jian He
(cherry picked from commit 9f7fcb54e798cf4fda1ea7972dd96491976e1857)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
YARN-2918. RM should not fail on startup if queue's configured labels do not
exist in cluster-node-labels. Contributed by Wangda Tan
(cherry picked from commit f489a4ec969f3727d03c8e85d51af1018fc0b2a1)
(cherry picked from commit d817fbb34d6e34991c6e512c20d71387750a98f4)
Project:
YARN-2019. Retrospect on decision of making RM crashed if any exception throw
in ZKRMStateStore. Contributed by Jian He.
(cherry picked from commit db57d91ac91e895bcb9a23fa50af0b2fbcb1db5a)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Revert "YARN-2890. MiniYARNCluster should start the timeline server based on
the configuration. Contributed by Mit Desai."
This reverts commit 8a47d1aa559c380869861c070af9d1e7a8732607.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Add missing test file of YARN-3733
(cherry picked from commit 405bbcf68c32d8fd8a83e46e686eacd14e5a533c)
(cherry picked from commit 344b7509153cdd993218cd5104c7e5c07cd35d3c)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
YARN-2920. Changed CapacityScheduler to kill containers on nodes where node
labels are changed. Contributed by Wangda Tan
(cherry picked from commit fdf042dfffa4d2474e3cac86cfb8fe9ee4648beb)
(cherry picked from commit 411836b74c6c02c0b5aebbbce29c209d93db1de2)
Project:
YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM
web page. Contributed by Xuan Gong.
(cherry picked from commit 85f6d67fa78511f255fcfa810afc9a156a7b483b)
(cherry picked from commit 426535007bcdc67331f7a37b5d69cc20b37c26e0)
Project:
YARN-2694. Ensure only single node label specified in ResourceRequest.
Contributed by Wangda Tan
(cherry picked from commit c1957fef29b07fea70938e971b30532a1e131fd0)
(cherry picked from commit 3ddafaa7c854dcf21ecc790c276927e7c869e62c)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM
WebUI. Contributed by Xuan Gong
(cherry picked from commit 4e886eb9cbd2dcb128bbfd17309c734083093a4c)
(cherry picked from commit 3f0c9e5fe36d201de021d989b23ebaeb2d9a027b)
Project:
YARN-2890. MiniYarnCluster should turn on timeline service if configured to do
so. Contributed by Mit Desai.
(cherry picked from commit 265ed1fe804743601a8b62cabc1e4dc2ec8e502f)
(cherry picked from commit 55b794e7fa205df655c19bbfe1de99091fa9dc64)
Project:
YARN-4092. Fixed UI redirection to print useful messages when both RMs are in
standby mode. Contributed by Xuan Gong
(cherry picked from commit 6b3b487d3f4883a6e849c71886da52c4c4d9f0bf)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed
cache files so that child processes running hadoop scripts can access these
files. Contributed by Junping Du.
(cherry picked from commit 9da81a395584cb1dbfdee01fd4de53522681)
(cherry picked from commit
YARN-3248. Display count of nodes blacklisted by apps in the web UI.
Contributed by Varun Vasudev
(cherry picked from commit 4728bdfa15809db4b8b235faa286c65de4a48cf6)
(cherry picked from commit e26b6e55e96b763063dfbd39977096367eafc1e3)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
HDFS-7570. SecondaryNameNode need twice memory when calling
reloadFromImageFile. Contributed by zhaoyunjiong.
(cherry picked from commit 85aec75ce53445e1abf840076d2e10f1e3c6d69b)
(cherry picked from commit 27eecaef10feb49c4160ad289fd301bba6608973)
Project:
YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to
track used-resources-by-label. Contributed by Wangda Tan
(cherry picked from commit 86358221fc85a7743052a0b4c1647353508bf308)
(cherry picked from commit cabf97ae4f2dad53c7b9e3d10a67876b16d94074)
Project:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c86d9bd1/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html
--
diff --git
a/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html
YARN-3248. Moving it to improvements section in CHANGES.txt.
(cherry picked from commit df52ff92ae42977bc743630191d1cbe1e17d00cf)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e8c4544d
Tree:
Set the release date for 2.6.1-RC0
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/075d899d
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/075d899d
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/075d899d
YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R
(cherry picked from commit 258623ff8bb1a1057ae3501d4f20982d5a59ea34)
(cherry picked from commit 1d1e7682c9cad6a2f819b390ca3368dfa29c7097)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
HDFS-8846. Add a unit test for INotify functionality across a layout version
upgrade (Zhe Zhang via Colin P. McCabe)
(cherry picked from commit a4d9acc51d1a977bc333da17780c00c72e8546f1)
(cherry picked from commit 9264b7e119efb70fb355904652beeb97e7ad90b9)
Project:
YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets
connection issue. Contributed by Xuan Gong
(cherry picked from commit 214fd1408c21f596d1d15217c11b58b34561aab7)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit:
Preparing for release 2.6.1: Updating site update page.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cfb012a2
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/cfb012a2
Diff:
YARN-3978. Configurably turn off the saving of container info in Generic AHS
(Eric Payne via jeagles)
(cherry picked from commit 3cd02b95224e9d43fd63a4ef9ac5c44f113f710d)
(cherry picked from commit 899df5bce03ea4f94487e48c1d38bd30ae10c26f)
Project:
Repository: hadoop
Updated Branches:
refs/heads/branch-2.6 934886486 -> 1828ba00b (forced update)
HADOOP-12280. Skip unit tests based on maven profile rather than
NativeCodeLoader.isNativeCodeLoaded (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit
HDFS-8384. Allow NN to startup if there are files having a lease but are not
under construction. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/33537078
Tree:
HDFS-8053. Move DFSIn/OutputStream and related classes to hadoop-hdfs-client.
Contributed by Mingliang Liu.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/bf37d3d8
Tree:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
--
diff --git
HDFS-8053. Move DFSIn/OutputStream and related classes to hadoop-hdfs-client.
Contributed by Mingliang Liu.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/94cbb6d1
Tree:
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsDataOutputStream.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClientFaultInjector.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClientFaultInjector.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
--
diff --git
Repository: hadoop
Updated Branches:
refs/heads/trunk 861b52db2 -> bf37d3d80
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/client/HdfsDataOutputStream.java
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockReaderFactory.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bf37d3d8/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClientFaultInjector.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
--
diff --git
Repository: hadoop
Updated Branches:
refs/heads/branch-2 b46e4ceaf -> 94cbb6d16
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/client/HdfsDataOutputStream.java
http://git-wip-us.apache.org/repos/asf/hadoop/blob/94cbb6d1/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockReaderFactory.java
--
diff --git
78 matches
Mail list logo