Repository: hadoop
Updated Branches:
refs/heads/branch-2.7 f133e0161 -> c2a4ce771
HDFS-11379. DFSInputStream may infinite loop requesting block locations.
Contributed by Daryn Sharp.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/ha
Repository: hadoop
Updated Branches:
refs/heads/branch-2 5575328bb -> 93219b645
YARN-6125. The application attempt's diagnostic message should have a maximum
size
(Contributed by Andras Piros via Daniel Templeton)
(cherry picked from commit c7a36e613053ec8b46004b887c2f13535469)
Project:
Repository: hadoop
Updated Branches:
refs/heads/branch-2 10fd5627b -> 5575328bb
YARN-6193. FairScheduler might not trigger preemption when using DRF. (kasha)
(cherry picked from commit dbbfcf74ab44d7bfdc805b63affd0defc57182b8)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commi
Repository: hadoop
Updated Branches:
refs/heads/trunk c7a36e613 -> dbbfcf74a
YARN-6193. FairScheduler might not trigger preemption when using DRF. (kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/dbbfcf74
Tree: ht
Repository: hadoop
Updated Branches:
refs/heads/trunk 9a9283778 -> c7a36e613
YARN-6125. The application attempt's diagnostic message should have a maximum
size
(Contributed by Andras Piros via Daniel Templeton)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wi
Repository: hadoop
Updated Branches:
refs/heads/branch-2 06386b7e7 -> 10fd5627b
YARN-6188. Fix OOM issue with decommissioningNodesWatcher in the case of
clusters with
large number of nodes (Contributed by Ajay Jadhav via Daniel Templeton)
(cherry picked from commit 585168cc1bdb87398d4f388f3ee
Repository: hadoop
Updated Branches:
refs/heads/trunk 4c26c241a -> 9a9283778
YARN-6188. Fix OOM issue with decommissioningNodesWatcher in the case of
clusters with
large number of nodes (Contributed by Ajay Jadhav via Daniel Templeton)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/r
Repository: hadoop
Updated Branches:
refs/heads/trunk 02c549484 -> 4c26c241a
HADOOP-13805. UGI.getCurrentUser() fails if user does not have a keytab
associated. Contributed by Xiao Chen, Wei-Chiu Chuang, Yongjun Zhang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http:
Repository: hadoop
Updated Branches:
refs/heads/HDFS-10285 34e0df3b7 -> 58240d86a
HDFS-11239: [SPS]: Check Mover file ID lease also to determine whether Mover is
running. Contributed by Wei Zhou
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/
HDFS-10794. [SPS]: Provide storage policy satisfy worker at DN for
co-ordinating the block storage movement work. Contributed by Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6ecfe24d
Tree: http://git-wip-us.apac
HDFS-11243. [SPS]: Add a protocol command from NN to DN for dropping the SPS
work and queues. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/34e0df3b
Tree: http://git-wip-us.apache.org/re
HDFS-11029. [SPS]:Provide retry mechanism for the blocks which were failed
while moving its storage at DNs. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/79bcaed2
Tree: http://git-wip-us
HDFS-10884: [SPS]: Add block movement tracker to track the completion of block
movement future tasks at DN. Contributed by Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e4983d56
Tree: http://git-wip-us.apache.org
HDFS-10802. [SPS]: Add satisfyStoragePolicy API in HdfsAdmin. Contributed by
Yuanbo Liu
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/87c7f896
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/87c7f896
Diff: http:/
HDFS-10954. [SPS]: Provide mechanism to send blocks movement result back to NN
from coordinator DN. Contributed by Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/047e1cd4
Tree: http://git-wip-us.apache.org/repos/a
HDFS-11150: [SPS]: Provide persistence when satisfying storage policy.
Contributed by Yuanbo Liu
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/41bd9f17
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/41bd9f17
Dif
HDFS-10885. [SPS]: Mover tool should not be allowed to run when Storage Policy
Satisfier is on. Contributed by Wei Zhou
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3e335489
Tree: http://git-wip-us.apache.org/repos/asf/h
HDFS-11293: [SPS]: Local DN should be given preference as source node, when
target available in same node. Contributed by Yuanbo Liu and Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/01d1b93b
Tree: htt
YARN-6171. ConcurrentModificationException on FSAppAttempt.containersToPreempt.
(Miklos Szegedi via kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a77f4324
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a7
HDFS-11193 : [SPS]: Erasure coded files should be considered for satisfying
storage policy. Contributed by Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3b1b32df
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/627da6f7
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/627da6f7
Diff: http://git-wip-us
YARN-4753. Use doxia macro to generate in-page TOC of YARN site documentation.
(iwasakims)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/fbc0c2bd
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/fbc0c2bd
Diff: htt
HDFS-11068: [SPS]: Provide unique trackID to track the block movement sends to
coordinator. Contributed by Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/866876b5
Tree: http://git-wip-us.apache.org/repos/asf/hadoo
HDFS-10801. [SPS]: Protocol buffer changes for sending storage movement
commands from NN to DN. Contributed by Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/407b8e8e
Tree: http://git-wip-us.apache.org/repos/asf/h
HDFS-11100. Recursively deleting file protected by sticky bit should fail.
Contributed by John Zhuge.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5690b51e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/5690b51
HADOOP-14040. Use shaded aws-sdk uber-JAR 1.11.86. Contributed by Steve
Loughran and Sean Mackrory
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/658702ef
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/658702ef
D
YARN-6177. Yarn client should exit with an informative error message if an
incompatible Jersey library is used at client. Contributed by Weiwei Yang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5d339c46
Tree: http://git
HADOOP-14072. AliyunOSS: Failed to read from stream when seek beyond the
download size. Contributed by Genmao Yu
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/cd3e59a3
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/t
YARN-6061. Addendum. Remove extraneous change.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/353a9b2d
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/353a9b2d
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/di
YARN-6163. FS Preemption is a trickle for severely starved applications. (kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6c25dbcd
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/6c25dbcd
Diff: http://git-wip
HDFS-11123. [SPS] Make storage policy satisfier daemon work on/off dynamically.
Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/6176ef1f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop
YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate
classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4fa1afdb
Tree: http://git-wip-us.apa
HDFS-11186. [SPS]: Daemon thread of SPS should start only in Active NN.
Contributed by Wei Zhou
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7eb68acf
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/7eb68acf
Diff
HDFS-11309. [SPS]: chooseTargetTypeInSameNode should pass accurate block size
to chooseStorage4Block while choosing target. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5a6b09e0
Tree: h
HDFS-11248: [SPS]: Handle partial block location movements. Contributed by
Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/90fdaaca
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/90fdaaca
Diff: http://git
HDFS-11151. [SPS]: StoragePolicySatisfier should gracefully handle when there
is no target node with the required storage type. Contributed by Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/29b91956
Tree: http://g
YARN-5798. Set UncaughtExceptionHandler for all FairScheduler threads. (Yufei
Gu via kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/74dd1422
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/74dd1422
Diff: ht
HDFS-11032: [SPS]: Handling of block movement failure at the coordinator
datanode. Contributed by Rakesh R
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7fee7765
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/7f
HADOOP-14049. Honour AclBit flag associated to file/folder permission for Azure
datalake account. Contributed by Vishwajeet Dusane
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f4329990
Tree: http://git-wip-us.apache.org/
YARN-4212. FairScheduler: Can't create a DRF queue under a FAIR policy queue.
(Yufei Gu via kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/11be3f70
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/11be3f70
D
Repository: hadoop
Updated Branches:
refs/heads/HDFS-10285 efe7a1cc8 -> 34e0df3b7 (forced update)
HDFS-11409. DatanodeInfo getNetworkLocation and setNetworkLocation shoud use
volatile instead of synchronized. Contributed by Chen Liang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/r
HDFS-11238. Fix checkstyle warnings in NameNode#createNameNode. Contributed by
Ethan Li.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8acb376c
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8acb376c
Diff: http:
YARN-6156. AM blacklisting to consider node label partition (Bibin A Chundatt
via Varun Saxena)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b7613e0f
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/b7613e0f
Diff
HDFS-11289. [SPS]: Make SPS movement monitor timeouts configurable. Contributed
by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d875c184
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/d875c1
HDFS-11375. Display the volume storage type in datanode UI. Contributed by
Surendra Singh Lilhore
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0741dd3b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0741dd3b
Di
HDFS-10800: [SPS]: Daemon thread in Namenode to find blocks placed in other
storage than what the policy specifies. Contributed by Uma Maheswara Rao G
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/5920a38a
Tree: http://gi
HDFS-11410. Use the cached instance when edit logging SetAclOp, SetXAttrOp and
RemoveXAttrOp.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/02c54948
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/02c54948
Diff:
HADOOP-14019. Fix some typos in the s3a docs. Contributed by Steve Loughran
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/bdad8b7b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/bdad8b7b
Diff: http://git-wip-us.a
YARN-6183. Few missing informations in Application and Application Attempt
pages for new YARN UI. Contributed by Akhil PB.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ff751323
Tree: http://git-wip-us.apache.org/repos/as
HDFS-11333. Print a user friendly error message when plugins are not found.
Contributed by Wei-Chiu Chuang.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/859bd159
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8
YARN-6174. Log files pattern should be same for both running and finished
container. Contributed by Xuan Gong.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ce2d5bfa
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tre
YARN-6061. Add an UncaughtExceptionHandler for critical threads in RM. (Yufei
Gu via kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/652679aa
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/652679aa
Diff: ht
http://git-wip-us.apache.org/repos/asf/hadoop/blob/4fa1afdb/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/api/impl/TimelineConnector.java
--
diff --git
a/hadoop-yarn-project/hadoop-
YARN-6200. addendum to fix compilation error caused by reverting YARN-5068.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e63a7814
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e63a7814
Diff: http://git-wip-us.a
YARN-6200. Reverting since the same functionality achieved by YARN-1623.
Revert "YARN-5068. Expose scheduler queue to application master. (Harish
Jaiprakash via rohithsharmaks)"
This reverts commit b7ac85259c7d20c33bef9c9cb40b8aabcab70755.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/
HADOOP-13942. Update checkstyle and checkstyle plugin version to handle
indentation of JDK8 Lambdas.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1e11080b
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1e11080b
Addendum patch for YARN-6174 - remove deleted file.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0fc6f383
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/0fc6f383
Diff: http://git-wip-us.apache.org/repos/asf/hado
HDFS-11265. Extend visualization for Maintenance Mode under Datanode tab in the
NameNode UI. (Marton Elek via mingma)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a136936d
Tree: http://git-wip-us.apache.org/repos/asf/had
HDFS-11391. Numeric usernames do no work with WebHDFS FS write access. (Pierre
Villard via Yongjun Zhang)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8e53f2b9
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8e5
59 matches
Mail list logo