[hadoop] branch trunk updated: HDFS-17074. Remove incorrect comment in TestRedudantBlocks#setup. (#5822). Contributed by farmmamba.
This is an automated email from the ASF dual-hosted git repository.
ayushsaxena pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new 130bd033d53 HDFS-17074. Remove incorrect comment in
TestRedudantBlocks#setup. (#5822). Contributed by farmmamba.
130bd033d53 is described below
commit 130bd033d53d7a1621045b2ee0e24111a7599c15
Author: hfutatzhanghb
AuthorDate: Fri Jul 21 03:15:40 2023 +0800
HDFS-17074. Remove incorrect comment in TestRedudantBlocks#setup. (#5822).
Contributed by farmmamba.
Reviewed-by: zhangshuyan
Signed-off-by: Ayush Saxena
---
.../java/org/apache/hadoop/hdfs/server/namenode/TestRedudantBlocks.java | 1 -
1 file changed, 1 deletion(-)
diff --git
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestRedudantBlocks.java
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestRedudantBlocks.java
index 1a1fc16215a..f5d54d29fdc 100644
---
a/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestRedudantBlocks.java
+++
b/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestRedudantBlocks.java
@@ -66,7 +66,6 @@ public class TestRedudantBlocks {
public void setup() throws IOException {
Configuration conf = new Configuration();
conf.setLong(DFSConfigKeys.DFS_BLOCK_SIZE_KEY, blockSize);
-// disable block recovery
conf.setInt(DFSConfigKeys.DFS_NAMENODE_REDUNDANCY_INTERVAL_SECONDS_KEY, 1);
conf.setInt(DFSConfigKeys.DFS_HEARTBEAT_INTERVAL_KEY, 1);
SimulatedFSDataset.setFactory(conf);
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] branch trunk updated (80fefd093f7 -> fbe9a292469)
This is an automated email from the ASF dual-hosted git repository. ayushsaxena pushed a change to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git from 80fefd093f7 HDFS-17067 Use BlockingThreadPoolExecutorService for nnProbingThreadPool in ObserverReadProxy (#5803) add fbe9a292469 YARN-11540. Fix typo: form -> from (#5861). Contributed by Seokchan Yoon. No new revisions were added by this update. Summary of changes: .../apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java| 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] branch feature-HADOOP-18073-s3a-sdk-upgrade updated (75220b77387 -> acb31b6757f)
This is an automated email from the ASF dual-hosted git repository. stevel pushed a change to branch feature-HADOOP-18073-s3a-sdk-upgrade in repository https://gitbox.apache.org/repos/asf/hadoop.git omit 75220b77387 fixes issues after rebase omit 1f137d3283c HADOOP-18565. Complete outstanding items for the AWS SDK V2 upgrade. (#5421) omit fb6d12a9a59 adds in unit check for bytes omit ce02671de4a update GET range referrer header logic to V2 omit 644a32f9d27 updates new providers in TestS3AAWSCredentialsProvider to V2 omit 0338fd89f6d Add unit tests for SelectEventStreamPublisher omit 38dff867b9d Add unit tests for BlockingEnumeration omit 0c2fd282526 Move TransferManager initialization to ClientFactory omit 1ab7e6827d0 Reinstate old constants omit aa1cf19ffaa Move MultiObjectDeleteException to impl omit 68510c8ab12 HADOOP-18073. Address review comments. (#31) omit f2bf08cae13 HADOOP-18073. Upgrade AWS SDK to v2 in S3A [work in progress] add 482897a0f65 Fix typos in HDFS documents. (#5665) add 8e173851410 HDFS-17009. RBF: state store putAll should also return failed records (#5664) add 5ddaf2e133d YARN-11493. [Federation] ConfiguredRMFailoverProxyProvider Supports Randomly Select an Router. (#5651) add 03163f9de26 HDFS-17011. Fix the metric of "HttpPort" at DataNodeInfo (#5657). Contributed by Zhaohui Wang. add 350dcaf6167 HDFS-17010. Add a subtree test to TestSnapshotDiffReport. (#5656) add 78cc528739c HDFS-17012.Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT. (#5659). Contributed by JiangHua Zhu. add ff8eac517a3 YARN-11463. Node Labels root directory creation doesn't have a retry logic - 2nd addendum (#5670) add bba663038d9 YARN-8898. Fix FederationInterceptor#allocate to set application priority in allocateResponse. (#5645) add f6770dee476 HDFS-16979. RBF: Add proxyuser port in hdfsauditlog (#5552). Contributed by liuguanghua. add 4627242c449 HADOOP-18652. Path.suffix raises NullPointerException (#5653). Contributed by Patrick Grandjean. add 441fb232939 HDFS-17018. Improve dfsclient log format. (#5668). Contributed by Xianming Lei. add 339bc7b3a6e HDFS-16653. Improve error messages in ShortCircuitCache. (#5568). Contributed by ECFuzz. add 0914b3e7920 HDFS-16697. Add logs if resources are not available in NameNodeResourcePolicy. (#5569). Contributed by ECFuzz. add 5272ed86708 HADOOP-17518. Update the regex to A-Z (#5669). Contributed by Nishtha Shah. add 408dbf318e7 HDFS-17014. HttpFS Add Support getStatus API (#5660). Contributed by Hualong Zhang. add 9a524ede872 HDFS-17022. Fix the exception message to print the Identifier pattern (#5678). Contributed by Nishtha Shah. add 0110e24ed86 YARN-11496. Improve TimelineService log format. (#5677). Contributed by Xianming Lei. add af933f3a4f9 HDFS-17017. Fix the issue of arguments number limit in report command in DFSAdmin (#5667). Contributed by Haiyang Hu. add 5b22dc6aced HDFS-16909. Improve ReplicaMap#mergeAll method. (#5353). Contributed by ZhangHB. add afe850ca2c2 HADOOP-18746. Install Python 3 for Windows 10 docker image (#5679) add 3b65b5d68f8 HDFS-17020. RBF: mount table addAll should print failed records in std error (#5674) add a98d15804a9 MAPREDUCE-7419. Upgrade Junit 4 to 5 in hadoop-mapreduce-client-common (#5028). Contributed by Ashutosh Gupta. add aeb3f6f1a84 YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation (#5644) add e9740cb17ae HDFS-16908. Fix javadoc of field IncrementalBlockReportManager#readyToSend. (#5351). Contributed by farmmamba. add e6b54f7f683 Revert "HADOOP-18706. Improve S3ABlockOutputStream recovery (#5563)" add b977065cc4c YARN-11478. [Federation] SQLFederationStateStore Support Store ApplicationSubmitData. (#5663) add 97afb33c73b YARN-11276. Add LRU cache for RMWebServices.getApps. (#4793) add 86c250a54a5 YARN-7720. Race condition between second app attempt and UAM timeout when first attempt node is down. (#5672) add 124313d2159 HDFS-17026. RBF: NamenodeHeartbeatService should update JMX report with configurable frequency. (#5691). Contributed by hchaverri. add 9acf462d268 HDFS-17000. Fix faulty loop condition in TestDFSStripedOutputStreamUpdatePipeline (#5699). Contributed by Marcono1234. add d92a5815f45 HDFS-17027. RBF: Adds auto-msync support for clients connecting to routers. (#5693) add f8b7ddf69c5 HDFS-16996. Fix flaky testFsCloseAfterClusterShutdown in TestFileCreation (#5697). Contributed by Nishtha Shah. add 9f1e23cc675 HDFS-17031. Reduce some repeated codes in RouterRpcServer. (#5701). Contributed by Chengwei Wang. add 160b9fc3c92 HADOOP-18755. openFile builder new optLong() methods break hbase-filesystem (#5704) add 03a499821c9 HADOOP-18207. Introduce hadoop-logging module (#5503)
[hadoop] branch trunk updated: HDFS-17067 Use BlockingThreadPoolExecutorService for nnProbingThreadPool in ObserverReadProxy (#5803)
This is an automated email from the ASF dual-hosted git repository.
inigoiri pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new 80fefd093f7 HDFS-17067 Use BlockingThreadPoolExecutorService for
nnProbingThreadPool in ObserverReadProxy (#5803)
80fefd093f7 is described below
commit 80fefd093f7117757bc2d2ad8f5ca57538d8632e
Author: Xing Lin
AuthorDate: Thu Jul 20 10:46:41 2023 -0700
HDFS-17067 Use BlockingThreadPoolExecutorService for nnProbingThreadPool in
ObserverReadProxy (#5803)
---
.../namenode/ha/ObserverReadProxyProvider.java | 26 ++
1 file changed, 12 insertions(+), 14 deletions(-)
diff --git
a/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/ObserverReadProxyProvider.java
b/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/ObserverReadProxyProvider.java
index 11143d7ef5a..2c58ad1a97b 100644
---
a/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/ObserverReadProxyProvider.java
+++
b/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/ObserverReadProxyProvider.java
@@ -27,11 +27,8 @@ import java.net.URI;
import java.util.concurrent.Callable;
import java.util.concurrent.ExecutionException;
import java.util.concurrent.RejectedExecutionException;
-import java.util.concurrent.ExecutorService;
import java.util.concurrent.Future;
-import java.util.concurrent.ThreadPoolExecutor;
import java.util.concurrent.TimeUnit;
-import java.util.concurrent.ArrayBlockingQueue;
import java.util.concurrent.TimeoutException;
import java.util.List;
@@ -54,6 +51,7 @@ import org.apache.hadoop.ipc.RPC;
import org.apache.hadoop.ipc.RemoteException;
import org.apache.hadoop.ipc.RpcInvocationHandler;
import org.apache.hadoop.ipc.StandbyException;
+import org.apache.hadoop.util.BlockingThreadPoolExecutorService;
import org.apache.hadoop.util.Time;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
@@ -187,18 +185,8 @@ public class ObserverReadProxyProvider
/**
* Threadpool to send the getHAServiceState requests.
- *
- * One thread running all the time, with up to 4 threads. Idle threads will
be killed after
- * 1 minute. At most 1024 requests can be submitted before they start to be
rejected.
- *
- * Each hdfs client will have its own ObserverReadProxyProvider. Thus,
- * having 1 thread running should be sufficient in most cases.
- * We are not expecting to receive a lot of outstanding RPC calls
- * from a single hdfs client, thus setting the queue size to 1024.
*/
- private final ExecutorService nnProbingThreadPool =
- new ThreadPoolExecutor(1, 4, 1L, TimeUnit.MINUTES,
- new ArrayBlockingQueue(1024));
+ private final BlockingThreadPoolExecutorService nnProbingThreadPool;
/**
* By default ObserverReadProxyProvider uses
@@ -262,6 +250,15 @@ public class ObserverReadProxyProvider
+ "class does not implement {}", uri,
ClientProtocol.class.getName());
this.observerReadEnabled = false;
}
+
+/*
+ * At most 4 threads will be running and each thread will die after 10
+ * seconds of no use. Up to 132 tasks (4 active + 128 waiting) can be
+ * submitted simultaneously.
+ */
+nnProbingThreadPool =
+BlockingThreadPoolExecutorService.newInstance(4, 128, 10L,
TimeUnit.SECONDS,
+"nn-ha-state-probing");
}
public AlignmentContext getAlignmentContext() {
@@ -648,6 +645,7 @@ public class ObserverReadProxyProvider
}
}
failoverProxy.close();
+nnProbingThreadPool.shutdown();
}
@Override
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] branch branch-3.3 updated: HADOOP-18752. Change fs.s3a.directory.marker.retention to "keep" -everything but the switch (#5859)
This is an automated email from the ASF dual-hosted git repository.
stevel pushed a commit to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/branch-3.3 by this push:
new 210104e99e2 HADOOP-18752. Change fs.s3a.directory.marker.retention to
"keep" -everything but the switch (#5859)
210104e99e2 is described below
commit 210104e99e2e7a67eeaa7007ed35d5aa0fd36bd0
Author: Steve Loughran
AuthorDate: Thu Jul 20 18:47:35 2023 +0100
HADOOP-18752. Change fs.s3a.directory.marker.retention to "keep"
-everything but the switch (#5859)
This change has all of PR #5689 *except* for changing the
default value of marker retention from keep to delete.
1. leaves the default value of fs.s3a.directory.marker.retention
at "delete"
2. no longer prints a message when an S3A FS instances is
instantiated with any option other than delete.
3. Updates the directory marker documentation
Switching to marker retention improves performance
on any S3 bucket as there are no needless marker DELETE requests
-leading to a reduction in write IOPS and and any delays waiting
for the DELETE call to finish.
There are *very* significant improvements on versioned buckets,
where tombstone markers slow down LIST operations: the more
tombstones there are, the worse query planning gets.
Having versioning enabled on production stores is the foundation
of any data protection strategy, so this has tangible benefits
in production.
Marker deletion is *not* compatible with older hadoop releases;
specifically
- Hadoop branch 2 < 2.10.2
- Any release of Hadoop 3.0.x and Hadoop 3.1.x
- Hadoop 3.2.0 and 3.2.1
- Hadoop 3.3.0
Incompatible releases have no problems reading data in stores
where markers are retained, but can get confused when deleting
or renaming directories.
Contributed by Steve Loughran
---
.../hadoop/fs/s3a/impl/DirectoryPolicyImpl.java| 4 +-
.../site/markdown/tools/hadoop-aws/committers.md | 2 +-
.../markdown/tools/hadoop-aws/directory_markers.md | 233 +++--
.../src/site/markdown/tools/hadoop-aws/index.md| 9 +-
.../src/site/markdown/tools/hadoop-aws/s3guard.md | 10 +-
.../src/site/markdown/tools/hadoop-aws/testing.md | 36 +---
6 files changed, 137 insertions(+), 157 deletions(-)
diff --git
a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/DirectoryPolicyImpl.java
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/DirectoryPolicyImpl.java
index a1aa2580b65..7d501944308 100644
---
a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/DirectoryPolicyImpl.java
+++
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/DirectoryPolicyImpl.java
@@ -186,11 +186,11 @@ public final class DirectoryPolicyImpl
policy = DELETE;
break;
case DIRECTORY_MARKER_POLICY_KEEP:
- LOG.info("Directory markers will be kept");
+ LOG.debug("Directory markers will be kept");
policy = KEEP;
break;
case DIRECTORY_MARKER_POLICY_AUTHORITATIVE:
- LOG.info("Directory markers will be kept on authoritative"
+ LOG.debug("Directory markers will be kept on authoritative"
+ " paths");
policy = new DirectoryPolicyImpl(MarkerPolicy.Authoritative,
authoritativeness);
diff --git
a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/committers.md
b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/committers.md
index 38aea18cad1..4dd69e8efe4 100644
--- a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/committers.md
+++ b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/committers.md
@@ -792,7 +792,7 @@ Security
Delegation token support is disabled
Directory Markers
-The directory marker policy is "delete"
+The directory marker policy is "keep"
Available Policies: delete, keep, authoritative
Authoritative paths: fs.s3a.authoritative.path=```
```
diff --git
a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/directory_markers.md
b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/directory_markers.md
index f27a1c2f66e..a375b0bdb96 100644
---
a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/directory_markers.md
+++
b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/directory_markers.md
@@ -12,11 +12,11 @@
limitations under the License. See accompanying LICENSE file.
-->
-# Experimental: Controlling the S3A Directory Marker Behavior
+# Controlling the S3A Directory Marker Behavior
-This document discusses an experimental feature of the S3A
-connector since Hadoop 3.3.1: the ability to retain directory
-marker objects above paths containing files or subdirectories.
+This document discusses a performance fe
[hadoop] branch branch-3.3 updated (caeed401b2e -> d567a714095)
This is an automated email from the ASF dual-hosted git repository. stevel pushed a change to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/hadoop.git from caeed401b2e HADOOP-18795. S3A DelegationToken plugin to expand return type of binding (#5821) add d567a714095 HDFS-13916. Distcp SnapshotDiff to support WebHDFS. (#5839) No new revisions were added by this update. Summary of changes: .../java/org/apache/hadoop/tools/DistCpSync.java | 74 ++ .../org/apache/hadoop/tools/TestDistCpSync.java| 161 ++--- 2 files changed, 188 insertions(+), 47 deletions(-) - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] branch trunk updated (104a323f6f6 -> c35f31640ec)
This is an automated email from the ASF dual-hosted git repository. stevel pushed a change to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git from 104a323f6f6 HADOOP-18795. S3A DelegationToken plugin to expand return type of binding (#5821) add c35f31640ec HADOOP-18807. Close child file systems in ViewFileSystem when cache is disabled. (#5847) No new revisions were added by this update. Summary of changes: .../org/apache/hadoop/fs/viewfs/InodeTree.java | 5 ++ .../apache/hadoop/fs/viewfs/ViewFileSystem.java| 34 .../hadoop/fs/viewfs/TestViewFileSystemClose.java | 61 ++ 3 files changed, 100 insertions(+) create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/viewfs/TestViewFileSystemClose.java - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[hadoop] branch branch-3.3 updated: HADOOP-18795. S3A DelegationToken plugin to expand return type of binding (#5821)
This is an automated email from the ASF dual-hosted git repository.
stevel pushed a commit to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/branch-3.3 by this push:
new caeed401b2e HADOOP-18795. S3A DelegationToken plugin to expand return
type of binding (#5821)
caeed401b2e is described below
commit caeed401b2e358613d026f48e278e16f3707afee
Author: Steve Loughran
AuthorDate: Thu Jul 20 11:27:58 2023 +0100
HADOOP-18795. S3A DelegationToken plugin to expand return type of binding
(#5821)
Adds a class DelegationBindingInfo which contains binding info
beyond just the AWS credential list.
The binding class can be expanded when needed. Until then, all existing
implementations will work, as the new method
DelegationBindingInfo deploy(AbstractS3ATokenIdentifier
retrievedIdentifier)
falls back to the original methods.
Contributed by Steve Loughran
---
.../delegation/AbstractDelegationTokenBinding.java | 35 ---
.../s3a/auth/delegation/DelegationBindingInfo.java | 52 ++
.../s3a/auth/delegation/S3ADelegationTokens.java | 40 +
3 files changed, 103 insertions(+), 24 deletions(-)
diff --git
a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/auth/delegation/AbstractDelegationTokenBinding.java
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/auth/delegation/AbstractDelegationTokenBinding.java
index 6e31c006e26..6af413e44d6 100644
---
a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/auth/delegation/AbstractDelegationTokenBinding.java
+++
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/auth/delegation/AbstractDelegationTokenBinding.java
@@ -198,15 +198,37 @@ public abstract class AbstractDelegationTokenBinding
extends AbstractDTService {
return (T) identifier;
}
+ /**
+ * Deploy, returning the binding information.
+ * The base implementation calls
+ *
+ * @param retrievedIdentifier any identifier -null if deployed unbonded.
+ * @return binding information
+ * @throws IOException any failure.
+ */
+ public DelegationBindingInfo deploy(AbstractS3ATokenIdentifier
retrievedIdentifier)
+throws IOException {
+requireServiceStarted();
+AWSCredentialProviderList credentialProviders =
+retrievedIdentifier == null
+? deployUnbonded()
+: bindToTokenIdentifier(retrievedIdentifier);
+return new DelegationBindingInfo()
+.withCredentialProviders(credentialProviders);
+ }
+
/**
* Perform any actions when deploying unbonded, and return a list
* of credential providers.
* @return non-empty list of AWS credential providers to use for
* authenticating this client with AWS services.
* @throws IOException any failure.
+ * @throws UnsupportedOperationException in the base implementation.
*/
- public abstract AWSCredentialProviderList deployUnbonded()
- throws IOException;
+ public AWSCredentialProviderList deployUnbonded()
+ throws IOException {
+throw new UnsupportedOperationException("unimplemented");
+ }
/**
* Bind to the token identifier, returning the credential providers to use
@@ -214,11 +236,14 @@ public abstract class AbstractDelegationTokenBinding
extends AbstractDTService {
* @param retrievedIdentifier the unmarshalled data
* @return non-empty list of AWS credential providers to use for
* authenticating this client with AWS services.
- * @throws IOException any failure.
+ * @throws IOException any failure
+ * @throws UnsupportedOperationException in the base implementation.
*/
- public abstract AWSCredentialProviderList bindToTokenIdentifier(
+ public AWSCredentialProviderList bindToTokenIdentifier(
AbstractS3ATokenIdentifier retrievedIdentifier)
- throws IOException;
+ throws IOException {
+throw new UnsupportedOperationException("unimplemented");
+ }
/**
* Create a new subclass of {@link AbstractS3ATokenIdentifier}.
diff --git
a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/auth/delegation/DelegationBindingInfo.java
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/auth/delegation/DelegationBindingInfo.java
new file mode 100644
index 000..00d607c9912
--- /dev/null
+++
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/auth/delegation/DelegationBindingInfo.java
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http:
[hadoop] branch trunk updated (82c8070e93a -> 104a323f6f6)
This is an automated email from the ASF dual-hosted git repository.
stevel pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
from 82c8070e93a YARN-9877 - Intermittent TIME_OUT of LogAggregationReport
(#5784)
add 104a323f6f6 HADOOP-18795. S3A DelegationToken plugin to expand return
type of binding (#5821)
No new revisions were added by this update.
Summary of changes:
.../delegation/AbstractDelegationTokenBinding.java | 35 ++---
...nIdentifier.java => DelegationBindingInfo.java} | 45 +++---
.../s3a/auth/delegation/S3ADelegationTokens.java | 40 ++-
3 files changed, 74 insertions(+), 46 deletions(-)
copy
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/auth/delegation/{RoleTokenIdentifier.java
=> DelegationBindingInfo.java} (53%)
-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
