This is an automated email from the ASF dual-hosted git repository.
stevel pushed a change to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
from 1520b84 YARN-10519. Refactor QueueMetricsForCustomResources class to
move to yarn-common package. Contributed by Minni Mittal
new a44890e HADOOP-17296. ABFS: Force reads to be always of buffer size.
new d3caa15 Hadoop-17413. Release elastic byte buffer pool at close
new 5f312a0 HADOOP-17422: ABFS: Set default ListMaxResults to max server
limit (#2535) Contributed by Sumangala Patki
new f3a0ca6 HADOOP-17407. ABFS: Fix NPE on delete idempotency flow
new cb67292 HADOOP-17347. ABFS: Read optimizations
new 4865589 HADOOP-17404. ABFS: Small write - Merge append and flush
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
hadoop-tools/hadoop-azure/pom.xml | 2 +
.../src/config/checkstyle-suppressions.xml | 2 +
.../hadoop/fs/azurebfs/AbfsConfiguration.java | 54 +++
.../fs/azurebfs/AzureBlobFileSystemStore.java | 6 +
.../fs/azurebfs/constants/AbfsHttpConstants.java | 1 +
.../fs/azurebfs/constants/ConfigurationKeys.java | 13 +
.../constants/FileSystemConfigurations.java | 12 +-
.../fs/azurebfs/constants/HttpQueryParams.java | 1 +
.../services/AppendRequestParameters.java | 69 +++
.../hadoop/fs/azurebfs/services/AbfsClient.java | 50 +-
.../fs/azurebfs/services/AbfsHttpOperation.java | 39 +-
.../fs/azurebfs/services/AbfsInputStream.java | 231 ++++++++-
.../azurebfs/services/AbfsInputStreamContext.java | 62 +++
.../fs/azurebfs/services/AbfsOutputStream.java | 70 ++-
.../azurebfs/services/AbfsOutputStreamContext.java | 11 +
.../fs/azurebfs/services/AbfsRestOperation.java | 2 +-
.../fs/azurebfs/services/ReadBufferManager.java | 105 ++++-
.../hadoop-azure/src/site/markdown/abfs.md | 18 +-
.../fs/azurebfs/AbstractAbfsIntegrationTest.java | 8 +
.../fs/azurebfs/ITestAbfsNetworkStatistics.java | 339 +++++++------
.../azurebfs/ITestAzureBlobFileSystemDelete.java | 31 +-
.../ITestAzureBlobFileSystemListStatus.java | 8 +-
.../ITestAzureBlobFileSystemRandomRead.java | 244 ++++++++--
.../fs/azurebfs/ITestSmallWriteOptimization.java | 523 +++++++++++++++++++++
.../fs/azurebfs/services/ITestAbfsInputStream.java | 256 ++++++++++
.../services/ITestAbfsInputStreamReadFooter.java | 358 ++++++++++++++
.../ITestAbfsInputStreamSmallFileReads.java | 326 +++++++++++++
.../azurebfs/services/ITestAbfsOutputStream.java | 17 +-
.../fs/azurebfs/services/TestAbfsClient.java | 46 ++
.../fs/azurebfs/services/TestAbfsInputStream.java | 223 ++++++++-
.../fs/azurebfs/services/TestAbfsOutputStream.java | 279 ++++++-----
.../fs/azurebfs/services/TestAbfsPerfTracker.java | 13 +
.../hadoop/fs/azurebfs/utils/TestMockHelpers.java | 59 +++
33 files changed, 3031 insertions(+), 447 deletions(-)
create mode 100644
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/services/AppendRequestParameters.java
create mode 100644
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestSmallWriteOptimization.java
create mode 100644
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestAbfsInputStream.java
create mode 100644
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestAbfsInputStreamReadFooter.java
create mode 100644
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestAbfsInputStreamSmallFileReads.java
create mode 100644
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/utils/TestMockHelpers.java
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
