This is an automated email from the ASF dual-hosted git repository. keepromise pushed a change to branch HDFS-17531 in repository https://gitbox.apache.org/repos/asf/hadoop.git
omit 82bccee6538 HDFS-17715. [ARR] Add documentation for asynchronous router. (#7318). Contributed by Jian Zhang. omit 58b13914f55 HDFS-17651.[ARR] Async handler executor isolation (#7244). Contributed by hfutatzhanghb. omit 5b7bc50dcda HDFS-17650. [ARR] The router server-side rpc protocol PB supports asynchrony. (#7139). Contributed by hfutatzhanghb. omit e350b83942d HDFS-17640.[ARR] RouterClientProtocol supports asynchronous rpc. (#7188) omit 240efd49caa HADOOP-19361. RPC DeferredMetrics bugfix. (#7220). Contributed by hfutatzhanghb. omit 824224270ce HDFS-17672. [ARR] Move asynchronous related classes to the async package. (#7184). Contributed by Jian Zhang. omit 2ef69623685 HDFS-17659. [ARR]Router Quota supports asynchronous rpc. (#7157). Contributed by hfutatzhanghb. omit 6f038f3e57f HDFS-17656. [ARR] RouterNamenodeProtocol and RouterUserProtocol supports asynchronous rpc. (#7159). Contributed by Jian Zhang. omit 1d7471f4def HDFS-17596. [ARR] RouterStoragePolicy supports asynchronous rpc. (#6988). Contributed by hfutatzhanghb. omit 4bf866a18ed HDFS-17601. [ARR] RouterRpcServer supports asynchronous rpc. (#7108). Contributed by hfutatzhanghb. omit 24baed0ecbb HDFS-17595. [ARR] ErasureCoding supports asynchronous rpc. (#6983). Contributed by hfutatzhanghb. omit 7be68eb61b3 HDFS-17597. [ARR] RouterSnapshot supports asynchronous rpc. (#6994). Contributed by Wenqi Li. omit dd1192f0478 HDFS-17594. [ARR] RouterCacheAdmin supports asynchronous rpc. (#6986). Contributed by Archie73. omit 4a9e44cdf95 HDFS-17545. [ARR] router async rpc client. (#6871). Contributed by Jian Zhang. omit 58b02672925 HDFS-17544. [ARR] The router client rpc protocol PB supports asynchrony. (#6870). Contributed by Jian Zhang. omit 4cbadefd054 HADOOP-19235. IPC client uses CompletableFuture to support asynchronous operations. (#6888) omit d7a0bfd3234 HDFS-17543. [ARR] AsyncUtil makes asynchronous code more concise and easier. (#6868). Contributed by Jian Zhang. add b24996cb96a HDFS-17719. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-hdfs-httpfs Part1. (#7371) add b4168c37b7a YARN-11760. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-applications-distributedshell. (#7373) add 14b71596d45 YARN-11761. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-services-core. (#7374) add 19bd575e32e MAPREDUCE-7421. [JDK17] Upgrade Junit 4 to 5 in hadoop-mapreduce-client-jobclient Part1. (#7358) add 2291fabdfc4 YARN-11758. [UI2] On the Cluster Metrics page make the Resource Usage⦠(#7331) add 2202c95e1d2 HADOOP-19375: Organize JDK version-specific code in IDEA friendly approach add c4dace07719 HADOOP-19377: Avoid initializing useless HashMap in protocolImplMapArray. add 6e7511c8ac7 HDFS-12431. Upgrade JUnit from 4 to 5 in hadoop-hdfs Part1. (#7383) add 5fb99fc6efb HDFS-17543. [ARR] AsyncUtil makes asynchronous code more concise and easier. (#6868). Contributed by Jian Zhang. add e295ebc1f22 HADOOP-19235. IPC client uses CompletableFuture to support asynchronous operations. (#6888) add 8012b4ccf12 HDFS-17544. [ARR] The router client rpc protocol PB supports asynchrony. (#6870). Contributed by Jian Zhang. add 3f925b34ba0 HDFS-17545. [ARR] router async rpc client. (#6871). Contributed by Jian Zhang. add e103ad1471c HDFS-17594. [ARR] RouterCacheAdmin supports asynchronous rpc. (#6986). Contributed by Archie73. add 37c7cdd9acd HDFS-17597. [ARR] RouterSnapshot supports asynchronous rpc. (#6994). Contributed by Wenqi Li. add 3082ed6b047 HDFS-17595. [ARR] ErasureCoding supports asynchronous rpc. (#6983). Contributed by hfutatzhanghb. add c688b0abfd0 HDFS-17601. [ARR] RouterRpcServer supports asynchronous rpc. (#7108). Contributed by hfutatzhanghb. add 056591a1160 HDFS-17596. [ARR] RouterStoragePolicy supports asynchronous rpc. (#6988). Contributed by hfutatzhanghb. add fb89508ccb7 HDFS-17656. [ARR] RouterNamenodeProtocol and RouterUserProtocol supports asynchronous rpc. (#7159). Contributed by Jian Zhang. add 9c793f9abe6 HDFS-17659. [ARR]Router Quota supports asynchronous rpc. (#7157). Contributed by hfutatzhanghb. add 8b9a9c387c4 HDFS-17672. [ARR] Move asynchronous related classes to the async package. (#7184). Contributed by Jian Zhang. add 1fbc8f971ea HADOOP-19361. RPC DeferredMetrics bugfix. (#7220). Contributed by hfutatzhanghb. add b1796a3078d HDFS-17640.[ARR] RouterClientProtocol supports asynchronous rpc. (#7188) add d94518c045c HDFS-17650. [ARR] The router server-side rpc protocol PB supports asynchrony. (#7139). Contributed by hfutatzhanghb. add bdff83ae1f2 HDFS-17651.[ARR] Async handler executor isolation (#7244). Contributed by hfutatzhanghb. add ad83682c54f HDFS-17715. [ARR] Add documentation for asynchronous router. (#7318). Contributed by Jian Zhang. This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (82bccee6538) \ N -- N -- N refs/heads/HDFS-17531 (ad83682c54f) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: hadoop-common-project/hadoop-annotations/pom.xml | 34 +- .../ExcludePrivateAnnotationsJDiffDoclet.java | 0 .../ExcludePrivateAnnotationsStandardDoclet.java | 0 .../tools/IncludePublicAnnotationsJDiffDoclet.java | 0 .../IncludePublicAnnotationsStandardDoclet.java | 0 .../classification/tools/RootDocProcessor.java | 0 .../classification/tools/StabilityOptions.java | 0 .../src/main/java/org/apache/hadoop/ipc/RPC.java | 9 +- hadoop-hdfs-project/hadoop-hdfs-httpfs/pom.xml | 20 ++ .../hadoop/fs/http/client/BaseTestHttpFSWith.java | 287 ++++++++--------- .../client/TestHttpFSFWithSWebhdfsFileSystem.java | 10 +- .../client/TestHttpFSFWithWebhdfsFileSystem.java | 6 +- .../TestHttpFSFileSystemLocalFileSystem.java | 11 +- .../client/TestHttpFSWithHttpFSFileSystem.java | 6 +- .../server/TestCheckUploadContentTypeFilter.java | 2 +- .../fs/http/server/TestHttpFSAccessControlled.java | 28 +- .../hadoop/fs/http/server/TestHttpFSServer.java | 351 +++++++++++---------- .../fs/http/server/TestHttpFSServerNoACLs.java | 32 +- .../fs/http/server/TestHttpFSServerNoXAttrs.java | 28 +- .../fs/http/server/TestHttpFSServerWebServer.java | 30 +- .../fs/http/server/TestHttpFSWithKerberos.java | 37 ++- .../hadoop/lib/lang/TestRunnableCallable.java | 17 +- .../org/apache/hadoop/lib/lang/TestXException.java | 6 +- .../apache/hadoop/lib/server/TestBaseService.java | 8 +- .../org/apache/hadoop/lib/server/TestServer.java | 80 +++-- .../hadoop/lib/server/TestServerConstructor.java | 37 ++- .../hadoop/TestFileSystemAccessService.java | 45 +-- .../TestInstrumentationService.java | 10 +- .../service/scheduler/TestSchedulerService.java | 4 +- .../lib/service/security/TestGroupsService.java | 24 +- .../hadoop/lib/servlet/TestHostnameFilter.java | 6 +- .../apache/hadoop/lib/servlet/TestMDCFilter.java | 8 +- .../hadoop/lib/servlet/TestServerWebApp.java | 39 ++- .../java/org/apache/hadoop/lib/util/TestCheck.java | 102 ++++-- .../hadoop/lib/util/TestConfigurationUtils.java | 6 +- .../hadoop/lib/wsrs/TestInputStreamEntity.java | 4 +- .../hadoop/lib/wsrs/TestJSONMapProvider.java | 8 +- .../apache/hadoop/lib/wsrs/TestJSONProvider.java | 8 +- .../java/org/apache/hadoop/lib/wsrs/TestParam.java | 6 +- .../java/org/apache/hadoop/test/HFSTestCase.java | 7 +- .../java/org/apache/hadoop/test/HTestCase.java | 17 +- .../java/org/apache/hadoop/test/TestDirHelper.java | 48 ++- .../apache/hadoop/test/TestExceptionHelper.java | 63 ++-- .../org/apache/hadoop/test/TestHFSTestCase.java | 39 ++- .../java/org/apache/hadoop/test/TestHTestCase.java | 27 +- .../org/apache/hadoop/test/TestHdfsHelper.java | 55 ++-- .../org/apache/hadoop/test/TestJettyHelper.java | 57 ++-- hadoop-hdfs-project/hadoop-hdfs/pom.xml | 26 +- .../org/apache/hadoop/hdfs/TestListFilesInDFS.java | 8 +- .../hadoop/hdfs/crypto/TestHdfsCryptoStreams.java | 16 +- .../apache/hadoop/hdfs/TestDFSClientFailover.java | 0 .../apache/hadoop/conf/TestNoDefaultsJobConf.java | 12 +- .../test/java/org/apache/hadoop/fs/DFSCIOTest.java | 6 +- .../test/java/org/apache/hadoop/fs/TestDFSIO.java | 29 +- .../java/org/apache/hadoop/fs/TestFileSystem.java | 12 +- .../test/java/org/apache/hadoop/fs/TestJHLA.java | 10 +- .../java/org/apache/hadoop/fs/slive/TestSlive.java | 10 +- .../java/org/apache/hadoop/hdfs/TestNNBench.java | 44 +-- .../hadoop/io/TestSequenceFileMergeProgress.java | 4 +- .../apache/hadoop/ipc/TestMRCJCSocketFactory.java | 20 +- .../hadoop/mapred/ClusterMapReduceTestCase.java | 8 +- .../org/apache/hadoop/mapred/HadoopTestCase.java | 8 +- .../java/org/apache/hadoop/mapred/MRCaching.java | 7 +- .../apache/hadoop/mapred/NotificationTestCase.java | 16 +- .../org/apache/hadoop/mapred/TestBadRecords.java | 17 +- .../apache/hadoop/mapred/TestClientRedirect.java | 16 +- .../hadoop/mapred/TestClientServiceDelegate.java | 200 +++++++----- .../mapred/TestClusterMapReduceTestCase.java | 14 +- .../java/org/apache/hadoop/mapred/TestCollect.java | 2 +- .../hadoop/mapred/TestCombineFileInputFormat.java | 6 +- .../hadoop/mapred/TestCombineOutputCollector.java | 2 +- .../mapred/TestCombineSequenceFileInputFormat.java | 20 +- .../hadoop/mapred/TestCombineTextInputFormat.java | 33 +- .../mapred/TestCommandLineJobSubmission.java | 16 +- .../org/apache/hadoop/mapred/TestComparators.java | 14 +- .../mapred/TestConcatenatedCompressedInput.java | 143 ++++----- .../apache/hadoop/mapred/TestFieldSelection.java | 4 +- .../mapred/TestFileInputFormatPathFilter.java | 12 +- .../apache/hadoop/mapred/TestFileOutputFormat.java | 4 +- .../hadoop/mapred/TestFixedLengthInputFormat.java | 78 +++-- .../apache/hadoop/mapred/TestGetSplitHosts.java | 4 +- .../java/org/apache/hadoop/mapred/TestIFile.java | 5 +- .../org/apache/hadoop/mapred/TestIFileStreams.java | 10 +- .../org/apache/hadoop/mapred/TestInputPath.java | 4 +- .../hadoop/mapred/TestJavaSerialization.java | 29 +- .../org/apache/hadoop/mapred/TestJobCleanup.java | 43 +-- .../org/apache/hadoop/mapred/TestJobClients.java | 12 +- .../org/apache/hadoop/mapred/TestJobCounters.java | 38 +-- .../java/org/apache/hadoop/mapred/TestJobName.java | 10 +- .../apache/hadoop/mapred/TestJobSysDirWithDFS.java | 8 +- .../hadoop/mapred/TestKeyValueTextInputFormat.java | 52 +-- .../org/apache/hadoop/mapred/TestLazyOutput.java | 4 +- .../hadoop/mapred/TestLineRecordReaderJobs.java | 4 +- .../hadoop/mapred/TestLocalJobSubmission.java | 36 +-- .../hadoop/mapred/TestMRCJCFileInputFormat.java | 22 +- .../mapred/TestMRCJCFileOutputCommitter.java | 26 +- .../apache/hadoop/mapred/TestMRCJCJobClient.java | 9 +- .../org/apache/hadoop/mapred/TestMRCJCJobConf.java | 10 +- .../hadoop/mapred/TestMROpportunisticMaps.java | 4 +- .../hadoop/mapred/TestMRTimelineEventHandling.java | 137 ++++---- .../apache/hadoop/mapred/TestMapOutputType.java | 12 +- .../org/apache/hadoop/mapred/TestMapProgress.java | 8 +- .../java/org/apache/hadoop/mapred/TestMapRed.java | 36 +-- .../java/org/apache/hadoop/mapred/TestMerge.java | 4 +- .../apache/hadoop/mapred/TestMiniMRBringup.java | 7 +- .../apache/hadoop/mapred/TestMiniMRChildTask.java | 43 ++- .../apache/hadoop/mapred/TestMiniMRClasspath.java | 9 +- .../hadoop/mapred/TestMiniMRClientCluster.java | 71 ++--- .../apache/hadoop/mapred/TestMiniMRDFSCaching.java | 12 +- .../mapred/TestMiniMRWithDFSWithDistinctUsers.java | 15 +- .../hadoop/mapred/TestMultiFileInputFormat.java | 6 +- .../apache/hadoop/mapred/TestMultiFileSplit.java | 6 +- .../hadoop/mapred/TestMultipleLevelCaching.java | 22 +- .../mapred/TestMultipleTextOutputFormat.java | 4 +- .../org/apache/hadoop/mapred/TestNetworkedJob.java | 39 ++- .../hadoop/mapred/TestOldCombinerGrouping.java | 27 +- .../mapred/TestQueueConfigurationParser.java | 9 +- .../org/apache/hadoop/mapred/TestReduceFetch.java | 17 +- .../mapred/TestReduceFetchFromPartialMem.java | 27 +- .../org/apache/hadoop/mapred/TestReduceTask.java | 6 +- .../org/apache/hadoop/mapred/TestReporter.java | 38 +-- .../hadoop/mapred/TestResourceMgrDelegate.java | 72 +++-- .../TestSequenceFileAsBinaryInputFormat.java | 20 +- .../TestSequenceFileAsBinaryOutputFormat.java | 43 ++- .../mapred/TestSequenceFileAsTextInputFormat.java | 13 +- .../hadoop/mapred/TestSequenceFileInputFilter.java | 4 +- .../hadoop/mapred/TestSequenceFileInputFormat.java | 10 +- .../org/apache/hadoop/mapred/TestSortedRanges.java | 4 +- .../mapred/TestSpecialCharactersInOutputPath.java | 9 +- .../hadoop/mapred/TestStatisticsCollector.java | 8 +- .../org/apache/hadoop/mapred/TestTaskCommit.java | 32 +- .../hadoop/mapred/TestTaskPerformanceSplits.java | 36 +-- .../org/apache/hadoop/mapred/TestTaskStatus.java | 89 +++--- .../apache/hadoop/mapred/TestTextInputFormat.java | 127 ++++---- .../apache/hadoop/mapred/TestTextOutputFormat.java | 6 +- .../hadoop/mapred/TestUserDefinedCounters.java | 6 +- .../java/org/apache/hadoop/mapred/TestUtils.java | 5 +- .../apache/hadoop/mapred/TestWritableJobConf.java | 4 +- .../org/apache/hadoop/mapred/TestYARNRunner.java | 106 ++++--- .../hadoop/mapred/jobcontrol/TestJobControl.java | 37 ++- .../mapred/jobcontrol/TestLocalJobControl.java | 6 +- .../apache/hadoop/mapred/join/TestDatamerge.java | 39 +-- .../hadoop/mapred/join/TestTupleWritable.java | 46 +-- .../join/TestWrappedRecordReaderClassloader.java | 10 +- .../org/apache/hadoop/mapred/lib/TestChain.java | 2 +- .../hadoop/mapred/lib/TestChainMapReduce.java | 12 +- .../mapred/lib/TestDelegatingInputFormat.java | 7 +- .../mapred/lib/TestKeyFieldBasedComparator.java | 10 +- .../mapred/lib/TestKeyFieldBasedPartitioner.java | 8 +- .../hadoop/mapred/lib/TestLineInputFormat.java | 22 +- .../hadoop/mapred/lib/TestMultipleInputs.java | 4 +- .../hadoop/mapred/lib/TestMultipleOutputs.java | 43 +-- .../mapred/lib/TestMultithreadedMapRunner.java | 6 +- .../mapred/lib/aggregate/TestAggregates.java | 4 +- .../hadoop/mapred/lib/db/TestConstructQuery.java | 8 +- .../hadoop/mapred/pipes/TestPipeApplication.java | 14 +- .../org/apache/hadoop/mapred/pipes/TestPipes.java | 27 +- .../mapred/pipes/TestPipesNonJavaInputFormat.java | 16 +- .../org/apache/hadoop/mapreduce/TestChild.java | 66 ++-- .../apache/hadoop/mapreduce/TestMRJobClient.java | 100 +++--- .../partition/TestMRKeyFieldBasedComparator.java | 6 +- .../distributedshell/DistributedShellBaseTest.java | 110 +++---- .../applications/distributedshell/TestClient.java | 4 +- .../distributedshell/TestDSAppMaster.java | 68 ++-- .../distributedshell/TestDSTimelineV10.java | 218 +++++++------ .../distributedshell/TestDSTimelineV15.java | 18 +- .../distributedshell/TestDSTimelineV20.java | 89 +++--- .../TestDSWithMultipleNodeManager.java | 106 ++++--- .../hadoop/yarn/service/ServiceTestUtils.java | 33 +- .../TestDefaultUpgradeComponentsFinder.java | 23 +- .../apache/hadoop/yarn/service/TestServiceAM.java | 86 ++--- .../hadoop/yarn/service/TestServiceManager.java | 108 ++++--- .../yarn/service/TestYarnNativeServices.java | 235 +++++++------- .../client/TestBuildExternalComponents.java | 17 +- .../hadoop/yarn/service/client/TestServiceCLI.java | 85 ++--- .../yarn/service/client/TestServiceClient.java | 46 +-- .../yarn/service/component/TestComponent.java | 114 +++---- .../TestComponentDecommissionInstances.java | 35 +- .../component/TestComponentRestartPolicy.java | 4 +- .../component/instance/TestComponentInstance.java | 99 +++--- .../yarn/service/conf/TestAppJsonResolve.java | 39 +-- .../yarn/service/conf/TestLoadExampleAppJson.java | 25 +- .../service/conf/TestValidateServiceNames.java | 7 +- .../containerlaunch/TestAbstractLauncher.java | 10 +- .../yarn/service/monitor/TestServiceMonitor.java | 19 +- .../service/monitor/probe/TestDefaultProbe.java | 60 ++-- .../provider/TestAbstractProviderService.java | 30 +- .../yarn/service/provider/TestProviderUtils.java | 12 +- .../providers/TestAbstractClientProvider.java | 24 +- .../providers/TestDefaultClientProvider.java | 11 +- .../service/providers/TestProviderFactory.java | 4 +- .../TestServiceTimelinePublisher.java | 12 +- .../yarn/service/utils/TestCoreFileSystem.java | 15 +- .../hadoop/yarn/service/utils/TestFilterUtils.java | 41 ++- .../yarn/service/utils/TestServiceApiUtil.java | 115 +++---- .../app/components/queue-usage-donut-chart.js | 39 ++- .../main/webapp/app/templates/cluster-overview.hbs | 70 ++-- 197 files changed, 3347 insertions(+), 3095 deletions(-) rename hadoop-common-project/hadoop-annotations/src/main/{java => java8}/org/apache/hadoop/classification/tools/ExcludePrivateAnnotationsJDiffDoclet.java (100%) rename hadoop-common-project/hadoop-annotations/src/main/{java => java8}/org/apache/hadoop/classification/tools/ExcludePrivateAnnotationsStandardDoclet.java (100%) rename hadoop-common-project/hadoop-annotations/src/main/{java => java8}/org/apache/hadoop/classification/tools/IncludePublicAnnotationsJDiffDoclet.java (100%) rename hadoop-common-project/hadoop-annotations/src/main/{java => java8}/org/apache/hadoop/classification/tools/IncludePublicAnnotationsStandardDoclet.java (100%) rename hadoop-common-project/hadoop-annotations/src/main/{java => java8}/org/apache/hadoop/classification/tools/RootDocProcessor.java (100%) rename hadoop-common-project/hadoop-annotations/src/main/{java => java8}/org/apache/hadoop/classification/tools/StabilityOptions.java (100%) rename hadoop-hdfs-project/hadoop-hdfs/src/test/{java => java8}/org/apache/hadoop/hdfs/TestDFSClientFailover.java (100%) --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org