[jira] [Created] (HADOOP-14087) S3A typo in pom.xml test exclusions
Aaron Fabbri created HADOOP-14087: - Summary: S3A typo in pom.xml test exclusions Key: HADOOP-14087 URL: https://issues.apache.org/jira/browse/HADOOP-14087 Project: Hadoop Common Issue Type: Sub-task Components: fs/s3 Affects Versions: HADOOP-13345 Reporter: Aaron Fabbri Assignee: Aaron Fabbri When you overload DDB, you get error messages warning of throttling, [as documented by AWS|http://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Programming.Errors.html#Programming.Errors.MessagesAndCodes] Reduce load on DDB by doing a table lookup before the create, then, in table create/delete operations and in get/put actions, recognise the error codes and retry using an appropriate retry policy (exponential backoff + ultimate failure) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-14060) KMS /logs servlet should have access control
[
https://issues.apache.org/jira/browse/HADOOP-14060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Chen resolved HADOOP-14060.
Resolution: Duplicate
> KMS /logs servlet should have access control
>
>
> Key: HADOOP-14060
> URL: https://issues.apache.org/jira/browse/HADOOP-14060
> Project: Hadoop Common
> Issue Type: Bug
> Components: kms
>Affects Versions: 3.0.0-alpha3
>Reporter: John Zhuge
>Assignee: John Zhuge
>
> HADOOP-14047 makes KMS call {{HttpServer2#setACL}}. Access control works fine
> for /conf, /jmx, /logLevel, and /stacks, but not for /logs.
> The code in {{AdminAuthorizedServlet#doGet}} for /logs and
> {{ConfServlet#doGet}} for /conf are quite similar. This makes me believe that
> /logs should subject to the same access control as intended by the original
> developer.
> IMHO this could either be my misconfiguration or there is a bug somewhere in
> {{HttpServer2}}.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14086) Improve DistCp Speed for small files
Zheng Shao created HADOOP-14086: --- Summary: Improve DistCp Speed for small files Key: HADOOP-14086 URL: https://issues.apache.org/jira/browse/HADOOP-14086 Project: Hadoop Common Issue Type: Improvement Components: tools/distcp Affects Versions: 2.6.5 Reporter: Zheng Shao Assignee: Zheng Shao Priority: Minor When using distcp to copy lots of small files, NameNode naturally becomes a bottleneck. The current distcp code did *not* optimize to reduce the NameNode calls. We should restructure the code to reduce the number of NameNode calls as much as possible to speed up the copy of small files. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14085) Drop unnecessary type assertion and cast
Sean Mackrory created HADOOP-14085: -- Summary: Drop unnecessary type assertion and cast Key: HADOOP-14085 URL: https://issues.apache.org/jira/browse/HADOOP-14085 Project: Hadoop Common Issue Type: Sub-task Reporter: Sean Mackrory Assignee: Sean Mackrory This is a spin-off from some discussion on HADOOP-13736. There's an assertion and type-cast that often causes a large number of test failures (this can be seen at HADOOP-14041). It appears to be unnecessary - things work really well by just removing that, and unless there's a good reason or test of something S3-specific, we should handle FileStatus in metadata anyway. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14084) Shell.joinThread swallows InterruptedException
Shixiong Zhu created HADOOP-14084: - Summary: Shell.joinThread swallows InterruptedException Key: HADOOP-14084 URL: https://issues.apache.org/jira/browse/HADOOP-14084 Project: Hadoop Common Issue Type: Bug Reporter: Shixiong Zhu Priority: Minor In "Shell.joinThread", when the user tries to interrupt the thread that runs Shell.joinThread, it will catch InterruptedException and propagate it to thread t. However, it doesn't set the interrupt state of the current thread before returning, so the user codes won't know it's already interrupted and should exit. See https://github.com/apache/hadoop/blob/9e19f758c1950cbcfcd1969461a8a910efca0767/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java#L1035 -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/230/ [Feb 14, 2017 2:09:10 PM] (Arun Suresh) YARN-5966. AMRMClient changes to support ExecutionType update. (asuresh) [Feb 14, 2017 4:45:56 PM] (aajisaka) HADOOP-14058. Fix [Feb 14, 2017 4:59:21 PM] (sunilg) YARN-5912. Fix breadcrumb issues for various pages in new YARN UI. [Feb 14, 2017 5:11:55 PM] (weichiu) HDFS-11084. Add a regression test for sticky bit support of OIV [Feb 14, 2017 8:52:34 PM] (xyao) HDFS-11409. DatanodeInfo getNetworkLocation and setNetworkLocation shoud [Feb 14, 2017 9:39:41 PM] (kasha) YARN-6061. Add an UncaughtExceptionHandler for critical threads in RM. [Feb 14, 2017 9:40:53 PM] (yzhang) HDFS-11391. Numeric usernames do no work with WebHDFS FS write access. [Feb 14, 2017 11:19:52 PM] (kasha) YARN-6061. Addendum. Remove extraneous change. [Feb 15, 2017 4:09:10 AM] (iwasakims) YARN-4753. Use doxia macro to generate in-page TOC of YARN site [Feb 15, 2017 7:35:08 AM] (aajisaka) HADOOP-13942. Update checkstyle and checkstyle plugin version to handle [Feb 15, 2017 7:53:50 AM] (aajisaka) HDFS-11238. Fix checkstyle warnings in NameNode#createNameNode. [Feb 15, 2017 8:34:30 AM] (kai.zheng) HADOOP-14072. AliyunOSS: Failed to read from stream when seek beyond the [Feb 15, 2017 9:18:17 AM] (varunsaxena) YARN-6156. AM blacklisting to consider node label partition (Bibin A [Feb 15, 2017 10:22:57 AM] (sunilg) YARN-6183. Few missing informations in Application and Application [Feb 15, 2017 10:50:35 AM] (weichiu) HDFS-11333. Print a user friendly error message when plugins are not -1 overall The following subsystems voted -1: compile unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.TestDFSInputStream hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer hadoop.hdfs.server.datanode.checker.TestThrottledAsyncChecker hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.server.timeline.TestRollingLevelDB hadoop.yarn.server.timeline.TestTimelineDataManager hadoop.yarn.server.timeline.TestLeveldbTimelineStore hadoop.yarn.server.timeline.webapp.TestTimelineWebServices hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.mapred.TestShuffleHandler hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService Timed out junit tests : org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache compile: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/230/artifact/out/patch-compile-root.txt [124K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/230/artifact/out/patch-compile-root.txt [124K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/230/artifact/out/patch-compile-root.txt [124K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/230/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [384K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/230/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/230/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/230/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [72K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/230/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [324K]
[jira] [Created] (HADOOP-14083) Old SSL clients should work with KMS
John Zhuge created HADOOP-14083:
---
Summary: Old SSL clients should work with KMS
Key: HADOOP-14083
URL: https://issues.apache.org/jira/browse/HADOOP-14083
Project: Hadoop Common
Issue Type: Improvement
Components: kms
Affects Versions: 2.8.0, 2.7.4, 2.6.6
Reporter: John Zhuge
Assignee: John Zhuge
Priority: Minor
HADOOP-13812 upgraded Tomcat to 6.0.48 which filters weak ciphers. Old SSL
clients such as curl stop working. The symptom is {{NSS error -12286}} when
running {{curl -v}}.
Instead of forcing the SSL clients to upgrade, we can configure Tomcat to
explicitly allow enough weak ciphers so that old SSL clients can work.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/ [Feb 14, 2017 10:48:08 AM] (yqlin) HDFS-11407. Document the missing usages of OfflineImageViewer [Feb 14, 2017 10:57:20 AM] (yqlin) HDFS-11408. The config name of balance bandwidth is out of date. [Feb 14, 2017 2:09:10 PM] (Arun Suresh) YARN-5966. AMRMClient changes to support ExecutionType update. (asuresh) [Feb 14, 2017 4:45:56 PM] (aajisaka) HADOOP-14058. Fix [Feb 14, 2017 4:59:21 PM] (sunilg) YARN-5912. Fix breadcrumb issues for various pages in new YARN UI. [Feb 14, 2017 5:11:55 PM] (weichiu) HDFS-11084. Add a regression test for sticky bit support of OIV [Feb 14, 2017 8:52:34 PM] (xyao) HDFS-11409. DatanodeInfo getNetworkLocation and setNetworkLocation shoud [Feb 14, 2017 9:39:41 PM] (kasha) YARN-6061. Add an UncaughtExceptionHandler for critical threads in RM. [Feb 14, 2017 9:40:53 PM] (yzhang) HDFS-11391. Numeric usernames do no work with WebHDFS FS write access. [Feb 14, 2017 11:19:52 PM] (kasha) YARN-6061. Addendum. Remove extraneous change. [Feb 15, 2017 4:09:10 AM] (iwasakims) YARN-4753. Use doxia macro to generate in-page TOC of YARN site -1 overall The following subsystems voted -1: asflicense unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.hdfs.security.TestDelegationTokenForProxyUser hadoop.hdfs.TestBlocksScheduledCounter hadoop.hdfs.TestReadStripedFileWithMissingBlocks hadoop.hdfs.server.namenode.TestDecommissioningStatus hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks hadoop.hdfs.server.datanode.TestDataNodeUUID hadoop.yarn.server.timeline.webapp.TestTimelineWebServices hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/diff-compile-javac-root.txt [168K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/diff-patch-pylint.txt [20K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/diff-patch-shellcheck.txt [24K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/whitespace-eol.txt [11M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/diff-javadoc-javadoc-root.txt [2.2M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [936K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [324K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/318/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
