[jira] [Reopened] (HADOOP-13067) cleanup the dockerfile
[ https://issues.apache.org/jira/browse/HADOOP-13067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reopened HADOOP-13067: > cleanup the dockerfile > -- > > Key: HADOOP-13067 > URL: https://issues.apache.org/jira/browse/HADOOP-13067 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Fix For: 3.0.0-alpha1 > > Attachments: HADOOP-13067-branch-2.00.patch, HADOOP-13067.00.patch > > > - hackage.haskell.org is pretty unreliable, switch to fpcomplete's mirror > - quiet some of the output to make jenkins debugging easier > - some other random fixes -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13318) Allow configurable connection timeouts for KMSClientProvider
Xiao Chen created HADOOP-13318: -- Summary: Allow configurable connection timeouts for KMSClientProvider Key: HADOOP-13318 URL: https://issues.apache.org/jira/browse/HADOOP-13318 Project: Hadoop Common Issue Type: Improvement Components: kms Reporter: Xiao Chen Priority: Minor It would be useful to be able to configure timeouts for the http connections in KMSClientProvider. Both readtimeout and connecttimeout would be useful. https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSClientProvider.java#L528 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13317) Add logs to KMS servier-side to improve supportability
Xiao Chen created HADOOP-13317: -- Summary: Add logs to KMS servier-side to improve supportability Key: HADOOP-13317 URL: https://issues.apache.org/jira/browse/HADOOP-13317 Project: Hadoop Common Issue Type: Improvement Components: kms Reporter: Xiao Chen Assignee: Xiao Chen Priority: Minor [KMS.java|https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-kms/src/main/java/org/apache/hadoop/crypto/key/kms/server/KMS.java] is the main class that serves KMS http requests. There're currently no logs at all, making trouble shooting difficult. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13316) Delegation Tokens should not be renewed or retrived using delegation token authentication
Xiao Chen created HADOOP-13316: -- Summary: Delegation Tokens should not be renewed or retrived using delegation token authentication Key: HADOOP-13316 URL: https://issues.apache.org/jira/browse/HADOOP-13316 Project: Hadoop Common Issue Type: Bug Components: kms, security Affects Versions: 2.6.0 Reporter: Xiao Chen Assignee: Xiao Chen Priority: Blocker -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk + YARN-5121 + JDK8 on OS X
For more details, see https://builds.apache.org/job/hadoop-qbt-osx-java8/36/ No changes -1 overall The following subsystems voted -1: unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed CTEST tests : test_test_libhdfs_threaded_hdfs_static test_test_libhdfs_zerocopy_hdfs_static test_test_native_mini_dfs Failed junit tests : hadoop.crypto.TestCryptoCodec hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec hadoop.fs.TestSymlinkLocalFSFileContext hadoop.fs.TestSymlinkLocalFSFileSystem hadoop.ipc.TestRPCWaitForProxy hadoop.net.unix.TestDomainSocket hadoop.fs.TestEnhancedByteBufferAccess hadoop.hdfs.client.impl.TestBlockReaderFactory hadoop.hdfs.client.impl.TestBlockReaderLocal hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation hadoop.hdfs.server.datanode.TestDataNodeUUID hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation hadoop.hdfs.server.datanode.TestLargeBlockReport hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA hadoop.hdfs.server.namenode.ha.TestEditLogTailer hadoop.hdfs.server.namenode.TestEditLog hadoop.hdfs.shortcircuit.TestShortCircuitCache hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead hadoop.hdfs.TestDFSInputStream hadoop.hdfs.TestParallelShortCircuitRead hadoop.hdfs.TestParallelShortCircuitReadNoChecksum hadoop.hdfs.TestParallelShortCircuitReadUnCached hadoop.hdfs.TestParallelUnixDomainRead hadoop.hdfs.TestPersistBlocks hadoop.hdfs.TestRead hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer hadoop.tracing.TestTracingShortCircuitLocalRead hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.resourcemanager.TestRMAdminService hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.client.api.impl.TestYarnClient hadoop.yarn.client.cli.TestLogsCLI hadoop.mapreduce.filecache.TestClientDistributedCacheManager hadoop.mapreduce.v2.TestMRJobs hadoop.mapred.nativetask.compresstest.CompressTest hadoop.mapred.nativetask.kvtest.KVTest hadoop.mapred.nativetask.kvtest.LargeKVTest hadoop.mapred.gridmix.TestGridmixMemoryEmulation hadoop.mapred.gridmix.TestResourceUsageEmulators cc: https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/diff-compile-cc-root.txt [8.0K] javac: https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/diff-compile-javac-root.txt [208K] CTEST: https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt [4.0K] unit: https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [136K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [524K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt [12K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [36K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [24K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [52K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [72K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [96K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/ [Jun 23, 2016 6:48:18 AM] (aajisaka) HDFS-10561. test_native_mini_dfs fails by NoClassDefFoundError. [Jun 24, 2016 9:39:32 AM] (kai.zheng) HDFS-10460. Recompute block checksum for a particular range less than -1 overall The following subsystems voted -1: unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.client.api.impl.TestYarnClient hadoop.yarn.client.cli.TestLogsCLI hadoop.mapred.TestMRCJCFileOutputCommitter cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-compile-javac-root.txt [172K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-patch-pylint.txt [16K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/whitespace-eol.txt [12M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-javadoc-javadoc-root.txt [2.3M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [140K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [92K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [124K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13314) Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error
Vinayakumar B created HADOOP-13314: -- Summary: Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error Key: HADOOP-13314 URL: https://issues.apache.org/jira/browse/HADOOP-13314 Project: Hadoop Common Issue Type: Bug Reporter: Vinayakumar B Assignee: Vinayakumar B Priority: Trivial HADOOP-13079 added package-info.java in test\java\org\apache\hadoop\fs\shell\ to avoid checkstyle comment. But this resulted in an eclipse compile error "The type package-info is already defined", because in src folder in same package package-info.java already present. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13313) S3A TemporaryAWSCredentialsProvider to support Hadoop Credential providers for secrets
Steve Loughran created HADOOP-13313:
---
Summary: S3A TemporaryAWSCredentialsProvider to support Hadoop
Credential providers for secrets
Key: HADOOP-13313
URL: https://issues.apache.org/jira/browse/HADOOP-13313
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3, security
Affects Versions: 2.8.0
Reporter: Steve Loughran
The session credential provider in {{TemporaryAWSCredentialsProvider}} should
use {{S3AUtils.getPassword()}} to get the password details, rather than rely on
the secrets to be kept in the configuration XML file
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/72/ [Jun 22, 2016 2:38:20 PM] (iwasakims) HADOOP-12588. addendum patch to fix intermittent failure of [Jun 22, 2016 2:45:25 PM] (stevel) HADOOP-13203 S3A: Support fadvise "random" mode for high performance [Jun 22, 2016 6:17:43 PM] (uma.gangumalla) HDFS-10473: Allow only suitable storage policies to be set on striped [Jun 23, 2016 12:20:13 AM] (ozawa) MAPREDUCE-6721. mapreduce.reduce.shuffle.memory.limit.percent=0.0 should [Jun 23, 2016 2:04:54 AM] (Arun Suresh) YARN-5171. Extend DistributedSchedulerProtocol to notify RM of [Jun 23, 2016 4:26:10 AM] (aajisaka) MAPREDUCE-6641. TestTaskAttempt fails in trunk. Contributed by Haibo [Jun 23, 2016 4:48:49 AM] (xgong) YARN-5266. Wrong exit code while trying to get app logs using regex via [Jun 23, 2016 5:06:13 AM] (uma.gangumalla) HDFS-10555: Unable to loadFSEdits due to a failure in readCachePoolInfo. [Jun 23, 2016 5:28:12 AM] (aajisaka) YARN-5278. Remove unused argument in [Jun 23, 2016 6:11:58 AM] (aajisaka) HADOOP-13307. add rsync to Dockerfile so that precommit archive works. -1 overall The following subsystems voted -1: docker Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
