[jira] [Resolved] (HADOOP-16500) S3ADelegationTokens to only log at debug on startup
[ https://issues.apache.org/jira/browse/HADOOP-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16500. - Resolution: Fixed Fix Version/s: 3.3.0 Committed to trunk. > S3ADelegationTokens to only log at debug on startup > --- > > Key: HADOOP-16500 > URL: https://issues.apache.org/jira/browse/HADOOP-16500 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 >Affects Versions: 3.3.0 >Reporter: Steve Loughran >Assignee: Steve Loughran >Priority: Major > Fix For: 3.3.0 > > > downgrade the log at info to log at debug when S3A comes up with DT support. > Otherwise it's too noisy. > Things still get printed when tokens are created. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/ [Aug 13, 2019 3:30:33 PM] (ekrogen) HDFS-14370. Add exponential backoff to the edit log tailer to avoid [Aug 13, 2019 5:27:43 PM] (ebadger) YARN-9442. container working directory has group read permissions. [Aug 13, 2019 9:28:18 PM] (xkrogen) HADOOP-16459. Backport of HADOOP-16266. Add more fine-grained processing -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/empty-configuration.xml hadoop-tools/hadoop-azure/src/config/checkstyle-suppressions.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/public/crossdomain.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client Boxed value is unboxed and then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:[line 335] Failed junit tests : hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.tools.TestDFSAdminWithHA hadoop.hdfs.TestRollingUpgrade hadoop.hdfs.TestDFSStorageStateRecovery hadoop.hdfs.TestHdfsAdmin hadoop.yarn.client.cli.TestRMAdminCLI hadoop.yarn.client.api.impl.TestAMRMProxy hadoop.registry.secure.TestSecureLogins hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2 cc: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-compile-cc-root-jdk1.7.0_95.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-compile-javac-root-jdk1.7.0_95.txt [328K] cc: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-compile-cc-root-jdk1.8.0_222.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-compile-javac-root-jdk1.8.0_222.txt [308K] checkstyle: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-checkstyle-root.txt [16M] hadolint: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-patch-hadolint.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-patch-shellcheck.txt [72K] shelldocs: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-patch-shelldocs.txt [8.0K] whitespace: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/whitespace-eol.txt [12M] https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/whitespace-tabs.txt [1.2M] xml: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/xml.txt [12K] findbugs: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase_hadoop-yarn-server-timelineservice-hbase-client-warnings.html [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-javadoc-javadoc-root-jdk1.7.0_95.txt [16K] https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/diff-javadoc-javadoc-root-jdk1.8.0_222.txt [1.1M] unit: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [316K] https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/413/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoo
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1228/ [Aug 13, 2019 2:57:20 AM] (ayushsaxena) HDFS-14708. [Aug 13, 2019 10:08:55 AM] (31469764+bshashikant) HDDS-1908. TestMultiBlockWritesWithDnFailures is failing (#1282) [Aug 13, 2019 1:34:00 PM] (abmodi) YARN-9744. RollingLevelDBTimelineStore.getEntityByTime fails with NPE. [Aug 13, 2019 1:39:01 PM] (nanda) HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh. (#1284) [Aug 13, 2019 1:47:10 PM] (ayushsaxena) HDFS-13505. Turn on HDFS ACLs by default. Contributed by Siyao Meng. [Aug 13, 2019 3:52:59 PM] (xkrogen) HDFS-14717. [Dynamometer] Remove explicit search for JUnit dependency [Aug 13, 2019 4:21:18 PM] (ebadger) YARN-9442. container working directory has group read permissions. [Aug 13, 2019 9:37:32 PM] (aengineer) HDDS-1886. Use ArrayList#clear to address audit failure scenario [Aug 13, 2019 9:57:05 PM] (aengineer) HDDS-1488. Scm cli command to start/stop replication manager. [Aug 13, 2019 10:30:53 PM] (aengineer) HDDS-1891. Ozone fs shell command should work with default port when [Aug 13, 2019 10:57:24 PM] (aengineer) HDDS-1961. TestStorageContainerManager#testScmProcessDatanodeHeartbeat [Aug 13, 2019 11:03:31 PM] (aengineer) HDDS-1917. TestOzoneRpcClientAbstract is failing. [Aug 13, 2019 11:27:57 PM] (weichiu) HDFS-14665. HttpFS: LISTSTATUS response is missing HDFS-specific fields [Aug 13, 2019 11:39:40 PM] (iwasakims) HDFS-14423. Percent (%) and plus (+) characters no longer work in [Aug 13, 2019 11:50:49 PM] (weichiu) HDFS-14625. Make DefaultAuditLogger class in FSnamesystem to Abstract. [Aug 13, 2019 11:56:59 PM] (aengineer) HDDS-1916. Only contract tests are run in ozonefs module [Aug 14, 2019 12:10:36 AM] (aengineer) HDDS-1659. Define the process to add proposal/design docs to the Ozone [Aug 14, 2019 12:15:26 AM] (weichiu) HDFS-14491. More Clarity on Namenode UI Around Blocks and Replicas. [Aug 14, 2019 12:27:04 AM] (aengineer) HDDS-1928. Cannot run ozone-recon compose due to syntax error -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core Class org.apache.hadoop.applications.mawo.server.common.TaskStatus implements Cloneable but does not define or use clone method At TaskStatus.java:does not define or use clone method At TaskStatus.java:[lines 39-346] Equals method for org.apache.hadoop.applications.mawo.server.worker.WorkerId assumes the argument is of type WorkerId At WorkerId.java:the argument is of type WorkerId At WorkerId.java:[line 114] org.apache.hadoop.applications.mawo.server.worker.WorkerId.equals(Object) does not check for null argument At WorkerId.java:null argument At WorkerId.java:[lines 114-115] Failed CTEST tests : test_test_libhdfs_ops_hdfs_static test_test_libhdfs_threaded_hdfs_static test_test_libhdfs_zerocopy_hdfs_static test_test_native_mini_dfs test_libhdfs_threaded_hdfspp_test_shim_static test_hdfspp_mini_dfs_smoke_hdfspp_test_shim_static libhdfs_mini_stress_valgrind_hdfspp_test_static memcheck_libhdfs_mini_stress_valgrind_hdfspp_test_static test_libhdfs_mini_stress_hdfspp_test_shim_static test_hdfs_ext_hdfspp_test_shim_static Failed junit tests : hadoop.hdfs.server.federation.router.TestRouterWithSecureStartup hadoop.hdfs.server.federation.security.TestRouterHttpDelegationToken hadoop.hdfs.server.federation.router.TestRouterFaultTolerant hadoop.mapreduce.v2.hs.webapp.TestHSWebApp cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1228/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1228/artifact/out/diff-compile-javac-root.txt [332K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x
[jira] [Created] (HADOOP-16516) Upgrade Wildfly-11.0.0.Beta1 to a stable version with no CVEs
Vivek Ratnavel Subramanian created HADOOP-16516: --- Summary: Upgrade Wildfly-11.0.0.Beta1 to a stable version with no CVEs Key: HADOOP-16516 URL: https://issues.apache.org/jira/browse/HADOOP-16516 Project: Hadoop Common Issue Type: Task Components: tools Reporter: Vivek Ratnavel Subramanian The transitive dependency Wildfly-11.0.0Beta1 brought in by azure-data-lake-store-sdk 2.3.3 has 3 known medium severity CVEs and needs to be upgraded. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-16335) ERROR: namenode can only be executed by root while executing "hdfs namenode -format"
[
https://issues.apache.org/jira/browse/HADOOP-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki resolved HADOOP-16335.
---
Resolution: Invalid
I think this is coufiguration issue. If you define env var
HDFS_NAMENODE_USER=root in hadoop-env.sh or somewhere and run the command by
another user, you will get the error.
{noformat}
$ HDFS_NAMENODE_USER=root bin/hadoop namenode -format
WARNING: Use of this script to execute namenode is deprecated.
WARNING: Attempting to execute replacement "hdfs namenode" instead.
ERROR: namenode can only be executed by root.
{noformat}
I'm closing this as invalid. Please reopen if this turns out to be bug in
scripts.
> ERROR: namenode can only be executed by root while executing "hdfs namenode
> -format"
>
>
> Key: HADOOP-16335
> URL: https://issues.apache.org/jira/browse/HADOOP-16335
> Project: Hadoop Common
> Issue Type: Bug
> Components: common
>Affects Versions: 3.2.0
>Reporter: Lakshmi Narayanan G
>Priority: Trivial
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/414/ [Aug 14, 2019 3:35:14 AM] (iwasakims) HDFS-14423. Percent (%) and plus (+) characters no longer work in [Error replacing 'FILE' - Workspace is not accessible] - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
