[jira] [Created] (HADOOP-15618) Fix debug log for property IPC_CLIENT_BIND_WILDCARD_ADDR_KEY
Ajay Kumar created HADOOP-15618:
---
Summary: Fix debug log for property
IPC_CLIENT_BIND_WILDCARD_ADDR_KEY
Key: HADOOP-15618
URL: https://issues.apache.org/jira/browse/HADOOP-15618
Project: Hadoop Common
Issue Type: Bug
Reporter: Ajay Kumar
Assignee: Ajay Kumar
Fix log message in Client class.
Currently:{code}LOG.debug("{} set to true. Will bind client sockets to wildcard
"
+ "address.",
CommonConfigurationKeys.IPC_CLIENT_BIND_WILDCARD_ADDR_KEY);{code}
to
{code}LOG.debug("{} set to {}",
CommonConfigurationKeys.IPC_CLIENT_BIND_WILDCARD_ADDR_KEY,
bindToWildCardAddress);{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15476) fix logging for split-dns multihome
Ajay Kumar created HADOOP-15476: --- Summary: fix logging for split-dns multihome Key: HADOOP-15476 URL: https://issues.apache.org/jira/browse/HADOOP-15476 Project: Hadoop Common Issue Type: Bug Reporter: Ajay Kumar Fix debug log statement introduced in [HADOOP-15250]. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15456) create base image for running secure ozone cluster
Ajay Kumar created HADOOP-15456: --- Summary: create base image for running secure ozone cluster Key: HADOOP-15456 URL: https://issues.apache.org/jira/browse/HADOOP-15456 Project: Hadoop Common Issue Type: Sub-task Reporter: Ajay Kumar Assignee: Ajay Kumar -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-15443) hadoop shell should allow non-privileged user to start secure daemons.
[ https://issues.apache.org/jira/browse/HADOOP-15443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar resolved HADOOP-15443. - Resolution: Not A Problem > hadoop shell should allow non-privileged user to start secure daemons. > -- > > Key: HADOOP-15443 > URL: https://issues.apache.org/jira/browse/HADOOP-15443 > Project: Hadoop Common > Issue Type: Bug >Reporter: Ajay Kumar >Assignee: Ajay Kumar >Priority: Major > Attachments: HADOOP-15443.poc.patch > > > With [HDFS-13081] now secure Datanode can be started without root privileges > if rpc port is protected via sasl and ssl is enabled for http. However hadoop > shell still has check for privilged user in hadoop-functions.sh. Jira intends > to amend it, at-least for hdfs. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15443) hadoop shell should allow non-privileged user to start secure daemons.
Ajay Kumar created HADOOP-15443: --- Summary: hadoop shell should allow non-privileged user to start secure daemons. Key: HADOOP-15443 URL: https://issues.apache.org/jira/browse/HADOOP-15443 Project: Hadoop Common Issue Type: Bug Reporter: Ajay Kumar Assignee: Ajay Kumar With [HDFS-13081] now secure Datanode can be started without root privileges if rpc port is protected via sasl and ssl is enabled for http. However hadoop shell still has check for privilged user in hadoop-functions.sh. Jira intends to amend it, at-least for hdfs. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15395) DefaultImpersonationProvider fails to parse proxy user config if username has . in it
Ajay Kumar created HADOOP-15395: --- Summary: DefaultImpersonationProvider fails to parse proxy user config if username has . in it Key: HADOOP-15395 URL: https://issues.apache.org/jira/browse/HADOOP-15395 Project: Hadoop Common Issue Type: Bug Reporter: Ajay Kumar DefaultImpersonationProvider fails to parse proxy user config if username has . in it. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15333) Depreciate or remove Groups#getUserToGroupsMappingServiceWithLoadedConfiguration
Ajay Kumar created HADOOP-15333:
---
Summary: Depreciate or remove
Groups#getUserToGroupsMappingServiceWithLoadedConfiguration
Key: HADOOP-15333
URL: https://issues.apache.org/jira/browse/HADOOP-15333
Project: Hadoop Common
Issue Type: Improvement
Reporter: Ajay Kumar
Assignee: Ajay Kumar
Groups#getUserToGroupsMappingServiceWithLoadedConfiguration introduced in
YARN-1676 reinitializes its static instance i.e \{{GROUPS}}. This instance is
stored by UGI for local reference. Use of
getUserToGroupsMappingServiceWithLoadedConfiguration results in UGI reference
detached from Parent class. This jira intends to discuss probable removal or
depreciation of this function to remove innocuous bug resulting from it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15295) Remove redundant logging related to tags from Configuration
Ajay Kumar created HADOOP-15295:
---
Summary: Remove redundant logging related to tags from
Configuration
Key: HADOOP-15295
URL: https://issues.apache.org/jira/browse/HADOOP-15295
Project: Hadoop Common
Issue Type: Improvement
Reporter: Ajay Kumar
Assignee: Ajay Kumar
Remove redundant logging related to tags from Configuration.
{code}
2018-03-06 18:55:46,164 INFO conf.Configuration: Removed undeclared tags:
2018-03-06 18:55:46,237 INFO conf.Configuration: Removed undeclared tags:
2018-03-06 18:55:46,249 INFO conf.Configuration: Removed undeclared tags:
2018-03-06 18:55:46,256 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15202) Deprecate CombinedIPWhiteList to use CombinedIPList
Ajay Kumar created HADOOP-15202: --- Summary: Deprecate CombinedIPWhiteList to use CombinedIPList Key: HADOOP-15202 URL: https://issues.apache.org/jira/browse/HADOOP-15202 Project: Hadoop Common Issue Type: New Feature Reporter: Ajay Kumar Assignee: Ajay Kumar Deprecate CombinedIPWhiteList to use CombinedIPList. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15178) Generalize NetUtils#wrapException to handle other subclasses with String Constructor.
Ajay Kumar created HADOOP-15178: --- Summary: Generalize NetUtils#wrapException to handle other subclasses with String Constructor. Key: HADOOP-15178 URL: https://issues.apache.org/jira/browse/HADOOP-15178 Project: Hadoop Common Issue Type: Bug Environment: NetUtils#wrapException returns an IOException if exception passed to it is not of type SocketException,EOFException,NoRouteToHostException,SocketTimeoutException,UnknownHostException,ConnectException,BindException. By default, it should always return instance (subclass of IOException) of same type unless a String constructor is not available. Reporter: Ajay Kumar Assignee: Ajay Kumar -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15155) Typo in javadoc of ReconfigurableBase#reconfigureProperty
Ajay Kumar created HADOOP-15155:
---
Summary: Typo in javadoc of ReconfigurableBase#reconfigureProperty
Key: HADOOP-15155
URL: https://issues.apache.org/jira/browse/HADOOP-15155
Project: Hadoop Common
Issue Type: Bug
Reporter: Ajay Kumar
Assignee: Ajay Kumar
Priority: Minor
There is a typo in javadoc of reconfigureProperty#reconfigurePropertyImpl
{code}
* This method cannot be overridden, subclasses should instead override
* reconfigureProperty.
{code}
should change to
{code}
* This method cannot be overridden, subclasses should instead override
* reconfigurePropertyImpl.
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15114) Add closeStreams(...) to IOUtils
Ajay Kumar created HADOOP-15114: --- Summary: Add closeStreams(...) to IOUtils Key: HADOOP-15114 URL: https://issues.apache.org/jira/browse/HADOOP-15114 Project: Hadoop Common Issue Type: Improvement Environment: Add closeStreams(...) in IOUtils. Originally suggested by [Jason Lowe|https://issues.apache.org/jira/browse/HDFS-12881?focusedCommentId=16288320=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16288320]. Reporter: Ajay Kumar Assignee: Ajay Kumar -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14969) Improve diagnostics in secure DataNode startup
Ajay Kumar created HADOOP-14969:
---
Summary: Improve diagnostics in secure DataNode startup
Key: HADOOP-14969
URL: https://issues.apache.org/jira/browse/HADOOP-14969
Project: Hadoop Common
Issue Type: Improvement
Reporter: Ajay Kumar
Assignee: Ajay Kumar
When DN secure mode configuration is incorrect, it throws the following
exception from Datanode#checkSecureConfig
{code}
private static void checkSecureConfig(DNConf dnConf, Configuration conf,
SecureResources resources) throws RuntimeException {
if (!UserGroupInformation.isSecurityEnabled()) {
return;
}
...
throw new RuntimeException("Cannot start secure DataNode without " +
"configuring either privileged resources or SASL RPC data transfer " +
"protection and SSL for HTTP. Using privileged resources in " +
"combination with SASL RPC data transfer protection is not supported.");
{code}
The DN should print more useful diagnostics as to what exactly what went wrong.
Also when starting secure DN with resources then the startup scripts should
launch the SecureDataNodeStarter class. If no SASL is configured and
SecureDataNodeStarter is not used, then we could mention that too.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14889) Suppress the fsnamesystem lock warning on nn startup
Ajay Kumar created HADOOP-14889:
---
Summary: Suppress the fsnamesystem lock warning on nn startup
Key: HADOOP-14889
URL: https://issues.apache.org/jira/browse/HADOOP-14889
Project: Hadoop Common
Issue Type: Improvement
Reporter: Ajay Kumar
If FsNameSystemLock is held for more than 10 seconds then we log stacktrace .
We can suppress this fsnamesystem lock warning on NameNode startup.
{code}
17/09/20 21:41:39 INFO namenode.FSNamesystem: FSNamesystem write lock held for
7159 ms via
java.lang.Thread.getStackTrace(Thread.java:1552)
org.apache.hadoop.util.StringUtils.getStackTrace(StringUtils.java:945)
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.writeUnlock(FSNamesystem.java:1659)
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1074)
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:703)
org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:688)
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:752)
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:992)
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:976)
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1701)
org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1769)
Number of suppressed write-lock reports: 0
Longest write-lock held interval: 7159
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14803) Upgrade JUnit 3 TestCase to JUnit 4 in TestS3NInMemoryFileSystem
Ajay Kumar created HADOOP-14803: --- Summary: Upgrade JUnit 3 TestCase to JUnit 4 in TestS3NInMemoryFileSystem Key: HADOOP-14803 URL: https://issues.apache.org/jira/browse/HADOOP-14803 Project: Hadoop Common Issue Type: Test Reporter: Ajay Kumar -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14795) TestMapFileOutputFormat missing @after annotation
Ajay Kumar created HADOOP-14795: --- Summary: TestMapFileOutputFormat missing @after annotation Key: HADOOP-14795 URL: https://issues.apache.org/jira/browse/HADOOP-14795 Project: Hadoop Common Issue Type: Bug Reporter: Ajay Kumar Assignee: Ajay Kumar Priority: Minor TestMapFileOutputFormat missing @after annotation. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14775) Change junit dependency in parent pom file to junit 5 while maintaining backward compatibility to junit4.
Ajay Kumar created HADOOP-14775: --- Summary: Change junit dependency in parent pom file to junit 5 while maintaining backward compatibility to junit4. Key: HADOOP-14775 URL: https://issues.apache.org/jira/browse/HADOOP-14775 Project: Hadoop Common Issue Type: Task Affects Versions: 3.0.0-alpha4 Reporter: Ajay Kumar Assignee: Ajay Kumar Change junit dependency in parent pom file to junit 5 while maintaining backward compatibility to junit4. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
