[jira] [Created] (HADOOP-10557) FsShell -cp -p does not preserve extended ACLs
Akira AJISAKA created HADOOP-10557: -- Summary: FsShell -cp -p does not preserve extended ACLs Key: HADOOP-10557 URL: https://issues.apache.org/jira/browse/HADOOP-10557 Project: Hadoop Common Issue Type: Bug Reporter: Akira AJISAKA This issue tracks enhancing FsShell cp to * preserve extended ACLs by -p option or * add a new command-line option for preserving extended ACLs. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10558) java.net.UnknownHostException: Invalid host name: local host is: (unknown)
Sami Abobala created HADOOP-10558: - Summary: java.net.UnknownHostException: Invalid host name: local host is: (unknown) Key: HADOOP-10558 URL: https://issues.apache.org/jira/browse/HADOOP-10558 Project: Hadoop Common Issue Type: Bug Environment: two node cluster ubuntu 12.04 LTS in both Java version 1.7.0_25 node 1: core i5 4 GB RAM node 2: core i3 4 GB RAM Reporter: Sami Abobala I had this exception every time i try to run map-red job, I went to http://wiki.apache.org/hadoop/UnknownHost and tried every possible solution and still have the same result Task Id : attempt_1398945803120_0001_m_04_0, Status : FAILED Container launch failed for container_1398945803120_0001_01_06 : java.lang.reflect.UndeclaredThrowableException . . Caused by: com.google.protobuf.ServiceException: java.net.UnknownHostException: Invalid host name: local host is: (unknown); destination host is: fatima-HP-ProBook-4520s:8042; java.net.UnknownHostException; For more details see: http://wiki.apache.org/hadoop/UnknownHost . . -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Reopened] (HADOOP-10516) the NodeManager in slave does not starting
[ https://issues.apache.org/jira/browse/HADOOP-10516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sami Abobala reopened HADOOP-10516: --- I edit the cluster ID in DataNode and NameNode and make them the same. the NodeManager in slave does not starting -- Key: HADOOP-10516 URL: https://issues.apache.org/jira/browse/HADOOP-10516 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.23.9 Environment: two node cluster ubuntu 12.04 LTS in both Java version 1.7.0_25 node 1: core i5 4 GB RAM node 2: core i3 4 GB RAM Reporter: Sami Abobala Priority: Critical Labels: cloud, hadoop, yarn the Node Manager cannot start in the slave node and this is the log: 2014-04-17 14:47:54,217 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:205) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:328) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:370) Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:139) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) ... 3 more Caused by: java.lang.reflect.UndeclaredThrowableException at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:176) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:135) ... 4 more Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From fatima-HP-ProBook-4520s/127.0.1.1 to 0.0.0.0:8031 failed $ at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:144) at com.sun.proxy.$Proxy24.registerNodeManager(Unknown Source) at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59) ... 6 more Caused by: java.net.ConnectException: Call From fatima-HP-ProBook-4520s/127.0.1.1 to 0.0.0.0:8031 failed on connection exception: java.net.Conn$ at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:700) at org.apache.hadoop.ipc.Client.call(Client.java:1098) at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:141) ... 8 more Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495) at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:462) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:559) at org.apache.hadoop.ipc.Client$Connection.access$2100(Client.java:207) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1204) at org.apache.hadoop.ipc.Client.call(Client.java:1074) ... 9 more 2014-04-17 14:47:54,221 INFO org.apache.hadoop.ipc.Server: Stopping server on 41790 2014-04-17 14:47:54,222 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system.. 2014-04-17 14:47:54,222 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system... 2014-04-17 14:47:54,224 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped. 2014-04-17 14:47:54,224 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete. 2014-04-17 14:47:54,224 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG: / -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HADOOP-10516) the NodeManager in slave does not starting
[ https://issues.apache.org/jira/browse/HADOOP-10516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sami Abobala resolved HADOOP-10516. --- Resolution: Fixed the NodeManager in slave does not starting -- Key: HADOOP-10516 URL: https://issues.apache.org/jira/browse/HADOOP-10516 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.23.9 Environment: two node cluster ubuntu 12.04 LTS in both Java version 1.7.0_25 node 1: core i5 4 GB RAM node 2: core i3 4 GB RAM Reporter: Sami Abobala Priority: Critical Labels: cloud, hadoop, yarn the Node Manager cannot start in the slave node and this is the log: 2014-04-17 14:47:54,217 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:205) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:328) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:370) Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:139) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) ... 3 more Caused by: java.lang.reflect.UndeclaredThrowableException at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:176) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:135) ... 4 more Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From fatima-HP-ProBook-4520s/127.0.1.1 to 0.0.0.0:8031 failed $ at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:144) at com.sun.proxy.$Proxy24.registerNodeManager(Unknown Source) at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59) ... 6 more Caused by: java.net.ConnectException: Call From fatima-HP-ProBook-4520s/127.0.1.1 to 0.0.0.0:8031 failed on connection exception: java.net.Conn$ at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:700) at org.apache.hadoop.ipc.Client.call(Client.java:1098) at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:141) ... 8 more Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495) at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:462) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:559) at org.apache.hadoop.ipc.Client$Connection.access$2100(Client.java:207) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1204) at org.apache.hadoop.ipc.Client.call(Client.java:1074) ... 9 more 2014-04-17 14:47:54,221 INFO org.apache.hadoop.ipc.Server: Stopping server on 41790 2014-04-17 14:47:54,222 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system.. 2014-04-17 14:47:54,222 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system... 2014-04-17 14:47:54,224 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped. 2014-04-17 14:47:54,224 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete. 2014-04-17 14:47:54,224 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG: / -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10559) add a method to UserGroupInformation to load settings from a given conf file
Steve Loughran created HADOOP-10559:
---
Summary: add a method to UserGroupInformation to load settings
from a given conf file
Key: HADOOP-10559
URL: https://issues.apache.org/jira/browse/HADOOP-10559
Project: Hadoop Common
Issue Type: Improvement
Components: security
Affects Versions: 2.4.0
Reporter: Steve Loughran
There's no easy way to set up the security parameters of a process unless it's
set in core-site.xml, because it's just inited via:
{{initialize(new Configuration(), false);}}
# If it is defined in an XML resource injected in to the config resource list
via {{Configuration.addResource()}} -then it *may* get picked up, but only if
nothing has already created the configs.
# If it is defined in any other means -you can't get it in.
This is an issue with client apps that don't have core-site XML files on their
classpath, and which are loading their configs more dynamically. Everything
works on an insecure cluster, but try to target a secure one and things break.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Created] (HADOOP-10560) Update NativeS3FileSystem to issue copy commands for files with in a directory with a configurable number of threads
Ted Malaska created HADOOP-10560:
Summary: Update NativeS3FileSystem to issue copy commands for
files with in a directory with a configurable number of threads
Key: HADOOP-10560
URL: https://issues.apache.org/jira/browse/HADOOP-10560
Project: Hadoop Common
Issue Type: Improvement
Components: fs/s3
Reporter: Ted Malaska
Priority: Minor
In NativeS3FileSystem if you do a copy of a directory it will copy all the
files to the new location, but it will do this with one thread. Code is below.
This jira will allow a configurable number of threads to be used to issue the
copy commands to S3.
do {
PartialListing listing = store.list(srcKey, S3_MAX_LISTING_LENGTH,
priorLastKey, true);
for (FileMetadata file : listing.getFiles())
{ keysToDelete.add(file.getKey()); store.copy(file.getKey(), dstKey +
file.getKey().substring(srcKey.length())); }
priorLastKey = listing.getPriorLastKey();
} while (priorLastKey != null);
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Created] (HADOOP-10561) Copy command with preserve option should handle Xattrs
Uma Maheswara Rao G created HADOOP-10561: Summary: Copy command with preserve option should handle Xattrs Key: HADOOP-10561 URL: https://issues.apache.org/jira/browse/HADOOP-10561 Project: Hadoop Common Issue Type: Sub-task Components: fs Affects Versions: HDFS XAttrs (HDFS-2006) Reporter: Uma Maheswara Rao G The design docs for Xattrs stated that we handle preserve options with copy commands From doc: Preserve option of commands like “cp -p” shell command and “distcp -p” should work on XAttrs. In the case of source fs supports XAttrs but target fs does not support, XAttrs will be ignored with warning message -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10563) Remove the dependency of jsp in trunk
Haohui Mai created HADOOP-10563: --- Summary: Remove the dependency of jsp in trunk Key: HADOOP-10563 URL: https://issues.apache.org/jira/browse/HADOOP-10563 Project: Hadoop Common Issue Type: Improvement Reporter: Haohui Mai Assignee: Haohui Mai Attachments: HADOOP-10563.000.patch After HDFS-6252 neither hdfs nor yarn uses jsp, thus the dependency of the jsp can be removed from the pom. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10564) Add username to native RPCv9 client
Colin Patrick McCabe created HADOOP-10564: - Summary: Add username to native RPCv9 client Key: HADOOP-10564 URL: https://issues.apache.org/jira/browse/HADOOP-10564 Project: Hadoop Common Issue Type: Sub-task Components: native Affects Versions: HADOOP-10388 Reporter: Colin Patrick McCabe Assignee: Colin Patrick McCabe Add the ability for the native RPCv9 client to set a username when initiating a connection. -- This message was sent by Atlassian JIRA (v6.2#6252)
