access Permission issure

2013-08-02 Thread 闫昆
I use hadoop 2.0 superuser is hadoop I use eclipse connection hadoop cluster,but when I create dir throw exception org.apache.hadoop.security.AccessControlException: Permission denied: user=dyf, access=WRITE, inode="/":hadoop:hadoop:drwxr-xr-x I set hadoop.security.authorization in core-site.xm

How to construct path to a HDFS dir in local host

2013-08-02 Thread Huy Pham
So I am trying to get the content of a HDFS dir. The instruction gives an example like this: FileStatus[] status = fs.listStatus(new Path("hdfs://jp.seka.com:9000/user/jeka/in")); But now I need to apply this example to my local host, which has HDFS dir "/data". I tried putting "/data" and "hdfs

Re: Extra start-up overhead with hadoop-2.1.0-beta

2013-08-02 Thread Krishna Kishore Bonagiri
Hi Omkar, I have got these number by running a simple C program on the containers that fetches the timestamp in microseconds and exits. The times mentioned are low and high, they are not varying so drastically with in a version but there are huge differences(like a second) between the two versio

Pydoop 0.10.0_rc1

2013-08-02 Thread Simone Leo
Hello everyone, we're happy to announce that we have just released Pydoop 0.10.0_rc1 (http://pydoop.sourceforge.net). The main change with respect to the previous version is support for CDH 4.3.0. Most of the work for this has been done by our newest project member, Mauro Del Rio: please jo

JobClient methods doesn't have a timeout. --> org.apache.hadoop.ipc.Client.call(...) blocks infinate

2013-08-02 Thread Christian Schneider
Hi, it would be nice if we can specify a timeout for JobClient Calls. If we call JobClient.getJob(...) and the connection breaks, it blocks without getting a timeout. This is because the org.apache.hadoop.ipc.Client.call(...) looks like this: public Writable call(RPC.RpcKind rpcKind, Writable r