Re: Abandoning Block
rahul patodi wrote: I think you should setup passwordless ssh from master to all VMs you can do this by running this command on master: ssh-keygen -t rsa -P "" ssh-copy-id -i $HOME/.ssh/id_rsa.pub slave -Thanks and Regards, Rahul Patodi Associate Software Engineer, Impetus Infotech (India) Private Limited, www.impetus.com Mob:09907074413 On Tue, Dec 7, 2010 at 10:38 AM, Adarsh Sharma wrote: li ping wrote: Make sure the VMs can reach each other (e.g,IPtables). And the DNS/ip is correct. On Mon, Dec 6, 2010 at 7:05 PM, Adarsh Sharma wrote: Dear all, I am facing below problem while running Hadoop on VM's. I am using hadoop0-.20.2 with JDK6 My jobtracker log says that :-2010-12-06 15:16:06,618 INFO org.apache.hadoop.mapred.JobTracker: JobTracker up at: 54311 2010-12-06 15:16:06,618 INFO org.apache.hadoop.mapred.JobTracker: JobTracker webserver: 50030 2010-12-06 15:16:06,738 INFO org.apache.hadoop.mapred.JobTracker: Cleaning up the system directory 2010-12-06 15:16:06,801 INFO org.apache.hadoop.mapred.CompletedJobStatusStore: Completed job store is inactive 2010-12-06 15:17:15,830 INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.56:50010] 2010-12-06 15:17:15,830 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning block blk_377241628391316172_1001 2010-12-06 15:17:15,832 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to find target node: 192.168.0.56:50010 2010-12-06 15:18:30,836 INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.56:50010] 2010-12-06 15:18:30,836 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning block blk_2025622418653738085_1001 2010-12-06 15:18:30,838 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to find target node: 192.168.0.56:50010 2010-12-06 15:19:45,842 INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.61:50010] 2010-12-06 15:19:45,843 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning block blk_696328516245550547_1001 2010-12-06 15:19:45,845 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to find target node: 192.168.0.61:50010 2010-12-06 15:21:00,849 INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.55:50010] 2010-12-06 15:21:00,849 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning block blk_6110605884701761678_1001 2010-12-06 15:21:00,853 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to find target node: 192.168.0.55:50010 2010-12-06 15:21:06,854 WARN org.apache.hadoop.hdfs.DFSClient: DataStreamer Exception: java.io.IOException: Unable to create new block. at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2845) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2288) 2010-12-06 15:21:06,855 WARN org.apache.hadoop.hdfs.DFSClient: Error Recovery for block blk_6110605884701761678_1001 bad datanode[0] nodes == null 2010-12-06 15:21:06,855 WARN org.apache.hadoop.hdfs.DFSClient: Could not get block locations. Source file "/home/hadoop/mapred/system/ jobtracker.info" - Aborting... 2010-12-06 15:21:06,855 WARN org.apache.hadoop.mapred.JobTracker: Writing to file hdfs://ws-test:54310/home/hadoop/mapred/system/jobtracker.infofailed! 41,1 5% tem/jobtracker.info failed! 2010-12-06 15:21:06,855 WARN org.apache.hadoop.mapred.JobTracker: FileSystem is not ready yet! 2010-12-06 15:21:06,862 WARN org.apache.hadoop.mapred.JobTracker: Failed to initialize recovery manager. java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.55:50010] at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:213) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.createBlockOutputStream(DFSClient.java:2870) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2826) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102) at org.apache.hadoop.hdfs.DFSClien
Re: Abandoning Block
I think you should setup passwordless ssh from master to all VMs you can do this by running this command on master: ssh-keygen -t rsa -P "" ssh-copy-id -i $HOME/.ssh/id_rsa.pub slave -Thanks and Regards, Rahul Patodi Associate Software Engineer, Impetus Infotech (India) Private Limited, www.impetus.com Mob:09907074413 On Tue, Dec 7, 2010 at 10:38 AM, Adarsh Sharma wrote: > li ping wrote: > >> Make sure the VMs can reach each other (e.g,IPtables). And the DNS/ip is >> correct. >> >> On Mon, Dec 6, 2010 at 7:05 PM, Adarsh Sharma > >wrote: >> >> >> >>> Dear all, >>> >>> I am facing below problem while running Hadoop on VM's. I am using >>> hadoop0-.20.2 with JDK6 >>> >>> My jobtracker log says that :-2010-12-06 15:16:06,618 INFO >>> org.apache.hadoop.mapred.JobTracker: JobTracker up at: 54311 >>> 2010-12-06 15:16:06,618 INFO org.apache.hadoop.mapred.JobTracker: >>> JobTracker webserver: 50030 >>> 2010-12-06 15:16:06,738 INFO org.apache.hadoop.mapred.JobTracker: >>> Cleaning >>> up the system directory >>> 2010-12-06 15:16:06,801 INFO >>> org.apache.hadoop.mapred.CompletedJobStatusStore: Completed job store is >>> inactive >>> 2010-12-06 15:17:15,830 INFO org.apache.hadoop.hdfs.DFSClient: Exception >>> in >>> createBlockOutputStream java.net.SocketTimeoutException: 69000 millis >>> timeout while waiting for channel to be ready for connect. ch : >>> java.nio.channels.SocketChannel[connection-pending remote=/ >>> 192.168.0.56:50010] >>> 2010-12-06 15:17:15,830 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning >>> block blk_377241628391316172_1001 >>> 2010-12-06 15:17:15,832 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to >>> find target node: 192.168.0.56:50010 >>> 2010-12-06 15:18:30,836 INFO org.apache.hadoop.hdfs.DFSClient: Exception >>> in >>> createBlockOutputStream java.net.SocketTimeoutException: 69000 millis >>> timeout while waiting for channel to be ready for connect. ch : >>> java.nio.channels.SocketChannel[connection-pending remote=/ >>> 192.168.0.56:50010] >>> 2010-12-06 15:18:30,836 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning >>> block blk_2025622418653738085_1001 >>> 2010-12-06 15:18:30,838 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to >>> find target node: 192.168.0.56:50010 >>> 2010-12-06 15:19:45,842 INFO org.apache.hadoop.hdfs.DFSClient: Exception >>> in >>> createBlockOutputStream java.net.SocketTimeoutException: 69000 millis >>> timeout while waiting for channel to be ready for connect. ch : >>> java.nio.channels.SocketChannel[connection-pending remote=/ >>> 192.168.0.61:50010] >>> 2010-12-06 15:19:45,843 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning >>> block blk_696328516245550547_1001 >>> 2010-12-06 15:19:45,845 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to >>> find target node: 192.168.0.61:50010 >>> 2010-12-06 15:21:00,849 INFO org.apache.hadoop.hdfs.DFSClient: Exception >>> in >>> createBlockOutputStream java.net.SocketTimeoutException: 69000 millis >>> timeout while waiting for channel to be ready for connect. ch : >>> java.nio.channels.SocketChannel[connection-pending remote=/ >>> 192.168.0.55:50010] >>> 2010-12-06 15:21:00,849 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning >>> block blk_6110605884701761678_1001 >>> 2010-12-06 15:21:00,853 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to >>> find target node: 192.168.0.55:50010 >>> 2010-12-06 15:21:06,854 WARN org.apache.hadoop.hdfs.DFSClient: >>> DataStreamer >>> Exception: java.io.IOException: Unable to create new block. >>> at >>> >>> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2845) >>> at >>> >>> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102) >>> at >>> >>> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2288) >>> >>> 2010-12-06 15:21:06,855 WARN org.apache.hadoop.hdfs.DFSClient: Error >>> Recovery for block blk_6110605884701761678_1001 bad datanode[0] nodes == >>> null >>> 2010-12-06 15:21:06,855 WARN org.apache.hadoop.hdfs.DFSClient: Could not >>> get block locations. Source file "/home/hadoop/mapred/system/ >>> jobtracker.info" - Aborting... >>> 2010-12-06 15:21:06,855 WARN org.apache.hadoop.mapred.JobTracker: Writing >>> to file >>> hdfs://ws-test:54310/home/hadoop/mapred/system/jobtracker.infofailed! >>> >>> 41,1 5% >>> >>> tem/jobtracker.info failed! >>> 2010-12-06 15:21:06,855 WARN org.apache.hadoop.mapred.JobTracker: >>> FileSystem is not ready yet! >>> 2010-12-06 15:21:06,862 WARN org.apache.hadoop.mapred.JobTracker: Failed >>> to >>> initialize recovery manager. >>> java.net.SocketTimeoutException: 69000 millis timeout while waiting for >>> channel to be ready for connect. ch : >>> java.nio.channels.SocketChannel[connection-pending remote=/ >>> 192.168.0.55:50010] >>> at >>> >>> org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:213) >>> at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404) >
Re: Abandoning Block
li ping wrote: Make sure the VMs can reach each other (e.g,IPtables). And the DNS/ip is correct. On Mon, Dec 6, 2010 at 7:05 PM, Adarsh Sharma wrote: Dear all, I am facing below problem while running Hadoop on VM's. I am using hadoop0-.20.2 with JDK6 My jobtracker log says that :-2010-12-06 15:16:06,618 INFO org.apache.hadoop.mapred.JobTracker: JobTracker up at: 54311 2010-12-06 15:16:06,618 INFO org.apache.hadoop.mapred.JobTracker: JobTracker webserver: 50030 2010-12-06 15:16:06,738 INFO org.apache.hadoop.mapred.JobTracker: Cleaning up the system directory 2010-12-06 15:16:06,801 INFO org.apache.hadoop.mapred.CompletedJobStatusStore: Completed job store is inactive 2010-12-06 15:17:15,830 INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.56:50010] 2010-12-06 15:17:15,830 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning block blk_377241628391316172_1001 2010-12-06 15:17:15,832 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to find target node: 192.168.0.56:50010 2010-12-06 15:18:30,836 INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.56:50010] 2010-12-06 15:18:30,836 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning block blk_2025622418653738085_1001 2010-12-06 15:18:30,838 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to find target node: 192.168.0.56:50010 2010-12-06 15:19:45,842 INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.61:50010] 2010-12-06 15:19:45,843 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning block blk_696328516245550547_1001 2010-12-06 15:19:45,845 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to find target node: 192.168.0.61:50010 2010-12-06 15:21:00,849 INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.55:50010] 2010-12-06 15:21:00,849 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning block blk_6110605884701761678_1001 2010-12-06 15:21:00,853 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to find target node: 192.168.0.55:50010 2010-12-06 15:21:06,854 WARN org.apache.hadoop.hdfs.DFSClient: DataStreamer Exception: java.io.IOException: Unable to create new block. at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2845) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2288) 2010-12-06 15:21:06,855 WARN org.apache.hadoop.hdfs.DFSClient: Error Recovery for block blk_6110605884701761678_1001 bad datanode[0] nodes == null 2010-12-06 15:21:06,855 WARN org.apache.hadoop.hdfs.DFSClient: Could not get block locations. Source file "/home/hadoop/mapred/system/ jobtracker.info" - Aborting... 2010-12-06 15:21:06,855 WARN org.apache.hadoop.mapred.JobTracker: Writing to file hdfs://ws-test:54310/home/hadoop/mapred/system/jobtracker.infofailed! 41,1 5% tem/jobtracker.info failed! 2010-12-06 15:21:06,855 WARN org.apache.hadoop.mapred.JobTracker: FileSystem is not ready yet! 2010-12-06 15:21:06,862 WARN org.apache.hadoop.mapred.JobTracker: Failed to initialize recovery manager. java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.55:50010] at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:213) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.createBlockOutputStream(DFSClient.java:2870) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2826) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102) at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2288) 2010-12-06 15:21:16,864 WARN org.apache.hadoop.mapred.JobTracker: Retrying... 2010-12-06 15:22:25,879 INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream java.net.SocketTimeoutException: 69000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ 192.168.0.61:50010] 2010
Re: HDFS and distcp issue??
On 12/06/2010 07:48 PM, Dmitriy Ryaboy wrote: Do you have the failing task's log? -Dmitriy On Sat, Dec 4, 2010 at 12:47 PM, hadoopman wrote: I'll have to look for it. This is my first full blown installation of Hadoop. Still a LOT to learn Is that the name it's typically called? Yeah I know. It's a beginners question :-) Thanks!
Re: HDFS and distcp issue??
Do you have the failing task's log? -Dmitriy On Sat, Dec 4, 2010 at 12:47 PM, hadoopman wrote: > I've run into an interesting problem with syncing a couple of clusters > using distcp. We've validated that it works to a local installation from > our remote cluster. I suspect our firewalls 'may' be responsible for the > problem we're experiencing. We're using ports 9000, 9001 and 50010.I've > verified all three ports are available to the namenodes and datanodes in > both directions. Is there something else we're missing? > > Looks like it get's to 80% before it fails. Here's what we're seeing. > > # u...@hnn1:~$ hadoop distcp hdfs://hnn1:9000/user/testing > hdfs://hnn2:9000/user > > 10/12/03 15:58:10 INFO tools.DistCp: > srcPaths=[hdfs://hnn1:9000/user/testing] > > 10/12/03 15:58:10 INFO tools.DistCp: destPath=hdfs://hnn2:9000/user > > 10/12/03 15:58:11 INFO tools.DistCp: srcCount=6 > > 10/12/03 15:58:11 INFO mapred.JobClient: Running job: job_201011221457_0019 > > 10/12/03 15:58:12 INFO mapred.JobClient: map 0% reduce 0% > > 10/12/03 15:58:36 INFO mapred.JobClient: map 19% reduce 0% > > 10/12/03 15:58:45 INFO mapred.JobClient: map 39% reduce 0% > > 10/12/03 15:59:03 INFO mapred.JobClient: map 60% reduce 0% > > 10/12/03 15:59:12 INFO mapred.JobClient: map 80% reduce 0% > > 10/12/03 15:59:32 INFO mapred.JobClient: Task Id : > attempt_201011221457_0019_m_00_0, Status : FAILED > > java.io.IOException: Copied: 0 Skipped: 0 Failed: 5 > >at > org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:572) > >at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) > >at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358) > >at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) > >at org.apache.hadoop.mapred.Child.main(Child.java:170) > > 10/12/03 15:59:33 INFO mapred.JobClient: map 0% reduce 0% > > 10/12/03 15:59:55 INFO mapred.JobClient: map 19% reduce 0% > > 10/12/03 16:00:04 INFO mapred.JobClient: map 39% reduce 0% > > 10/12/03 16:00:22 INFO mapred.JobClient: map 60% reduce 0% > > 10/12/03 16:00:31 INFO mapred.JobClient: map 80% reduce 0% > > 10/12/03 16:00:51 INFO mapred.JobClient: Task Id : > attempt_201011221457_0019_m_00_1, Status : FAILED > > java.io.IOException: Copied: 0 Skipped: 0 Failed: 5 > >at > org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:572) > >at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) > >at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358) > >at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) > >at org.apache.hadoop.mapred.Child.main(Child.java:170) > > Thanks! > -- Dmitriy V Ryaboy Twitter Analytics http://twitter.com/squarecog
Re: Abandoning Block
Make sure the VMs can reach each other (e.g,IPtables). And the DNS/ip is correct. On Mon, Dec 6, 2010 at 7:05 PM, Adarsh Sharma wrote: > Dear all, > > I am facing below problem while running Hadoop on VM's. I am using > hadoop0-.20.2 with JDK6 > > My jobtracker log says that :-2010-12-06 15:16:06,618 INFO > org.apache.hadoop.mapred.JobTracker: JobTracker up at: 54311 > 2010-12-06 15:16:06,618 INFO org.apache.hadoop.mapred.JobTracker: > JobTracker webserver: 50030 > 2010-12-06 15:16:06,738 INFO org.apache.hadoop.mapred.JobTracker: Cleaning > up the system directory > 2010-12-06 15:16:06,801 INFO > org.apache.hadoop.mapred.CompletedJobStatusStore: Completed job store is > inactive > 2010-12-06 15:17:15,830 INFO org.apache.hadoop.hdfs.DFSClient: Exception in > createBlockOutputStream java.net.SocketTimeoutException: 69000 millis > timeout while waiting for channel to be ready for connect. ch : > java.nio.channels.SocketChannel[connection-pending remote=/ > 192.168.0.56:50010] > 2010-12-06 15:17:15,830 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning > block blk_377241628391316172_1001 > 2010-12-06 15:17:15,832 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to > find target node: 192.168.0.56:50010 > 2010-12-06 15:18:30,836 INFO org.apache.hadoop.hdfs.DFSClient: Exception in > createBlockOutputStream java.net.SocketTimeoutException: 69000 millis > timeout while waiting for channel to be ready for connect. ch : > java.nio.channels.SocketChannel[connection-pending remote=/ > 192.168.0.56:50010] > 2010-12-06 15:18:30,836 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning > block blk_2025622418653738085_1001 > 2010-12-06 15:18:30,838 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to > find target node: 192.168.0.56:50010 > 2010-12-06 15:19:45,842 INFO org.apache.hadoop.hdfs.DFSClient: Exception in > createBlockOutputStream java.net.SocketTimeoutException: 69000 millis > timeout while waiting for channel to be ready for connect. ch : > java.nio.channels.SocketChannel[connection-pending remote=/ > 192.168.0.61:50010] > 2010-12-06 15:19:45,843 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning > block blk_696328516245550547_1001 > 2010-12-06 15:19:45,845 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to > find target node: 192.168.0.61:50010 > 2010-12-06 15:21:00,849 INFO org.apache.hadoop.hdfs.DFSClient: Exception in > createBlockOutputStream java.net.SocketTimeoutException: 69000 millis > timeout while waiting for channel to be ready for connect. ch : > java.nio.channels.SocketChannel[connection-pending remote=/ > 192.168.0.55:50010] > 2010-12-06 15:21:00,849 INFO org.apache.hadoop.hdfs.DFSClient: Abandoning > block blk_6110605884701761678_1001 > 2010-12-06 15:21:00,853 INFO org.apache.hadoop.hdfs.DFSClient: Waiting to > find target node: 192.168.0.55:50010 > 2010-12-06 15:21:06,854 WARN org.apache.hadoop.hdfs.DFSClient: DataStreamer > Exception: java.io.IOException: Unable to create new block. > at > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2845) > at > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102) > at > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2288) > > 2010-12-06 15:21:06,855 WARN org.apache.hadoop.hdfs.DFSClient: Error > Recovery for block blk_6110605884701761678_1001 bad datanode[0] nodes == > null > 2010-12-06 15:21:06,855 WARN org.apache.hadoop.hdfs.DFSClient: Could not > get block locations. Source file "/home/hadoop/mapred/system/ > jobtracker.info" - Aborting... > 2010-12-06 15:21:06,855 WARN org.apache.hadoop.mapred.JobTracker: Writing > to file hdfs://ws-test:54310/home/hadoop/mapred/system/jobtracker.infofailed! > > 41,1 5% > > tem/jobtracker.info failed! > 2010-12-06 15:21:06,855 WARN org.apache.hadoop.mapred.JobTracker: > FileSystem is not ready yet! > 2010-12-06 15:21:06,862 WARN org.apache.hadoop.mapred.JobTracker: Failed to > initialize recovery manager. > java.net.SocketTimeoutException: 69000 millis timeout while waiting for > channel to be ready for connect. ch : > java.nio.channels.SocketChannel[connection-pending remote=/ > 192.168.0.55:50010] > at > org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:213) > at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404) > at > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.createBlockOutputStream(DFSClient.java:2870) > at > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2826) > at > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102) > at > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2288) > 2010-12-06 15:21:16,864 WARN org.apache.hadoop.mapred.JobTracker: > Retrying... > 2010-12-06 15:22:25,879 INFO org.apache.hadoop.hdfs.DFSClient: Exception in > createBlockOutputStream java.net.SocketTimeoutException:
Log files umask/rights
Hi ! I am wondering if there is a way to specify the rights of the logfiles ... Currently my history logs are chmodded 600 ... I'd need them to be at least 644 Any idea ? -- -- Arthur CARANTA art...@caranta.com http://www.caranta.com --
