Hi
Total size of the source data is aproximately 20GB when we run the cluster.
Let me identify how to enable the debug logs
thanks indeed
jayaseelan
From: Uma Maheswara Rao G [mailto:mahesw...@huawei.com]
Sent: Thursday, December 22, 2011 12:06 PM
To: hdfs-user@hadoop.apache.org
Subject: RE: could not sink exception
At what load you are running the cluster?
Looks NN not able to choose the targets for block.
When choosing the targets NN will check many conditions like what is the thread
count in DNs and allocated space for the node, ...etc.
If NN finds any of the nodes in that situation it will not choose the targets.
That logs were debug logs. If you are getting this error frequently, you can
just enable the debug log and check the reason once.
Regards,
Uma
From: Jayaseelan E [jayaseela...@ericsson.com]
Sent: Thursday, December 22, 2011 11:58 AM
To: Harsh J; hdfs-user@hadoop.apache.org
Subject: REG:could not sink exception
Hi
When we tried to run the hadoop flows we got the following exception for all
the tasks and it is failed.error is little bit confusing.I have two data
nodes,but both are healthy and nodes are
Up and running.
com.ericsson.cim.base.core.exception.CimProcessingException: Could not sink.
Got an IOException with message: org.apache.hadoop.ipc.RemoteException:
java.io.IOException: File
/data/processing/events/usage/Processed_at_20111215100837/_temporary/_attempt_201112150454_0036_m_00_0/ServiceUsageChargedAccBalCS4_20111001-m-0
could only be replicated to 0 nodes, instead of 1
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1282)
at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:469)
at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:512)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:968)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:964)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:962)
Thanks indeed
jayaseelan
