Hi Subroto,
Anything in the DN logs? Maybe the one DN is out of disk space? You
need to have 5*BLOCK_SIZE free.
-Todd
On Tue, Jun 19, 2012 at 1:29 AM, Subroto wrote:
> Hi,
>
> When DFS cluster;
> The datanodes keep on dumping the logs:
> 2012-06-19 04:05:04,842 INFO
> org.apache.hadoop.hdfs.se
But I have downloaded "hadoop-streaming-0.20.205.0.jar" and it
contains StreamXmlRecordReader.class file. This means it should
support StreamInputFormat.
Regards,
Mohammad Tariq
On Tue, Jun 19, 2012 at 5:54 PM, Mohammad Tariq wrote:
> Thanks Madhu. I'll do that.
>
> Regards,
> Mohammad
Thanks Madhu. I'll do that.
Regards,
Mohammad Tariq
On Tue, Jun 19, 2012 at 5:43 PM, madhu phatak wrote:
> Seems like StreamInputFormat not yet ported to new API.That's why you are
> not able to set as InputFormatClass. You can file a jira for this issue.
>
>
> On Tue, Jun 19, 2012 at 4:49
Seems like StreamInputFormat not yet ported to new API.That's why you are
not able to set as InputFormatClass. You can file a jira for this issue.
On Tue, Jun 19, 2012 at 4:49 PM, Mohammad Tariq wrote:
> My driver function looks like this -
>
> public static void main(String[] args) throws IOEx
My driver function looks like this -
public static void main(String[] args) throws IOException,
InterruptedException, ClassNotFoundException {
// TODO Auto-generated method stub
Configuration conf = new Configuration();
Job job = new Job();
Hello Madhu,
Thanks for the response. Actually I was trying to use the
new API (Job). Have you tried that. I was not able to set the
InputFormat using the Job API.
Regards,
Mohammad Tariq
On Tue, Jun 19, 2012 at 4:28 PM, madhu phatak wrote:
> Hi,
> Set the following propertie
Hi,
Set the following properties in driver class
jobConf.set("stream.recordreader.class",
"org.apache.hadoop.streaming.StreamXmlRecordReader");
jobConf.set("stream.recordreader.begin",
"start-tag");
jobConf.set("stream.recordreader.end",
"end-tag");
jobConf.setInputForma
Hi,
When DFS cluster;
The datanodes keep on dumping the logs:
2012-06-19 04:05:04,842 INFO
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Adding
block pool BP-1233167859-10.10.35.8-1340093005960
2012-06-19 04:05:04,861 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
