Re: Is continuous map reduce supported

2010-08-24 Thread Harsh J
There's Chain-Mapping and Chain-Reducing available. With good docs: http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapred/lib/ChainReducer.html However, something as simple as Twister (which has iterative mapreduces based on a while-like condition loop) isn't directly available

Is continuous map reduce supported

2010-08-24 Thread Stephen Mullins
Hello, I have not used Hadoop but am researching it for an analytics project. I would like to know if Hadoop supports continuous or incremental map reduce functionality. If not, are there any plans to add it? Thanks, Stephen

Re: Custom Input Format in New API (Convert Mahaout XMLInput Format to New API)

2010-08-24 Thread Amareshwari Sri Ramadasu
With new api, next method reads key and value into member variables, and the key and value read by next method can read by getCurrentKey() and getCurrentValue(). For example see LineRecoredReader, SequenceFileRecordReader in org.apache.hadoop.mapreduce.lib.input package. Thanks Amareshwari On

Re: Custom Input Format in New API (Convert Mahaout XMLInput Format to New API)

2010-08-24 Thread Robin Anil
+mahout-user On Tue, Aug 24, 2010 at 5:37 PM, Shuja Rehman wrote: > Hi > I am trying to convert Mahout xmlInputFormat to new API but this is not > working. The problem which i think is that in old api we have next method > which takes key and value and we can set it in the method > > public

Custom Input Format in New API (Convert Mahaout XMLInput Format to New API)

2010-08-24 Thread Shuja Rehman
Hi I am trying to convert Mahout xmlInputFormat to new API but this is not working. The problem which i think is that in old api we have next method which takes key and value and we can set it in the method public boolean next(LongWritable key, Text value) throws IOException { but in new API,