Re: Map/Reduce with XML files ..

2008-04-29 Thread Prasan Ary
Kayla, Here is the custom xml reader. - Colin Evans [EMAIL PROTECTED] wrote: Date: Tue, 04 Mar 2008 11:27:34 -0800 From: Colin Evans [EMAIL PROTECTED] To: core-user@hadoop.apache.org Subject: Re: map/reduce function on xml

Re: Map/Reduce with XML files ..

2008-04-29 Thread Ted Dunning
files? - Original Message From: Ted Dunning [EMAIL PROTECTED] To: core-user@hadoop.apache.org Sent: Monday, April 28, 2008 4:16:20 PM Subject: Re: Map/Reduce with XML files .. The only real problem with xml and map-reduce is if you are talking about one gargantuan XML file

Map/Reduce with XML files ..

2008-04-28 Thread Kayla Jay
Hello Has anyone had any experience with processing xml files within Hadoop within their maps/reduces? In particular, has anyone used any sort of XQuery/XPath processing within their maps/reduces? Say I have XML string passed to the map and now I want to find something in particular via

Re: Map/Reduce with XML files ..

2008-04-28 Thread Ted Dunning
The only real problem with xml and map-reduce is if you are talking about one gargantuan XML file. That makes correct splitting difficult. If you are talking about millions or billions of small xml files (stored in some sort of container file), then hadoop should be pretty easy to use. On

Re: Map/Reduce with XML files ..

2008-04-28 Thread Kayla Jay
? - Original Message From: Ted Dunning [EMAIL PROTECTED] To: core-user@hadoop.apache.org Sent: Monday, April 28, 2008 4:16:20 PM Subject: Re: Map/Reduce with XML files .. The only real problem with xml and map-reduce is if you are talking about one gargantuan XML file. That makes correct