Re: Map Reduce when downloading files...

2011-05-25 Thread Michael Giannakopoulos
Thanks a lot! I 'll try it...

Re: Map Reduce when downloading files...

2011-05-25 Thread Harsh J
I haven't gone through the whole thing, but getting the Configuration object via a static member "conf" set only during submission (main()) will not work - and is probably why there's an NPE. Use the Context object in the map() call to get a configuration instance. That is the only right way I kno

Re: Map Reduce when downloading files...

2011-05-25 Thread Michael Giannakopoulos
Alright, I 'll send you the code (it's an amateur application). Any help is appreciated! (Don't bother with the Flickrj API)... And something else, how do you debug a map/reduce app so as to be sure what happens. I use eclipse and hadoop's plugin for eclipse (Galileo). Thanks a lot! MetaFlickrPro

Re: Map Reduce when downloading files...

2011-05-25 Thread Harsh J
Based on your stacktrace, the 'Task' did begin alright. (This is post-configuration/setup) You're getting an NPE on metaFlickrPro\.PhotosDownload$MapClass\.map(PhotosDownload\.java:124) Its not possible for us to tell why since the point that was thrown is from your custom code - and we do not hav

Map Reduce when downloading files...

2011-05-25 Thread Michael Giannakopoulos
Hello guys, I have written an application that downloads metadata from 3 groups of Flickr and i implement a map/reduce task so as metadata to be processed by 3 different mappers (each corresponds to one group...). My app runs on single mode, but when i try to run it in a pseudo-distributed mode had