Re: File does not exist on part-r-00000 file after reducer runs

2013-02-11 Thread Robert Evans
e: Monday, February 11, 2013 12:02 AM To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" mailto:user@hadoop.apache.org>> Subject: File does not exist on part-r-0 file after reducer runs Are there any rules against writing results to Reducer.Context while in

File does not exist on part-r-00000 file after reducer runs

2013-02-10 Thread David Parks
Are there any rules against writing results to Reducer.Context while in the cleanup() method? I’ve got a reducer that is downloading a few 10’s of millions of images from a set of URLs feed to it. To be efficient I run many connections in parallel, but limit connections per domain and frequ