[google-appengine] Re: Blobstore filename created in MapReduce job too long to create BlobKey

2013-03-06 Thread Ryan Huebsch
Hi, We've filed an issue https://code.google.com/p/googleappengine/issues/detail?id=8932 to track the issue. We are investigating the problem. On Friday, March 1, 2013 8:25:17 PM UTC-8, Jamie Niemasik wrote: > > I've been receiving intermittent errors from MapReduce jobs. I'm running > Python

Re: [google-appengine] Re: Blobstore filename created in MapReduce job too long to create BlobKey

2013-03-06 Thread Jamie Niemasik
: ) I tried the same thing last night, but wasn't ready to declare victory because I saw new errors. Happily, it turns out those were from old tasks (with retry counts nearing 1000) whose states were not compatible with the new MR code. I've purged the queue and cleaned out the associated blobs an

[google-appengine] Re: Blobstore filename created in MapReduce job too long to create BlobKey

2013-03-06 Thread bmurr
Well, I think I have it solved. I was using an older version of the mapreduce library, which uses mapreduce.lib.files to interact with the blobstore. The newer version of mapreduce uses google.appengine.api.files instead, which doesn't cause this problem. These two libraries seem pretty similar

Re: [google-appengine] Re: Blobstore filename created in MapReduce job too long to create BlobKey

2013-03-05 Thread Jamie Niemasik
Thanks Alex. Yes, they are writable; however, I can't find any errors in the logs, other than the name errors themselves (and those occur right after "Final result for job … is 'success'). The mapreduce code gets through files.finalize(filename), but blows up in get_blob_key because the filename is

[google-appengine] Re: Blobstore filename created in MapReduce job too long to create BlobKey

2013-03-05 Thread Alex Burgel
On Friday, March 1, 2013 11:25:17 PM UTC-5, Jamie Niemasik wrote: > Some of the filenames are 288 bytes long, while some are 992. The M/R spec > name and id in each case is nearly the same and is very short; I don't see > where this variance comes from. > Have you noticed if the long file names

[google-appengine] Re: Blobstore filename created in MapReduce job too long to create BlobKey

2013-03-05 Thread Ben Fox
I've been having a similar problem. As far as I know, we didn't run into this problem until 1st March. Before then, I am fairly certain all filenames were 288 characters in length and since then have been 992 characters. A solution (at least in Java, presumably Python has something similar) is

[google-appengine] Re: Blobstore filename created in MapReduce job too long to create BlobKey

2013-03-05 Thread bmurr
I've also been having this problem. Did you manage to find any workarounds? On Saturday, March 2, 2013 4:25:17 AM UTC, Jamie Niemasik wrote: > > I've been receiving intermittent errors from MapReduce jobs. I'm running > Python 2.7. > > The specific error is "BadValueError: name must be under