I've never been there so I'm speculating. Is "deadline exceeded" something
you can catch and then still perform further processing?
One would expect that allowing you further processing would somewhat defeat
the objective of having a deadline in the first place.

You might need to pre-slice your file into segments that you know will not
go anywhere near the deadline.

Since you're resigned to parsing some of your document via the task queue,
you might as well parse it all that way, and do zero parsing synchronous to
the upload.

On Wed, Oct 28, 2009 at 1:33 PM, Baron <richar...@gmail.com> wrote:

>
> hello,
>
> part of my app uploads a file and needs to parse each line of the
> file. The parsing of the whole document takes longer than 30 seconds,
> so I was wondering how to handle this.
>
> Currently I am considering storing the upload in the datastore and
> parse as far as I can. Then when I get DeadlineExceededError I create
> a new Task Queue with the line number to continue from.
>
> Is there a problem with this? Or a better way?
>
> thanks
> >
>

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply via email to