[google-appengine] Re: BadRequestError: offset may not be above 1000
This is a pagination problem:
- items per page: 10
.
.
.
On Mar 8, 5:25 pm, djidjadji wrote:
> If you sort on time why do you want to see the object that was stored
> 2000 entries ago.
> Do you also need the objects with time stamp 0..2000?
> It makes more sense to find the objects 10 days or 3 month ago.
>
> 2009/3/8 Let Delete My Apps :
>
>
>
> > Does an utility exists to simplify this bad work? (or some examples)
>
> > I use this order:
> > query.order('-time')
> > .
> > .
> > .
> > On Mar 8, 4:57 pm, djidjadji wrote:
> >> Make multiple queries. Use a value from the last object retrieved to
> >> select new objects with a greater value, __key__ is a good field to
> >> use, or use the field you sort on.
> >> Make sure you will stay within 30 sec wall clock time.
>
> >> 2009/3/8 Let Delete My Apps :
>
> >> > Sorry but I do not understand :-(
> >> > How can I see the record 2001 ?
> >> > .
> >> > .
> >> > On Mar 8, 2:00 pm, "Sharp-Developer.Net"
> >> > wrote:
> >> >> Fromhttp://code.google.com/appengine/docs/python/datastore/queryclass.html
> >> >> :
>
> >> >> The datastore fetches offset + limit results to the application. The
> >> >> first offset results are not skipped by the datastore itself.
> >> >> --
> >> >> Alexhttp://sharp-developer.net/
>
> >> >> On Mar 8, 10:56 am, Let Delete My Apps
> >> >> wrote:
>
> >> >> > *** The Query Class
> >> >> > ***http://code.google.com/appengine/docs/python/datastore/queryclass.html
>
> >> >> > --> fetch(limit, offset=0)
> >> >> > offset --> The number of results to skip.
>
> >> >> > Then?
> >> >> > Why do I see this error?
>
> >> >> > BadRequestError: offset may not be above 1000
> >> >> > .
> >> >> > .
> >> >> > On Mar 8, 6:06 am, Wooble wrote:
>
> >> >> > > On Mar 7, 5:05 pm, Let Delete My Apps
> >> >> > > wrote:
>
> >> >> > > > Hi All,
> >> >> > > > I see this error using this code:
>
> >> >> > > > query.fetch(1000, offset=1001)
>
> >> >> > > RTFM before deleting all of your apps.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
If you sort on time why do you want to see the object that was stored
2000 entries ago.
Do you also need the objects with time stamp 0..2000?
It makes more sense to find the objects 10 days or 3 month ago.
2009/3/8 Let Delete My Apps :
>
> Does an utility exists to simplify this bad work? (or some examples)
>
> I use this order:
> query.order('-time')
> .
> .
> .
> On Mar 8, 4:57 pm, djidjadji wrote:
>> Make multiple queries. Use a value from the last object retrieved to
>> select new objects with a greater value, __key__ is a good field to
>> use, or use the field you sort on.
>> Make sure you will stay within 30 sec wall clock time.
>>
>> 2009/3/8 Let Delete My Apps :
>>
>>
>>
>> > Sorry but I do not understand :-(
>> > How can I see the record 2001 ?
>> > .
>> > .
>> > On Mar 8, 2:00 pm, "Sharp-Developer.Net"
>> > wrote:
>> >> Fromhttp://code.google.com/appengine/docs/python/datastore/queryclass.html
>> >> :
>>
>> >> The datastore fetches offset + limit results to the application. The
>> >> first offset results are not skipped by the datastore itself.
>> >> --
>> >> Alexhttp://sharp-developer.net/
>>
>> >> On Mar 8, 10:56 am, Let Delete My Apps
>> >> wrote:
>>
>> >> > *** The Query Class
>> >> > ***http://code.google.com/appengine/docs/python/datastore/queryclass.html
>>
>> >> > --> fetch(limit, offset=0)
>> >> > offset --> The number of results to skip.
>>
>> >> > Then?
>> >> > Why do I see this error?
>>
>> >> > BadRequestError: offset may not be above 1000
>> >> > .
>> >> > .
>> >> > On Mar 8, 6:06 am, Wooble wrote:
>>
>> >> > > On Mar 7, 5:05 pm, Let Delete My Apps
>> >> > > wrote:
>>
>> >> > > > Hi All,
>> >> > > > I see this error using this code:
>>
>> >> > > > query.fetch(1000, offset=1001)
>>
>> >> > > RTFM before deleting all of your apps.
> >
>
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
Does an utility exists to simplify this bad work? (or some examples)
I use this order:
query.order('-time')
.
.
.
On Mar 8, 4:57 pm, djidjadji wrote:
> Make multiple queries. Use a value from the last object retrieved to
> select new objects with a greater value, __key__ is a good field to
> use, or use the field you sort on.
> Make sure you will stay within 30 sec wall clock time.
>
> 2009/3/8 Let Delete My Apps :
>
>
>
> > Sorry but I do not understand :-(
> > How can I see the record 2001 ?
> > .
> > .
> > On Mar 8, 2:00 pm, "Sharp-Developer.Net"
> > wrote:
> >> Fromhttp://code.google.com/appengine/docs/python/datastore/queryclass.html
> >> :
>
> >> The datastore fetches offset + limit results to the application. The
> >> first offset results are not skipped by the datastore itself.
> >> --
> >> Alexhttp://sharp-developer.net/
>
> >> On Mar 8, 10:56 am, Let Delete My Apps
> >> wrote:
>
> >> > *** The Query Class
> >> > ***http://code.google.com/appengine/docs/python/datastore/queryclass.html
>
> >> > --> fetch(limit, offset=0)
> >> > offset --> The number of results to skip.
>
> >> > Then?
> >> > Why do I see this error?
>
> >> > BadRequestError: offset may not be above 1000
> >> > .
> >> > .
> >> > On Mar 8, 6:06 am, Wooble wrote:
>
> >> > > On Mar 7, 5:05 pm, Let Delete My Apps
> >> > > wrote:
>
> >> > > > Hi All,
> >> > > > I see this error using this code:
>
> >> > > > query.fetch(1000, offset=1001)
>
> >> > > RTFM before deleting all of your apps.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
Make multiple queries. Use a value from the last object retrieved to select new objects with a greater value, __key__ is a good field to use, or use the field you sort on. Make sure you will stay within 30 sec wall clock time. 2009/3/8 Let Delete My Apps : > > Sorry but I do not understand :-( > How can I see the record 2001 ? > . > . > On Mar 8, 2:00 pm, "Sharp-Developer.Net" > wrote: >> Fromhttp://code.google.com/appengine/docs/python/datastore/queryclass.html >> : >> >> The datastore fetches offset + limit results to the application. The >> first offset results are not skipped by the datastore itself. >> -- >> Alexhttp://sharp-developer.net/ >> >> On Mar 8, 10:56 am, Let Delete My Apps >> wrote: >> >> > *** The Query Class >> > ***http://code.google.com/appengine/docs/python/datastore/queryclass.html >> >> > --> fetch(limit, offset=0) >> > offset --> The number of results to skip. >> >> > Then? >> > Why do I see this error? >> >> > BadRequestError: offset may not be above 1000 >> > . >> > . >> > On Mar 8, 6:06 am, Wooble wrote: >> >> > > On Mar 7, 5:05 pm, Let Delete My Apps >> > > wrote: >> >> > > > Hi All, >> > > > I see this error using this code: >> >> > > > query.fetch(1000, offset=1001) >> >> > > RTFM before deleting all of your apps. > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
Sorry but I do not understand :-( How can I see the record 2001 ? . . On Mar 8, 2:00 pm, "Sharp-Developer.Net" wrote: > Fromhttp://code.google.com/appengine/docs/python/datastore/queryclass.html > : > > The datastore fetches offset + limit results to the application. The > first offset results are not skipped by the datastore itself. > -- > Alexhttp://sharp-developer.net/ > > On Mar 8, 10:56 am, Let Delete My Apps > wrote: > > > *** The Query Class > > ***http://code.google.com/appengine/docs/python/datastore/queryclass.html > > > --> fetch(limit, offset=0) > > offset --> The number of results to skip. > > > Then? > > Why do I see this error? > > > BadRequestError: offset may not be above 1000 > > . > > . > > On Mar 8, 6:06 am, Wooble wrote: > > > > On Mar 7, 5:05 pm, Let Delete My Apps > > > wrote: > > > > > Hi All, > > > > I see this error using this code: > > > > > query.fetch(1000, offset=1001) > > > > RTFM before deleting all of your apps. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
>From http://code.google.com/appengine/docs/python/datastore/queryclass.html : The datastore fetches offset + limit results to the application. The first offset results are not skipped by the datastore itself. -- Alex http://sharp-developer.net/ On Mar 8, 10:56 am, Let Delete My Apps wrote: > *** The Query Class > ***http://code.google.com/appengine/docs/python/datastore/queryclass.html > > --> fetch(limit, offset=0) > offset --> The number of results to skip. > > Then? > Why do I see this error? > > BadRequestError: offset may not be above 1000 > . > . > On Mar 8, 6:06 am, Wooble wrote: > > > On Mar 7, 5:05 pm, Let Delete My Apps > > wrote: > > > > Hi All, > > > I see this error using this code: > > > > query.fetch(1000, offset=1001) > > > RTFM before deleting all of your apps. > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
*** The Query Class *** http://code.google.com/appengine/docs/python/datastore/queryclass.html --> fetch(limit, offset=0) offset --> The number of results to skip. Then? Why do I see this error? BadRequestError: offset may not be above 1000 . . On Mar 8, 6:06 am, Wooble wrote: > On Mar 7, 5:05 pm, Let Delete My Apps > wrote: > > > Hi All, > > I see this error using this code: > > > query.fetch(1000, offset=1001) > > RTFM before deleting all of your apps. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
On Mar 7, 5:05 pm, Let Delete My Apps wrote: > Hi All, > I see this error using this code: > > query.fetch(1000, offset=1001) RTFM before deleting all of your apps. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
There are a few tips in the "Updating Existing Entities" section of this article too: http://code.google.com/appengine/articles/update_schema.html cheers, Emmanuel. On 21 Sep 2008, at 14:15, Aral Balkan wrote: > > Hi, > > I'm not sure when this changed but it seems that you cannot specify > offsets above 1,000 which kind of kills my backup app. > > How are we supposed to iterate over large datasets? > > Thanks, > Aral > > --- RECURSION, n. See recursion --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
GAE uses client-side offsets, that means it first runs the query, then iterates on the result to reach the offset you specified. This implies that the offset cannot be greater than the result limit: http://code.google.com/appengine/docs/datastore/creatinggettinganddeletingdata.html#Getting_Entities_Using_a_Query (read the section called "Executing the Query and Accessing Results") To iterate over a large dataset you need to have a unique field that you will filter and order by. I suggest checking out this video: http://sites.google.com/site/io/building-scalable-web-applications-with-google-app-engine Closer to the end Brett explains how to compose such a field. On Sep 22, 3:38 am, Michael <[EMAIL PROTECTED]> wrote: > I have the same problem. I can understand the result limit, but > offset ? > Simple solution is add a record ID . > > On Sep 21, 10:15 am, Aral Balkan <[EMAIL PROTECTED]> wrote: > > > Hi, > > > I'm not sure when this changed but it seems that you cannot specify > > offsets above 1,000 which kind of kills my backup app. > > > How are we supposed to iterate over large datasets? > > > Thanks, > > Aral --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
Perhaps more targetted queries? On 9/21/08, Aral Balkan <[EMAIL PROTECTED]> wrote: > > Hi, > > I'm not sure when this changed but it seems that you cannot specify > offsets above 1,000 which kind of kills my backup app. > > How are we supposed to iterate over large datasets? > > Thanks, > Aral > > > -- Sent from Gmail for mobile | mobile.google.com Byron --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: BadRequestError: offset may not be above 1000
I have the same problem. I can understand the result limit, but offset ? Simple solution is add a record ID . On Sep 21, 10:15 am, Aral Balkan <[EMAIL PROTECTED]> wrote: > Hi, > > I'm not sure when this changed but it seems that you cannot specify > offsets above 1,000 which kind of kills my backup app. > > How are we supposed to iterate over large datasets? > > Thanks, > Aral --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
