Re: [google-appengine] Re: Rabbit hole of bugs with billing

[Richard Baron Penman]

Hello,
that is the contact form I tried previously but the instructions to find
the required ID's appears out of date.


On Fri, Sep 4, 2015 at 10:06 PM, Ryan (Cloud Platform Support) <
rbruy...@google.com> wrote:

> Salutations Plumo,
>
> This is best way to contact sales
> .
> Let me now if you have any issues.
>
> On Friday, September 4, 2015 at 4:42:52 AM UTC-4, Plumo wrote:
>>
>> Hello,
>>
>> I started being charged for an old app with $0 quota. Tried disabling
>> billing but get a server error. Then tried contacting support but the
>> instructions to fill in fields for the support ticket are out of date - no
>> longer match the billing interface.
>> Is there a direct email for billing support?
>>
>> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Google App Engine" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/google-appengine/bscHmCastcI/unsubscribe
> .
> To unsubscribe from this group and all its topics, send an email to
> google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/cadfcab5-b9ca-4978-a43a-59e22a82b99f%40googlegroups.com
> 
> .
>
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAOV1wRVnmaRnxOWgC-2F%2B6ZJqMqPGq%2BuzjzgBrCev9bnEeLcxw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: app using excessive storage

[Richard Baron Penman]

making field names shorted is an interesting idea. Is this known to work? I
would have expected these kind of optimizations to be done internally.


On Tue, May 24, 2011 at 11:22 PM, Francois Masurel f.masu...@gmail.comwrote:

 Hi Richard,

 Try reducing the length of your kinds and properties names.

 Even application name might have to be taken into account, not sure though.

 Francois

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] app using excessive storage

[Richard Baron Penman]

I want to fit the datastore into 1GB because this app is for another client
who isn't expecting to need billing enabled.

Is there documentation about these default indices?



On Tue, May 24, 2011 at 11:52 PM, Barry Hunter barrybhun...@gmail.comwrote:

 Remember that every single property (well excepting blob/text) has 2
 indexes - automatically, unless you explicity say that a property is
 to be unindexed.

 Then again 1.5G is only $5-6 a year, even using the high replication
 datastore.

 To reduce the storage use, could set properties to be unindexed. But
 would have to loop over all the entities and re-put them. Probably end
 up costing you more than just keeping them.


 On 24 May 2011 14:17, Plumo richar...@gmail.com wrote:
  hello,
  my app has 396MB of entities but is using 1.48GB of storage. I understand
  this may be because the indices add a lot of overhead.
  I have 1 index: category ▲ , state ▲ , title ▲
  and 1 big table:
 
  title: string
  category: int
  address: string
  city: string
  state: int
  zip_code: string
  country: string
  telephone: string
  website: string
  menu: text
  latitude: double
  longitude: double
  source: string
  created: datetime
  updated: datetime
 
  Any advice how to reduce this excessive storage overhead?
  Richard
 
  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.
 

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Help desk app

[Richard Baron Penman]

yes there are many proprietary paid help desk systems like mojo, but that's
not what I'm after.

Is there atleast an email app running on GAE, which I could integrate
tickets with?



On Tue, Dec 21, 2010 at 1:05 AM, supercobra superco...@gmail.com wrote:

 Mojo Helpdesk is integrated with Google apps and receives email,
 create tickets, set ticket status, etc... Not on GAE yet but fully
 integrated with single sign on and Google accounts.

 www.mojohelpdesk.com





 On Mon, Dec 20, 2010 at 7:35 AM, Richard richar...@gmail.com wrote:
  Have any open source help desk apps been built for GAE? Something that
  receives emails, creates a ticket, send replies, set ticket status, etc
 
  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To post to this group, send email to google-appeng...@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
  For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.
 

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: datastore viewer delay

[Baron]

yeah my dataviewer always shows, but there seems to be a delay in
updating the content.


On Nov 18, 3:11 pm, 风笑雪 kea...@gmail.com wrote:
 Model will always show in dataviewer.

 The only way I find to not show it is re-define you Model class
 without any property, and deploy it again.

 2009/11/18 Baron richar...@gmail.com:

  Hello,

  I removed all the records from a model but when I checked the data
  viewer they were still there for atleast 15 minutes afterwards. When I
  delete a record is it actually deleted immediately, or just scheduled
  for deletion?

  thanks,
  Richard

  --

  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appeng...@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=.

--

You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=.

[google-appengine] datastore viewer delay

[Baron]

Hello,

I removed all the records from a model but when I checked the data
viewer they were still there for atleast 15 minutes afterwards. When I
delete a record is it actually deleted immediately, or just scheduled
for deletion?

thanks,
Richard

--

You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=.

[google-appengine] Re: drop table?

[Baron]

thanks for the clarification Nick - reading the docs again makes that
clear.


On Nov 12, 9:39 pm, Nick Johnson (Google) nick.john...@google.com
wrote:
 Key names must be unique for a given kind and parent. If you do the
 following:

 ---
 for i in range(100):
   MyEntity(key_name='foo', value=i).put()
 ---

 you are overwriting the entity with key name 'foo' repeatedly with new
 values. Only the last one is stored.

 -Nick Johnson



 On Thu, Nov 12, 2009 at 3:23 AM, Baron richar...@gmail.com wrote:

  yes I am creating a single entity with that key_name for all my
  records (~10). This also lets me use transactions on my records
  now.

   a big fail if you want to use the datastore to, well, store data.
  What side effects will this cause? - degraded response time?

  Richard

  On Nov 12, 4:40 am, Wooble geoffsp...@gmail.com wrote:
   On Nov 11, 8:43 am, Baron richar...@gmail.com wrote:

can I use entities to speed up deleting? It seems when I give all my
model instances the same key_name the deleting is much faster because
MyModel.all(keys_only=True) returns only a single record now.
Am I missing something here?

   Ummm... it sounds like you're only creating a single entity.  This is
   absolutely great if you want to delete it, and probably a big fail if
   you want to use the datastore to, well, store data.
  --~--~-~--~~~---~--~~
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en
  -~--~~~~--~~--~--~---

 --
 Nick Johnson, Developer Programs Engineer, App Engine
 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
 368047

--

You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=.

[google-appengine] Avoiding duplicates

[Baron]

Hello,

I am uploading some data and sometimes a put() fails (TimeoutError) so
that only a subset of the records are added. If I put() the records
again then there will be duplicates.

I first thought of using transactions, but creating entity groups
seems awkward for my dataset - I have 10 records with no logical
groups.

I was thinking would an easier workaround be to just give each record
a unique key_name, so that if it was uploaded twice it would just
override the previous record. Is that a sensible solution?

Thanks

--

You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=.

[google-appengine] Re: Avoiding duplicates

[Baron]

thanks for the confirmation!


On Nov 13, 12:43 pm, GAEfan ken...@gmail.com wrote:
 Baron:

 That is exactly what key names are for.  You can write over the same
 entity (it has to have the same key name to be the same entity), and
 no harm done.  Or, if the key doesn't exist, create the entity.  The
 put() does both.

 thisEntity = thisModel.get_by_key_name('thisKey')
 if not thisEntity:
   thisEntity = thisModel(key_name='thisKey', trait1='hey',
 trait2='there', etc.)
   thisEntity.put()
 else:
   thisEntity.trait1 = 'changed to hello'  (if you need to change
 anything)
   thisEntity.put()

 If you put the records again, there will not be duplicates, as the
 key_name is unique.

 Bottom line:  Don't make any model without creating an easy-to-
 remember-and-call key_name.  It will come in handy some day.

--

You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=.

[google-appengine] Re: Not all Requests are logged

[Baron]

Thanks for the tip.
Are these global variables cached indefinitely? For example in the
counter example you linked, will the counter keep increasing or be
reset to 0 every so often?



On Nov 13, 2:09 pm, 风笑雪 kea...@gmail.com wrote:
 There is an document about app cache and handler 
 cache:http://code.google.com/appengine/docs/python/runtime.html#App_Caching

 I can also give you some example code, but you need modify it to fit
 your framework(maybe a decorator for your handler):

 main.py:

 cache = {} # must be a global variable

 def main():
   # get the request path
   page = cache.get(path, None)
   if page and page['time'] - time()  page['cache_time']
     # output page['content']
   else:
     # generate your page and output it
     cache['path'] = {'time': time(), 'cache_time': 60, 'content': content}

 if __name__ = '__main__':
   main()

 2009/11/13 GAEfan ken...@gmail.com:

  Thanks, Keakon.  Can you please explain in more detail about your
  handler cache?

  --

  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appeng...@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=.



--

You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=.

[google-appengine] Re: drop table?

[Baron]

can I use entities to speed up deleting? It seems when I give all my
model instances the same key_name the deleting is much faster because
MyModel.all(keys_only=True) returns only a single record now.
Am I missing something here?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: drop table?

[Baron]

yes I am creating a single entity with that key_name for all my
records (~10). This also lets me use transactions on my records
now.

 a big fail if you want to use the datastore to, well, store data.
What side effects will this cause? - degraded response time?

Richard


On Nov 12, 4:40 am, Wooble geoffsp...@gmail.com wrote:
 On Nov 11, 8:43 am, Baron richar...@gmail.com wrote:

  can I use entities to speed up deleting? It seems when I give all my
  model instances the same key_name the deleting is much faster because
  MyModel.all(keys_only=True) returns only a single record now.
  Am I missing something here?

 Ummm... it sounds like you're only creating a single entity.  This is
 absolutely great if you want to delete it, and probably a big fail if
 you want to use the datastore to, well, store data.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: Reaching application limit

[Baron]

 You should be able to create up to 20 applications now.
yeah I received an email from Nick a few minutes after posting

 If an app is deleted, the developer who requested deletion (who is not 
 necessarily the app's creator) receives a credit and can then create one 
 additional app.
oh, I knew about deletion but didn't know it freed up quota - thanks!

Richard


On Nov 11, 8:17 am, Ikai L (Google) ika...@google.com wrote:
 Richard,

 You should be able to create up to 20 applications now. I also want to note
 that SDK 1.2.6 made it possible to delete applications:

 http://code.google.com/appengine/kb/adminconsole.html#delete%5Fapp



 On Tue, Nov 10, 2009 at 4:19 AM, Baron richar...@gmail.com wrote:

  thanks Nick

  On Nov 10, 10:57 pm, Baron richar...@gmail.com wrote:
   Hello,

   I have 9 applications used and am in discussion with another client,
   so I should soon reach 10.
   Could I please get more added to my quota?

   Thanks,
   Richard

 --
 Ikai Lan
 Developer Programs Engineer, Google App Engine
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: More than 10 applications

[Baron]

still no word. I will create another thread to try and get
attention...


On Nov 4, 10:30 am, Baron richar...@gmail.com wrote:
 there is a Google guy Nick Johnson who answers these requests. (You
 can find him by searching the archives.) I have emailed him about
 expanding my app limit and will let you know what happens.

 Richard

 On Nov 2, 3:44 pm, Chris chris.slink...@gmail.com wrote:



  I'm looking to use Google App Engine to launch some GWT based
  solutions for clients. However, I can't help but see the inherent
  problem of running out of applications. Once I've hosted10
  applications how can I host the 11th?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Reaching application limit

[Baron]

Hello,

I have 9 applications used and am in discussion with another client,
so I should soon reach 10.
Could I please get more added to my quota?

Thanks,
Richard
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: Reaching application limit

[Baron]

thanks Nick


On Nov 10, 10:57 pm, Baron richar...@gmail.com wrote:
 Hello,

 I have 9 applications used and am in discussion with another client,
 so I should soon reach 10.
 Could I please get more added to my quota?

 Thanks,
 Richard
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: drop table?

[Baron]

  thanks for the keys_only tip.
  I removed ~30K records from the datastore, which used most of my daily
  CPU quota. Is deleting meant to be this expensive?

 Yes; in the datastore deletes and puts are very expensive (since they
 need to alter all of your indexes), and reads are very cheap.  It's
 definitely designed for applications where reads far outnumber writes.

Ah OK - thought I must be doing something wrong to burn my quota so
easily.
To reduce CPU usage is it possible to delay rebuilding the index until
all the data is uploaded?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: More than 10 applications

[Baron]

there is a Google guy Nick Johnson who answers these requests. (You
can find him by searching the archives.) I have emailed him about
expanding my app limit and will let you know what happens.

Richard


On Nov 2, 3:44 pm, Chris chris.slink...@gmail.com wrote:
 I'm looking to use Google App Engine to launch some GWT based
 solutions for clients. However, I can't help but see the inherent
 problem of running out of applications. Once I've hosted 10
 applications how can I host the 11th?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] drop table?

[Baron]

Hello,

I want to remove all records from a table. The table will have a lot
of records, so is it possible to somehow drop the table?
Or do I need to setup a taskqueue to progressively delete it?

thanks,
Richard
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: how to order query by separate field

[Baron]

I found that if I used my query a few times on the development server
then your above code snippet was automatically inserted in my
index.yaml - neat! (not app.yaml)
Then when I uploaded to Google App Engine I got errors for a few
minutes while the index was building, but eventually it worked.


On Oct 30, 12:02 pm, ryan baldwin ryanbald...@gmail.com wrote:
 In my example I left out the sorts by A ascending because I later realised
 it may not be necessary... I believe, however, that my index *does* sort by
 createdDate ascending... I haven't written one in a long, long time, so my
 apologies. ;)

 - ryan.

 On Thu, Oct 29, 2009 at 7:01 PM, ryan baldwin ryanbald...@gmail.com wrote:
  I believe you can create an index that sorts by youngest, then by name, and
  you should be good.  Assuming your youngest field is called createdDate.

  In app.yaml:

   - kind: MyModel
    properties:
      - name: createdDate
        direction: asc

  If I understand what I just typed, that will create an index on the MyModel
  entity, ordering first by createdDate ascending then by A ascending.  You
  could, I believe, then do the following:

  MyModel.all().filter=('A =', 123).order(createdDate).fetch(limit=20)

  That being said, I'm not sure if DataStore actually guarantees the order of
  results... I assume so...?

  - ryan.

  On Thu, Oct 29, 2009 at 6:53 PM, Baron richar...@gmail.com wrote:

  Hello,

  I have a model with over 1000 records and I want to select the top N
  records on field A that satisfy conditions on field B. (For example
  the youngest N records with a certain name.)

  My concern is if I only filter on field B and order in code
  afterwards, then I will miss some records not in the top 1000.

  I was hoping to create an index so that the results are always ordered
  by field A, but that doesn't seem to be possible.
  Ideas?


--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: perform task on upload

[Baron]

thanks Stephen - that's just what I was thinking over the weekend
because the files may be over 1MB so I would need to split them up
anyway.

Richard


On Oct 30, 11:41 pm, Stephen sdea...@gmail.com wrote:
 On Oct 28, 1:33 pm, Baron richar...@gmail.com wrote:

  hello,

  part of my app uploads a file and needs to parse each line of the
  file. The parsing of the whole document takes longer than 30 seconds,
  so I was wondering how to handle this.

  Currently I am considering storing the upload in the datastore and
  parse as far as I can. Then when I get DeadlineExceededError I create
  a new Task Queue with the line number to continue from.

  Is there a problem with this? Or a better way?

 You could experimentally determine how many lines you can parse in
 20-25 wall-clock seconds (within the 30 seconds DeadlineExceededError
 limit).

 When the file is uploaded, immediately spit it into chunks of the
 above size. Then db.put() all chunks to the db in a single call.

 Create n tasks to process the chunks, one for each chunk, passing a
 key to each.

 The above has have the advantage that the client which uploaded the
 file gets a response quicker (it does not have to wait for the initial
 30 sec timeout), and the chunks are parsed in parallel (if you
 configure the queue to do so).
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: Will memcache data ever be evicted if have spare memory?

[Baron]

ah OK.

Do you know how much memcache memory each app can use before values
start being evicted?
The quota page lists the daily rate as 10GB, but not the size.



On Oct 29, 4:32 pm, ryan baldwin ryanbald...@gmail.com wrote:
 That is incorrect. The value can be ejected from Memcache at any time. As
 some of the Googlers have stated in the groups, you should not design your
 applications to depend on a persistent cache.

 - ryan.



 On Wed, Oct 28, 2009 at 11:25 PM, Baron richar...@gmail.com wrote:

  Hello,

  If I store only a single int in my app memcache, how long can I expect
  it so stay cached?

  According to the docs Values may be evicted from the cache when a new
  value is added to the cache if the cache is low on memory.
  So then in the case of my single int there should be no memory
  problems and the data will last indefinitely. Is that right?

  thanks
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: perform task on upload

[Baron]

I know it won't be - it is a fixed column CSV


On Oct 29, 11:31 am, OvermindDL1 overmind...@gmail.com wrote:
 On Wed, Oct 28, 2009 at 7:33 AM, Baron richar...@gmail.com wrote:

  hello,

  part of my app uploads a file and needs to parse each line of the
  file. The parsing of the whole document takes longer than 30 seconds,
  so I was wondering how to handle this.

  Currently I am considering storing the upload in the datastore and
  parse as far as I can. Then when I get DeadlineExceededError I create
  a new Task Queue with the line number to continue from.

  Is there a problem with this? Or a better way?

 What if the document was one exceedingly long line?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: Will memcache data ever be evicted if have spare memory?

[Baron]

that's interesting Barry. I had assumed each user had their own
dedicated quota, which I guess would be wasteful.

Has anyone done tests of the eviction rates?


On Oct 29, 11:41 pm, Barry Hunter barrybhun...@googlemail.com wrote:
 memcache is a shared system. Everybody uses from the same 'pool'*. So
 if the system as a whole is running out of memory maybe your data will
 get evicted.

 Some have stated there is also a per user limit (perhaps 10Mb - but it
 could change).

 As others have stated - never design that the data will be thare later
 (maybe the memcache node your data was on was restarted or crashed) -
 its a temporally cache. If you find a cached value, bonus(!),
 otherwise just generate the data like you where going to anyway.

 * I beleive that is how Google have implemented it anyway.

 2009/10/29 Baron richar...@gmail.com:



  ah OK.

  Do you know how much memcache memory each app can use before values
  start being evicted?
  The quota page lists the daily rate as 10GB, but not the size.

  On Oct 29, 4:32 pm, ryan baldwin ryanbald...@gmail.com wrote:
  That is incorrect. The value can be ejected from Memcache at any time. As
  some of the Googlers have stated in the groups, you should not design your
  applications to depend on a persistent cache.

  - ryan.

  On Wed, Oct 28, 2009 at 11:25 PM, Baron richar...@gmail.com wrote:

   Hello,

   If I store only a single int in my app memcache, how long can I expect
   it so stay cached?

   According to the docs Values may be evicted from the cache when a new
   value is added to the cache if the cache is low on memory.
   So then in the case of my single int there should be no memory
   problems and the data will last indefinitely. Is that right?

   thanks


--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] how to order query by separate field

[Baron]

Hello,

I have a model with over 1000 records and I want to select the top N
records on field A that satisfy conditions on field B. (For example
the youngest N records with a certain name.)

My concern is if I only filter on field B and order in code
afterwards, then I will miss some records not in the top 1000.

I was hoping to create an index so that the results are always ordered
by field A, but that doesn't seem to be possible.
Ideas?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] perform task on upload

[Baron]

hello,

part of my app uploads a file and needs to parse each line of the
file. The parsing of the whole document takes longer than 30 seconds,
so I was wondering how to handle this.

Currently I am considering storing the upload in the datastore and
parse as far as I can. Then when I get DeadlineExceededError I create
a new Task Queue with the line number to continue from.

Is there a problem with this? Or a better way?

thanks
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Will memcache data ever be evicted if have spare memory?

[Baron]

Hello,

If I store only a single int in my app memcache, how long can I expect
it so stay cached?

According to the docs Values may be evicted from the cache when a new
value is added to the cache if the cache is low on memory.
So then in the case of my single int there should be no memory
problems and the data will last indefinitely. Is that right?

thanks
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Re: Dev Datastore viewer error When Accessing Any Entities

[baron]

Disregard.  I jumped the gun.  Turns out having None in a
db.PhoneNumberProperty() doesn't bode well for the SDK console
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Dev Datastore viewer error When Accessing Any Entities

[baron]

I am getting the following error when trying to view any model data in
the SDK console dataviewer.  I can access the entities via the
interactive console without issue but the SDK console throws this
error:

Traceback (most recent call last):
  File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/ext/webapp/__init__.py, line 496, in __call__
handler.get(*groups)
  File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/ext/admin/__init__.py, line 672, in get
field = data_type.input_field(name, value, sample_values)
  File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/ext/admin/__init__.py, line 774, in input_field
if len(sample_value)  255 or sample_value.find('\n') = 0:
TypeError: object of type 'NoneType' has no len()

--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---

[google-appengine] Multiple db.ReferenceProperties

[baron]

First some model code:

class SomeUserClass(db.Model):
someId = db.StringProperty(required=True)

class SomeReferenceClass(db.Model):
origin = db.ReferenceProperty(SomeUserClass,
collection_name='originSet', required=True)
target = db.ReferenceProperty(SomeUserClass,
collection_name='targetSet', required=True)

According to the docs, there should be 2 implicit sets (originSet and
targetSet) on the SomeUserClass.  When I instantiate an instance of
SomeUserClass and try to access originSet or targetSet I am always
returned an empty result set.  I can query SomeReferenceClass using
GQL and I receive results so I know they are in there.  Example query:

a = SomeUserClass().get('someIdOfAUser')
res = SomeUserClass.gql('WHERE origin = :1', a.key())

The query returns result but the originSet and targetSet do not.  Is
this a bug, am I missing something or can you not have 2
db.ReferenceProperties pointing to the same class?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---