[google-appengine] Re: System Performance

2010-04-20 Thread Ray Malone
Thanks, I found my issues.  App Engine Utilities had grown the session
database store to over 5000 records.  It appears the code is not
optimized for lots of sessions.  I deleted all of the records and my
app is running fast again.  Thanks

On Apr 19, 10:57 pm, Ray Malone rayish...@gmail.com wrote:
 I have code that is running poorly all of a sudden today.  Normally it
 runs well, i've listed the normal and the current stats below.  But 2
 our of 3 today are running like this 200 22765ms 22234cpu_ms
 18617api_cpu_ms    With no other activity on the app I can refresh
 the page and 2 out of 3 run pooryly and the 1 out of 3 runs within
 normal ranges.   I know it's not my app.   I'm about to see some spike
 in my app's usage and random Deadline Exceeded errors and other random
 errors don't look good on my part.

 I'm also getting deadline exceeded errors and random odd errors like
 The API call user.CreateLoginURL() was explicitly cancelled.

 Normal 200 16957ms 2750cpu_ms 1291api_cpu_ms
 Currently: 200 22765ms 22234cpu_ms 18617api_cpu_ms 

 --
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group 
 athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] System Performance

2010-04-19 Thread Ray Malone
I have code that is running poorly all of a sudden today.  Normally it
runs well, i've listed the normal and the current stats below.  But 2
our of 3 today are running like this 200 22765ms 22234cpu_ms
18617api_cpu_msWith no other activity on the app I can refresh
the page and 2 out of 3 run pooryly and the 1 out of 3 runs within
normal ranges.   I know it's not my app.   I'm about to see some spike
in my app's usage and random Deadline Exceeded errors and other random
errors don't look good on my part.

I'm also getting deadline exceeded errors and random odd errors like
The API call user.CreateLoginURL() was explicitly cancelled.

Normal 200 16957ms 2750cpu_ms 1291api_cpu_ms
Currently: 200 22765ms 22234cpu_ms 18617api_cpu_ms 


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Being Charged for The API call mail.Send() took too long to respond and was cancelled errors

2010-04-09 Thread Ray Malone
I know there is an issue open on sending mail and the API erroring
out.  My code will try again and logs if the email was sent to prevent
dups, but, I'm being charged for emails that are not being sent.  The
email counter still increments even though this error occurs.

The API call mail.Send() took too long to respond and was cancelled.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Data Store Timeouts that are Random

2009-12-11 Thread Ray Malone
Thank you very much.   I've added it to my project and hope it helps.
It's embarrassing for our clients to see these random errors.

On Dec 5, 10:08 pm, Robin B robi...@gmail.com wrote:
 Spurious DB Timeouts are pretty common on GAE.  If you want to
 autoretry timeouts, use this:

 http://appengine-cookbook.appspot.com/recipe/autoretry-datastore-time...

 Robin

 On Dec 4, 2:19 pm, gae123 pa...@gae123.com wrote:



  Same experience here. In fact, a user just yesterday called me about
  this, I looked at the logs and it was a timeout... I have now removed
  the Sever Error message and replaced it with a very polite these
  things happen just retry in a few seconds and only call me if it
  happens every time

  On Dec 4, 10:40 am, Ray Malone rayish...@gmail.com wrote:

   My app has been running for almost a year now and runs great.  The
   speed of app engine compared to hosting anywhere else has been great.
   However, I get random timeouts for simple gets.  These queries are the
   exact same that run all day long several time a day and as you can see
   from my logs there was no activity between for over 20 seconds before
   or after the issue.

   12-04 09:24AM 57.445 /find?city=baltimorerss=1 200 338ms 390cpu_ms
   255api_cpu_ms 0kb TwitterFeed 3,gzip(gfe),gzip(gfe)
   12-04 09:24AM 36.325 /find?city=martinsburgrss=1 500 4651ms 575cpu_ms
   12api_cpu_ms 1kb TwitterFeed 3,gzip(gfe),gzip(gfe)
   12-04 09:20AM 53.315 / 973ms 745cpu_ms 629api_cpu_ms 0kb Mozilla/4.0
   (compatible; MSIE 5.01; Windows NT 5.0),gzip(gfe)

--

You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.




[google-appengine] Re: Standard and mobile edition apps under same domain (two different sub domains)

2009-12-04 Thread Ray Malone
Under the setting for the app in your domain manager you should be
able to add a another sub domain to point to the same app.  Then you
will need to update your records from the company you registered with
to point the sub domain to ghs.google.com.  I do this with several of
my apps.  However, you will need to detect the domain to determine
which one is which.

On Dec 3, 8:38 pm, djennings djenni...@pga.com wrote:
 I created a website (including blog) along with a mobile edition using
 python. The website, blog and mobile edition will eventually be under
 a Google Apps/Engine domain. The main app will be hosted atwww.domain.com
 and the mobile edition atwww.domain.com/mobile/, and this works just
 fine on the local dev appserver right now.

 But I would prefer to have the mobile edition app at m.domain.com
 instead of www.domain.com/mobile/. How could this work with two
 separate sub domain apps written both in python under the same google
 apps domain?

--

You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.




[google-appengine] Data Store Timeouts that are Random

2009-12-04 Thread Ray Malone
My app has been running for almost a year now and runs great.  The
speed of app engine compared to hosting anywhere else has been great.
However, I get random timeouts for simple gets.  These queries are the
exact same that run all day long several time a day and as you can see
from my logs there was no activity between for over 20 seconds before
or after the issue.


12-04 09:24AM 57.445 /find?city=baltimorerss=1 200 338ms 390cpu_ms
255api_cpu_ms 0kb TwitterFeed 3,gzip(gfe),gzip(gfe)
12-04 09:24AM 36.325 /find?city=martinsburgrss=1 500 4651ms 575cpu_ms
12api_cpu_ms 1kb TwitterFeed 3,gzip(gfe),gzip(gfe)
12-04 09:20AM 53.315 / 973ms 745cpu_ms 629api_cpu_ms 0kb Mozilla/4.0
(compatible; MSIE 5.01; Windows NT 5.0),gzip(gfe)

--

You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.




[google-appengine] Best way to structure data

2009-07-28 Thread Ray Malone

I have a class that holds users and a class with objects the users
own.The user class stores the user type.  I want to query to find
all objects owned by users of a specific type.  I have a ref that
points to users in the objects class, but not sure how I can use this
to do what I need.  I know I can access the objects from the Ref, but
not sure how to pass the query as a list to a template and acesss the
Ref.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Using another SMTP Server

2009-07-28 Thread Ray Malone

We would like to send out news letters to our customers and the
current email API is a little limiting.  We are looking to use another
service provider, but they require the server to connect via SMTP and
use authinication.  Is there any way to use this within App Engine?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Need help with Email, getting an odd error

2009-07-04 Thread Ray Malone

message.send()
  File /base/python_lib/versions/1/google/appengine/api/mail.py,
line 513, in send
raise e
ApplicationError: ApplicationError: 1

I'm sending out several hundred emails to people that have signed up
to announcements, but after 70 or so go I get this error.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Google Login Redirect back to page after user registers.

2009-05-30 Thread Ray Malone

else:
  self.redirect(users.create_login_url(self.request.uri))

If the user has not signed in, tell webapp to redirect the user's
browser to the Google account sign-in screen. The redirect includes
the URL to this page (self.request.uri) so the Google account sign-in
mechanism will send the user back here after the user has signed in or
registered for a new account.

this doesn't seem to work.  If the user registers they have to
validate their new id and doesn't send the user back to the page.
It's makes for a odd way to register new users.  Any way to do this so
the validation email or the validation page will actually send the
user back to your site.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Re: App redesign

2009-05-04 Thread Ray Malone

I think you are going to have to recreate the entities.  You can't
just update them. You may want to use the new report API or Cron
to make the changes.  It's going to take a while no matter which way
you go.

On May 3, 11:34 am, vanya vanya@gmail.com wrote:
 I have created about million entities without key_name. And now I need
 key_name so that to reduce CPU time consumption. Also I want to change
 the app design. How to recreate these entities in short time?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Re: The API call mail.Send() required more quota than is available.

2009-05-04 Thread Ray Malone

I figured out my issue.  I needed to enable billing to send more than
32 a minute.You can send about 4600 a minute when it's enabled.

On May 4, 11:10 am, Ray Malone rayish...@gmail.com wrote:
 I don't understand what's happened.  It allowed me to send about 100
 emails then stopped with this error.  Is it because I made multiple
 requests at the same time?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] The API call mail.Send() required more quota than is available.

2009-05-04 Thread Ray Malone

I don't understand what's happened.  It allowed me to send about 100
emails then stopped with this error.  Is it because I made multiple
requests at the same time?


--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Re: GAE should give app users guesstimate of site permanence.

2009-04-24 Thread Ray Malone

I personally don't want google to put ads on app engine apps

On Apr 24, 5:29 pm, Alkis Evlogimenos ('Αλκης Ευλογημένος)
evlogime...@gmail.com wrote:
 If you app gets tons of traffic what stops you from monetizing it by putting
 AdSense on it? Why do you want google to do it for you?

 On Fri, Apr 24, 2009 at 9:41 PM, Amir Michail amich...@gmail.com wrote:

  Hi,

  The idea is to use existing data to guesstimate how well an app will
  scale and whether Google would be willing to fund its scalability via
  ads in case its developers are not willing to pay.

  This sort of assurance of the permanence of a site could really do
  wonders for Web 2.0.

  Amir

 --

 Alkis
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Re: Timeout: datastore timeout: operation took too long.

2009-04-18 Thread Ray Malone

Today, my app has seen 2 timeout errors at 3:10 pm according to the
log.  Each one was 30 seconds apart.  One was a Get and the other a
Put.  Each on totally different classes that are not connected in any
way.

On Apr 17, 4:15 pm, Brandon Thomson gra...@gmail.com wrote:
 Google will not really acknowledge this as a problem or defect but
 neither do they provide a lot of options for workaround. My experience
 is that Timeouts do occur on about 0.5% of puts regardless of size of
 entity. These are root entities. It is not caused by write contention
 from multiple requests on the entity. A handler only called by
 periodic cron job will experience it.

 For one week in March when they were playing around with the
 architecture Timeouts went from about 0.5% of all puts to about 5%.
 Since it has been not as bad. There was an open defect but they
 recently closed 
 it:http://code.google.com/p/googleappengine/issues/detail?id=764

 I agree with notcourage about queues being a good solution and this is
 what I do because the data has to go somewhere. Currently I am using
 SQS. But a perhaps more important question is, is the time you spend
 implementing these workarounds better spent implementing your app on a
 different platform? I honestly don't know the answer, maybe notcourage
 has a better idea. I am curious to hear any more thoughts you have.
 Because if we are trying to make money this is always at front of
 mind.

 On Apr 17, 12:14 pm, notcourage klr...@gmail.com wrote:

  Good for you that your company has good prospects. As somebody who has
  built high traffic sites (co-founder of IGN.com), I offer some advice:
  Don't even think about driving traffic to it unless it has been stable
  for weeks. If you are having problems w/ minute traffic, you can't
  imagine how bad it will be under load. Plan for graceful degradation.
  Some possible degradations: Read-only mode except for existing
  registered users. Static site.

  Another thing to try is to queue put's in memcache, in a simple
  datastore q, or inhttp://aws.amazon.com/sqs/. The deferred put's can
  be stored as simple Strings using the Pickler.

  On Apr 17, 5:12 am,RayMalone rayish...@gmail.com wrote:

   Speaking only for my app, I can tell this is not an application
   issue.  My datastore is made up of only root entities and in most
   cases works well quickly.  My app doesn't see large volumes of
   requests per second and it's more like requests per minute.     There
   is no possible way the errors I'm seeing are from contention given the
   minutes between requests.  And, the same exact process is handled a
   few hours before within 600ms.      My app is soon to increase in
   volume and needs to be stable.  I love using app engine, but I've
   never faced errors like this on any other platform from IIS Server and
   SQL Server to PHP and MY SQL or even Unix and Oracle.   Don't get me
   wrong, I understand the difference in the platforms, If there is
   anything I can do to prevent this I would love to know.  I'm not
   moving my app, but need to find a solution.  My company will be on the
   local NBC news (I will be mentioning app engine) and may see a huge
   volume hitting the site next week.

   On Apr 17, 4:54 am, Sylvain sylvain.viv...@gmail.com wrote:

Datastoretimeoutis one of the biggest (and oldest) issue with GAE
and mostly because it is random.
You can get it on get, put, fetch,... even with few entities.

I hope that soon, datastoretimeoutwill be negligible. Currently, it
is not the case.

Regards

On 17 avr, 09:50, Paul Kinlan paul.kin...@gmail.com wrote:

 Hi,

 I would just like to add myself into this, my app twitterautofollow 
 (twollo)
 regularly gets DataStore time outs on puts (in the most part).  All my
 entities are root entities.

 I did have a thread open on this only a few days ago.

 Paul

 2009/4/17RayMalone rayish...@gmail.com

  I'm seeing random timeouts where there are many seconds or minutes
  between requests and hours before app engine handled the same 
  request
  within 400ms.  I hit another one today that will actually cost my
  business, not much but some.  My app needs to catch these and I am 
  on
  many pain points.    However, I think the timeouts needs addressed.

  On Apr 16, 7:10 pm, DarkCoiote darkcoi...@gmail.com wrote:
   Yes... I've read that...

   The problem with using all entities as root is that I'm unable to 
   use
   transactions as it is... I would have to code a lit bit... 
   although
   I just found a paper describing a project that seems really good.

  http://danielwilkerson.com/dist-trans-gae.html

   I think it will be presented this weekend, and I really hope that
   it goes public or even yet plugged to app engine!

   Just double-checked my GAE logs, and it seems that I'm getting
   timeouts in get operations as well... multiple 

[google-appengine] Re: Timeout: datastore timeout: operation took too long.

2009-04-17 Thread Ray Malone

Speaking only for my app, I can tell this is not an application
issue.  My datastore is made up of only root entities and in most
cases works well quickly.  My app doesn't see large volumes of
requests per second and it's more like requests per minute. There
is no possible way the errors I'm seeing are from contention given the
minutes between requests.  And, the same exact process is handled a
few hours before within 600ms.  My app is soon to increase in
volume and needs to be stable.  I love using app engine, but I've
never faced errors like this on any other platform from IIS Server and
SQL Server to PHP and MY SQL or even Unix and Oracle.   Don't get me
wrong, I understand the difference in the platforms, If there is
anything I can do to prevent this I would love to know.  I'm not
moving my app, but need to find a solution.  My company will be on the
local NBC news (I will be mentioning app engine) and may see a huge
volume hitting the site next week.



On Apr 17, 4:54 am, Sylvain sylvain.viv...@gmail.com wrote:
 Datastore timeout is one of the biggest (and oldest) issue with GAE
 and mostly because it is random.
 You can get it on get, put, fetch,... even with few entities.

 I hope that soon, datastore timeout will be negligible. Currently, it
 is not the case.

 Regards

 On 17 avr, 09:50, Paul Kinlan paul.kin...@gmail.com wrote:

  Hi,

  I would just like to add myself into this, my app twitterautofollow (twollo)
  regularly gets DataStore time outs on puts (in the most part).  All my
  entities are root entities.

  I did have a thread open on this only a few days ago.

  Paul

  2009/4/17RayMalone rayish...@gmail.com

   I'm seeing random timeouts where there are many seconds or minutes
   between requests and hours before app engine handled the same request
   within 400ms.  I hit another one today that will actually cost my
   business, not much but some.  My app needs to catch these and I am on
   many pain points.    However, I think the timeouts needs addressed.

   On Apr 16, 7:10 pm, DarkCoiote darkcoi...@gmail.com wrote:
Yes... I've read that...

The problem with using all entities as root is that I'm unable to use
transactions as it is... I would have to code a lit bit... although
I just found a paper describing a project that seems really good.

   http://danielwilkerson.com/dist-trans-gae.html

I think it will be presented this weekend, and I really hope that
it goes public or even yet plugged to app engine!

Just double-checked my GAE logs, and it seems that I'm getting
timeouts in get operations as well... multiple requests could cause
that too (one get 'over' a put for example)...

Have to check my code

Thank you

On Apr 16, 2:10 pm, Jeff S (Google) j...@google.com wrote:

 On Thu, Apr 16, 2009 at 4:16 AM, DarkCoiote darkcoi...@gmail.com
   wrote:

  On Apr 15, 3:26 pm, Jeff S (Google) j...@google.com wrote:
   HiRay,

   Which operation was is that timed out (get, query, put)? Also, how
   consistently are you seeing these timeouts?

   I generally recommend catching datastore timeouts and handling 
   them
   in a
  way
   that makes sense for your app. There are currently occasional
   (quite rare
  as
   a percentage) timeouts for queries and gets, and timeouts

   on a put is often
   an indicator of contention on that entity or entity group.

  well... almost (if not all) of the timeouts I'm seeing are on 'put'
  operations...
  but contention would need, like, 2 or more operations on the same
  entity
   (all my entities are roots... stupid, I know ), right?

 Actually, making most of your entities roots is often better than deep
 ancestor trees in terms of overall write throughput. In a 
 transactional
 write a entity is updated which has a parent entity, the ancestors are
 locked. So if nearly concurrent requests update different entities
   which all
 share a common ancestor (in other words the entities are in the same
   entity
 group), some of the child entity updates could fail due to contention
   on
 writes. There are more details here in the documentation:

http://code.google.com/appengine/docs/python/datastore/keysandentityg.
   ..

 
 Tips for using entity groups:

 - Only use entity groups when they are needed for transactions. For
   other
 relationships between entities, use ReferenceProperty properties and
   Key
 values, which can be used in queries.

 - The more entity groups your application has—that is, the more root
 entities there are—the more efficiently the datastore can distribute
   the
 entity groups across datastore nodes. Better distribution improves the
 performance of creating and updating data. Also, multiple users
   attempting
 to update entities in the same entity group at the same time will 
 cause
   some
 users to retry 

[google-appengine] Re: Timeout: datastore timeout: operation took too long.

2009-04-16 Thread Ray Malone

I'm seeing random timeouts where there are many seconds or minutes
between requests and hours before app engine handled the same request
within 400ms.  I hit another one today that will actually cost my
business, not much but some.  My app needs to catch these and I am on
many pain points.However, I think the timeouts needs addressed.

On Apr 16, 7:10 pm, DarkCoiote darkcoi...@gmail.com wrote:
 Yes... I've read that...

 The problem with using all entities as root is that I'm unable to use
 transactions as it is... I would have to code a lit bit... although
 I just found a paper describing a project that seems really good.

 http://danielwilkerson.com/dist-trans-gae.html

 I think it will be presented this weekend, and I really hope that
 it goes public or even yet plugged to app engine!

 Just double-checked my GAE logs, and it seems that I'm getting
 timeouts in get operations as well... multiple requests could cause
 that too (one get 'over' a put for example)...

 Have to check my code

 Thank you

 On Apr 16, 2:10 pm, Jeff S (Google) j...@google.com wrote:

  On Thu, Apr 16, 2009 at 4:16 AM, DarkCoiote darkcoi...@gmail.com wrote:

   On Apr 15, 3:26 pm, Jeff S (Google) j...@google.com wrote:
HiRay,

Which operation was is that timed out (get, query, put)? Also, how
consistently are you seeing these timeouts?

I generally recommend catching datastore timeouts and handling them in a
   way
that makes sense for your app. There are currently occasional (quite 
rare
   as
a percentage) timeouts for queries and gets, and timeouts

on a put is often
an indicator of contention on that entity or entity group.

   well... almost (if not all) of the timeouts I'm seeing are on 'put'
   operations...
   but contention would need, like, 2 or more operations on the same
   entity
    (all my entities are roots... stupid, I know ), right?

  Actually, making most of your entities roots is often better than deep
  ancestor trees in terms of overall write throughput. In a transactional
  write a entity is updated which has a parent entity, the ancestors are
  locked. So if nearly concurrent requests update different entities which all
  share a common ancestor (in other words the entities are in the same entity
  group), some of the child entity updates could fail due to contention on
  writes. There are more details here in the documentation:

 http://code.google.com/appengine/docs/python/datastore/keysandentityg...

  
  Tips for using entity groups:

  - Only use entity groups when they are needed for transactions. For other
  relationships between entities, use ReferenceProperty properties and Key
  values, which can be used in queries.

  - The more entity groups your application has—that is, the more root
  entities there are—the more efficiently the datastore can distribute the
  entity groups across datastore nodes. Better distribution improves the
  performance of creating and updating data. Also, multiple users attempting
  to update entities in the same entity group at the same time will cause some
  users to retry their transactions, possibly causing some to fail to commit
  changes. Do not put all of the application's entities under one root.

  - A good rule of thumb for entity groups is that they should be about the
  size of a single user's worth of data or smaller.

  - Entity groups do not have a significant impact on the speed of queries.
  

  If your entities are roots, then yes contention could occur if the same
  entity were updated by overlapping requests.

  Thank you,

  Jeff

   I'll check for bugs that could cause multiples requests and stuff like
   that

   Thank you

Happy coding,

Jeff

On Mon, Apr 13, 2009 at 4:11 PM, DarkCoiote darkcoi...@gmail.com
   wrote:

 Looks like my and others problem... posted a few days ago:

http://groups.google.com/group/google-appengine/browse_thread/thread/.
   ..

 Random datastore timeouts in totally unexpected places...

 On Apr 13, 2:36 pm,RayMalone rayish...@gmail.com wrote:
  I'm not sure why this occurs all of a sudden.  The same job runs in
  600ms.    Then once in a while this runs over 6800 MS and times out.
  I can't have jobs just timeout for no reason.    According to my 
  logs
  during this time the only other request was a second prior.  This
  occurred at 04-13 09:13AM 29.627 today and other times at random in
  the last few days.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Timeout: datastore timeout: operation took too long.

2009-04-13 Thread Ray Malone

I'm not sure why this occurs all of a sudden.  The same job runs in
600ms.Then once in a while this runs over 6800 MS and times out.
I can't have jobs just timeout for no reason.According to my logs
during this time the only other request was a second prior.  This
occurred at 04-13 09:13AM 29.627 today and other times at random in
the last few days.


--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Re: SMS via Email

2009-04-07 Thread Ray Malone

I agree.  I'm using a gateway as well.  I wouldn't recommend the email
method.   Jim, I am curious on who you are using for .03 a text.

On Apr 7, 10:30 am, Jim jeb62...@gmail.com wrote:
 I've had problems with that approach in the past including:

 -- the email to text gateways operated by the cell carriers can be
 very slow
 -- I've found that the gateways often mess up the formatting of the
 message, depending on the gateway it might wind up in the SMS with
 things like SUBJ: and BODY and junk like that cluttering up your
 message.
 -- determining the correct email gateway to use from the cellphone
 number is no longer reliable.  It used to be you could look up with
 the area code and exchange and determine which carrier issued the
 number and then know which email gateway to use.  Well, actually you
 can still do that but with cellphone number portability, you don't
 know which carrier currently services the number, you just know which
 carrier issued the number.   So you wind up having to ask your
 customer to provide their phone number and specify which carrier they
 use.

 I recently did an integration to a SMS gateway.  They have a variety
 of APIs including HTTPS, XML, SOAP, etc.  They have a callback
 mechanism so your app gets status updates on the delivery status of
 each message.  Only draw back is it cost $0.03 per message.  There may
 be cheaper ones out there, I'm not sure as I got tired of looking
 around and three cents was reasonable for my usage.

 It just depends on if you're willing to live with the limitations,
 then the email approach is fine.  If you need something cleaner and
 more reliable, then I suggest subscribing to a sms gateway service.

 On Apr 7, 1:21 am, MajorProgamming sefira...@gmail.com wrote:

  I am currently developing an app that will send text message
  reminders. I was thinking of using each carrier's email gateway to
  handle the messages. Are there any potential scaling problems with
  this method?

  (I plan on sending the text messages via the GAE Email system)

  Thank you,
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] A better datastore viewer?

2009-04-07 Thread Ray Malone

Does anyone know a better datastore viewer then the one that comes by
default.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Re: Noobie with google app engine. Need some help.

2009-04-07 Thread Ray Malone

Take a look at the documentation for uploading an app here
http://code.google.com/appengine/docs/python/tools/uploadinganapp.html

However, I think you are using the app engine patch and may need this
instead.  http://code.google.com/p/app-engine-patch/wiki/GettingStarted

I don't use the path and don't have experience setting it up, but this
should help.



On Apr 7, 10:52 am, Aaron shyhockey...@gmail.com wrote:
 HI, I am very confused on how to use google app engine. I have a job
 as a vp of technlology. I was a website developer.

 I only know html,css, php, python.  I never heavily used python so I
 am rusty with it.

 I only had experience with using apache and mysql.

 I am new to google application and have been doing research on it. I
 found it uses a different database system.

 I already made the website for the company now I need to upload it to
 google apps and also make modifications in python scripts to add some
 server sided functionalities.

 So far it's been about 4 weeks. My ceo is really upset. He never gave
 a deadline but he wanted it to be done as soon as possible. He is now
 breathing down my neck. I am stressed out .

 So to make matters worst I need to learn how google apps engine works
 and how I can use it in a quick manner.

 The ceo has been talking to the previous VP of technology.

 He is the one the made the website. I just added onto it. So He gave
 me the original website files meaningthe python and the folder.

 He told me I have to use manage.py  to update or test run the app
 meaning the website.

 Currently I tried the manage.py which was inthe apps folder  and this
 folder was in googles engine folder.

 I been getting a error saying can't find SDK.

 So I moved the manage.py to googles app engine folder and it worked.
 Yet when I tried updating It showed 96 files trying to be updated to
 googles server then I got a limit error.

 I e-mailed the ceo which e-mailed the previous programmer. He told me
 that the manage.py needs to stay in the app folder not the google
 engine folder.

 He told me I need to use  PATH=$PATH:/path/to/google_

 I don't understand what he ment by that.   I am guessing  I had to add
 that to manage.py?

 Not sure I might e-mail them back.

 So currently I need to just update a website which is a web app on
 google app engine.

 So I need to learn the structure of how to use  google apps engine.

 I need a tutorial that would explain  me the structure  from a php/
 mysql apache user point of view.

 Meaning I need a explanation  what's used with php and what is used in
 google that relates to php in the server sided way.

 I thiink that would be the quickest way i can learn this else I might
 get fired. I do really need to keep this job.

 I told the ceo that I am not experienced in google nor python. I  did
 some coding in python but it wasn't that much to make any app.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Time Outs with Data Store

2009-03-12 Thread Ray Malone

Last night I had several timouts reading an entity with one record.
It started around 7pm and continued until this morning where it
stopped.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] New User Email Validation Redirect

2009-03-12 Thread Ray Malone

Does anyone know how to redirect the user back to your app after they
create a new user account and get the email from Google Accounts to
validate thier email address.  This makes user sign up clunky if there
isn't a way to do this.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] WWW. Help

2009-01-09 Thread Ray Malone

I've noticed that appspot.com sites are not accessable when you add WWW.
to the name.  Any Idea why or is it just my sites?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] cpu usage

2009-01-07 Thread Ray Malone

Hi I get a message on my script that my average cpu is over 1300.
However, when I review the details I can't see any cpu time used or
any High CPU requests used.  Second of all my script is not all that
complicated and only makes 8 datastore api calls per request.  I'm not
sure where to look to tune it.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Re: Should I use App Engine Patch

2009-01-07 Thread Ray Malone

thanks for the advice all.

On Jan 4, 12:30 pm, Bobby bobbysoa...@gmail.com wrote:
 I was also undecided on whether to go with Django on top of the GAE
 but ended up going for it using the AppEngine Patch and i'm glad i
 did.

 Yesterday i needed to setup feeds and Django took care of everything
 in literally a couple of lines - it just keeps on giving.

 Also, the beauty of self-contained apps (so easy to do in Django) is
 something you won't be able to go without after having done a few.

 There are some types of sites where i wouldn't use Django but these
 are mostly specialized apps (more of web-based applications than
 content-driven sites).

 I highly recommend you look into both the AppEngine Django Helper and
 the AppEngine Patch (create some simple Django apps, go through the
 documentation for the AppEngine and Django side-by-side), above all
 it's important you get a feel for what's out there so you can make the
 best decisions, you'll learn alot about best practices - also see the
 video Waldemar linked to.

 Bobby

 On Jan 4, 8:20 am, Waldemar Kornewald wkornew...@gmail.com wrote:

  On Jan 3, 6:43 pm, gops patelgo...@gmail.com wrote:

   think this way :: if there was a need of app engine patch than google
   would have released it.

  Actually, Google did release django-helper, but we (app-engine-patch)
  disagreed about unnecessarily introducing a new model class for Django
  users. More interestingly, I discussed that with Matt Brown (maintains
  django-helper) and he agreed with our decision. It would've just been
  difficult to remove the custom model class, again.

   and i personally think , webapp is sufficient for pretty large
   project , afterall

  * no matter how 
  much django do for you ,

  *

   atlast for
   sufficiently large project we endup
   with our own library-or-framework.

  Translation:
  No matter how much time you can save, code reuse is for sissies! ;)

  Bye,
  Waldemar Kornewald
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Should I use App Engine Patch

2009-01-02 Thread Ray Malone

I'm not sure of the benefits of using the Patch.  I have been able to
build two good sized apps (1000+ lines of code each) using the App
Engine defaults.   I know my code is not best practice yet, so I'm
looking to learn more and make my next app better.  While I like how
the models are setup, the process of creating and maintaining an app
seems complicated.  Can you tell me what I would gain from using the
Patch.  Thanks
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] lower case string query

2008-12-31 Thread Ray Malone

I can't seem to find documentation on how to filter a string value and
expect a lower case value.  For example if users input their names in
upper and lower case I want to find the value using a lower case value
later.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---



[google-appengine] Re: lower case string query

2008-12-31 Thread Ray Malone

I came up with the same approach, however, this is a unclean way to
handle it.  Is this the only option?

On Dec 31, 10:42 am, Rodrigo Moraes rodrigo.mor...@gmail.com
wrote:
 On Wed, Dec 31, 2008 at 1:27 PM, Ray Malone wrote:
  I can't seem to find documentation on how to filter a string value and
  expect a lower case value.  For example if users input their names in
  upper and lower case I want to find the value using a lower case value
  later.

 You'd need to store a copy of the name in lowercase, so that you can
 filter by it.

 -- rodrigo
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---