[google-appengine] Re: Interpreting datastore quota details

[imyousuf]

On Feb 27, 11:40 pm, "Ikai L (Google)"  wrote:
> Are you using setProperty on your Entities or setUnindexedProperty?
>

Ah huh! That explains it, I should use set unindexed property as you
suggested, thanks a lot :).

Best regards,

Imran

> http://code.google.com/appengine/docs/java/javadoc/com/google/appengi...,
> java.lang.Object)
>
>  java.lang.Object)>All properties are indexed by default. The index viewer in
> the datastore viewer only refers to custom indexes generated from your local
> config.
>
>
>
>
>
> On Sat, Feb 27, 2010 at 9:34 AM, imyousuf  wrote:
> > Hmm...
> > The thing is, I did not create any index consciously and the Datastore
> > Index viewer says -
> > "You have not created indexes for this application."
>
> > Moreover I am using the Datastore API directly to reduce JPA/JDO
> > overhead, under these
> > circumstance what could be the reason for 10x difference? If you would
> > still go with
> > index, how can I ensure that, there is no index except for the primary
> > keys, as I designed
> > the app to use primary keys only.
>
> > Thank you,
>
> > Imran
>
> > On Feb 27, 12:14 am, "Ikai L (Google)"  wrote:
> > > Total storage includes things such as indexes. Indexes can consume
> > several
> > > times what the actual entity consumes worth of data, so it's worth noting
> > > that for space efficiency purposes you should not over-index fields. Mark
> > > them as unindexed when possible.
>
> > > On Thu, Feb 25, 2010 at 11:00 PM, imyousuf  wrote:
> > > > Hi,
>
> > > > I am having trouble to understand datastore quota details for my
> > > > application. My Datastore Statistics say Total size of all entities is
> > > > 14 MegaBytes. Whereas my quota details say: 13% - 0.13 of 1.00 GBytes
>
> > > > I am not sure how 14MB equates to 0.13 of 1.00GBytes.
>
> > > > Can someone please help me understand it?
>
> > > > Thank you,
>
> > > > Imran
>
> > > > --
> > > > You received this message because you are subscribed to the Google
> > Groups
> > > > "Google App Engine" group.
> > > > To post to this group, send email to google-appengine@googlegroups.com
> > .
> > > > To unsubscribe from this group, send email to
> > > > google-appengine+unsubscr...@googlegroups.com > > >  e...@googlegroups.com> > e...@googlegroups.com>
> > > > .
> > > > For more options, visit this group at
> > > >http://groups.google.com/group/google-appengine?hl=en.
>
> > > --
> > > Ikai Lan
> > > Developer Programs Engineer, Google App Enginehttp://
> > googleappengine.blogspot.com|http://twitter.com/app_engine
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com > e...@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
>
> --
> Ikai Lan
> Developer Programs Engineer, Google App 
> Enginehttp://googleappengine.blogspot.com|http://twitter.com/app_engine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Remote XML documents being truncated by GAE

[Wooble]

It's neither.  All API responses are limited to 1MB, including
urlfetch.

On Feb 27, 5:42 am, davenaff  wrote:
> It isn't #1, but I bet it is #2.
>
> I'm using urllib and I didn't realize that Google had modified the
> library to use urlfetch underneath.
>
> Thanks for the pointer.
>
> On Feb 27, 1:49 am, Sylvain  wrote:
>
> > 30 seconds response limit 
> > ?http://code.google.com/intl/fr/appengine/docs/python/runtime.html#The...
>
> > or the URL Fetch deadline limit (5s by 
> > default)http://code.google.com/intl/fr/appengine/docs/python/urlfetch/fetchfu...
>
> > Else I don't know.
>
> > On Feb 27, 9:53 am, davenaff  wrote:
>
> > > I have a simple service that requests a remote XML document, formats
> > > it and displays it.
>
> > > Recently, I began to see some of the XML documents truncated. It
> > > consistently happens at character 1048544.  This of course causes my
> > > SAX parser to fail.
>
> > > In dev (using the SDK), it works fine and full documents are handled
> > > just fine, so this problem seems to be exclusive to the GAE production
> > > environment.
>
> > > The App receives very little traffic.
>
> > > Am I hitting some App Engine limit? Other ideas?
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] JPA Netbeans

[midi]

Are there any tutorials on JPA with Netbeans using App Engine.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Login on third level domains.

[Adam]

I have a different third level domain for each region my app supports
(restaurant search).

It seems like a user logged into toronto.fyood.com is not logged into
ottawa.fyood.com.

Any way I can change this?  I'm using google for authentication.

And while we're at it, can someone explain what the expected
interaction between gmail and my app should be?

I'm having a hard time finding the pattern.

If I log into gmail, I still get prompted for my password when I hit
my app. Logging out of gmail leaves me logged into my app, but logging
out of
my app logs me out of gmail?

And logging into my app means I'm logged into gmail?  Is this
expected?  This seems like a big XSS risk.

A

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: My max requests / seconds is 3. My cron jobs fail with: "Request was aborted after waiting too long.."

[Eli Jones]

I'm guessing there's just some weird coding you're doing that's causing the
breakage.

Personally, I'd make all the cron jobs just one cron.. and have that one
cron simply add one named start task to a queue... then have that start task
do all of your initial task adding using named tasks with the appropriate
countdown (or eta) and try,except handling TaskAlreadyExiststs and
TombStonedTask errors by passing silently.

A starting task like that will always succeed.. it will just keep retrying
until every named task it should create is created.  Then, you can get down
to debugging what it is about your queues that may still be borking (I don't
use rates in my queues.. so I am not familiar with gotchas in that area).

On Sat, Feb 27, 2010 at 3:06 AM, Marc Provost  wrote:

> Thanks for you help Eli! I didn't know about the unique name feature.
> I will use that trick, at least for the most important crons. Still, I
> wonder why I see this failure if my requests / seconds is never higher
> than 3 in my dashboard. I mean, if I saw spikes close to 30 at least I
> could start debugging. And the failure rate is much higher than 0.1%.
> It's more like 5%. And it's weird, sometimes the first cron will fail
> when there is no activity at all... why? It always fail after 10
> seconds. Sometimes the first cron fails, sometimes the 5th, etc. And
> my app itself has almost no traffic.
>
> A few notes:
>
> * Yeah, I use chaining. I am not adding the 1000s tasks in one shot.
> Sorry for not specifying that. None of my cron/queue is close to the
> 30 second limit. I didn't see a 30 second timeout error in my logs for
> a long time.
> * I use a queue with a rate of 5 tasks per second, so approximately
> 300 tasks will go through per minute and 1200 tasks in 4 minutes.
> Hence my approximation. I also manually ran the cron jobs and saw them
> complete in about 4 minutes.
>
> Basically, the question I'm trying to answer here is:
>
> Why I'm I seeing the "simultaneous dynamic request limit error" if:
>
> 1) In my dashboard, the max rate of requests I see is 3. Far from 30.
> 2) The rate of my queue is 5 / second. Again, far from 30.
> 3) This error occurs even for the first cron job, when there is no
> other tasks / cron running (and my app has almost no traffic)
>
> Thanks again for your tips.
> Marc
>
>
>
>
> On Feb 26, 8:16 pm, Wooble  wrote:
> > On Feb 26, 7:46 pm, Locke  wrote:
> >
> > > I have also seen this timeout error when trying to add to the task
> > > queue. What is interesting to me is that it kills my process after 10
> > > seconds, instead of the thirty seconds we supposedly are allowed.
> >
> > The 30 seconds are for a request that actually runs.  This message
> > indicates your request handler didn't get run at all, because too many
> > instances of your application were already running.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Data Viewer is reporting erro r on simple GQL query

[will]

Just now I get a "There were errors: GQL Query" in the Data Viewer.

SELECT * FROM User WHERE enabled=FALSE

I have tried other queries as well. None of them work. They worked before though.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Replace String Problem

[Petert[at]ipowow]

Thanks, stupid error.

I did have it the other way, the problem happened when I added the
"vote link" line.

What you get for swapping between many languages everyday.

Peter


On Feb 27, 5:59 am, Wooble  wrote:
> This isn't an appengine problem.  Python strings are immutable;
> str.replace() doesn't modify the original string, it returns a
> modified string.
>
> On Feb 25, 6:10 pm, "Petert[at]ipowow"  wrote:
>
>
>
> > I'm having a problem with replace string which has just started
> > happening recently. The code was working with no problems before.
>
> > Can someone have a look and see if I'm doing something wrong
>
> > Code - starting at line 395
> > -
> > msgt = self.request.get('txt')
> > logging.info(msgt)
> > logging.info("PIN"+smscode)
> > msgt.replace("##Access Code##", smscode)
> > msgt.replace("##Vote Link##", votekey)
> > msg = "Your pin code is [" + smscode + "]\n\n" + msgt
> > logging.info(msgt)
> > logging.info(msg)
>
> > Log Entries
> > ---
> > IINFO     2010-02-25 23:05:30,218 vote.py:396] Pin ##Access Code##
> > INFO     2010-02-25 23:05:30,218 vote.py:397] PIN35356
> > INFO     2010-02-25 23:05:30,218 vote.py:401] Pin ##Access Code##
> > INFO     2010-02-25 23:05:30,218 vote.py:402] Your pin code is [35356]
>
> > Pin ##Access Code##
>
> > As it can be seen, the replace function isn't working.
>
> > Peter Tippettwww.ipowow.com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] GAE/J Low Level API Transaction management.

[Patrick Twohig]

FWIW, it looks like that particular issue is a bug with the local
development server and not on the actual app engine.  I tried it out in my
app and it seems that it finds all objects properly.

Pat.

On Thu, Feb 25, 2010 at 6:24 PM, Jeff Schnitzer  wrote:

> Looks good to me, but I don't work for Google so the only help I can
> offer is starring the issue :-(
>
> Jeff
>
> On Thu, Feb 25, 2010 at 5:44 PM, Patrick Twohig
>  wrote:
> > Jeff,
> >
> > I made an issue regarding it, let me know if my unit test left anything
> out.
> >
> > Thanks,
> > Patrick.
> >
> > http://code.google.com/p/googleappengine/issues/detail?id=2879
> >
> > On Fri, Feb 19, 2010 at 1:16 AM, Patrick Twohig <
> patr...@namazustudios.com>
> > wrote:
> >>
> >> I had that suspicion, but, I wasn't 100% sure.  I wonder if it's an
> issue
> >> that shows up in production or just local datastore.
> >>
> >> Pat.
> >>
> >> On Thu, Feb 18, 2010 at 1:34 PM, Jeff Schnitzer 
> >> wrote:
> >>>
> >>> I just created a unit test for this case (there wasn't one before) and
> >>> sure enough, it fails.  Looks like a bug in appengine.  Create an
> >>> issue, I'll star it.
> >>>
> >>> The failing unit test is the last one in this file:
> >>>
> >>>
> http://code.google.com/p/objectify-appengine/source/browse/trunk/src/com/googlecode/ob
> >>> jectify/test/QueryTests.java
> >>>
> >>> FWIW, our implementation is the ancestor() method:
> >>>
> >>>
> http://code.google.com/p/objectify-appengine/source/browse/trunk/src/com/googlecode/objectify/impl/QueryImpl.java
> >>>
> >>> Javadocs are on the interface class:
> >>>
> >>>
> http://objectify-appengine.googlecode.com/svn/trunk/javadoc/com/googlecode/objectify/Query.html
> >>>
> >>> Jeff
> >>>
> >>> On Thu, Feb 18, 2010 at 11:22 AM, Patrick Twohig
> >>>  wrote:
> >>> > Duly noted.  However, I'm not about to rewrite a bulk of my code over
> a
> >>> > single issue I'm having.  At the time I started this, I hadn't
> realized
> >>> > Objectify existed and tried using JDO which turned out to be a
> gigantic
> >>> > nightmare, so I slimmed it down and wrote my own wrapper similar to
> >>> > Objectify.  Right now the only pressing issue is that ancestor
> queries
> >>> > aren't working as expected and it's driving me nuts.  Could you
> perhaps
> >>> > point me to some source in Objectify that executes an ancestor query
> >>> > that I
> >>> > may be able to see?
> >>> >
> >>> > On Wed, Feb 17, 2010 at 10:05 PM, Jeff Schnitzer <
> j...@infohazard.org>
> >>> > wrote:
> >>> >>
> >>> >> The documentation I wrote up here might help:
> >>> >>
> >>> >> http://code.google.com/p/objectify-appengine/wiki/Concepts
> >>> >>
> >>> >> You might consider using something like Objectify (or Twig, or
> >>> >> SimpleDS, etc) instead of the Low-Level API.
> >>> >>
> >>> >> Jeff
> >>> >>
> >>> >> On Wed, Feb 17, 2010 at 9:23 PM, Patrick Twohig
> >>> >>  wrote:
> >>> >> > Aside from the Javadocs, does there exist any further
> documentation
> >>> >> > on
> >>> >> > the
> >>> >> > GAE/J low-level API.  I've had a handfull of issues with it so far
> >>> >> > and
> >>> >> > I'm
> >>> >> > at a bit of a loss.  I'm having trouble with ancestor queries.
> >>> >> > Specifically, I'm not getting any child entities when I look for
> >>> >> > objects
> >>> >> > with no kind specified and just an ancestor.  However, the
> >>> >> > equivalent
> >>> >> > code
> >>> >> > in python performs as expected.
> >>> >> >
> >>> >> > I was also curious how GAE/J organizes transactions.  From what I
> >>> >> > gather
> >>> >> > in
> >>> >> > the documentation, each transaction is organized in a ThreadLocal
> >>> >> > stack.
> >>> >> > Every time you call DatastoreService.beginTransaction() it creates
> a
> >>> >> > new
> >>> >> > transaction, pushes it on the thread local stack then when it's
> >>> >> > done,
> >>> >> > it's
> >>> >> > popped of.  I was curious if it may be possible to add a method
> that
> >>> >> > can
> >>> >> > provide the current transaction given a particular key somehow.
> >>> >> >
> >>> >> >
> >>> >> > --
> >>> >> > Patrick H. Twohig.
> >>> >> >
> >>> >> > Namazu Studios
> >>> >> > P.O. Box 34161
> >>> >> > San Diego, CA 92163-4161
> >>> >> >
> >>> >> > --
> >>> >> > You received this message because you are subscribed to the Google
> >>> >> > Groups
> >>> >> > "Google App Engine" group.
> >>> >> > To post to this group, send email to
> >>> >> > google-appeng...@googlegroups.com.
> >>> >> > To unsubscribe from this group, send email to
> >>> >> > google-appengine+unsubscr...@googlegroups.com
> .
> >>> >> > For more options, visit this group at
> >>> >> > http://groups.google.com/group/google-appengine?hl=en.
> >>> >> >
> >>> >>
> >>> >> --
> >>> >> You received this message because you are subscribed to the Google
> >>> >> Groups
> >>> >> "Google App Engine" group.
> >>> >> To post to this group, send email to
> >>> >> google-appeng...@googlegroups.com.
> >>> >> To unsubscribe from this group, send email to
> >>> >> google-appengine+unsubscr...@

[google-appengine] Microsoft emails are bouncing

[Greg Tracy]

Over the last week, emails sent from my app to Microsoft accounts -
hotmail, msn, live, etc. - are bouncing.

---
550 550 SC-004 Mail rejected by Windows Live Hotmail for policy
reasons. A block has been placed against your IP address because we
have received complaints concerning mail coming from that IP address.
---

I recognize that this is not something the GAE team can control
directly, but I'm hopeful that GAE can work with Microsoft's
postmaster services on our behalf to come up with a solution.

Thanks.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Parallel access to appengine

[Gary Orser]

Hi all,

We were trying to create programmatic parallel access to our appengine
application.

>From EC2, we were attempting (with threads) to run parallel access
(url gets/posts) to
our appid.   There are some long running processes that we need to run
on EC2, for which
we would like to get a bunch of information (entities + processing on
appspot) quickly.

We seem to be running into a limit on the number of accesses that are
allowed.
(4 threads seems to be the effective limit)

Is there some sort of denial of service limit imposed on multiple
accesses from a single IP?

Cheers, Gary

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Server

[Massimiliano]

Hi to all!
The Google server is down. Are you facing this problem?

-- 

My email: massimiliano.pietr...@gmail.com
My Google Wave: massimiliano.pietr...@googlewave.com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Logging, the best approach

[megaswin]

Hi

As I understand GAE always logs all incoming requests (ip, agent,
etc). Also an application can use  java.util.logging.Logger for
logging app-specific events. Something like that:

private static final Logger logger =
Logger.getLogger(SearchServlet.class.getName());

protected void doPost(HttpServletRequest request, HttpServletResponse
response)
throws ServletException, IOException {
...
SearchRequest searchRequest = RequestParser.parse(request);
logger.info("searchRequest = " + searchRequest )
...
}

So here is my question : is it ok to use logger.info(...) if number of
requests is quite high? Is there any constraints/quotas? May be will
be better to save such information in database?

Thanks,
Maxim

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: My max requests / seconds is 3. My cron jobs fail with: "Request was aborted after waiting too long.."

[Locke]

On Feb 26, 8:16 pm, Wooble  wrote:
> The 30 seconds are for a request that actually runs.  This message
> indicates your request handler didn't get run at all, because too many
> instances of your application were already running.

This happens when one or two instances are running, actually.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Billing and Quota Problem

[Thomas Johansson]

Just a quick thought until you get an answer from support - Have you
tried changing the budget just slightly (say, by a cent daily),
perhaps that will fix things?

On Feb 27, 5:04 pm, jread  wrote:
> A further 24 hours has passed and our CPU quota on the app has _still_
> not updated to match the budget we have set for it.
>
> On Feb 26, 10:07 am, jread  wrote:
>
> > Hi,
>
> > Yesterday our demo app hit its CPU quota (appid: steprep-demo) so I
> > went in and rebalanced the quota to allow for more CPU. The Cost /
> > Budget column updated to show the new max value for CPU and based on
> > that column we had capacity again. The available quota, however,
> > remained at the level it was at before and stayed maxed out at 100%. I
> > tried clicking through the Settings link to ensure that the quota had
> > indeed been rebalanced and on that page it shows the increased CPU
> > quota value which matches the monetary value that has been set.
>
> > I ended up having to wait for the quota to reset itself in order to
> > get our app back online. Even now, around 12 hours later, we are still
> > seeing the same CPU quota value and the new monetary value.
>
> > Any help is appreciated,
> > Thanks,
> > Jeff.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Interpreting datastore quota details

[Ikai L (Google)]

Are you using setProperty on your Entities or setUnindexedProperty?

http://code.google.com/appengine/docs/java/javadoc/com/google/appengine/api/datastore/Entity.html#setUnindexedProperty(java.lang.String,
java.lang.Object)

All properties are indexed by default. The index viewer in
the datastore viewer only refers to custom indexes generated from your local
config.

On Sat, Feb 27, 2010 at 9:34 AM, imyousuf  wrote:

> Hmm...
> The thing is, I did not create any index consciously and the Datastore
> Index viewer says -
> "You have not created indexes for this application."
>
> Moreover I am using the Datastore API directly to reduce JPA/JDO
> overhead, under these
> circumstance what could be the reason for 10x difference? If you would
> still go with
> index, how can I ensure that, there is no index except for the primary
> keys, as I designed
> the app to use primary keys only.
>
> Thank you,
>
> Imran
>
> On Feb 27, 12:14 am, "Ikai L (Google)"  wrote:
> > Total storage includes things such as indexes. Indexes can consume
> several
> > times what the actual entity consumes worth of data, so it's worth noting
> > that for space efficiency purposes you should not over-index fields. Mark
> > them as unindexed when possible.
> >
> >
> >
> >
> >
> > On Thu, Feb 25, 2010 at 11:00 PM, imyousuf  wrote:
> > > Hi,
> >
> > > I am having trouble to understand datastore quota details for my
> > > application. My Datastore Statistics say Total size of all entities is
> > > 14 MegaBytes. Whereas my quota details say: 13% - 0.13 of 1.00 GBytes
> >
> > > I am not sure how 14MB equates to 0.13 of 1.00GBytes.
> >
> > > Can someone please help me understand it?
> >
> > > Thank you,
> >
> > > Imran
> >
> > > --
> > > You received this message because you are subscribed to the Google
> Groups
> > > "Google App Engine" group.
> > > To post to this group, send email to google-appengine@googlegroups.com
> .
> > > To unsubscribe from this group, send email to
> > > google-appengine+unsubscr...@googlegroups.com e...@googlegroups.com>
> > > .
> > > For more options, visit this group at
> > >http://groups.google.com/group/google-appengine?hl=en.
> >
> > --
> > Ikai Lan
> > Developer Programs Engineer, Google App Enginehttp://
> googleappengine.blogspot.com|http://twitter.com/app_engine
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
http://googleappengine.blogspot.com | http://twitter.com/app_engine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Interpreting datastore quota details

[imyousuf]

Hmm...
The thing is, I did not create any index consciously and the Datastore
Index viewer says -
"You have not created indexes for this application."

Moreover I am using the Datastore API directly to reduce JPA/JDO
overhead, under these
circumstance what could be the reason for 10x difference? If you would
still go with
index, how can I ensure that, there is no index except for the primary
keys, as I designed
the app to use primary keys only.

Thank you,

Imran

On Feb 27, 12:14 am, "Ikai L (Google)"  wrote:
> Total storage includes things such as indexes. Indexes can consume several
> times what the actual entity consumes worth of data, so it's worth noting
> that for space efficiency purposes you should not over-index fields. Mark
> them as unindexed when possible.
>
>
>
>
>
> On Thu, Feb 25, 2010 at 11:00 PM, imyousuf  wrote:
> > Hi,
>
> > I am having trouble to understand datastore quota details for my
> > application. My Datastore Statistics say Total size of all entities is
> > 14 MegaBytes. Whereas my quota details say: 13% - 0.13 of 1.00 GBytes
>
> > I am not sure how 14MB equates to 0.13 of 1.00GBytes.
>
> > Can someone please help me understand it?
>
> > Thank you,
>
> > Imran
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com > e...@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
>
> --
> Ikai Lan
> Developer Programs Engineer, Google App 
> Enginehttp://googleappengine.blogspot.com|http://twitter.com/app_engine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Server error? => "The application already has the maximum number of versions"

[Robert Kluin]

There is a limit on the number of deployed instances for each app, I  
think it is 10.  Just delete an old version.


Robert



On Feb 27, 2010, at 1:50, Nickolas Daskalou  wrote:


I've been trying to upload a minor version of my app (have tried 3
times in the last 5 minutes) and I'm getting this error using the Mac
OS X GoogleAppEngineLauncher app:

Error 403: --- begin server output ---

Too Many Versions (403)
The application already has the maximum number of versions.
--- end server output ---

There's nothing on my Quotas page that indicates I've exceeded or even
getting close to any version limits.

The last successful upload of my app occurred about 20 hours ago. App
id is "sportwurks".

--
You received this message because you are subscribed to the Google  
Groups "Google App Engine" group.
To post to this group, send email to google- 
appeng...@googlegroups.com.
To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com 
.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en 
.




--
You received this message because you are subscribed to the Google Groups "Google 
App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Indexes Not Building

[jread]

Hello,

We deployed a new version of our app (appid: steprep) yesterday
afternoon and we have seven new indexes that say they are building but
are still sitting at zero progress. Can someone unstick them?

Thanks,
Jeff.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Billing and Quota Problem

[jread]

A further 24 hours has passed and our CPU quota on the app has _still_
not updated to match the budget we have set for it.

On Feb 26, 10:07 am, jread  wrote:
> Hi,
>
> Yesterday our demo app hit its CPU quota (appid: steprep-demo) so I
> went in and rebalanced the quota to allow for more CPU. The Cost /
> Budget column updated to show the new max value for CPU and based on
> that column we had capacity again. The available quota, however,
> remained at the level it was at before and stayed maxed out at 100%. I
> tried clicking through the Settings link to ensure that the quota had
> indeed been rebalanced and on that page it shows the increased CPU
> quota value which matches the monetary value that has been set.
>
> I ended up having to wait for the quota to reset itself in order to
> get our app back online. Even now, around 12 hours later, we are still
> seeing the same CPU quota value and the new monetary value.
>
> Any help is appreciated,
> Thanks,
> Jeff.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Erratic behavior with back-references

[Tim Hoffman]

Hi

One thing that may not be obviouse with back references (reference
sets) is that
if the class that holds the reference has not been imported the named
collection (or entity_set)
won't be available in you object that you are trying to access the
back references through.

Hope that make sense.

So you might have the situation where the instance has been restarted
and some other code that has normally run that does the import,
has yet to happen.

This is probably not what is happening, but thought I would mention
it.

T

On Feb 27, 12:21 am, Josh  wrote:
> Hi, I'm relatively new to GAE so I'm not sure if I'm overlooking
> something relatively simple, but some help would be greatly
> appreciated:
>
> I'm working on an app where users can add others as contacts. To do
> this, I have a User model and a Contact model:
>
> class User(db.Model):
>         username = db.StringProperty(required=True)
>         firstname = db.StringProperty()
>         lastname = db.StringProperty()
>         email = db.EmailProperty(required=True)
>         address = db.PostalAddressProperty(required=False)
>         password = db.StringProperty(required=True)
>
> class Contact(db.Model):
>         contacter =
> db.ReferenceProperty(User,required=True,collection_name='contacters')
>         contactee =
> db.ReferenceProperty(User,required=True,collection_name='contactees')
>         accepted = db.BooleanProperty(required=True,default=False)
>
> The relationships are unidirectional, so User A (contacter) can
> request User B (contactee) as a contact and User B must then accept
> User A. User A now has User B added as a contact, whereas User B
> doesn't see anything different. To get a list of contacts for User A,
> I'm using the back-reference property.
>
> user = db.get(self.session['userkey']) //uses other info to get fetch
> a User object
> ...
> contactList = [] //blank array of contacts
> if hasattr(user,'contacters'):
>         for contact in user.contacters: //loops through all Contact objects
> that refer to the current user as a contacter
>                 if contact.accepted == True:
>                         contactList.append(contact.contactee)
>
> The rest of the code is arbitrary, but in short I then loop through
> the contactList array and print out the users for the "contacts" page.
> The problem here is that it only works sporadically. Quite
> astonishingly, I sometimes refresh the page and the contacts it finds
> will disappear completely. There aren't any errors being logged, and
> when I come back the next day or a few hours later it's back again. I
> have an autocomplete script on a different page that queries another
> class to get a list of matching contacts. It uses a similar back-
> reference property, and this also works sporadically.
>
> Are there any known issues / caching-features that I'm not aware of,
> that might be causing this? Are back-references not the right way to
> go about this? Thanks in advance!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] How to set indexed=False for a dynamic property of Expando?

[风笑雪]

Because building indexes takes more cpu time and datastore space,
otherwise Google wouldn't offer "indexed=False" parameter for static
properties.

BTW, how about an expando with several dynamic list properties? I
think it can reach the index limit very soon.

--
keakon



2010/2/27 Andrew Chilton :
> On 27 February 2010 13:58, 风笑雪  wrote:
>> Most time I only want the static properties of Expando to be indexed,
>> but the dynamic properties are always automatically indexed too.
>>
>> Is there any way to remove these indexes, just like
>> db.IntegerProperty(indexed=False) dose for the static properties?
>
> Unless you are hitting the index limit, why don't you want to index
> these properties?
>
> Cheers,
> Andy
>
> --
> contact: Andrew Chilton
> website: http://www.chilts.org/blog/
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] How to set indexed=False for a dynamic property of Expando?

[Andrew Chilton]

On 27 February 2010 13:58, 风笑雪  wrote:
> Most time I only want the static properties of Expando to be indexed,
> but the dynamic properties are always automatically indexed too.
>
> Is there any way to remove these indexes, just like
> db.IntegerProperty(indexed=False) dose for the static properties?

Unless you are hitting the index limit, why don't you want to index
these properties?

Cheers,
Andy

-- 
contact: Andrew Chilton
website: http://www.chilts.org/blog/

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Access to App Engine admin page

[dominity]

I've also noticed that when I'm redirected page of google search has
quite strange content. It appears with some scripts and iframe. Iframe
contains usual page for google search. Also, I've noticed that the
same content there is when I'm on gmail and press Sign Out. I'm
redirected to google search page with iframe. Maybe it's problem?

Best regards, Alexander.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Access to App Engine admin page

[dominity]

No, it doesn't help. After login page, I'm redirected to search engine
page.
I've also tested it with Opera without success. Maybe it's problem
with OS, is it? Or with firewall? I'm under Windows XP sp3 and ESET
SmartSecurity 4.

Best regards, Alexander.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Remote XML documents being truncated by GAE

[davenaff]

It isn't #1, but I bet it is #2.

I'm using urllib and I didn't realize that Google had modified the
library to use urlfetch underneath.

Thanks for the pointer.

On Feb 27, 1:49 am, Sylvain  wrote:
> 30 seconds response limit 
> ?http://code.google.com/intl/fr/appengine/docs/python/runtime.html#The...
>
> or the URL Fetch deadline limit (5s by 
> default)http://code.google.com/intl/fr/appengine/docs/python/urlfetch/fetchfu...
>
> Else I don't know.
>
> On Feb 27, 9:53 am, davenaff  wrote:
>
> > I have a simple service that requests a remote XML document, formats
> > it and displays it.
>
> > Recently, I began to see some of the XML documents truncated. It
> > consistently happens at character 1048544.  This of course causes my
> > SAX parser to fail.
>
> > In dev (using the SDK), it works fine and full documents are handled
> > just fine, so this problem seems to be exclusive to the GAE production
> > environment.
>
> > The App receives very little traffic.
>
> > Am I hitting some App Engine limit? Other ideas?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: How to set indexed=False for a dynamic property of Expando?

[风笑雪]

Thanks for your reply.
I don't won't to use db.Text.

I find a way to implement it, but seems not safe in the future version:

class A(db.Expando):
 pass

a = A()
a.prop = 1
A._unindexed_properties = frozenset(['prop'])
a.put()



--
keakon



2010/2/27 peterk :
> I don't believe you can.
>
> However you could cast your dynamic property to one of the datastore
> properties that are implicitly not indexed (e.g. db.Text) e.g. for a
> integer 123456789
>
> expando.dynamic_prop = db.Text(str(123456789))
>
> Then when you want to get it back use int(expando.dynamic_prop) to
> cast it back to an integer. Probably not as efficient as if there were
> the ability to flag properties as indexed or not, but I recall trying
> this and it worked.
>
> On Feb 27, 12:58 am, 风笑雪  wrote:
>> Most time I only want the static properties of Expando to be indexed,
>> but the dynamic properties are always automatically indexed too.
>>
>> Is there any way to remove these indexes, just like
>> db.IntegerProperty(indexed=False) dose for the static properties?
>>
>> Thank you.
>>
>> --
>> keakon
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Remote XML documents being truncated by GAE

[Sylvain]

30 seconds response limit ? 
http://code.google.com/intl/fr/appengine/docs/python/runtime.html#The_Request_Timer

or the URL Fetch deadline limit (5s by default)
http://code.google.com/intl/fr/appengine/docs/python/urlfetch/fetchfunction.html

Else I don't know.



On Feb 27, 9:53 am, davenaff  wrote:
> I have a simple service that requests a remote XML document, formats
> it and displays it.
>
> Recently, I began to see some of the XML documents truncated. It
> consistently happens at character 1048544.  This of course causes my
> SAX parser to fail.
>
> In dev (using the SDK), it works fine and full documents are handled
> just fine, so this problem seems to be exclusive to the GAE production
> environment.
>
> The App receives very little traffic.
>
> Am I hitting some App Engine limit? Other ideas?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: How to set indexed=False for a dynamic property of Expando?

[peterk]

I don't believe you can.

However you could cast your dynamic property to one of the datastore
properties that are implicitly not indexed (e.g. db.Text) e.g. for a
integer 123456789

expando.dynamic_prop = db.Text(str(123456789))

Then when you want to get it back use int(expando.dynamic_prop) to
cast it back to an integer. Probably not as efficient as if there were
the ability to flag properties as indexed or not, but I recall trying
this and it worked.

On Feb 27, 12:58 am, 风笑雪  wrote:
> Most time I only want the static properties of Expando to be indexed,
> but the dynamic properties are always automatically indexed too.
>
> Is there any way to remove these indexes, just like
> db.IntegerProperty(indexed=False) dose for the static properties?
>
> Thank you.
>
> --
> keakon

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Remote XML documents being truncated by GAE

[davenaff]

I have a simple service that requests a remote XML document, formats
it and displays it.

Recently, I began to see some of the XML documents truncated. It
consistently happens at character 1048544.  This of course causes my
SAX parser to fail.

In dev (using the SDK), it works fine and full documents are handled
just fine, so this problem seems to be exclusive to the GAE production
environment.

The App receives very little traffic.

Am I hitting some App Engine limit? Other ideas?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: My max requests / seconds is 3. My cron jobs fail with: "Request was aborted after waiting too long.."

[Marc Provost]

Thanks for you help Eli! I didn't know about the unique name feature.
I will use that trick, at least for the most important crons. Still, I
wonder why I see this failure if my requests / seconds is never higher
than 3 in my dashboard. I mean, if I saw spikes close to 30 at least I
could start debugging. And the failure rate is much higher than 0.1%.
It's more like 5%. And it's weird, sometimes the first cron will fail
when there is no activity at all... why? It always fail after 10
seconds. Sometimes the first cron fails, sometimes the 5th, etc. And
my app itself has almost no traffic.

A few notes:

* Yeah, I use chaining. I am not adding the 1000s tasks in one shot.
Sorry for not specifying that. None of my cron/queue is close to the
30 second limit. I didn't see a 30 second timeout error in my logs for
a long time.
* I use a queue with a rate of 5 tasks per second, so approximately
300 tasks will go through per minute and 1200 tasks in 4 minutes.
Hence my approximation. I also manually ran the cron jobs and saw them
complete in about 4 minutes.

Basically, the question I'm trying to answer here is:

Why I'm I seeing the "simultaneous dynamic request limit error" if:

1) In my dashboard, the max rate of requests I see is 3. Far from 30.
2) The rate of my queue is 5 / second. Again, far from 30.
3) This error occurs even for the first cron job, when there is no
other tasks / cron running (and my app has almost no traffic)

Thanks again for your tips.
Marc




On Feb 26, 8:16 pm, Wooble  wrote:
> On Feb 26, 7:46 pm, Locke  wrote:
>
> > I have also seen this timeout error when trying to add to the task
> > queue. What is interesting to me is that it kills my process after 10
> > seconds, instead of the thirty seconds we supposedly are allowed.
>
> The 30 seconds are for a request that actually runs.  This message
> indicates your request handler didn't get run at all, because too many
> instances of your application were already running.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.