[google-appengine] Re: Updating Google App Engine datastore

[Tristan]

I haven't seen a framework that does data versioning like that.. but I
haven't looked very hard as I rolled my own abstraction layer with the
datastore...

Here's an excerpt from some stuff I wrote a while back and never got
around to publishing. It's a little outdated from what I do nowadays,
but it captures the essence of the framework that can do updating:

===

Entity Versions and Lazy Migration

Before diving into data versioning, let's quickly go over how we will
use the methods we created. First, let's create a BaseEntity object in
the datastore:

  ...

  BaseEntity myEntity = new BaseEntity();
  myEntity.setCreatedAt(new Date());
  myEntity.setUpdatedAt(myEntity.getCreatedAt());
  Key myEntityKey = datastore.put(myEntity.toEntity());

  ...

And that's how it's done. (Yes, we did not set version, more on that
later). Below is how we would read from the datastore (assuming we
have the entity key ready):

  ...

  Entity entity = datastore.get(myEntityKey);
  BaseEntity myEntity = new BaseEntity();
  entity = myEntity.fromEntity(entity);

  ...

After the call to fromEntity(Entity entity) above, myEntity is now
updated with the data from the datastore and is ready to be used. And
lastly, this is how we would update an entity in the datastore:

  ...

  Entity entity = datastore.get(myEntityKey);
  BaseEntity myEntity = new BaseEntity();
  entity = myEntity.fromEntity(entity);
  myEntity.setUpdatedAt(new Date());
  myEntityKey = datastore.put(myEntity.updateEntity(entity));

  ...

So you can see why we have toEntity() and updateEntity(Entity entity)
as separate methods. The updateEntity(Entity entity) does not touch
the entity key, therefore ensuring that when we execute a put to the
datastore, it will update the exact same entity instead of creating a
new one.

Now I have to confess. Our implementation of BaseEntity interface is
not quite correct. We are going to have to modify it in order to take
advantage of data versioning.

To illustrate how versioning works, let's assume that for some stupid
reason we want to store the createdAt date as a string! So we change
our implementation as follows:

public class BaseEntityImpl implements BaseEntity {

  /* variables */
  private String createdAt;
  private Date updatedAt;
  private Long version;

  ...

}

Ok, after making the above change we make sure that the interface and
the getters and setters are changed so that everything compiles. We
also change our fromEntity(Entity entity) method to reflect the new
state of things:

  ...

  @Override
  public Entity fromEntity(Entity entity){
setCreatedAt((String) entity.getProperty(BaseEntity.NcreatedAt));
setEntityKey(entity.getKey());
setUpdatedAt((Date) entity.getProperty(BaseEntity.NupdatedAt));
setVersion((Long) entity.getProperty(BaseEntity.Nversion));
return entity;
  }

  ...


But here's a catch! What if you have 10,000,000 entities already in
your production datastore where createdAt properties are stored as
Date objects? This is where data versioning becomes useful to do, what
I like to call, Lazy Migration (the idea is probably not new, so you
might know it as something else).

The concept behind lazy migration is to do the data migration from old
version to new version only when that data is actually read. Since we
are working with Google App Engine and we are paying for CPU cycles,
this may save you some money, especially if your schema happens to
change more than it should. Let's go back to our implementation and
set it up to support this concept.

First, we will go over what the implementation should have looked like
when createdAt was stored as Date:

public class BaseEntityImpl implements BaseEntity {

  /* variables */
  private Date createdAt;
  private Date updatedAt;
  private Long version = 1;

  ...

}

What we changed was the version number to 1. Now that we changed our
model to using String for storage, the implementation will look like:

public class BaseEntityImpl implements BaseEntity {

  /* variables */
  private String createdAt;
  private Date updatedAt;
  private Long version = 2;

  ...

}

And here is how we do the lazy migration inside fromEntity(Entity
entity):

  ...

  @Override
  public Entity fromEntity(Entity entity){
Object property;

Long version = ((Long) entity.getProperty(BaseEntity.Nversion));

// convert from old version (Date) to new version (String)
property = entity.getProperty(BaseEntity.NcreatedAt));
if (version.equals(1)){ // old version, do conversion
  setCreatedAt(((Date) property).toString());
  entity.setProperty(BaseEntity.NcreatedAt, getCreatedAt());
} else { // new version, no worries
  setCreatedAt((String) property));
}

setEntityKey(entity.getKey());
setUpdatedAt((Date) entity.getProperty(BaseEntity.NupdatedAt));

// we converted any old data to new data above, so set the new
version
entity.setProperty(BaseEntity.Nversion, getVersion());
return entity;
  }

 

[google-appengine] tasks and queues in google app engine

[Sandeep Arneja]

How do i cancel a task / queue which has already been scheduled? What
is the point of the task handler?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Updating Google App Engine datastore

[Víctor Mayoral]

Hey Tristan!

Thanks for your answer. I will check the docs again and take a look at
the low level API. The notification + trigger method seems pretty
intelligent i will also check that too.
But I was just wondering, isn't there something like a framework for
this types of jobs?.

Again, thanks

Víctor.


On 2 jun, 00:41, Tristan  wrote:
> Not sure how it would work in JDO but its simple to add properties in
> low-level datastore.
>
> I store my entities with a version property, when I update the entity,
> I change the version and change my code to either intialize a non-
> existing property on an old entity, or to delete a deprecated
> property. This happens lazily (only when the entity is actally used).
> You can also include a counter of how many entities were updated from
> old to new and have a flag trigger when 100% of updates are complete.
> Then in the next version of the code you can remove the updating
> method since all old entities were lazily updated. An alternative
> would be to set notification at 90% or some other percentage, and then
> trigger a task that cleans up the rest of the entities. I use this
> approach to keep my data consistent without the need for hugely
> intensive datastore scans to update when changes happen.
>
> Hope this will give you some ideas.
>
> Cheers!
>
> Tristan
>
> On Jun 1, 6:28 am, Víctor Mayoral  wrote:
>
>
>
> > Hello,
> > I've just an applications using GWT and GAE. After reading the docs
> > and doing some examples I decided to begin coding but soon I reach
> > something tricky.
>
> > My application data would be at the GAE datastore using JDO. I want to
> > assume
> > that the app "will live". Let me explain this:
> > The entities at the datastore will change. This means that some
> > properties would be added and some of them maybe removed what leaves
> > me with a ton of exceptions to handle. Knowing this, which should be
> > the way to update the datastore entities? One by one after a change
> > is
> > made? Should I handle exceptions and then change just the entitie
> > requested? Is there a way to do this cleaner?
>
> > I've been thinking about how to do this stuff with my actual
> > knowledge
> > and i think that the most logical way to proceed is get the object,
> > remove it from the database, create a new one based on this old
> > object
> > and then persist it again.
>
> > To sum up the question is about if there's a way to add a property to
> > an stored entitie in the datastore (GAE) easily.
>
> > I hope you to understand my lines. Any suggestion would be
> > appreciated.
>
> > Thanks,
>
> > Víctor.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Can't enable billing

[Kazuki Kyakuno]

thanks!
I'll wait to fix it.

2010/6/2 Jason (Google) :
> There was a substantial backlog in the billing pipeline starting late last
> week, which caused some discrepancies between the billing status that was
> reported in the Admin Console and the quotas that were actually being
> enforced. We're working on processing the backlog and preparing a fix for
> this so it shouldn't happen again going forward.
> If you still have specific billing issues, please use the billing issues
> form so you don't have to share your order information publicly.
> http://code.google.com/support/bin/request.py?contact_type=AppEngineBillingSupport
> - Jason
>
> On Mon, May 31, 2010 at 2:35 AM, kaz...@abars  wrote:
>>
>> Me too...
>> My another two apps have no problem.
>> But my one app can't set to billing mode.
>>
>> Billing history:
>> 2010-05-14 19:03:35 abars...@gmail.com   Billing Setup Successful
>> $0.00
>> 2010-05-14 19:02:30 abars...@gmail.com   Billing Setup Started
>>
>> but billing status is displayed as free.
>>
>> Billing Status: Free
>> This application is operating within the free quota levels. Enable
>> billing to grow beyond the free quotas. Learn more
>>
>> Billing Administrator: None
>> Since this application is operating within the free quota levels,
>> there isn't a billing administrator.
>> Current Balance: n/a Usage History
>> Resource Allocations:
>> ResourceBudget  Unit Cost   Paid Quota  Free Quota
>>  Total Daily Quota
>> CPU Timen/a  $0.10/CPU hour n/a  6.506.50 CPU hours
>> Bandwidth Out   n/a  $0.12/GByten/a  1.001.00 GBytes
>> Bandwidth Inn/a  $0.10/GByten/a  1.001.00 GBytes
>> Stored Data n/a  $0.005/GByte-day   n/a  1.001.00
>> GBytes
>> Recipients Emailed  n/a  $0.0001/Email  n/a  2,000.00
>>  2,000.00 Emails
>> Max Daily Budget:   n/a
>>
>>
>>
>>
>> On 5月29日, 午後3:38, Hugo Visser  wrote:
>> > At the moment, according to thebillingpage my app is operating in
>> > free mode. When I look at the quotas on the dashboard however it is
>> > using the quotas that I've set on thebillingpage, while again
>> > thebillingstatus is displayed as free.
>> >
>> > On May 29, 2:22 am, "Ikai L (Google)"  wrote:
>> >
>> >
>> >
>> > > It looks likebillingis a bit slow. The UI may say that you are not in
>> > > the
>> > > queue, but this is mislabeled. Whenbillingprocesses, your app will
>> > > automatically be updated to the correct status.
>> >
>> > > On Fri, May 28, 2010 at 1:44 PM, Ikai L (Google) 
>> > > wrote:
>> >
>> > > > I'm seeing the same issue. Let me follow up on this.
>> >
>> > > > On Fri, May 28, 2010 at 12:04 PM, G 
>> > > > wrote:
>> >
>> > > >> I'm trying to enablebilling, and it seems to be working - I check
>> > > >> out
>> > > >> and then the status says it's updating for 15 or so minutes, but
>> > > >> after
>> > > >> that it goes back to free with the "EnableBilling" button visible.
>> >
>> > > >> Is there some extra step I should be doing?
>> >
>> > > >> Thanks
>> >
>> > > >> G
>> >
>> > > >> --
>> > > >> You received this message because you are subscribed to the Google
>> > > >> Groups
>> > > >> "Google App Engine" group.
>> > > >> To post to this group, send email to
>> > > >> google-appeng...@googlegroups.com.
>> > > >> To unsubscribe from this group, send email to
>> > > >>
>> > > >> google-appengine+unsubscr...@googlegroups.com> > > >> e...@googlegroups.com>
>> > > >> .
>> > > >> For more options, visit this group at
>> > > >>http://groups.google.com/group/google-appengine?hl=en.
>> >
>> > > > --
>> > > > Ikai Lan
>> > > > Developer Programs Engineer, Google App Engine
>> > > > Blog:http://googleappengine.blogspot.com
>> > > > Twitter:http://twitter.com/app_engine
>> > > > Reddit:http://www.reddit.com/r/appengine
>> >
>> > > --
>> > > Ikai Lan
>> > > Developer Programs Engineer, Google App Engine
>> > > Blog:http://googleappengine.blogspot.com
>> > > Twitter:http://twitter.com/app_engine
>> > > Reddit:http://www.reddit.com/r/appengine
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appeng...@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegrou

[google-appengine] Re: HTTP Delete from Chrome not working

[pkeane]

Anyone else have this same problem or know a fix?  This seems to be
pretty much of a deal-breaker for building REST-based interfaces on
App Engine.

--Peter Keane

On May 15, 10:23 pm, pkeane  wrote:
> Hi All-
>
> I have seen mention of this same problem 
> here:http://stackoverflow.com/questions/2398012/how-to-use-http-method-del...
>
> and 
> here:http://www.mail-archive.com/google-appengine-j...@googlegroups.com/ms...
>
> I am using javascipt to send a DELETE request to a specific URL.  It
> works (properly deletes the resource) when I use the SDK locally using
> both Chrome and Firefox.  Additionally, it works properly when I use
> Firefox against the production app itself.  When I use Chrome against
> the production app, I get a 400 error.  Nothing shows up in the log
> (no record of a request at all) so it is obviously getting the 400
> before reaching application code.
>
> Here's the actual request and request headers from Firefox (gotten
> from Firebug) (this works):
>
> DELETEhttp://meta-box.appspot.com/item/aghtZXRhLWJveHIMCxIESXRlbRjBuwEM
>
> Host: meta-box.appspot.com
>
> User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.3) Gecko/
> 20100402 Namoroka/3.6.3
>
> Accept: */*
>
> Accept-Language: en-us,en;q=0.5
>
> Accept-Encoding: gzip,deflate
>
> Accept-Charset: UTF-8,*
>
> Keep-Alive: 115
>
> Connection: keep-alive
>
> X-Requested-With: XMLHttpRequest
>
> Referer:http://meta-box.appspot.com/items
>
> Cookie:
> ACSID=AJKiYcFf9c4ImzqZepfxUjGrl9M3nl8FdFP_xh14gqhrn3QZFvAO3TqJX14Z2AFNX6AtTi3iXjQKD5yvVUlgfQBZBjZ_aJhkJUOyuW4y0mt7QFkgciufavVbWbzM_4HpR_4Tr9d_aWumF2cGZ1Av1V9wF1Y5y3Y4j7duOPJuBuIPaFA7nZ8NoNK8kD41CNnmo74i6ULeGtczfQ2kxprOrazduU6dwzMIu0UQ94Rmwf9l0JKWH8jASvRp63u4as0Qg-
> Zo0NMO96Qi8zEGoJwJyb7pFyup-
> NlOo6JinHV68Q2TLkrWCxvdSosi21CFER7jAD0xJpCSd3qQ62gQPbaH09QiVkte7qbWcQ-
> fd3ENnmxVBpzD_u2UaxpS6XP4hA2MkWUcLcaye1NQZlkDW0vm7A67LX0iWJIn_YS7bmhS8cyJSkB71QUqXEhUcbDKec99sQFpcPpQeuMcgyHSLofzv9iu-
> OafbaikAMtRP-C34BavqLZb1cmsZjs
>
> And from Chrome (gotten from Developer Tools) (this does not work):
>
> Request URL:http://meta-box.appspot.com/item/
> aghtZXRhLWJveHIMCxIESXRlbRjxqwEM
> Request Method:DELETE
> Status Code:400 Bad Request
> Request Headers
> Accept:*/*
> Cache-Control:max-age=0
> Content-Type:application/xml
> Origin:http://meta-box.appspot.com
> Referer:http://meta-box.appspot.com/items
> User-Agent:Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/533.2
> (KHTML, like Gecko) Chrome/5.0.342.9 Safari/533.2
> X-Requested-With:XMLHttpRequest
> Request Payload
>  undefined
> Response Headers
> Content-Length:1350
> Content-Type:text/html; charset=UTF-8
> Date:Sun, 16 May 2010 03:19:56 GMT
> Server:GFE/2.0
>
> thanks-
> PeterKeane
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group 
> athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Appstats for Java not working

[Thomas Wiradikusuma]

Hi guys, I followed instructions from 
http://code.google.com/appengine/docs/java/tools/appstats.html,
basically just copy-pasting the whole thing. When I tried from Chrome,
after login using my one-and-only admin account, I got "Error: User
not in required role". Trying from Safari gave me "Error: NOT_FOUND".

Anybody have an idea? Thanks in advance.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: DeadlineExceeded on cold hits.

[Waleed Abdulla]

+1 and it's generally much higher on all requests, not only cold requests.



On Tue, Jun 1, 2010 at 7:21 PM, Brandon Thomson  wrote:

> Yes, we are also seeing this. Usually the call at the end of the
> traceback is something related to the filesystem. I think this is
> caused by the increasingly poor datastore performance.
>
> On Jun 1, 6:16 pm, Dave Peck  wrote:
> > Hi,
> >
> > In the past week, I've seen an alarming number of DeadlineExceeded
> > exceptions on cold hits to my applications.
> >
> > Most of the stack traces are shallow -- things blow up well before my
> > code is hit. Seehttp://pastie.org/988269for a stack trace.
> >
> > The `bootstrap.py` file is more-or-less a direct copy of the `main.py`
> > from Rietveld.
> >
> > Can someone on the App Engine team please point me in the right
> > direction here? This is a big change in GAE's behavior in the past
> > week, and it is affecting many of my applications (citygoround which
> > has been in production for half a year; code-doctor which is under
> > development, etc.)
> >
> > Cheers,
> > Dave Peck
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: DeadlineExceeded on cold hits.

[Brandon Thomson]

Yes, we are also seeing this. Usually the call at the end of the
traceback is something related to the filesystem. I think this is
caused by the increasingly poor datastore performance.

On Jun 1, 6:16 pm, Dave Peck  wrote:
> Hi,
>
> In the past week, I've seen an alarming number of DeadlineExceeded
> exceptions on cold hits to my applications.
>
> Most of the stack traces are shallow -- things blow up well before my
> code is hit. Seehttp://pastie.org/988269for a stack trace.
>
> The `bootstrap.py` file is more-or-less a direct copy of the `main.py`
> from Rietveld.
>
> Can someone on the App Engine team please point me in the right
> direction here? This is a big change in GAE's behavior in the past
> week, and it is affecting many of my applications (citygoround which
> has been in production for half a year; code-doctor which is under
> development, etc.)
>
> Cheers,
> Dave Peck

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Unscheduled downtime/problems lately

[Brandon Thomson]

We are also experiencing very high query latency, sometimes enough
that a non-compound query that matches one datastore entity will not
complete after 30s and all our available serving instances get eaten
up. We're going to try adding deadlines for all queries today and see
if that saves our application instances.

On Jun 1, 7:22 pm, Millisecond  wrote:
> Since I posted that my dashboard has been wonky and the errors
> counting _backwards_.
>
> So, there are only ~2k errors at the moment, but there definitely were
> ~3500 when I first posted.
>
> Really don't think I'm going crazy but I do feel like it with the
> dashboard at times...
>
> -C
>
> On Jun 1, 3:41 pm, Millisecond  wrote:
>
>
>
> > Yes, app id noticeorange.  3500+ latency related errors today in 2
> > major and ~10 minor spikes.
>
> > Most days since the 25th have had 5k+ errors, with several 20k+.
>
> > It's usually related to ms/req spikes coinciding with the high latency
> > spikes on the query latency graph.
>
> > -C
>
> > On Jun 1, 3:34 pm, "Ikai L (Google)"  wrote:
>
> > > The post-mortem should address the outage as well as the latency leading 
> > > up
> > > to the outage.
>
> > > We're keeping an eye on latency now. Are you experience latency in your
> > > application?
>
> > > On Tue, Jun 1, 2010 at 3:31 PM, Millisecond  wrote:
> > > > Thanks Ikai, I look forward to reading the post-mortem.  The last one
> > > > was indeed very good.
>
> > > > Will the post-mortem address the dramatically increased latency since
> > > > the 25th?  It's ongoing and has already caused tens of thousands of
> > > > errors on our site alone.  As far as I can tell, there's been no
> > > > official communication regarding that.
>
> > > > And it's still continuing with 1500ms+ for a lot of today:
>
> > > >http://code.google.com/status/appengine/detail/datastore/2010/06/01#a...
>
> > > > -C
>
> > > > On Jun 1, 3:16 pm, "Ikai L (Google)"  wrote:
> > > > > I just wanted to let you guys know to hang in there. We're working on 
> > > > > a
> > > > > post-mortem describing what went wrong and steps we are taking to 
> > > > > prevent
> > > > > this from happening again. I don't have an ETA for this yet, but we've
> > > > done
> > > > > this before (
> > > >http://groups.google.com/group/google-appengine/browse_thread/thread/...)
> > > > > and are committed to as much transparency as we can with regards to 
> > > > > these
> > > > > issues with you guys.
>
> > > > > On Tue, Jun 1, 2010 at 2:59 PM, Mark  wrote:
> > > > > > +1 as worried, I'm investing time in app engine and this is quite
> > > > > > discouraging to say the least! How often does this happen? (I don't
> > > > > > have a live app yet), but should I abandon app engine now before
> > > > > > getting myself in trouble?
>
> > > > > > On May 27, 1:32 pm, Jody Belka  wrote:
> > > > > > > And what do you know, no-one from Google has made any response
> > > > whatsoever
> > > > > > to
> > > > > > > this thread. And yet we know they are around, they occasionally do
> > > > write
> > > > > > > messages after all. Very disappointing.
>
> > > > > > > On 25 May 2010 21:51, Waleed Abdulla  wrote:
>
> > > > > > > > It's definitely worrisome. My app is down at the moment, my task
> > > > queue
> > > > > > > > backlog is at 4 days, and I'm very disappointed.
>
> > > > > > > > On Tue, May 25, 2010 at 12:46 PM, Flips 
> > > > > > > > 
> > > > > > wrote:
>
> > > > > > > >> These latency spikes are really annoying. Will the business app
> > > > engine
> > > > > > > >> edition use the same bigtable cluster as we do?
>
> > > > > > > >> On May 25, 9:03 pm, James  wrote:
> > > > > > > >> > +1
>
> > > > > > > >> > On May 25, 10:13 am, Jody Belka  wrote:> From
> > > > > > reading
> > > > > > > >> this list, there appear to have been quite few incidents lately
> > > > > > > >> > > where multiple sites start reporting errors, with the 
> > > > > > > >> > > status
> > > > page
> > > > > > > >> showing
>
> > > > > > > >> > ...
>
> > > > > > > >> --
> > > > > > > >> You received this message because you are subscribed to the 
> > > > > > > >> Google
> > > > > > Groups
> > > > > > > >> "Google App Engine" group.
> > > > > > > >> To post to this group, send email to
> > > > > > google-appeng...@googlegroups.com.
> > > > > > > >> To unsubscribe from this group, send email to
> > > > > > > >> google-appengine+unsubscr...@googlegroups.com > > > > > > >>  e...@googlegroups.com> > > > e...@googlegroups.com> > > > > > e...@googlegroups.com>
> > > > > > > >> .
> > > > > > > >> For more options, visit this group at
> > > > > > > >>http://groups.google.com/group/google-appengine?hl=en.
>
> > > > > > > >  --
> > > > > > > > You received this message because you are subscribed to the 
> > > > > > > > Google
> > > > > > Groups
> > > > > > > > "Google App Engine" group.
> > > > > > > > To post to this group, send email to
> > > > google-appengine@googlegroups.com
> > > > > > .
> > > > > > > > To unsubscribe from this group, send email to
> > > > > > 

[google-appengine] 入れ込み

[Nariya Takemura]

今ドリコムの人から電話ありました


・入れ込み作業して欲しい
・終わったら、日吉さんとアプリゲットのメアドまでメールで連絡が欲しい

という事です。
今までのメールでついてた




Platinum Egg Inc.
   Nariya Takemura
President
takem...@platinum-egg.com
twitter:@nariya
skype:myr_myr


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Tasks Queues still manual in 1.3.4?

[hawkett]

The 'mac only' theory on the app engine launcher was a tad out of
date :) I was looking at the SDK download page (which only lists it
explicitly for mac)... sorry about that.

On Jun 1, 8:28 pm, Greg Tracy  wrote:
> I'm using the App Engine Launcher on XP and it works for me.
>
> On May 31, 7:24 pm, hawkett  wrote:
>
>
>
> > Slight possibility - looks like both Ryan and Nick are using the app
> > engine launcher, which is a mac only application that contains a copy
> > of the SDK. Are any of the people reporting it working using the app
> > engine launcher? I'm on mac, but is has been a while since I actually
> > ran my apps with the launcher - choosing instead to download to
> > download the linux SDK.  You guys could try that and see if you notice
> > any improvement.  Perhaps the SDK inside the launcher isn't quite
> > right. Unlikely, but something to test out.  Cheers,
>
> > Colin
>
> > On May 29, 6:49 am, Nick  wrote:
>
> > > I'm in California (7-8 hours behind UTC) and also have Ryan's problem.
> > > Tasks don't run automatically on the dev server, which is very
> > > frustrating and as Ryan reported I still see the message "Tasks will
> > > not run automatically" in the SDK console.
>
> > > I'm using Python and the GoogleAppEngineLauncher 1.3.4.794, SDK
> > > version: release: "1.3.4", timestamp: 1272392128, api_versions: ['1'].
>
> > > Any thoughts on why some of us aren't seeing this new feature?
>
> > > Thanks,
> > > Nick
>
> > > On May 28, 8:50 am, Tim Hoffman  wrote:
>
> > > > So am I (8 hours) and auto task running works fine,
>
> > > > Rgds
>
> > > > T
>
> > > > On May 28, 10:32 pm, djidjadji  wrote:
>
> > > > > I'm ahead a few hours of UTC and for me the automatic task queue 
> > > > > works.
> > > > > I have not modified the 1.3.4 SDK code.
>
> > > > > 2010/5/27 Kenneth :
>
> > > > > > The problem with the task not running automatically is because of 
> > > > > > this
> > > > > > bug:
>
> > > > > >http://code.google.com/p/googleappengine/issues/detail?id=2508
>
> > > > > > Basically it works fine in Mountain View, California, but not for
> > > > > > anyone who is ahead of UTC since the eta will be in the future.
>
> > > > > > Solution as described in the bug report is replace line 414 in
> > > > > > taskqueue.py:
>
> > > > > > def __determine_eta(eta=None, countdown=None,
> > > > > > now=datetime.datetime.now)
> > > > > > with
> > > > > > def __determine_eta(eta=None, countdown=None,
> > > > > > now=datetime.datetime.utcnow)
>
> > > > > > Hope that helps.
>
> > > > > > On May 22, 9:10 pm, andy stevko  wrote:
> > > > > >> I see auto run tasks all the time in my dev environment. I thought 
> > > > > >> the docs
> > > > > >> just were not up to date. I'm using the latest eclipse plugin.
>
> > > > > >> On May 22, 2010 12:42 PM, "Ryan Weber"  
> > > > > >> wrote:
>
> > > > > >> Strange, because that's not what is happening for me. I have to 
> > > > > >> still
> > > > > >> manually run them. Can anyone think of any reason why mine would 
> > > > > >> still be
> > > > > >> manual? When I saw all the features of the 1.3.4 release, I was 
> > > > > >> most looking
> > > > > >> forward to the auto-run of tasks, so I wouldn't have to click 
> > > > > >> "run" every
> > > > > >> time, but alas, no luck yet...

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Get, set, notify services

[Mitja Felicijan]

Thanks for the quick reply. REST api or some sort of RPC services will
sort my problem with get or set device. But the problem now is that I
have client GUI app running in browser. So I would probably need to
write some sort of Comet code on the browser side. And everything
happening on the hardware side must have effect in the app running in
browser without refreshing. I must also have in mind that the browser
will be running for couple of days constantly. So memory leakages will
probably be a problem.

Architecture of the system is like this:

Lamps (with remote control capabilities) <> embedded pc with lan
<> GAE services <> UI written in HTML, JS

A while ago I solved this problem with writing a socket daemon and
server was than able to connect to socket and communication was
instant. But Sockets are not supported in GAE as far as I understand.
And also Websockets are not fully supported.

I hope this explains my situation a bit more. Thanks in advance.


On Jun 2, 12:41 am, "Ikai L (Google)"  wrote:
> There may be some delay in the time between sending an XMPP message and it
> being processed by your application, but for all practical purposes it
> should be acceptable. You could always build an HTTP REST API and just call
> that directly - this would guarantee that the action is invoked as soon as
> it is called.
>
> On Tue, Jun 1, 2010 at 8:51 AM, Mitja Felicijan
> wrote:
>
>
>
> > Hi.
>
> > I need to develop 3 services for a personal project. Idea in doing
> > this via google app engine is interesting. But I have couple of
> > questions.
>
> > My services will receive data from external devices and their states
> > will be stored in database. On the client side a web application will
> > do some operations with this devices on the hardware side. In my case
> > I would use google app engine as a middle-ware. But the main problem
> > that occurred to is how will I communicate with notify service? I've
> > read this sort of things can be done through XMPP that is supported
> > under google app engine.
>
> > Do you thing it is possible and reliable if I use it in such fashion?
> > Do you also thing such software will be reliable and fast? I can not
> > afford to have lag.
>
> > Thnx in advance.
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
>
> --
> Ikai Lan
> Developer Programs Engineer, Google App Engine
> Blog:http://googleappengine.blogspot.com
> Twitter:http://twitter.com/app_engine
> Reddit:http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Updating a detached object which has a collection which has another collection

[Sandeep Arneja]

I am update the collection field of a detached object and persisting
it. Upon view the object i see that it still has the old items in its
collection.

@PersistenceCapable(detachable="true")
@FetchGroup(name="fet_num", member...@persistent(name="numbers")})
public class DirectoryBean {

public DirectoryBean(String nameOfCity, ArrayList
numbers) {
super();
this.nameOfCity = nameOfCity;
this.numbers = numbers;
}

@Persistent
@PrimaryKey
private String nameOfCity;

@Persistent
@Element(dependent = "true")
private ArrayList numbers;


@PersistenceCapable(detachable = "true")
@FetchGroup(name="fet_own", member...@persistent(name="owners")})
public class NumberBean {

public NumberBean(String areaCode, String num) {
super();
this.areaCode = areaCode;
this.num = num;
this.owners = new ArrayList();
}

@PrimaryKey
@Persistent(valueStrategy = IdGeneratorStrategy.IDENTITY)
private Key key;

@Persistent
private String areaCode;

@Persistent
private String num;

@Persistent
@Element(dependent = "true")
private ArrayList owners;


@PersistenceCapable(detachable = "true")
public class OwnerBean {

public OwnerBean(String fname, String lname) {
super();
this.fname = fname;
this.lname = lname;
}

@PrimaryKey
@Persistent(valueStrategy = IdGeneratorStrategy.IDENTITY)
private Key key;

@Persistent
private String fname;

@Persistent
private String lname;



PersistenceManager pm = PMF.get().getPersistenceManager();
pm.getFetchPlan().addGroup("fet_own").addGroup("fet_num");
pm.getFetchPlan().setMaxFetchDepth(-1);

pm.getFetchPlan().setDetachmentOptions(pm.getFetchPlan().DETACH_LOAD_FIELDS);
DirectoryBean dirBeanInstance,detachedDirBeanInstance=null;
try{
Key k = 
KeyFactory.createKey(DirectoryBean.class.getSimpleName(),
"lake City");
dirBeanInstance = 
pm.getObjectById(DirectoryBean.class,k);
detachedDirBeanInstance = 
pm.detachCopy(dirBeanInstance);
}catch(Exception e)
{
e.printStackTrace();
}finally
{
pm.close();
}

 ArrayList newNumBeans = new
ArrayList();
newNumBeans.add(new NumberBean("555", "777"));
detachedDirBeanInstance.setNumbers(newNumBeans);

pm = PMF.get().getPersistenceManager();
try{
pm.makePersistent(detachedDirBeanInstance);
}catch(Exception e)
{
e.printStackTrace();
}finally
{
pm.close();
}

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Unscheduled downtime/problems lately

[Millisecond]

Since I posted that my dashboard has been wonky and the errors
counting _backwards_.

So, there are only ~2k errors at the moment, but there definitely were
~3500 when I first posted.

Really don't think I'm going crazy but I do feel like it with the
dashboard at times...

-C

On Jun 1, 3:41 pm, Millisecond  wrote:
> Yes, app id noticeorange.  3500+ latency related errors today in 2
> major and ~10 minor spikes.
>
> Most days since the 25th have had 5k+ errors, with several 20k+.
>
> It's usually related to ms/req spikes coinciding with the high latency
> spikes on the query latency graph.
>
> -C
>
> On Jun 1, 3:34 pm, "Ikai L (Google)"  wrote:
>
>
>
> > The post-mortem should address the outage as well as the latency leading up
> > to the outage.
>
> > We're keeping an eye on latency now. Are you experience latency in your
> > application?
>
> > On Tue, Jun 1, 2010 at 3:31 PM, Millisecond  wrote:
> > > Thanks Ikai, I look forward to reading the post-mortem.  The last one
> > > was indeed very good.
>
> > > Will the post-mortem address the dramatically increased latency since
> > > the 25th?  It's ongoing and has already caused tens of thousands of
> > > errors on our site alone.  As far as I can tell, there's been no
> > > official communication regarding that.
>
> > > And it's still continuing with 1500ms+ for a lot of today:
>
> > >http://code.google.com/status/appengine/detail/datastore/2010/06/01#a...
>
> > > -C
>
> > > On Jun 1, 3:16 pm, "Ikai L (Google)"  wrote:
> > > > I just wanted to let you guys know to hang in there. We're working on a
> > > > post-mortem describing what went wrong and steps we are taking to 
> > > > prevent
> > > > this from happening again. I don't have an ETA for this yet, but we've
> > > done
> > > > this before (
> > >http://groups.google.com/group/google-appengine/browse_thread/thread/...)
> > > > and are committed to as much transparency as we can with regards to 
> > > > these
> > > > issues with you guys.
>
> > > > On Tue, Jun 1, 2010 at 2:59 PM, Mark  wrote:
> > > > > +1 as worried, I'm investing time in app engine and this is quite
> > > > > discouraging to say the least! How often does this happen? (I don't
> > > > > have a live app yet), but should I abandon app engine now before
> > > > > getting myself in trouble?
>
> > > > > On May 27, 1:32 pm, Jody Belka  wrote:
> > > > > > And what do you know, no-one from Google has made any response
> > > whatsoever
> > > > > to
> > > > > > this thread. And yet we know they are around, they occasionally do
> > > write
> > > > > > messages after all. Very disappointing.
>
> > > > > > On 25 May 2010 21:51, Waleed Abdulla  wrote:
>
> > > > > > > It's definitely worrisome. My app is down at the moment, my task
> > > queue
> > > > > > > backlog is at 4 days, and I'm very disappointed.
>
> > > > > > > On Tue, May 25, 2010 at 12:46 PM, Flips 
> > > > > wrote:
>
> > > > > > >> These latency spikes are really annoying. Will the business app
> > > engine
> > > > > > >> edition use the same bigtable cluster as we do?
>
> > > > > > >> On May 25, 9:03 pm, James  wrote:
> > > > > > >> > +1
>
> > > > > > >> > On May 25, 10:13 am, Jody Belka  wrote:> From
> > > > > reading
> > > > > > >> this list, there appear to have been quite few incidents lately
> > > > > > >> > > where multiple sites start reporting errors, with the status
> > > page
> > > > > > >> showing
>
> > > > > > >> > ...
>
> > > > > > >> --
> > > > > > >> You received this message because you are subscribed to the 
> > > > > > >> Google
> > > > > Groups
> > > > > > >> "Google App Engine" group.
> > > > > > >> To post to this group, send email to
> > > > > google-appeng...@googlegroups.com.
> > > > > > >> To unsubscribe from this group, send email to
> > > > > > >> google-appengine+unsubscr...@googlegroups.com > > > > > >>  e...@googlegroups.com> > > e...@googlegroups.com> > > > > e...@googlegroups.com>
> > > > > > >> .
> > > > > > >> For more options, visit this group at
> > > > > > >>http://groups.google.com/group/google-appengine?hl=en.
>
> > > > > > >  --
> > > > > > > You received this message because you are subscribed to the Google
> > > > > Groups
> > > > > > > "Google App Engine" group.
> > > > > > > To post to this group, send email to
> > > google-appengine@googlegroups.com
> > > > > .
> > > > > > > To unsubscribe from this group, send email to
> > > > > > > google-appengine+unsubscr...@googlegroups.com > > > > > >  e...@googlegroups.com> > > e...@googlegroups.com> > > > > e...@googlegroups.com>
> > > > > > > .
> > > > > > > For more options, visit this group at
> > > > > > >http://groups.google.com/group/google-appengine?hl=en.
>
> > > > > --
> > > > > You received this message because you are subscribed to the Google
> > > Groups
> > > > > "Google App Engine" group.
> > > > > To post to this group, send email to google-appengine@googlegroups.com
> > > .
> > > > > To unsubscribe from this group, send email to
> > > > > google-appengine+unsubscr...@googlegroups.com >

Re: [google-appengine] 403 error - automated queries

[Ikai L (Google)]

Are the gadgets making requests from App Engine? Or are they calling
makeRequest to App Engine which is in turn using the GData API?

On Sun, May 23, 2010 at 5:56 PM, mike  wrote:

> Hi, I have 3 gadgets that retrieve data from Google base. the gadgets
> are hosted on App Enginer. About a week ago, the gadgets started
> getting 403 errors and the gadgets are
> basically broken. I have not had a problem over the last year and
> longer. The error reads:
>
> "We're sorry..but your computer or network may be sending automated
> queries. To protect our users, we can't process your request right
> now.
> http://www.google.com/support/bin/answer.py?answer=86640";
>
>  I evaluated the traffic and can not identify a source of automated
> requests. There is also no evidence
> of a virus.
>
> How can I get the account reset? At this point I have lost a lot of
> users. Here is a link to the sites having the problem (which feed
> gadgets). For some reason, sometimes the first query shows results but
> after that the 403 error shows up.
>
> http://appdiner.appspot.com
> http://basestuff.appspot.com
> http://searchhomesales.appspot.com/
>
> Thanks,
> Mike J.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Get, set, notify services

[Ikai L (Google)]

There may be some delay in the time between sending an XMPP message and it
being processed by your application, but for all practical purposes it
should be acceptable. You could always build an HTTP REST API and just call
that directly - this would guarantee that the action is invoked as soon as
it is called.

On Tue, Jun 1, 2010 at 8:51 AM, Mitja Felicijan
wrote:

> Hi.
>
> I need to develop 3 services for a personal project. Idea in doing
> this via google app engine is interesting. But I have couple of
> questions.
>
> My services will receive data from external devices and their states
> will be stored in database. On the client side a web application will
> do some operations with this devices on the hardware side. In my case
> I would use google app engine as a middle-ware. But the main problem
> that occurred to is how will I communicate with notify service? I've
> read this sort of things can be done through XMPP that is supported
> under google app engine.
>
> Do you thing it is possible and reliable if I use it in such fashion?
> Do you also thing such software will be reliable and fast? I can not
> afford to have lag.
>
> Thnx in advance.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Updating Google App Engine datastore

[Tristan]

Not sure how it would work in JDO but its simple to add properties in
low-level datastore.

I store my entities with a version property, when I update the entity,
I change the version and change my code to either intialize a non-
existing property on an old entity, or to delete a deprecated
property. This happens lazily (only when the entity is actally used).
You can also include a counter of how many entities were updated from
old to new and have a flag trigger when 100% of updates are complete.
Then in the next version of the code you can remove the updating
method since all old entities were lazily updated. An alternative
would be to set notification at 90% or some other percentage, and then
trigger a task that cleans up the rest of the entities. I use this
approach to keep my data consistent without the need for hugely
intensive datastore scans to update when changes happen.

Hope this will give you some ideas.

Cheers!

Tristan

On Jun 1, 6:28 am, Víctor Mayoral  wrote:
> Hello,
> I've just an applications using GWT and GAE. After reading the docs
> and doing some examples I decided to begin coding but soon I reach
> something tricky.
>
> My application data would be at the GAE datastore using JDO. I want to
> assume
> that the app "will live". Let me explain this:
> The entities at the datastore will change. This means that some
> properties would be added and some of them maybe removed what leaves
> me with a ton of exceptions to handle. Knowing this, which should be
> the way to update the datastore entities? One by one after a change
> is
> made? Should I handle exceptions and then change just the entitie
> requested? Is there a way to do this cleaner?
>
> I've been thinking about how to do this stuff with my actual
> knowledge
> and i think that the most logical way to proceed is get the object,
> remove it from the database, create a new one based on this old
> object
> and then persist it again.
>
> To sum up the question is about if there's a way to add a property to
> an stored entitie in the datastore (GAE) easily.
>
> I hope you to understand my lines. Any suggestion would be
> appreciated.
>
> Thanks,
>
> Víctor.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Unscheduled downtime/problems lately

[Millisecond]

Yes, app id noticeorange.  3500+ latency related errors today in 2
major and ~10 minor spikes.

Most days since the 25th have had 5k+ errors, with several 20k+.

It's usually related to ms/req spikes coinciding with the high latency
spikes on the query latency graph.

-C

On Jun 1, 3:34 pm, "Ikai L (Google)"  wrote:
> The post-mortem should address the outage as well as the latency leading up
> to the outage.
>
> We're keeping an eye on latency now. Are you experience latency in your
> application?
>
>
>
>
>
> On Tue, Jun 1, 2010 at 3:31 PM, Millisecond  wrote:
> > Thanks Ikai, I look forward to reading the post-mortem.  The last one
> > was indeed very good.
>
> > Will the post-mortem address the dramatically increased latency since
> > the 25th?  It's ongoing and has already caused tens of thousands of
> > errors on our site alone.  As far as I can tell, there's been no
> > official communication regarding that.
>
> > And it's still continuing with 1500ms+ for a lot of today:
>
> >http://code.google.com/status/appengine/detail/datastore/2010/06/01#a...
>
> > -C
>
> > On Jun 1, 3:16 pm, "Ikai L (Google)"  wrote:
> > > I just wanted to let you guys know to hang in there. We're working on a
> > > post-mortem describing what went wrong and steps we are taking to prevent
> > > this from happening again. I don't have an ETA for this yet, but we've
> > done
> > > this before (
> >http://groups.google.com/group/google-appengine/browse_thread/thread/...)
> > > and are committed to as much transparency as we can with regards to these
> > > issues with you guys.
>
> > > On Tue, Jun 1, 2010 at 2:59 PM, Mark  wrote:
> > > > +1 as worried, I'm investing time in app engine and this is quite
> > > > discouraging to say the least! How often does this happen? (I don't
> > > > have a live app yet), but should I abandon app engine now before
> > > > getting myself in trouble?
>
> > > > On May 27, 1:32 pm, Jody Belka  wrote:
> > > > > And what do you know, no-one from Google has made any response
> > whatsoever
> > > > to
> > > > > this thread. And yet we know they are around, they occasionally do
> > write
> > > > > messages after all. Very disappointing.
>
> > > > > On 25 May 2010 21:51, Waleed Abdulla  wrote:
>
> > > > > > It's definitely worrisome. My app is down at the moment, my task
> > queue
> > > > > > backlog is at 4 days, and I'm very disappointed.
>
> > > > > > On Tue, May 25, 2010 at 12:46 PM, Flips 
> > > > wrote:
>
> > > > > >> These latency spikes are really annoying. Will the business app
> > engine
> > > > > >> edition use the same bigtable cluster as we do?
>
> > > > > >> On May 25, 9:03 pm, James  wrote:
> > > > > >> > +1
>
> > > > > >> > On May 25, 10:13 am, Jody Belka  wrote:> From
> > > > reading
> > > > > >> this list, there appear to have been quite few incidents lately
> > > > > >> > > where multiple sites start reporting errors, with the status
> > page
> > > > > >> showing
>
> > > > > >> > ...
>
> > > > > >> --
> > > > > >> You received this message because you are subscribed to the Google
> > > > Groups
> > > > > >> "Google App Engine" group.
> > > > > >> To post to this group, send email to
> > > > google-appeng...@googlegroups.com.
> > > > > >> To unsubscribe from this group, send email to
> > > > > >> google-appengine+unsubscr...@googlegroups.com > > > > >>  e...@googlegroups.com> > e...@googlegroups.com> > > > e...@googlegroups.com>
> > > > > >> .
> > > > > >> For more options, visit this group at
> > > > > >>http://groups.google.com/group/google-appengine?hl=en.
>
> > > > > >  --
> > > > > > You received this message because you are subscribed to the Google
> > > > Groups
> > > > > > "Google App Engine" group.
> > > > > > To post to this group, send email to
> > google-appengine@googlegroups.com
> > > > .
> > > > > > To unsubscribe from this group, send email to
> > > > > > google-appengine+unsubscr...@googlegroups.com > > > > >  e...@googlegroups.com> > e...@googlegroups.com> > > > e...@googlegroups.com>
> > > > > > .
> > > > > > For more options, visit this group at
> > > > > >http://groups.google.com/group/google-appengine?hl=en.
>
> > > > --
> > > > You received this message because you are subscribed to the Google
> > Groups
> > > > "Google App Engine" group.
> > > > To post to this group, send email to google-appengine@googlegroups.com
> > .
> > > > To unsubscribe from this group, send email to
> > > > google-appengine+unsubscr...@googlegroups.com > > >  e...@googlegroups.com> > e...@googlegroups.com>
> > > > .
> > > > For more options, visit this group at
> > > >http://groups.google.com/group/google-appengine?hl=en.
>
> > > --
> > > Ikai Lan
> > > Developer Programs Engineer, Google App Engine
> > > Blog:http://googleappengine.blogspot.com
> > > Twitter:http://twitter.com/app_engine
> > > Reddit:http://www.reddit.com/r/appengine
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to

Re: [google-appengine] Re: Unscheduled downtime/problems lately

[Ikai L (Google)]

The post-mortem should address the outage as well as the latency leading up
to the outage.

We're keeping an eye on latency now. Are you experience latency in your
application?

On Tue, Jun 1, 2010 at 3:31 PM, Millisecond  wrote:

> Thanks Ikai, I look forward to reading the post-mortem.  The last one
> was indeed very good.
>
> Will the post-mortem address the dramatically increased latency since
> the 25th?  It's ongoing and has already caused tens of thousands of
> errors on our site alone.  As far as I can tell, there's been no
> official communication regarding that.
>
> And it's still continuing with 1500ms+ for a lot of today:
>
> http://code.google.com/status/appengine/detail/datastore/2010/06/01#ae-trust-detail-datastore-query-latency
>
> -C
>
> On Jun 1, 3:16 pm, "Ikai L (Google)"  wrote:
> > I just wanted to let you guys know to hang in there. We're working on a
> > post-mortem describing what went wrong and steps we are taking to prevent
> > this from happening again. I don't have an ETA for this yet, but we've
> done
> > this before (
> http://groups.google.com/group/google-appengine/browse_thread/thread/...)
> > and are committed to as much transparency as we can with regards to these
> > issues with you guys.
> >
> >
> >
> >
> >
> > On Tue, Jun 1, 2010 at 2:59 PM, Mark  wrote:
> > > +1 as worried, I'm investing time in app engine and this is quite
> > > discouraging to say the least! How often does this happen? (I don't
> > > have a live app yet), but should I abandon app engine now before
> > > getting myself in trouble?
> >
> > > On May 27, 1:32 pm, Jody Belka  wrote:
> > > > And what do you know, no-one from Google has made any response
> whatsoever
> > > to
> > > > this thread. And yet we know they are around, they occasionally do
> write
> > > > messages after all. Very disappointing.
> >
> > > > On 25 May 2010 21:51, Waleed Abdulla  wrote:
> >
> > > > > It's definitely worrisome. My app is down at the moment, my task
> queue
> > > > > backlog is at 4 days, and I'm very disappointed.
> >
> > > > > On Tue, May 25, 2010 at 12:46 PM, Flips 
> > > wrote:
> >
> > > > >> These latency spikes are really annoying. Will the business app
> engine
> > > > >> edition use the same bigtable cluster as we do?
> >
> > > > >> On May 25, 9:03 pm, James  wrote:
> > > > >> > +1
> >
> > > > >> > On May 25, 10:13 am, Jody Belka  wrote:> From
> > > reading
> > > > >> this list, there appear to have been quite few incidents lately
> > > > >> > > where multiple sites start reporting errors, with the status
> page
> > > > >> showing
> >
> > > > >> > ...
> >
> > > > >> --
> > > > >> You received this message because you are subscribed to the Google
> > > Groups
> > > > >> "Google App Engine" group.
> > > > >> To post to this group, send email to
> > > google-appeng...@googlegroups.com.
> > > > >> To unsubscribe from this group, send email to
> > > > >> google-appengine+unsubscr...@googlegroups.com e...@googlegroups.com> > > e...@googlegroups.com>
> > > > >> .
> > > > >> For more options, visit this group at
> > > > >>http://groups.google.com/group/google-appengine?hl=en.
> >
> > > > >  --
> > > > > You received this message because you are subscribed to the Google
> > > Groups
> > > > > "Google App Engine" group.
> > > > > To post to this group, send email to
> google-appengine@googlegroups.com
> > > .
> > > > > To unsubscribe from this group, send email to
> > > > > google-appengine+unsubscr...@googlegroups.com e...@googlegroups.com> > > e...@googlegroups.com>
> > > > > .
> > > > > For more options, visit this group at
> > > > >http://groups.google.com/group/google-appengine?hl=en.
> >
> > > --
> > > You received this message because you are subscribed to the Google
> Groups
> > > "Google App Engine" group.
> > > To post to this group, send email to google-appengine@googlegroups.com
> .
> > > To unsubscribe from this group, send email to
> > > google-appengine+unsubscr...@googlegroups.com e...@googlegroups.com>
> > > .
> > > For more options, visit this group at
> > >http://groups.google.com/group/google-appengine?hl=en.
> >
> > --
> > Ikai Lan
> > Developer Programs Engineer, Google App Engine
> > Blog:http://googleappengine.blogspot.com
> > Twitter:http://twitter.com/app_engine
> > Reddit:http://www.reddit.com/r/appengine
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group,

[google-appengine] Re: Unscheduled downtime/problems lately

[Millisecond]

Thanks Ikai, I look forward to reading the post-mortem.  The last one
was indeed very good.

Will the post-mortem address the dramatically increased latency since
the 25th?  It's ongoing and has already caused tens of thousands of
errors on our site alone.  As far as I can tell, there's been no
official communication regarding that.

And it's still continuing with 1500ms+ for a lot of today:
http://code.google.com/status/appengine/detail/datastore/2010/06/01#ae-trust-detail-datastore-query-latency

-C

On Jun 1, 3:16 pm, "Ikai L (Google)"  wrote:
> I just wanted to let you guys know to hang in there. We're working on a
> post-mortem describing what went wrong and steps we are taking to prevent
> this from happening again. I don't have an ETA for this yet, but we've done
> this before 
> (http://groups.google.com/group/google-appengine/browse_thread/thread/...)
> and are committed to as much transparency as we can with regards to these
> issues with you guys.
>
>
>
>
>
> On Tue, Jun 1, 2010 at 2:59 PM, Mark  wrote:
> > +1 as worried, I'm investing time in app engine and this is quite
> > discouraging to say the least! How often does this happen? (I don't
> > have a live app yet), but should I abandon app engine now before
> > getting myself in trouble?
>
> > On May 27, 1:32 pm, Jody Belka  wrote:
> > > And what do you know, no-one from Google has made any response whatsoever
> > to
> > > this thread. And yet we know they are around, they occasionally do write
> > > messages after all. Very disappointing.
>
> > > On 25 May 2010 21:51, Waleed Abdulla  wrote:
>
> > > > It's definitely worrisome. My app is down at the moment, my task queue
> > > > backlog is at 4 days, and I'm very disappointed.
>
> > > > On Tue, May 25, 2010 at 12:46 PM, Flips 
> > wrote:
>
> > > >> These latency spikes are really annoying. Will the business app engine
> > > >> edition use the same bigtable cluster as we do?
>
> > > >> On May 25, 9:03 pm, James  wrote:
> > > >> > +1
>
> > > >> > On May 25, 10:13 am, Jody Belka  wrote:> From
> > reading
> > > >> this list, there appear to have been quite few incidents lately
> > > >> > > where multiple sites start reporting errors, with the status page
> > > >> showing
>
> > > >> > ...
>
> > > >> --
> > > >> You received this message because you are subscribed to the Google
> > Groups
> > > >> "Google App Engine" group.
> > > >> To post to this group, send email to
> > google-appeng...@googlegroups.com.
> > > >> To unsubscribe from this group, send email to
> > > >> google-appengine+unsubscr...@googlegroups.com > > >>  e...@googlegroups.com> > e...@googlegroups.com>
> > > >> .
> > > >> For more options, visit this group at
> > > >>http://groups.google.com/group/google-appengine?hl=en.
>
> > > >  --
> > > > You received this message because you are subscribed to the Google
> > Groups
> > > > "Google App Engine" group.
> > > > To post to this group, send email to google-appengine@googlegroups.com
> > .
> > > > To unsubscribe from this group, send email to
> > > > google-appengine+unsubscr...@googlegroups.com > > >  e...@googlegroups.com> > e...@googlegroups.com>
> > > > .
> > > > For more options, visit this group at
> > > >http://groups.google.com/group/google-appengine?hl=en.
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com > e...@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
>
> --
> Ikai Lan
> Developer Programs Engineer, Google App Engine
> Blog:http://googleappengine.blogspot.com
> Twitter:http://twitter.com/app_engine
> Reddit:http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Request was aborted after waiting too long to attempt to service your request.

[Waleed Abdulla]

I'm getting a ton of these errors today (about 20,000 errors) that rendered
my app almost non-functioning. Can anyone from the app engine team take a
look? app id is networked*hub. *
*
*
I'd really appreciate it. For some reason, this app seems to have proven
hard for the app engine to scale.

Regards,
Waleed

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Unscheduled downtime/problems lately

[Mark]

Thanks Ikai - I didn't see the downtime group before reading this
thread:

http://groups.google.com/group/google-appengine-downtime-notify

looks like good communication there, looking forward to deploying my
app,

Thanks

On Jun 1, 3:16 pm, "Ikai L (Google)"  wrote:
> I just wanted to let you guys know to hang in there. We're working on a
> post-mortem describing what went wrong and steps we are taking to prevent
> this from happening again. I don't have an ETA for this yet, but we've done
> this before 
> (http://groups.google.com/group/google-appengine/browse_thread/thread/...)
> and are committed to as much transparency as we can with regards to these
> issues with you guys.
>
>
>
>
>
> On Tue, Jun 1, 2010 at 2:59 PM, Mark  wrote:
> > +1 as worried, I'm investing time in app engine and this is quite
> > discouraging to say the least! How often does this happen? (I don't
> > have a live app yet), but should I abandon app engine now before
> > getting myself in trouble?
>
> > On May 27, 1:32 pm, Jody Belka  wrote:
> > > And what do you know, no-one from Google has made any response whatsoever
> > to
> > > this thread. And yet we know they are around, they occasionally do write
> > > messages after all. Very disappointing.
>
> > > On 25 May 2010 21:51, Waleed Abdulla  wrote:
>
> > > > It's definitely worrisome. My app is down at the moment, my task queue
> > > > backlog is at 4 days, and I'm very disappointed.
>
> > > > On Tue, May 25, 2010 at 12:46 PM, Flips 
> > wrote:
>
> > > >> These latency spikes are really annoying. Will the business app engine
> > > >> edition use the same bigtable cluster as we do?
>
> > > >> On May 25, 9:03 pm, James  wrote:
> > > >> > +1
>
> > > >> > On May 25, 10:13 am, Jody Belka  wrote:> From
> > reading
> > > >> this list, there appear to have been quite few incidents lately
> > > >> > > where multiple sites start reporting errors, with the status page
> > > >> showing
>
> > > >> > ...
>
> > > >> --
> > > >> You received this message because you are subscribed to the Google
> > Groups
> > > >> "Google App Engine" group.
> > > >> To post to this group, send email to
> > google-appeng...@googlegroups.com.
> > > >> To unsubscribe from this group, send email to
> > > >> google-appengine+unsubscr...@googlegroups.com > > >>  e...@googlegroups.com> > e...@googlegroups.com>
> > > >> .
> > > >> For more options, visit this group at
> > > >>http://groups.google.com/group/google-appengine?hl=en.
>
> > > >  --
> > > > You received this message because you are subscribed to the Google
> > Groups
> > > > "Google App Engine" group.
> > > > To post to this group, send email to google-appengine@googlegroups.com
> > .
> > > > To unsubscribe from this group, send email to
> > > > google-appengine+unsubscr...@googlegroups.com > > >  e...@googlegroups.com> > e...@googlegroups.com>
> > > > .
> > > > For more options, visit this group at
> > > >http://groups.google.com/group/google-appengine?hl=en.
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com > e...@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
>
> --
> Ikai Lan
> Developer Programs Engineer, Google App Engine
> Blog:http://googleappengine.blogspot.com
> Twitter:http://twitter.com/app_engine
> Reddit:http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] DeadlineExceeded on cold hits.

[Dave Peck]

Hi,

In the past week, I've seen an alarming number of DeadlineExceeded
exceptions on cold hits to my applications.

Most of the stack traces are shallow -- things blow up well before my
code is hit. See http://pastie.org/988269 for a stack trace.

The `bootstrap.py` file is more-or-less a direct copy of the `main.py`
from Rietveld.

Can someone on the App Engine team please point me in the right
direction here? This is a big change in GAE's behavior in the past
week, and it is affecting many of my applications (citygoround which
has been in production for half a year; code-doctor which is under
development, etc.)

Cheers,
Dave Peck



-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Unscheduled downtime/problems lately

[Ikai L (Google)]

I just wanted to let you guys know to hang in there. We're working on a
post-mortem describing what went wrong and steps we are taking to prevent
this from happening again. I don't have an ETA for this yet, but we've done
this before (
http://groups.google.com/group/google-appengine/browse_thread/thread/a7640a2743922dcf)
and are committed to as much transparency as we can with regards to these
issues with you guys.

On Tue, Jun 1, 2010 at 2:59 PM, Mark  wrote:

> +1 as worried, I'm investing time in app engine and this is quite
> discouraging to say the least! How often does this happen? (I don't
> have a live app yet), but should I abandon app engine now before
> getting myself in trouble?
>
> On May 27, 1:32 pm, Jody Belka  wrote:
> > And what do you know, no-one from Google has made any response whatsoever
> to
> > this thread. And yet we know they are around, they occasionally do write
> > messages after all. Very disappointing.
> >
> > On 25 May 2010 21:51, Waleed Abdulla  wrote:
> >
> >
> >
> > > It's definitely worrisome. My app is down at the moment, my task queue
> > > backlog is at 4 days, and I'm very disappointed.
> >
> > > On Tue, May 25, 2010 at 12:46 PM, Flips 
> wrote:
> >
> > >> These latency spikes are really annoying. Will the business app engine
> > >> edition use the same bigtable cluster as we do?
> >
> > >> On May 25, 9:03 pm, James  wrote:
> > >> > +1
> >
> > >> > On May 25, 10:13 am, Jody Belka  wrote:> From
> reading
> > >> this list, there appear to have been quite few incidents lately
> > >> > > where multiple sites start reporting errors, with the status page
> > >> showing
> >
> > >> > ...
> >
> > >> --
> > >> You received this message because you are subscribed to the Google
> Groups
> > >> "Google App Engine" group.
> > >> To post to this group, send email to
> google-appeng...@googlegroups.com.
> > >> To unsubscribe from this group, send email to
> > >> google-appengine+unsubscr...@googlegroups.com e...@googlegroups.com>
> > >> .
> > >> For more options, visit this group at
> > >>http://groups.google.com/group/google-appengine?hl=en.
> >
> > >  --
> > > You received this message because you are subscribed to the Google
> Groups
> > > "Google App Engine" group.
> > > To post to this group, send email to google-appengine@googlegroups.com
> .
> > > To unsubscribe from this group, send email to
> > > google-appengine+unsubscr...@googlegroups.com e...@googlegroups.com>
> > > .
> > > For more options, visit this group at
> > >http://groups.google.com/group/google-appengine?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Tasks Queues still manual in 1.3.4?

[Kenneth]

When I go into the dev console it still says that tasks will not run
automatically but they do, so that's a red herring.

What I was seeing was the eta for the task was 2 hours in the future.
So by changing the time zone settings the eta was now correct and the
tasks were running immediately.

YMMV.


On Jun 1, 10:08 pm, Ryan Weber  wrote:
> Has anyone on a mac w/osx been able to get it to work via the launcher?
>
>
>
> On Tue, Jun 1, 2010 at 3:28 PM, Greg Tracy  wrote:
>
> > I'm using the App Engine Launcher on XP and it works for me.
>
> > On May 31, 7:24 pm, hawkett  wrote:
> > > Slight possibility - looks like both Ryan and Nick are using the app
> > > engine launcher, which is a mac only application that contains a copy
> > > of the SDK. Are any of the people reporting it working using the app
> > > engine launcher? I'm on mac, but is has been a while since I actually
> > > ran my apps with the launcher - choosing instead to download to
> > > download the linux SDK.  You guys could try that and see if you notice
> > > any improvement.  Perhaps the SDK inside the launcher isn't quite
> > > right. Unlikely, but something to test out.  Cheers,
>
> > > Colin
>
> > > On May 29, 6:49 am, Nick  wrote:
>
> > > > I'm in California (7-8 hours behind UTC) and also have Ryan's problem.
> > > > Tasks don't run automatically on the dev server, which is very
> > > > frustrating and as Ryan reported I still see the message "Tasks will
> > > > not run automatically" in the SDK console.
>
> > > > I'm using Python and the GoogleAppEngineLauncher 1.3.4.794, SDK
> > > > version: release: "1.3.4", timestamp: 1272392128, api_versions: ['1'].
>
> > > > Any thoughts on why some of us aren't seeing this new feature?
>
> > > > Thanks,
> > > > Nick
>
> > > > On May 28, 8:50 am, Tim Hoffman  wrote:
>
> > > > > So am I (8 hours) and auto task running works fine,
>
> > > > > Rgds
>
> > > > > T
>
> > > > > On May 28, 10:32 pm, djidjadji  wrote:
>
> > > > > > I'm ahead a few hours of UTC and for me the automatic task queue
> > works.
> > > > > > I have not modified the 1.3.4 SDK code.
>
> > > > > > 2010/5/27 Kenneth :
>
> > > > > > > The problem with the task not running automatically is because of
> > this
> > > > > > > bug:
>
> > > > > > >http://code.google.com/p/googleappengine/issues/detail?id=2508
>
> > > > > > > Basically it works fine in Mountain View, California, but not for
> > > > > > > anyone who is ahead of UTC since the eta will be in the future.
>
> > > > > > > Solution as described in the bug report is replace line 414 in
> > > > > > > taskqueue.py:
>
> > > > > > > def __determine_eta(eta=None, countdown=None,
> > > > > > > now=datetime.datetime.now)
> > > > > > > with
> > > > > > > def __determine_eta(eta=None, countdown=None,
> > > > > > > now=datetime.datetime.utcnow)
>
> > > > > > > Hope that helps.
>
> > > > > > > On May 22, 9:10 pm, andy stevko  wrote:
> > > > > > >> I see auto run tasks all the time in my dev environment. I
> > thought the docs
> > > > > > >> just were not up to date. I'm using the latest eclipse plugin.
>
> > > > > > >> On May 22, 2010 12:42 PM, "Ryan Weber" 
> > wrote:
>
> > > > > > >> Strange, because that's not what is happening for me. I have to
> > still
> > > > > > >> manually run them. Can anyone think of any reason why mine would
> > still be
> > > > > > >> manual? When I saw all the features of the 1.3.4 release, I was
> > most looking
> > > > > > >> forward to the auto-run of tasks, so I wouldn't have to click
> > "run" every
> > > > > > >> time, but alas, no luck yet...
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com > e...@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Video of App Engine sessions from Google I/O 2010 are up!

[Ikai L (Google)]

Hey guys,

I just wanted to let everyone know that the App Engine sessions from Google
I/O 2010 are now online for your viewing pleasure. Check them out here:

http://googlecode.blogspot.com/2010/06/app-engine-teams-trip-to-io-2010-recap.html

These
are geared towards intermediate to advanced App Engine developers. There's a
lot of good stuff in here - I learned a bunch of stuff attending.

Happy viewing!

-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Unscheduled downtime/problems lately

[Mark]

+1 as worried, I'm investing time in app engine and this is quite
discouraging to say the least! How often does this happen? (I don't
have a live app yet), but should I abandon app engine now before
getting myself in trouble?

On May 27, 1:32 pm, Jody Belka  wrote:
> And what do you know, no-one from Google has made any response whatsoever to
> this thread. And yet we know they are around, they occasionally do write
> messages after all. Very disappointing.
>
> On 25 May 2010 21:51, Waleed Abdulla  wrote:
>
>
>
> > It's definitely worrisome. My app is down at the moment, my task queue
> > backlog is at 4 days, and I'm very disappointed.
>
> > On Tue, May 25, 2010 at 12:46 PM, Flips  wrote:
>
> >> These latency spikes are really annoying. Will the business app engine
> >> edition use the same bigtable cluster as we do?
>
> >> On May 25, 9:03 pm, James  wrote:
> >> > +1
>
> >> > On May 25, 10:13 am, Jody Belka  wrote:> From reading
> >> this list, there appear to have been quite few incidents lately
> >> > > where multiple sites start reporting errors, with the status page
> >> showing
>
> >> > ...
>
> >> --
> >> You received this message because you are subscribed to the Google Groups
> >> "Google App Engine" group.
> >> To post to this group, send email to google-appeng...@googlegroups.com.
> >> To unsubscribe from this group, send email to
> >> google-appengine+unsubscr...@googlegroups.com >>  e...@googlegroups.com>
> >> .
> >> For more options, visit this group at
> >>http://groups.google.com/group/google-appengine?hl=en.
>
> >  --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com > e...@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Accessing xml files in war directory

[Ikai L (Google)]

I'm able to parse XML doing this:

 File dir = new File("WEB-INF/catalog");
File[] files = dir.listFiles();

for(File file : files) {
  if(file.isFile() && file.getName().endsWith(".xml")) {
parseCatalogXml(file);
  }
}


The files are in my WEB-INF/catalog folder.

On Mon, May 31, 2010 at 4:03 PM, mark  wrote:

> Hello I am running this code server side and it is working fine in
> Development mode, buy when I push it to the app engine it is coming
> back null.
>
> DocumentBuilderFactory dbf = DocumentBuilderFactory.newInstance();
> DocumentBuilder db = dbf.newDocumentBuilder();
> Document doc = db.parse("test.xml");
> doc.getDocumentElement().normalize();
>
> Do I need to reference the xml file differently when I upload it to
> app engine?
>
> Thanks
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Google IO session videos

[Ikai L (Google)]

The videos are up:

http://www.youtube.com/view_play_list?p=FBF991DAE0E02FED

We are constantly
working on service issues, believe me. No one is getting a break here.

On Fri, May 28, 2010 at 6:30 PM, Jaroslav Záruba
wrote:

> We're probably a bit spoiled by the fact that 1) some of us have billing
> enabled and mainly 2) we're used that "beta" from Google is usually superior
> to "stable" from other companies...
>
>
> On Sat, May 29, 2010 at 3:19 AM, Shane  wrote:
>
>> No, he's saying it's "silly to assume the video editing folks are the
>> same folks doing App Engine systems work".
>>
>> GAE is beta, and is constantly being worked on, providing a free
>> service, so I think people just need to keep that in mind and calm
>> down.
>>
>> Let's try and keep it civil here, and work together as a team.
>>
>> On May 29, 3:32 am, Jody Belka  wrote:
>> > So is it silly to ask why we seem almost never to get any feedback on
>> here
>> > to the numerous and growing threads about service issues?
>> >
>> > On 28 May 2010 18:24, Ikai L (Google)  wrote:
>> >
>> >
>> >
>> > > We're working on that too. It's a bit silly to assume the video
>> editing
>> > > folks are the same folks doing App Engine systems work.
>> >
>> > > On Thu, May 27, 2010 at 4:18 PM, Viðar Svansson > >wrote:
>> >
>> > >> Can we wait with the videos and get the App Engine running. It is
>> just
>> > >> returning 500 errors now!
>> >
>> > >> On Thu, May 27, 2010 at 10:19 PM, Ikai L (Google) > >
>> > >> wrote:
>> > >> > Soon! We can't get them to you guys quickly enough, trust me on
>> this. My
>> > >> > guess is a few weeks.
>> >
>> > >> > On Thu, May 27, 2010 at 3:12 PM, Chris 
>> wrote:
>> >
>> > >> >> Hi
>> >
>> > >> >> Any ideas as for when these will be available on YouTube..can't
>> wait
>> > >> >> to see 'em :-)
>> >
>> > >> >> Thanks
>> >
>> > >> >> /Chris
>> >
>> > >> >> --
>> > >> >> You received this message because you are subscribed to the Google
>> > >> Groups
>> > >> >> "Google App Engine" group.
>> > >> >> To post to this group, send email to
>> google-appengine@googlegroups.com
>> > >> .
>> > >> >> To unsubscribe from this group, send email to
>> > >> >> google-appengine+unsubscr...@googlegroups.com> e...@googlegroups.com>
>> > >> .
>> > >> >> For more options, visit this group at
>> > >> >>http://groups.google.com/group/google-appengine?hl=en.
>> >
>> > >> > --
>> > >> > Ikai Lan
>> > >> > Developer Programs Engineer, Google App Engine
>> > >> > Blog:http://googleappengine.blogspot.com
>> > >> > Twitter:http://twitter.com/app_engine
>> > >> > Reddit:http://www.reddit.com/r/appengine
>> >
>> > >> > --
>> > >> > You received this message because you are subscribed to the Google
>> > >> Groups
>> > >> > "Google App Engine" group.
>> > >> > To post to this group, send email to
>> google-appeng...@googlegroups.com.
>> > >> > To unsubscribe from this group, send email to
>> > >> > google-appengine+unsubscr...@googlegroups.com> e...@googlegroups.com>
>> > >> .
>> > >> > For more options, visit this group at
>> > >> >http://groups.google.com/group/google-appengine?hl=en.
>> >
>> > >> --
>> > >> You received this message because you are subscribed to the Google
>> Groups
>> > >> "Google App Engine" group.
>> > >> To post to this group, send email to
>> google-appeng...@googlegroups.com.
>> > >> To unsubscribe from this group, send email to
>> > >> google-appengine+unsubscr...@googlegroups.com> e...@googlegroups.com>
>> > >> .
>> > >> For more options, visit this group at
>> > >>http://groups.google.com/group/google-appengine?hl=en.
>> >
>> > > --
>> > > Ikai Lan
>> > > Developer Programs Engineer, Google App Engine
>> > > Blog:http://googleappengine.blogspot.com
>> > > Twitter:http://twitter.com/app_engine
>> > > Reddit:http://www.reddit.com/r/appengine
>> >
>> > >  --
>> > > You received this message because you are subscribed to the Google
>> Groups
>> > > "Google App Engine" group.
>> > > To post to this group, send email to
>> google-appeng...@googlegroups.com.
>> > > To unsubscribe from this group, send email to
>> > > google-appengine+unsubscr...@googlegroups.com> e...@googlegroups.com>
>> > > .
>> > > For more options, visit this group at
>> > >http://groups.google.com/group/google-appengine?hl=en.
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appeng...@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com
>> .
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For mo

Re: [google-appengine] indexes stuck building

[Ikai L (Google)]

Can you vacuum your indexes? They are in error state at the moment.

On Thu, May 27, 2010 at 10:41 AM, Risto  wrote:

> Hi,
>
> I have a few indexes which are stuck at the building state.  I've
> uploaded the index definitions about 11hours ago and on the dashboard
> it still shows building: queued 0, running 0, completed 0, total 0.
> for the 3 new indexes.  These are for 2 different Kind's which both
> have 10+M entities.
>
> In parallel to these new new indexes, I'm running some schema updates
> which is currently running at about 8M entities out of 14M after 2
> days, 17hours.  Could that interfere with the index builds?
>
> appid: socicount
>
> I would appreciate if someone could check what's going on with this.
>
> cheers,
> risto
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] plans for 2-factor auth?

[Ikai L (Google)]

Do you mean such as with RSA tokens and such? You can definitely build your
own one time password implementation and email or (via an SMS or email SMS
gateway) SMS for a one time password.

On Thu, May 27, 2010 at 12:21 PM, Aljosa Mohorovic <
aljosa.mohoro...@gmail.com> wrote:

> are there any plans for 2-factor authentication?
> i don't mind that i can access my google reader stuff with my email/
> password but would like to have a second step (maybe a software OTP)
> to access my apps on appengine.
> any comments, tips or suggestions?
>
> Aljosa Mohorovic
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Total number of entities

[Ikai L (Google)]

Is it possible you are using sessions?

Note that indexes also take up space, though they should not add to your
entity count.

On Thu, May 27, 2010 at 12:52 AM, Stefano wrote:

> Hi...
> Datastore Statistics says I'm using 74KB with 247 entities, but
> counting the entities separately they are less than 30 and less than 2
> KB. What's going on?
> Maybe I'm create garbage? How can I resolve?
>
> Thank you
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Can't edit datastore entity in Control panel if entity has a ShortBlob

[Spines]

On the appspot.com admin control panel, I can't edit a datastore
entity if it has a ShortBlob property.  When trying to edit it, the
shortblob is shown in an editable textbox as ��,�:3�.  When trying to
save the entity, I get a page that says, "A server error has
occurred.". This happens when making any change to the entity, even if
I don't touch the ShortBlob property.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] mapreduce

[Ikai L (Google)]

Hi,

The first release of the mapper API will require a manual invocation of the
task.

If you need to map all entities, you will have to run the task. There's no
continuous process monitoring changed entities. You can probably build this
into your update workflow.

On Wed, May 26, 2010 at 1:29 AM, Waldemar Kornewald wrote:

> Hi,
> looking at the screenshots of the mapreduce library
> http://code.google.com/p/appengine-mapreduce/
> gives me the impression that I'll have to manually execute those
> mapreduce tasks. Will this change in the final release?
>
> Also, will I always have to periodically rerun the mapreduce task over
> the *whole* DB even if just a single entity has changed? Or will there
> be some CouchDB-like mapreduce tasks which run continuously in the
> background and react to DB changes such that only a subset of the DB
> needs to be recomputed?
>
> Bye,
> Waldemar Kornewald
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Tasks Queues still manual in 1.3.4?

[Ryan Weber]

Has anyone on a mac w/osx been able to get it to work via the launcher?

On Tue, Jun 1, 2010 at 3:28 PM, Greg Tracy  wrote:

>
> I'm using the App Engine Launcher on XP and it works for me.
>
>
> On May 31, 7:24 pm, hawkett  wrote:
> > Slight possibility - looks like both Ryan and Nick are using the app
> > engine launcher, which is a mac only application that contains a copy
> > of the SDK. Are any of the people reporting it working using the app
> > engine launcher? I'm on mac, but is has been a while since I actually
> > ran my apps with the launcher - choosing instead to download to
> > download the linux SDK.  You guys could try that and see if you notice
> > any improvement.  Perhaps the SDK inside the launcher isn't quite
> > right. Unlikely, but something to test out.  Cheers,
> >
> > Colin
> >
> > On May 29, 6:49 am, Nick  wrote:
> >
> >
> >
> > > I'm in California (7-8 hours behind UTC) and also have Ryan's problem.
> > > Tasks don't run automatically on the dev server, which is very
> > > frustrating and as Ryan reported I still see the message "Tasks will
> > > not run automatically" in the SDK console.
> >
> > > I'm using Python and the GoogleAppEngineLauncher 1.3.4.794, SDK
> > > version: release: "1.3.4", timestamp: 1272392128, api_versions: ['1'].
> >
> > > Any thoughts on why some of us aren't seeing this new feature?
> >
> > > Thanks,
> > > Nick
> >
> > > On May 28, 8:50 am, Tim Hoffman  wrote:
> >
> > > > So am I (8 hours) and auto task running works fine,
> >
> > > > Rgds
> >
> > > > T
> >
> > > > On May 28, 10:32 pm, djidjadji  wrote:
> >
> > > > > I'm ahead a few hours of UTC and for me the automatic task queue
> works.
> > > > > I have not modified the 1.3.4 SDK code.
> >
> > > > > 2010/5/27 Kenneth :
> >
> > > > > > The problem with the task not running automatically is because of
> this
> > > > > > bug:
> >
> > > > > >http://code.google.com/p/googleappengine/issues/detail?id=2508
> >
> > > > > > Basically it works fine in Mountain View, California, but not for
> > > > > > anyone who is ahead of UTC since the eta will be in the future.
> >
> > > > > > Solution as described in the bug report is replace line 414 in
> > > > > > taskqueue.py:
> >
> > > > > > def __determine_eta(eta=None, countdown=None,
> > > > > > now=datetime.datetime.now)
> > > > > > with
> > > > > > def __determine_eta(eta=None, countdown=None,
> > > > > > now=datetime.datetime.utcnow)
> >
> > > > > > Hope that helps.
> >
> > > > > > On May 22, 9:10 pm, andy stevko  wrote:
> > > > > >> I see auto run tasks all the time in my dev environment. I
> thought the docs
> > > > > >> just were not up to date. I'm using the latest eclipse plugin.
> >
> > > > > >> On May 22, 2010 12:42 PM, "Ryan Weber" 
> wrote:
> >
> > > > > >> Strange, because that's not what is happening for me. I have to
> still
> > > > > >> manually run them. Can anyone think of any reason why mine would
> still be
> > > > > >> manual? When I saw all the features of the 1.3.4 release, I was
> most looking
> > > > > >> forward to the auto-run of tasks, so I wouldn't have to click
> "run" every
> > > > > >> time, but alas, no luck yet...
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Searching through Model relationships in Google App Engine?

[Ikai L (Google)]

You should balance the needs of querying for children against updating the
parent - if you are checking for the lack of children much more than you are
actually updating parents, it will be way cheaper to implement a boolean
that denotes whether or not the parent has children. This isn't a relational
database, and thinking non-relationally (away from normalization) will yield
many performance benefits.

On Tue, May 25, 2010 at 10:50 AM, App Engine N00B <
vivek.securitywiz...@gmail.com> wrote:

> Hi!
>
> I have many models:
>
> class Parent (db.Model) :
>  data = db.StringProperty()
>
>
> class Child1 (db.Model) :
>  parent = db.ReferenceProperty(Parent)
>  childData = db.StringProperty()
>
> class Child2 (db.Model) :
>  parent = db.ReferenceProperty(Parent)
>  childData2 = db.StringProperty()
>
> class Child3 (db.Model) :
>  parent = db.ReferenceProperty(Parent)
>  childData3 = db.StringProperty()
>
> 
>
> I want a query which can give me a list of all parents which do not
> have a child yet. How do i do it?
>
> I do not want to maintain an identifier in the Parent model for each
> of the children as I want to add new child models very often.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Google engine upload

[Ikai L (Google)]

Which upload APIs are you referring to?

On Tue, May 25, 2010 at 10:06 AM, Ivan Junckes Filho
wrote:

> Hello, I have a doubt about using google upload API. If I use those
> API's and decide to host my app in another place will I be able to use
> the upload or I will have to implement everything again?
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Tasks Queues still manual in 1.3.4?

[Greg Tracy]

I'm using the App Engine Launcher on XP and it works for me.


On May 31, 7:24 pm, hawkett  wrote:
> Slight possibility - looks like both Ryan and Nick are using the app
> engine launcher, which is a mac only application that contains a copy
> of the SDK. Are any of the people reporting it working using the app
> engine launcher? I'm on mac, but is has been a while since I actually
> ran my apps with the launcher - choosing instead to download to
> download the linux SDK.  You guys could try that and see if you notice
> any improvement.  Perhaps the SDK inside the launcher isn't quite
> right. Unlikely, but something to test out.  Cheers,
>
> Colin
>
> On May 29, 6:49 am, Nick  wrote:
>
>
>
> > I'm in California (7-8 hours behind UTC) and also have Ryan's problem.
> > Tasks don't run automatically on the dev server, which is very
> > frustrating and as Ryan reported I still see the message "Tasks will
> > not run automatically" in the SDK console.
>
> > I'm using Python and the GoogleAppEngineLauncher 1.3.4.794, SDK
> > version: release: "1.3.4", timestamp: 1272392128, api_versions: ['1'].
>
> > Any thoughts on why some of us aren't seeing this new feature?
>
> > Thanks,
> > Nick
>
> > On May 28, 8:50 am, Tim Hoffman  wrote:
>
> > > So am I (8 hours) and auto task running works fine,
>
> > > Rgds
>
> > > T
>
> > > On May 28, 10:32 pm, djidjadji  wrote:
>
> > > > I'm ahead a few hours of UTC and for me the automatic task queue works.
> > > > I have not modified the 1.3.4 SDK code.
>
> > > > 2010/5/27 Kenneth :
>
> > > > > The problem with the task not running automatically is because of this
> > > > > bug:
>
> > > > >http://code.google.com/p/googleappengine/issues/detail?id=2508
>
> > > > > Basically it works fine in Mountain View, California, but not for
> > > > > anyone who is ahead of UTC since the eta will be in the future.
>
> > > > > Solution as described in the bug report is replace line 414 in
> > > > > taskqueue.py:
>
> > > > > def __determine_eta(eta=None, countdown=None,
> > > > > now=datetime.datetime.now)
> > > > > with
> > > > > def __determine_eta(eta=None, countdown=None,
> > > > > now=datetime.datetime.utcnow)
>
> > > > > Hope that helps.
>
> > > > > On May 22, 9:10 pm, andy stevko  wrote:
> > > > >> I see auto run tasks all the time in my dev environment. I thought 
> > > > >> the docs
> > > > >> just were not up to date. I'm using the latest eclipse plugin.
>
> > > > >> On May 22, 2010 12:42 PM, "Ryan Weber"  wrote:
>
> > > > >> Strange, because that's not what is happening for me. I have to still
> > > > >> manually run them. Can anyone think of any reason why mine would 
> > > > >> still be
> > > > >> manual? When I saw all the features of the 1.3.4 release, I was most 
> > > > >> looking
> > > > >> forward to the auto-run of tasks, so I wouldn't have to click "run" 
> > > > >> every
> > > > >> time, but alas, no luck yet...

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Query Latency, etc

[bFlood]

agreed, that's the worst Query latency graph I've ever seen

i really hope the answer to all of this doesn't come down to: "buy GAE
for Business, it has an SLA"



On Jun 1, 3:25 pm, James  wrote:
> Bay - Well put.
>
> Query latency status page is nearly all red today.  Same on Sunday.
>
> Ikai - A little transparency would go a long way here.  Can you
> oblige?
>
> On May 28, 12:39 pm, Bay  wrote:
>
>
>
> > There just needs to be more information. This is a service people pay
> > money for. Where are the explanations of todays errors? Adding an
> > issue at the tracker almost always goes unnoticed - writing in these
> > (three different) forum groups almost always goes unnoticed.
>
> > Can we expect these 500 error that have been coming and going for
> > months to be fixed one day, or are we supposed to pull our apps and
> > rewrite them into something that is less scalable but -actually-
> > working? This is not supposed to be hard. Everybody are confined to
> > java and python - nothing more, errors can be contained. No
> > filesystem, everything in a database which prohibit any operation that
> > look like join and has indexes for everything that can be fetched
> > except if one actually knows the unique key. With this in mind, things
> > are simple. Its not supposed to be that hard - if you can't do what
> > companies that allow SQL and multiple languages can, then please buy a
> > hosting company and get some best practices from there. You've got the
> > money - you've got our money, as we pay for the service. If you need
> > more money to make it work upp the prices a little, because -random-
> > 500 errors are unacceptable for everybody.
>
> > A few answers and a few pieces of information would be nice. Thank
> > you.
>
> > On May 28, 6:04 pm, Millisecond  wrote:
>
> > > The querylatencyhas been red on and off all morning, requests are
> > > returning 500's and not counting as errors (saw another thread I was
> > > going to reference about other people seeing this as well, but can't
> > > find it now), but no alerts/status 
> > > updates:http://code.google.com/status/appengine/detail/datastore/2010/05/28#a...
>
> > > The only day marked as 'service disruption' was May 25th, but we've
> > > thrown 75,000+ errors in the past week due tolatency, not including
> > > May 25th.
>
> > > Billing is missing and no word from Google on whether it's
> > > intentional:http://groups.google.com/group/google-appengine/browse_thread/thread/...
>
> > > Would be great to hear about how this is all just a temporary thing,
> > > what the problem is, and what Google's plan is to fix it.  But, at the
> > > moment, this feels like "normal operation" of AppEngine and nobody at
> > > Google is concerned which really has me concerned.
>
> > > -C

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Query Latency, etc

[James]

Bay - Well put.

Query latency status page is nearly all red today.  Same on Sunday.

Ikai - A little transparency would go a long way here.  Can you
oblige?



On May 28, 12:39 pm, Bay  wrote:
> There just needs to be more information. This is a service people pay
> money for. Where are the explanations of todays errors? Adding an
> issue at the tracker almost always goes unnoticed - writing in these
> (three different) forum groups almost always goes unnoticed.
>
> Can we expect these 500 error that have been coming and going for
> months to be fixed one day, or are we supposed to pull our apps and
> rewrite them into something that is less scalable but -actually-
> working? This is not supposed to be hard. Everybody are confined to
> java and python - nothing more, errors can be contained. No
> filesystem, everything in a database which prohibit any operation that
> look like join and has indexes for everything that can be fetched
> except if one actually knows the unique key. With this in mind, things
> are simple. Its not supposed to be that hard - if you can't do what
> companies that allow SQL and multiple languages can, then please buy a
> hosting company and get some best practices from there. You've got the
> money - you've got our money, as we pay for the service. If you need
> more money to make it work upp the prices a little, because -random-
> 500 errors are unacceptable for everybody.
>
> A few answers and a few pieces of information would be nice. Thank
> you.
>
> On May 28, 6:04 pm, Millisecond  wrote:
>
>
>
> > The querylatencyhas been red on and off all morning, requests are
> > returning 500's and not counting as errors (saw another thread I was
> > going to reference about other people seeing this as well, but can't
> > find it now), but no alerts/status 
> > updates:http://code.google.com/status/appengine/detail/datastore/2010/05/28#a...
>
> > The only day marked as 'service disruption' was May 25th, but we've
> > thrown 75,000+ errors in the past week due tolatency, not including
> > May 25th.
>
> > Billing is missing and no word from Google on whether it's
> > intentional:http://groups.google.com/group/google-appengine/browse_thread/thread/...
>
> > Would be great to hear about how this is all just a temporary thing,
> > what the problem is, and what Google's plan is to fix it.  But, at the
> > moment, this feels like "normal operation" of AppEngine and nobody at
> > Google is concerned which really has me concerned.
>
> > -C

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] need *.appspot.com certificate help

[Houston startup coder]

We have a client app on a tablet accessing GAE, and we want to install
the *.appspot.com certificate so every time the client app accesses
GAE for data transfer it won't prompt the user to accept the
*.appspot.com certificate.  Actually, we don't ever want the user to
be prompted, so we want to install the certificate with the app.

The problem is that we're trying to have that client app access a
different version of our app behind the scenes:

different-version.latest.my-app.appspot.com

Google's certificate is for *.appspot.com so even though we install
that certificate, it doesn't match

*.latest.*.appspot.com

and the user is being prompted every time the program tries to access
GAE.  We need SSL, so we can't get around this by simply using our own
domain instead of appspot.com, and we wanted to reserve the root
version of the application for our human user web app, but it seems
like the only way we can avoid this is by having the tablet
application access GAE via

my-app.appspot.com

Does anyone know of a workaround for this?  Thanks so much...

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: node allocation

[Geoffrey Spear]

On May 31, 5:06 pm, theresia freska  wrote:
> Hi list,
>
> Is there any way to control how many nodes we want to use? I want to
> compare request time of using n nodes to run my app. I use Java, but
> any input is appreciated. Thanks!

No.  The system automatically allocates instances as they're needed;
at present there's no way to control this manually.  The roadmap does
include a feature that would allow you to reserve warm instances to
avoid cold startup times.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Can't enable billing

[Jason (Google)]

There was a substantial backlog in the billing pipeline starting late last
week, which caused some discrepancies between the billing status that was
reported in the Admin Console and the quotas that were actually being
enforced. We're working on processing the backlog and preparing a fix for
this so it shouldn't happen again going forward.

If you still have specific billing issues, please use the billing issues
form so you don't have to share your order information publicly.

http://code.google.com/support/bin/request.py?contact_type=AppEngineBillingSupport

- Jason

On Mon, May 31, 2010 at 2:35 AM, kaz...@abars  wrote:

> Me too...
> My another two apps have no problem.
> But my one app can't set to billing mode.
>
> Billing history:
> 2010-05-14 19:03:35 abars...@gmail.com   Billing Setup Successful
> $0.00
> 2010-05-14 19:02:30 abars...@gmail.com   Billing Setup Started
>
> but billing status is displayed as free.
>
> Billing Status: Free
> This application is operating within the free quota levels. Enable
> billing to grow beyond the free quotas. Learn more
>
> Billing Administrator: None
> Since this application is operating within the free quota levels,
> there isn't a billing administrator.
> Current Balance: n/a Usage History
> Resource Allocations:
> ResourceBudget  Unit Cost   Paid Quota  Free Quota
>  Total Daily Quota
> CPU Timen/a  $0.10/CPU hour n/a  6.506.50 CPU hours
> Bandwidth Out   n/a  $0.12/GByten/a  1.001.00 GBytes
> Bandwidth Inn/a  $0.10/GByten/a  1.001.00 GBytes
> Stored Data n/a  $0.005/GByte-day   n/a  1.001.00
> GBytes
> Recipients Emailed  n/a  $0.0001/Email  n/a  2,000.00
>  2,000.00 Emails
> Max Daily Budget:   n/a
>
>
>
>
> On 5月29日, 午後3:38, Hugo Visser  wrote:
> > At the moment, according to thebillingpage my app is operating in
> > free mode. When I look at the quotas on the dashboard however it is
> > using the quotas that I've set on thebillingpage, while again
> thebillingstatus is displayed as free.
> >
> > On May 29, 2:22 am, "Ikai L (Google)"  wrote:
> >
> >
> >
> > > It looks likebillingis a bit slow. The UI may say that you are not in
> the
> > > queue, but this is mislabeled. Whenbillingprocesses, your app will
> > > automatically be updated to the correct status.
> >
> > > On Fri, May 28, 2010 at 1:44 PM, Ikai L (Google) 
> wrote:
> >
> > > > I'm seeing the same issue. Let me follow up on this.
> >
> > > > On Fri, May 28, 2010 at 12:04 PM, G 
> wrote:
> >
> > > >> I'm trying to enablebilling, and it seems to be working - I check
> out
> > > >> and then the status says it's updating for 15 or so minutes, but
> after
> > > >> that it goes back to free with the "EnableBilling" button visible.
> >
> > > >> Is there some extra step I should be doing?
> >
> > > >> Thanks
> >
> > > >> G
> >
> > > >> --
> > > >> You received this message because you are subscribed to the Google
> Groups
> > > >> "Google App Engine" group.
> > > >> To post to this group, send email to
> google-appeng...@googlegroups.com.
> > > >> To unsubscribe from this group, send email to
> > > >> google-appengine+unsubscr...@googlegroups.com e...@googlegroups.com>
> > > >> .
> > > >> For more options, visit this group at
> > > >>http://groups.google.com/group/google-appengine?hl=en.
> >
> > > > --
> > > > Ikai Lan
> > > > Developer Programs Engineer, Google App Engine
> > > > Blog:http://googleappengine.blogspot.com
> > > > Twitter:http://twitter.com/app_engine
> > > > Reddit:http://www.reddit.com/r/appengine
> >
> > > --
> > > Ikai Lan
> > > Developer Programs Engineer, Google App Engine
> > > Blog:http://googleappengine.blogspot.com
> > > Twitter:http://twitter.com/app_engine
> > > Reddit:http://www.reddit.com/r/appengine
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Server Error 500

[Marvin P.]

I've been getting 500 Errors on and off as well since the May 25. It's
very annoying.

On May 31, 1:47 pm, DJB  wrote:
> I've been receiving "Error 500" for the past (3) days (may 29-31).
>
> Details are below.
>
> Is this widespread? or only me?
>
> thanks,
> David
>
> C:\Program Files (x86)\Google\google_appengine\google\appengine\tools
> \dev_appser
> ver_login.py:33: DeprecationWarning: the md5 module is deprecated; use
> hashlib i
> nstead
>   import md5
> Application: bible-library; version: 1.
> Server: appengine.google.com.
> Scanning files on local disk.
> Scanned 500 files.
> Initiating update.
> Error 500: --- begin server output ---
>
> 
> 
> 500 Server Error
> 
> 
> Error: Server Error
> The server encountered an error and could not complete your
> request.If th
> e problem persists, please http://code.google.com/appengine/
> community.h
> tml">report your problem and mention this error message and the
> query that c
> aused it.
> 
> 
> --- end server output ---

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Blobstore upload range

[jcjones1515]

Does the blobstore support the HTTP 'Range' request header when
uploading data?  I see that it supports it for downloading, but it
would be helpful to be able to have our client code break up large
uploads into several HTTP requests using the Range request header.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Accesing my application-files

[Oggy]

Hi I'm new with google app engine.

I just deployed my Application "molwind" to the engine.
In my web.xml i described a parameter for the


http://java.sun.com/dtd/web-app_2_3.dtd";>


 
   
 
  Server
 
 
  com.emd.worldwind.servlet.Server
 
 
   configurl
http://localhost:8080/files/config.txt

   
   
 
  Server
 
 
/MolWind
 
   
 


That param-value is the path to the config-file on my Jetty-Server,
where i developed the app.
The config- file is located like:

MyApp
..WEB-INF
   ..web.xml
   ..appengine-web.xml
..META-INF
  ..
..data
  .config.txt
..frontend


Now my question is: Whats the location or url to acces my config-file

thanks a lot

nice regards

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Getting rid of JDO (loading requests too expensive)

[Brian Slesinsky]

Objectify doesn't scan the classpath so its startup time shouldn't be
affected by unused jars. However, other libraries in your application
might scan the classpath, so getting rid of unused jars might still be
a good idea.

On May 29, 7:42 am, Amir  Michail  wrote:
> On May 28, 7:33 pm, Viðar Svansson  wrote:
>
> > I have not tested the the performance of Twig but I think it loads
> > parents and children entities so it might load more than you need 
> > whengettingentities. My Objectify initialisation take around 200ms with
> > around 8 kinds.
>
> > Viðar
>
> I've modified my code to use  Objectify.  Do I need to remove unused
> jar files and/or change the configuration to reduce loading request
> times as much as possible with Objectify?
>
> I'm using the google Eclipse plugin.  The are a lot of jar files in
> the war/WEB-INF/lib directory:
>
> appengine-api-1.0-sdk-1.3.4.jar
> appengine-api-labs-1.3.4.jar
> appengine-jsr107cache-1.3.4.jar
> datanucleus-appengine-1.0.7.final.jar
> datanucleus-core-1.1.5.jar
> datanucleus-jpa-1.1.5.jar
> geronimo-jpa_3.0_spec-1.1.1.jar
> geronimo-jta_1.1_spec-1.1.1.jar
> gwt-servlet.jar
> jdo2-api-2.3-eb.jar
> jsr107cache-1.1.jar
> objectify-2.2.jar
>
> Amir
>
>
>
>
>
> > On Fri, May 28, 2010 at 3:31 PM, Amir  Michail  wrote:
>
> > > On May 27, 2:45 pm, Viðar Svansson  wrote:
> > >> Minimal change is probably to replace JDO with Twig. For more control
> > >> (and more changes to the code) you can go for Objectify.
>
> > >> Viðar
>
> > > Which one results in faster loading requests?
>
> > > Amir
>
> > >> On Thu, May 27, 2010 at 3:30 PM, Amir  Michail  
> > >> wrote:
>
> > >> > What is the easiest way to getridof JDO to improve loading request
> > >> > times?
>
> > >> > That is, what would require minimal changes to the code?
>
> > >> > --
> > >> > You received this message because you are subscribed to the Google 
> > >> > Groups "Google App Engine" group.
> > >> > To post to this group, send email to google-appeng...@googlegroups.com.
> > >> > To unsubscribe from this group, send email to 
> > >> > google-appengine+unsubscr...@googlegroups.com.
> > >> > For more options, visit this group 
> > >> > athttp://groups.google.com/group/google-appengine?hl=en.
>
> > > --
> > > You received this message because you are subscribed to the Google Groups 
> > > "Google App Engine" group.
> > > To post to this group, send email to google-appeng...@googlegroups.com.
> > > To unsubscribe from this group, send email to 
> > > google-appengine+unsubscr...@googlegroups.com.
> > > For more options, visit this group 
> > > athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Accessing xml files in war directory

[mark]

Hello I am running this code server side and it is working fine in
Development mode, buy when I push it to the app engine it is coming
back null.

DocumentBuilderFactory dbf = DocumentBuilderFactory.newInstance();
DocumentBuilder db = dbf.newDocumentBuilder();
Document doc = db.parse("test.xml");
doc.getDocumentElement().normalize();

Do I need to reference the xml file differently when I upload it to
app engine?

Thanks

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Updating Google App Engine datastore

[Víctor Mayoral]

Hello,
I've just an applications using GWT and GAE. After reading the docs
and doing some examples I decided to begin coding but soon I reach
something tricky.

My application data would be at the GAE datastore using JDO. I want to
assume
that the app "will live". Let me explain this:
The entities at the datastore will change. This means that some
properties would be added and some of them maybe removed what leaves
me with a ton of exceptions to handle. Knowing this, which should be
the way to update the datastore entities? One by one after a change
is
made? Should I handle exceptions and then change just the entitie
requested? Is there a way to do this cleaner?

I've been thinking about how to do this stuff with my actual
knowledge
and i think that the most logical way to proceed is get the object,
remove it from the database, create a new one based on this old
object
and then persist it again.

To sum up the question is about if there's a way to add a property to
an stored entitie in the datastore (GAE) easily.

I hope you to understand my lines. Any suggestion would be
appreciated.

Thanks,

Víctor.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Get, set, notify services

[Mitja Felicijan]

Hi.

I need to develop 3 services for a personal project. Idea in doing
this via google app engine is interesting. But I have couple of
questions.

My services will receive data from external devices and their states
will be stored in database. On the client side a web application will
do some operations with this devices on the hardware side. In my case
I would use google app engine as a middle-ware. But the main problem
that occurred to is how will I communicate with notify service? I've
read this sort of things can be done through XMPP that is supported
under google app engine.

Do you thing it is possible and reliable if I use it in such fashion?
Do you also thing such software will be reliable and fast? I can not
afford to have lag.

Thnx in advance.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] node allocation

[theresia freska]

Hi list,

Is there any way to control how many nodes we want to use? I want to
compare request time of using n nodes to run my app. I use Java, but
any input is appreciated. Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Problems with email from App Engine.

[Tony Of The Woods]

I set up a simple app that emails comments submitted on the site to
myself.

Firstly it's not completely clear from the docs what constitutes a
legal sender for an email.  Is it all of the following? :
(a) a registered developer of the application
(b) any legal receive address for the app, eg:
exam...@myappid.appspotmail.com
(c) the gmail address of any user logged in through the google login
service

No matter what I put in there I cannot successfully send any mail to
myself.  My mails do show up in the items sent count on the quota page
but they never get delivered.  I notice elsewhere that that have been
problems delivering to hotmail.  My email address is on one of the
mail.com domains.  Is it possible there is a glitch getting to
mail.com - or perhaps a blacklisting misunderstanding?

If I can send from exam...@myappid.appspotmail.com then I guess I
could put in a receiver process so I could see the bounced headers.
Is that the most sensible way of going about things?  Or maybe just
associate a gmail account with the app?


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Logs counted towards space quota?

[Nick Johnson (Google)]

On Tue, Jun 1, 2010 at 4:08 PM, gwstuff  wrote:

> Hi,
>
> Are logs currently counted towards an App's quota? If so, is there any
> way to delete old log messages?
>

No. There's a fixed amount of space set up for each app's logs at different
log levels, and they act as a circular buffer, evicting old records when
space is exhausted.


>
> I'm trying to understand the storage behavior of my app:
>
> Last updatedTotal number of entitiesSize of all entities
> 0:38:35 ago 122,918 41 MBytes
>
> However, under quotas:
>
> Total Stored Data23% 0.23 of 1.00 GBytes
>

This is because the size of indexes aren't included in the datastore stats.

-Nick Johnson


> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. ::
Registered in Dublin, Ireland, Registration Number: 368047
Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
368047

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Logs counted towards space quota?

[Jaroslav Záruba]

Could it be the rest are indexes..?

regards
  JZ

On Tue, Jun 1, 2010 at 5:08 PM, gwstuff  wrote:

> Hi,
>
> Are logs currently counted towards an App's quota? If so, is there any
> way to delete old log messages?
>
> I'm trying to understand the storage behavior of my app:
>
> Last updatedTotal number of entitiesSize of all entities
> 0:38:35 ago 122,918 41 MBytes
>
> However, under quotas:
>
> Total Stored Data23% 0.23 of 1.00 GBytes
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Logs counted towards space quota?

[gwstuff]

Hi,

Are logs currently counted towards an App's quota? If so, is there any
way to delete old log messages?

I'm trying to understand the storage behavior of my app:

Last updatedTotal number of entitiesSize of all entities
0:38:35 ago 122,918 41 MBytes

However, under quotas:

Total Stored Data23% 0.23 of 1.00 GBytes

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: A really easy question

[Backpack]

Gather all your data in one dict:

data={
  'lgourl':lgourl,
  'lista':lista,
  'more':stuff
}
self.response.out.write(template.render(view,data))


On Jun 1, 3:09 am, Massimiliano 
wrote:
> Dear Geoffrey,
> I need to pass to the render() three information: the main.hmtl, the logout
> URL (lgourl) and the list of element in need to be displayed in the html.
> How can I do this? is it this method wrong? Can't I give to the render() two
> dicts?
>
> Regards
>
> Massimiliano
>
> 2010/5/31 Geoffrey Spear 
>
>
>
>
>
> > It looks like you're passing 2 dicts to render(); you should only be
> > passing 1 with all of the values.
>
> > On May 31, 4:47 pm, Massimiliano 
> > wrote:
> > > Dear All,
> > > I'm a beginner. I'm three days thinking about this, but it's not working.
>
> > > In my main.py
> > > lista = db.Query(FOOD).order('-Date').fetch(30)
> > > self.response.out.write(template.render('main.html', {'lgourl':lgourl},
> > > {'lista':lista}))
>
> > > In my main.html
>
> > > {% block centro %}
> > > {% for elemento in lista %}
> > > {{elemento.Food}} ({{elemento.Nick}})
> > > {% endfor %}
> > > {% endblock %}
>
> > > I can't display nothing.
>
> > > Please, this is driving me crazy!
>
> > > Massimiliano
>
> > > --
>
> > > My email: massimiliano.pietr...@gmail.com
> > > My Google Wave: massimiliano.pietr...@googlewave.com
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appeng...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com > e...@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
>
> --
>
> My email: massimiliano.pietr...@gmail.com
> My Google Wave: massimiliano.pietr...@googlewave.com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Getting rid of JDO (loading requests too expensive)

[Jake]

Hey,

If you haven't done so already, check the Objectify group for similar
posts.  That mailing list is simply amazing and I often go there with
any GAE datastore related question.

In response to your question, I did remove some jars, but I build my
project with some crazy hacked-together maven install so it probably
won't help you.

Jake

On May 29, 8:42 pm, taoneill  wrote:
> Here are two good blog posts I've referred to in the 
> past:http://turbomanage.wordpress.com/2010/03/26/appengine-cold-starts-con...http://www.answercow.com/2010/03/google-app-engine-cold-start-guide-f...
>
> Basically, since the eclipse plugin always adds the JDO + JPA jars
> during deployment (even if you delete them manually), apparently you
> have to upload your app manually using the command line tool 
> (seehttp://code.google.com/appengine/docs/java/gettingstarted/uploading.html).
> I can't vouch for the cold start performance increase however because
> I haven't tried this myself.
>
> On May 29, 10:42 am, Amir  Michail  wrote:
>
> > On May 28, 7:33 pm, Viðar Svansson  wrote:
>
> > > I have not tested the the performance of Twig but I think it loads
> > > parents and children entities so it might load more than you need 
> > > whengettingentities. My Objectify initialisation take around 200ms with
> > > around 8 kinds.
>
> > > Viðar
>
> > I've modified my code to use  Objectify.  Do I need to remove unused
> > jar files and/or change the configuration to reduce loading request
> > times as much as possible with Objectify?
>
> > I'm using the google Eclipse plugin.  The are a lot of jar files in
> > the war/WEB-INF/lib directory:
>
> > appengine-api-1.0-sdk-1.3.4.jar
> > appengine-api-labs-1.3.4.jar
> > appengine-jsr107cache-1.3.4.jar
> > datanucleus-appengine-1.0.7.final.jar
> > datanucleus-core-1.1.5.jar
> > datanucleus-jpa-1.1.5.jar
> > geronimo-jpa_3.0_spec-1.1.1.jar
> > geronimo-jta_1.1_spec-1.1.1.jar
> > gwt-servlet.jar
> > jdo2-api-2.3-eb.jar
> > jsr107cache-1.1.jar
> > objectify-2.2.jar
>
> > Amir
>
> > > On Fri, May 28, 2010 at 3:31 PM, Amir  Michail  wrote:
>
> > > > On May 27, 2:45 pm, Viðar Svansson  wrote:
> > > >> Minimal change is probably to replace JDO with Twig. For more control
> > > >> (and more changes to the code) you can go for Objectify.
>
> > > >> Viðar
>
> > > > Which one results in faster loading requests?
>
> > > > Amir
>
> > > >> On Thu, May 27, 2010 at 3:30 PM, Amir  Michail  
> > > >> wrote:
>
> > > >> > What is the easiest way to getridof JDO to improve loading request
> > > >> > times?
>
> > > >> > That is, what would require minimal changes to the code?
>
> > > >> > --
> > > >> > You received this message because you are subscribed to the Google 
> > > >> > Groups "Google App Engine" group.
> > > >> > To post to this group, send email to 
> > > >> > google-appeng...@googlegroups.com.
> > > >> > To unsubscribe from this group, send email to 
> > > >> > google-appengine+unsubscr...@googlegroups.com.
> > > >> > For more options, visit this group 
> > > >> > athttp://groups.google.com/group/google-appengine?hl=en.
>
> > > > --
> > > > You received this message because you are subscribed to the Google 
> > > > Groups "Google App Engine" group.
> > > > To post to this group, send email to google-appeng...@googlegroups.com.
> > > > To unsubscribe from this group, send email to 
> > > > google-appengine+unsubscr...@googlegroups.com.
> > > > For more options, visit this group 
> > > > athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: ReferenceProperty prefetching: am I doing it backwards?

[Tim Hoffman]

Hi

yep, I did refer to Nicks blog, which is a much better approach.
Thanks for pointing that out.

Rgds

T

On Jun 1, 6:01 pm, djidjadji  wrote:
> Hi Tim,
>
> It's not recommended practice to use the Model._property members of the 
> object.
> These variables are implementation dependent.
> Better to use the get_value_for_datastore() method of the Property.
>
> 2010/6/1 Tim Hoffman :
>
>
>
> > Yep you are doing it wrong.
>
> > You have
>
> > tagresults = models.Tag.all().order(sort_order).filter("name =
> > ",tag_name).fetch(10)
> >        article_keys = [f.article.key() for f in tagresults]
>
> > The minute you reference f.article you have dereferenced article and
> > now have the object, then you
> > are fetching its key then fetching the article.
>
> > Have a look 
> > athttp://groups.google.com.au/group/google-appengine-python/browse_thre...
> > or Nick Johnsons article
> >http://www.google.com/url?sa=D&q=http://blog.notdot.net/2010/01/Refer...
>
> > Put simply you should
> > article_keys = [f._article for f in tagresults]
>
> > Then fetch the articles
>
> > results = models.Article.get(article_keys)
>
> > In your reverse query you are on the right track except
> > you have tags = [t for t in article.tag_set]
>
> > You probably want to do a [t for t in article.tag_set.fetch(100)]  or
> > similiar
> > other wise you will send lots of single fetches.
>
> > I haven't addressed caching.
>
> > You should run appstats before and after any changes so you can see
> > what sort of improvements you are getting.
>
> > Rgds

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: ReferenceProperty prefetching: am I doing it backwards?

[djidjadji]

Hi Tim,

It's not recommended practice to use the Model._property members of the object.
These variables are implementation dependent.
Better to use the get_value_for_datastore() method of the Property.

2010/6/1 Tim Hoffman :
> Yep you are doing it wrong.
>
> You have
>
> tagresults = models.Tag.all().order(sort_order).filter("name =
> ",tag_name).fetch(10)
>        article_keys = [f.article.key() for f in tagresults]
>
> The minute you reference f.article you have dereferenced article and
> now have the object, then you
> are fetching its key then fetching the article.
>
> Have a look at 
> http://groups.google.com.au/group/google-appengine-python/browse_thread/thread/9fb2ddf832a16e0e/
> or Nick Johnsons article
> http://www.google.com/url?sa=D&q=http://blog.notdot.net/2010/01/ReferenceProperty-prefetching-in-App-Engine&usg=AFQjCNGu1cRk9JIgOWBwM-6e8FBtTBpkRw
>
> Put simply you should
> article_keys = [f._article for f in tagresults]
>
> Then fetch the articles
>
> results = models.Article.get(article_keys)
>
> In your reverse query you are on the right track except
> you have tags = [t for t in article.tag_set]
>
> You probably want to do a [t for t in article.tag_set.fetch(100)]  or
> similiar
> other wise you will send lots of single fetches.
>
> I haven't addressed caching.
>
> You should run appstats before and after any changes so you can see
> what sort of improvements you are getting.
>
> Rgds

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: A really easy question

[djidjadji]

self.response.out.write(template.render('main.html',
{'lgourl':lgourl,'lista':lista}))

2010/6/1 Massimiliano :
> Dear Geoffrey,
> I need to pass to the render() three information: the main.hmtl, the logout
> URL (lgourl) and the list of element in need to be displayed in the html.
> How can I do this? is it this method wrong? Can't I give to the render() two
> dicts?
>
> Regards
>
> Massimiliano
>
> 2010/5/31 Geoffrey Spear 
>>
>> It looks like you're passing 2 dicts to render(); you should only be
>> passing 1 with all of the values.
>>
>> On May 31, 4:47 pm, Massimiliano 
>> wrote:
>> > Dear All,
>> > I'm a beginner. I'm three days thinking about this, but it's not
>> > working.
>> >
>> > In my main.py
>> > lista = db.Query(FOOD).order('-Date').fetch(30)
>> > self.response.out.write(template.render('main.html', {'lgourl':lgourl},
>> > {'lista':lista}))
>> >
>> > In my main.html
>> >
>> > {% block centro %}
>> > {% for elemento in lista %}
>> > {{elemento.Food}} ({{elemento.Nick}})
>> > {% endfor %}
>> > {% endblock %}
>> >
>> > I can't display nothing.
>> >
>> > Please, this is driving me crazy!
>> >
>> > Massimiliano
>> >
>> > --
>> >
>> > My email: massimiliano.pietr...@gmail.com
>> > My Google Wave: massimiliano.pietr...@googlewave.com
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appeng...@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>
>
>
> --
>
> My email: massimiliano.pietr...@gmail.com
> My Google Wave: massimiliano.pietr...@googlewave.com
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: ReferenceProperty prefetching: am I doing it backwards?

[Tim Hoffman]

Yep you are doing it wrong.

You have

tagresults = models.Tag.all().order(sort_order).filter("name =
",tag_name).fetch(10)
article_keys = [f.article.key() for f in tagresults]

The minute you reference f.article you have dereferenced article and
now have the object, then you
are fetching its key then fetching the article.

Have a look at 
http://groups.google.com.au/group/google-appengine-python/browse_thread/thread/9fb2ddf832a16e0e/
or Nick Johnsons article
http://www.google.com/url?sa=D&q=http://blog.notdot.net/2010/01/ReferenceProperty-prefetching-in-App-Engine&usg=AFQjCNGu1cRk9JIgOWBwM-6e8FBtTBpkRw

Put simply you should
article_keys = [f._article for f in tagresults]

Then fetch the articles

results = models.Article.get(article_keys)

In your reverse query you are on the right track except
you have tags = [t for t in article.tag_set]

You probably want to do a [t for t in article.tag_set.fetch(100)]  or
similiar
other wise you will send lots of single fetches.

I haven't addressed caching.

You should run appstats before and after any changes so you can see
what sort of improvements you are getting.

Rgds

T


On Jun 1, 11:43 am, Ben  wrote:
> My models look like this:
>
> class Article(db.Model):
>     author = db.UserProperty()
>     content = db.StringProperty(multiline=True)
>
> class Tag(polymodel.PolyModel):
>         article = db.ReferenceProperty(Article)
>         name = db.StringProperty()
>
> Now if I want to create a page which lists all the articles that use a
> particular tag, I'm doing this:
>
>         tagresults = models.Tag.all().order(sort_order).filter("name =
> ",tag_name).fetch(10)
>         article_keys = [f.article.key() for f in tagresults]
>         results = models.Article.get(seed_keys)
>
> Could I be doing that better? Is that the proper way to store things
> as a reference, particularly if I want it to be a very fast query, and
> preferably saveable in memcache?
>
> Now I also want to do the reverse: create a page that lists articles
> in order, and shows every tag used for each article.
>
>         articles = models.Article.all().order(sort_order).fetch(10)
>         for article in articles:
>                 tags = [t for t in article.tag_set]
>                 article.tags = [t.name for t in tags]
>
> That's all I'm doing, and it thus its having to run a query to fetch
> the tags, I think.
>
> I think I'm possibly doing both of these wrong, because I want to
> prefetch and memcache the parent or child depending on which type of
> page (tag pages which show articles, and article pages which show
> tags). I've read about a dozen articles on using the
> get_value_for_datastore but it doesn't look like it does what I'm
> looking for, unless I'm just not understanding it...
>
> Any help?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] ReferenceProperty prefetching: am I doing it backwards?

[Mr. Rajiv Bakulesh Shah]

Hi, Ben.

My app (a social bookmarking service) is similar to yours.  Conceptually, you 
provide a URL, and my app returns relevant tags.  Conversely, you search for 
keywords, and my app returns relevant URLs.  You can play with my app here: 
http://imi-imi.appspot.com/

Auto-tagging and search are inverse problems.  When you auto-tag, you provide 
content, and my app returns keywords.  When you search, you provide keywords, 
and my app returns content.

In search engine theory, we have data structures and algorithms optimized for 
both of these problems.  If you understand the data structures, the algorithms 
become apparent.  The relevant data structures are called forward and reverse 
indexes.  Forward indexes map content to keywords.  Reverse indexes map 
keywords to content.  You can learn more about forward and reverse indexes 
here: http://en.wikipedia.org/wiki/Index_(search_engine)

In your app, you have articles and tags.  Add forward indexes to articles and 
reverse indexes to tags like so:

class Article(db.Model):
author = db.UserProperty()
content = db.StringProperty(multiline=True)
keywords = db.ListProperty(str, default=[], indexed=False)

class Tag(polymodel.PolyModel):
keyword = db.StringProperty()
articles = db.ListProperty(db.Key, default=[], indexed=False)

Whenever a user tags an article, you have to modify two entities.  Add the 
keyword to the article object, and add the article object's key to the tag 
object (creating the tag object if it doesn't exist):

article.keywords.append(keyword)
tag = models.Tag.all().filter('keyword =', keyword).get()
if tag is None:
tag = models.Tag()
tag.keyword = keyword
tag.articles.append(article.key())
db.put([article, tag])

Now it's trivial to list all of the tags for an article (as tags are stored as 
an attribute - a list of strings - on every article object).  It's also easy to 
list all of the articles tagged with a certain keyword:

tag = models.Tag.all().filter('keyword =', keyword).get()
if tag is None:
articles = []
else:
articles = db.get(tag.articles)
articles = [article for article in articles if article is not None]

There are further optimizations.  You can stem keywords (so that a search for 
"blogs" also returns articles tagged "blog").  You can also manually assign 
keys that correspond to stemmed keywords for tag objects (to save yourself one 
datastore query per keyword per search query).  But I hope this is enough to 
get you started.

If you need more ideas, feel free to look through my source code: 
http://code.google.com/p/imi-imi/source/browse/#svn/trunk

Happy hacking,
Raj

On May 31, 2010, at 10:43 PM, Ben wrote:

> My models look like this:
> 
> class Article(db.Model):
>author = db.UserProperty()
>content = db.StringProperty(multiline=True)
> 
> class Tag(polymodel.PolyModel):
>   article = db.ReferenceProperty(Article)
>   name = db.StringProperty()
> 
> Now if I want to create a page which lists all the articles that use a
> particular tag, I'm doing this:
> 
>   tagresults = models.Tag.all().order(sort_order).filter("name =
> ",tag_name).fetch(10)
>   article_keys = [f.article.key() for f in tagresults]
>   results = models.Article.get(seed_keys)
> 
> Could I be doing that better? Is that the proper way to store things
> as a reference, particularly if I want it to be a very fast query, and
> preferably saveable in memcache?
> 
> Now I also want to do the reverse: create a page that lists articles
> in order, and shows every tag used for each article.
> 
>   articles = models.Article.all().order(sort_order).fetch(10)
>   for article in articles:
>   tags = [t for t in article.tag_set]
>   article.tags = [t.name for t in tags]
> 
> That's all I'm doing, and it thus its having to run a query to fetch
> the tags, I think.
> 
> I think I'm possibly doing both of these wrong, because I want to
> prefetch and memcache the parent or child depending on which type of
> page (tag pages which show articles, and article pages which show
> tags). I've read about a dozen articles on using the
> get_value_for_datastore but it doesn't look like it does what I'm
> looking for, unless I'm just not understanding it...
> 
> Any help?
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
> 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.goog

Re: [google-appengine] Re: A really easy question

[Massimiliano]

Dear Geoffrey,
I need to pass to the render() three information: the main.hmtl, the logout
URL (lgourl) and the list of element in need to be displayed in the html.
How can I do this? is it this method wrong? Can't I give to the render() two
dicts?

Regards

Massimiliano

2010/5/31 Geoffrey Spear 

> It looks like you're passing 2 dicts to render(); you should only be
> passing 1 with all of the values.
>
> On May 31, 4:47 pm, Massimiliano 
> wrote:
> > Dear All,
> > I'm a beginner. I'm three days thinking about this, but it's not working.
> >
> > In my main.py
> > lista = db.Query(FOOD).order('-Date').fetch(30)
> > self.response.out.write(template.render('main.html', {'lgourl':lgourl},
> > {'lista':lista}))
> >
> > In my main.html
> >
> > {% block centro %}
> > {% for elemento in lista %}
> > {{elemento.Food}} ({{elemento.Nick}})
> > {% endfor %}
> > {% endblock %}
> >
> > I can't display nothing.
> >
> > Please, this is driving me crazy!
> >
> > Massimiliano
> >
> > --
> >
> > My email: massimiliano.pietr...@gmail.com
> > My Google Wave: massimiliano.pietr...@googlewave.com
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 

My email: massimiliano.pietr...@gmail.com
My Google Wave: massimiliano.pietr...@googlewave.com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] ReferenceProperty prefetching: am I doing it backwards?

[djidjadji]

tagresults = models.Tag.all().order(sort_order).filter("name
=",tag_name).fetch(10)
article_keys = [Tag.article.get_value_for_datastore(f) for f in tagresults]
results = db.get(seed_keys)

This will not result in a datastore fetch for each article key you
need. The ReferenceProperty already contains the full Article db.Key.

But why don't you put the tag words in a StringListProperty in the
Article object?

2010/6/1 Ben :
> My models look like this:
>
> class Article(db.Model):
>    author = db.UserProperty()
>    content = db.StringProperty(multiline=True)
>
> class Tag(polymodel.PolyModel):
>        article = db.ReferenceProperty(Article)
>        name = db.StringProperty()
>
> Now if I want to create a page which lists all the articles that use a
> particular tag, I'm doing this:
>
>        tagresults = models.Tag.all().order(sort_order).filter("name =
> ",tag_name).fetch(10)
>        article_keys = [f.article.key() for f in tagresults]
>        results = models.Article.get(seed_keys)
>
> Could I be doing that better? Is that the proper way to store things
> as a reference, particularly if I want it to be a very fast query, and
> preferably saveable in memcache?
>
> Now I also want to do the reverse: create a page that lists articles
> in order, and shows every tag used for each article.
>
>        articles = models.Article.all().order(sort_order).fetch(10)
>        for article in articles:
>                tags = [t for t in article.tag_set]
>                article.tags = [t.name for t in tags]
>
> That's all I'm doing, and it thus its having to run a query to fetch
> the tags, I think.
>
> I think I'm possibly doing both of these wrong, because I want to
> prefetch and memcache the parent or child depending on which type of
> page (tag pages which show articles, and article pages which show
> tags). I've read about a dozen articles on using the
> get_value_for_datastore but it doesn't look like it does what I'm
> looking for, unless I'm just not understanding it...
>
> Any help?
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.