date:20100707

Hi,

   This page - 
http://code.google.com/appengine/docs/python/datastore/transactions.html
- says that we cannot raise more than 5 transactional tasks in a
single transaction, and I wanted to check if this was a limit that you
were hoping to raise, or if this is likely to be a long term
restriction?  Does this restriction limit API calls to the task queue
or actual number of tasks -  e.g. could I raise more than 5 by doing
them in batch with a single call to the task queue API? Cheers,

Colin

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Issue with admin access

2010-07-07 Thread Saxon Druce

My u...@myotherdomain.com account disappeared by itself from my app's
permissions list overnight. I re-added it, and then it worked fine
this time. If that was due to something which someone at Google did,
thanks!

Saxon

On Jul 2, 12:26 am, Saxon Druce saxondr...@gmail.com wrote:
 Hi,

 I am trying to set up the following:

 1. My app running atwww.mydomain.com
 2. Users can log in atwww.mydomain.com, using google accounts (not
 google apps)
 3. I can log in atwww.mydomain.com/admin, as an admin for my app

 To do this I have tried the following:

 a. Create a google apps account for mydomain.com
 b. Sign in towww.appspot.com/a/mydomain.com
 c. Create myapp, with google accounts authentication
 d. Add mydomain.com as a domain
 e. Add an alternative url ofwww.mydomain.com
 f. At this stage both points 1 and 2 above work
 g. In my app.yaml, add a handler for /admin with login: admin
 h. As expected I can't log in to /admin as my google apps account
 (because I chose google accounts authentication)
 i. So I create a google account (not google apps) for
 u...@myotherdomain.com
 j. While logged in towww.appspot.com/a/mydomain.com, invite
 u...@myotherdomain.com as an admin
 k. Log in to google as u...@myotherdomain.com
 l. Click the link in the invitation email, and accept
 m. If I log back in towww.appspot.com/a/mydomain.com, then
 u...@myotherdomain.com shows up as a user
 n. BUT if I log out and log in towww.appspot.comas
 u...@myotherdomain.com, then myapp is not listed
 o. AND if I go towww.mydomain.com/admin(or myapp.appspot.com/admin)
 and log in as u...@myotherdomain.com, then I get Error: Forbidden
 Your client does not have permission to get URL /admin from this
 server.

 Have I done something wrong?

 Is there a better way to achieve what I want? Maybe I should have
 created myapp under u...@myotherdomain.com, and then just done steps
 a, d and e?

 Thanks,
 Saxon

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Getting Started hangup with Eclipse

2010-07-07 Thread Blue Shoes

I am just now getting back to trying to use the GAE plug-in for
Eclipse. Here's a pertinent piece of information that relates to a
problem I will decribe below: I also have the Adobe Flash Builder plug-
in installed in Eclipse

The three GAE buttons appear in the tool bar as you described. But I
still do not have any GAE perspectives available, only perspectives
for Adobe Flash Builder, Java, CVS Repository, etc. If I open one of
those perspectives--say, Adobe Flash Builder--click on the GAE New
Web Application Project button in the toolbar, supply a project name,
etc., it creates a project, but the perspective is still the one for
Adobe Flash Builder and the context menus on the Explorer panel have
only menu items relating to Adobe Flash Builder.

What am I missing?

On Jul 2, 12:27 pm, Jaroslav Záruba jaroslav.zar...@gmail.com wrote:
I don't think there will be need to pay anything. :) People are very helpful
here.

The plug-in does not install new perspective. You should see new item in
Window - Preferences. And to some perspectives (Java, Debug,...) it adds
three buttons.

On Fri, Jul 2, 2010 at 2:48 AM, Blue Shoes anderson.ala...@gmail.comwrote:

I am starting from scratch and have attempted to follow the directions
at Getting Started. I got so far as downloading and installing the
GAE plug-in for Eclipse, but I do not see it as an available Eclipse
perspective. I am admittedly not expert on Eclipse, but what might be
my problem? For what it is worth, I have GoToMeeting with which a can
connect remotely to somebody and show them my screen and give them
control of my keyboard and mouse. I would be willing to pay a
reasonable fee for help in overcoming these Getting Started snags.

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscrib...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

Google Eclipse plug-in.png
40KViewDownload- Hide quoted text -

- Show quoted text -

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Getting Started hangup with Eclipse

2010-07-07 Thread Blue Shoes

How does one invoke the New wizard? If I choose File | New, it
displays a submenu (not a wizard) that had only Adobe Flex stuff on
it.

On Jul 2, 12:31 pm, Jaroslav Záruba jaroslav.zar...@gmail.com wrote:
Oh, and obviously you should see couple of new options under the New wizard,
see attachment.

2010/7/2 Jaroslav Záruba jaroslav.zar...@gmail.com

I don't think there will be need to pay anything. :) People are very
helpful here.

The plug-in does not install new perspective. You should see new item in
Window - Preferences. And to some perspectives (Java, Debug,...) it adds
three buttons.

On Fri, Jul 2, 2010 at 2:48 AM, Blue Shoes anderson.ala...@gmail.comwrote:

Google Eclipse plug-in (2).png
38KViewDownload- Hide quoted text -

- Show quoted text -

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Getting Started hangup with Eclipse

2010-07-07 Thread Jaroslav Záruba

Again, there's no GWT/GAE perspective. :)

On Wed, Jul 7, 2010 at 3:33 PM, Blue Shoes anderson.ala...@gmail.comwrote:

How does one invoke the New wizard? If I choose File | New, it
displays a submenu (not a wizard) that had only Adobe Flex stuff on
it.

But this is really weird. Is it possible you have it hidden under the File
- New - Other...?

I would try to rename your current Eclipse installation folder and download
one without the Flex stuff. According to my experience this is safe.
Unfortunately Google seem to recommend clear install with every update the
plugin gets, so you will play like that anyways. (But it is more of an
annoyance then a pain. Last time I had to re-install Ecilpse it preserved
all my settings. Even those I had to export/import manually in the past.)

On Jul 2, 12:31 pm, Jaroslav Záruba jaroslav.zar...@gmail.com wrote:
Oh, and obviously you should see couple of new options under the New
wizard,
see attachment.

2010/7/2 Jaroslav Záruba jaroslav.zar...@gmail.com

I don't think there will be need to pay anything. :) People are very
helpful here.

The plug-in does not install new perspective. You should see new item
in
Window - Preferences. And to some perspectives (Java, Debug,...) it
adds
three buttons.

On Fri, Jul 2, 2010 at 2:48 AM, Blue Shoes anderson.ala...@gmail.com
wrote:

--
You received this message because you are subscribed to the Google
Groups
Google App Engine group.
To post to this group, send email to
google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
google-appengine%2bunsubscrib...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

Google Eclipse plug-in (2).png
38KViewDownload- Hide quoted text -

- Show quoted text -

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Getting Started hangup with Eclipse

2010-07-07 Thread Jaroslav Záruba

2010/7/7 Jaroslav Záruba jaroslav.zar...@gmail.com

 Unfortunately Google seem to recommend clear install with every update the
 plugin gets,


Oh, looks like I was kinda wrong here. :)

On Wed, Jul 7, 2010 at 3:34 PM, Jason Parekh jasonpar...@gmail.com wrote:

 Yes, the clean installation is recommended *for milestones only* -- mainly
 because the code may have a few issues due to its milestone status, so we
 wouldn't want your existing stable Eclipse environment to become unusable.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] NeedIndexError: The index for this query is not ready to serve.

2010-07-07 Thread adamea

Why is my index taking so long to build? I have 39 rows in my database
and it's been going for a considerable amount of time!

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Getting Started hangup with Eclipse

2010-07-07 Thread Alon Carmel

You didnt specify if you want to develop for GAE in python or java. if your
going to use java your good to go with the GAE plugin, but if you want
pyhton you need to install PyDev which installs a perspective and some GAE
new project wizards.

haul if you need help.
-
Cheers,
public static function AlonCarmel() {
//Contact me
var email = 'a...@aloncarmel.me';
var twitter = '@aloncarmel';
var web = 'http://aloncarmel.me';
var phone = '+972-54-4860380';
}

* If you received an unsolicited email from by mistake that wasn't of your
matter please delete immediately. All E-mail sent from Alon Carmel is
copyrighted to Alon Carmel 2008. Any details revealed in e-mails sent by
Alon Carmel are owned by the Author only. Any attempt to duplicate or
imitate any of the Content is prohibited under copyright law 2008.



2010/7/7 Jaroslav Záruba jaroslav.zar...@gmail.com

 2010/7/7 Jaroslav Záruba jaroslav.zar...@gmail.com

 Unfortunately Google seem to recommend clear install with every update the
 plugin gets,


 Oh, looks like I was kinda wrong here. :)

 On Wed, Jul 7, 2010 at 3:34 PM, Jason Parekh jasonpar...@gmail.com
  wrote:

 Yes, the clean installation is recommended *for milestones only* --
 mainly because the code may have a few issues due to its milestone status,
 so we wouldn't want your existing stable Eclipse environment to become
 unusable.

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Getting Started hangup with Eclipse

2010-07-07 Thread Jeff Schwartz

I'd just add that there is also value in Aptana's plugins for html, css and
javascript support but it is not absolutely necessary. Also note that their
current release has a bug when installed in Helios (Eclispe 3.6). This bug
is not present when installed in older versions of Eclipse. Supposedly they
are working on a fix for Helios but I just tried their nightly build and
that failed to install.

On Wed, Jul 7, 2010 at 10:37 AM, Alon Carmel a...@aloncarmel.me wrote:

 You didnt specify if you want to develop for GAE in python or java. if your
 going to use java your good to go with the GAE plugin, but if you want
 pyhton you need to install PyDev which installs a perspective and some GAE
 new project wizards.

 haul if you need help.
 -
 Cheers,
 public static function AlonCarmel() {
 //Contact me
 var email = 'a...@aloncarmel.me';
 var twitter = '@aloncarmel';
 var web = 'http://aloncarmel.me';
 var phone = '+972-54-4860380';
 }

 * If you received an unsolicited email from by mistake that wasn't of your
 matter please delete immediately. All E-mail sent from Alon Carmel is
 copyrighted to Alon Carmel 2008. Any details revealed in e-mails sent by
 Alon Carmel are owned by the Author only. Any attempt to duplicate or
 imitate any of the Content is prohibited under copyright law 2008.




 2010/7/7 Jaroslav Záruba jaroslav.zar...@gmail.com

 2010/7/7 Jaroslav Záruba jaroslav.zar...@gmail.com

 Unfortunately Google seem to recommend clear install with every update the
 plugin gets,


 Oh, looks like I was kinda wrong here. :)

 On Wed, Jul 7, 2010 at 3:34 PM, Jason Parekh jasonpar...@gmail.com
  wrote:

 Yes, the clean installation is recommended *for milestones only* --
 mainly because the code may have a few issues due to its milestone status,
 so we wouldn't want your existing stable Eclipse environment to become
 unusable.

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
--
Jeff

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] NeedIndexError: The index for this query is not ready to serve.

2010-07-07 Thread Jeff Schwartz

Google announced that appengine would be undergoing maintenance today so
that might be the reason.

On Wed, Jul 7, 2010 at 10:05 AM, adamea adam.earns...@gmail.com wrote:

 Why is my index taking so long to build? I have 39 rows in my database
 and it's been going for a considerable amount of time!

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
--
Jeff

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] 5 transactional tasks

2010-07-07 Thread Nate Bauernfeind

I have noticed that batch datastore calls run within a single transaction.
The maximum number of entities that can be added or deleted (and probably
modified, though I have not tried) was 500. I'm betting you could probably
wrap them around a single transaction. Though, from my experience, I
wouldn't really recommend doing this (since trying to commit two batches of
500 to the datastore within the same call tended to time out for me).

Also, don't confuse transactional tasks with the task queue. Transactional
tasks are the those that will all happen simultaneously or will graciously
fail without any partial commits. Due to the implementation details you
probably want to avoid intentionally doing lots of transaction updates on
the same few objects, since it is possible (if you are kicking lots of
simultaneous jobs off with the task queue) to shoot yourself in the foot and
have a very small success rate.

Transactions work with the task queue in such a way that the task will only
be added to the queue if no other piece of your commits fail. For example,
you wouldn't really want your app to run the new user code if you couldn't
create the new user account for that user because someone else registered
that user name at the same time. I.E. Things on the task queue do not
continue running within the same transaction if they were created within
one.

On Wed, Jul 7, 2010 at 4:22 AM, hawkett hawk...@gmail.com wrote:

Hi,

This page -
http://code.google.com/appengine/docs/python/datastore/transactions.html
- says that we cannot raise more than 5 transactional tasks in a
single transaction, and I wanted to check if this was a limit that you
were hoping to raise, or if this is likely to be a long term
restriction? Does this restriction limit API calls to the task queue
or actual number of tasks - e.g. could I raise more than 5 by doing
them in batch with a single call to the task queue API? Cheers,

Colin

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] 5 transactional tasks

2010-07-07 Thread Robert Kluin

We use a simple technique to effectively add more than 5
_transactional_ tasks.  In our datastore transaction we add one
transactional fanout task.  The fanout task creates all of the other
tasks, and each task is given a name.  Naming the task prevents adding
the same task more than once, but at the same time we get 'eventual
consistency' because the other tasks will eventually get created.


Robert






On Wed, Jul 7, 2010 at 10:46 AM, Nate Bauernfeind
nate.bauernfe...@gmail.com wrote:
 I have noticed that batch datastore calls run within a single transaction.
 The maximum number of entities that can be added or deleted (and probably
 modified, though I have not tried) was 500. I'm betting you could probably
 wrap them around a single transaction. Though, from my experience, I
 wouldn't really recommend doing this (since trying to commit two batches of
 500 to the datastore within the same call tended to time out for me).
 Also, don't confuse transactional tasks with the task queue. Transactional
 tasks are the those that will all happen simultaneously or will graciously
 fail without any partial commits. Due to the implementation details you
 probably want to avoid intentionally doing lots of transaction updates on
 the same few objects, since it is possible (if you are kicking lots of
 simultaneous jobs off with the task queue) to shoot yourself in the foot and
 have a very small success rate.
 Transactions work with the task queue in such a way that the task will only
 be added to the queue if no other piece of your commits fail. For example,
 you wouldn't really want your app to run the new user code if you couldn't
 create the new user account for that user because someone else registered
 that user name at the same time. I.E. Things on the task queue do not
 continue running within the same transaction if they were created within
 one.

 On Wed, Jul 7, 2010 at 4:22 AM, hawkett hawk...@gmail.com wrote:

 Hi,

   This page -
 http://code.google.com/appengine/docs/python/datastore/transactions.html
 - says that we cannot raise more than 5 transactional tasks in a
 single transaction, and I wanted to check if this was a limit that you
 were hoping to raise, or if this is likely to be a long term
 restriction?  Does this restriction limit API calls to the task queue
 or actual number of tasks -  e.g. could I raise more than 5 by doing
 them in batch with a single call to the task queue API? Cheers,

 Colin

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] list-property, many to many, 5000 indexes...HELP!

Hi I think I have a fair handle on how Datastore works, but I need to
check, and I need some help with a design

lets say I have:
a very large list of BOOKS
the BOOKS are tagged- adventure+romance,   historical+drama,
animation+sci-fi+comedy, etc...
and I have a very large list of USERS.
USERS can read a very large number of BOOKS
And I, as a USER, can have a very large number of USERS who are my
friend.

What I want , in english, is
;  Return a list of all the BOOKS tagged with sci-fi and romance
that have been read by USERS who are my friend, sorted by Most
Frequently Read.

Now, I know I can model tags with a ListProperty, so that filtering is
easy = WHERE tag AND tag AND tag...
And I know that I can sort Books by Most Frequently Read  quite easily

But due to the large number of BOOKS that could be read by  a USER,
and the large number of USERS who could be my friend, I cant
practically model  BOOKS READ BY USERS and  USERS WHO ARE MY FRIEND as
ListProperties...

...Because I would blow the 5000 index limit per entity, because each
value of ListPropery generates its own index entry.  Is that correct?

I cant find a way to handle this without resorting to filtering in
memory.  Am I dumb, or is that just the way it is?

My solution is:

BOOK:
numerOfReads
TagList
otherStuff


Then I look up a relationship entity to find out everyone who is a
FRIEND of mine.
FRIENDS:
userKey
friendKey

Then I look up a relationship entity to find out which BOOKS that
USERS have read
BOOKSREAD:
userKey
bookKey
TagList
numberOfReads

So first I pull into memory the list of my particular friendKeys from
the FRIENDS table.

Then I churn through the table of BOOKSREAD, using the duplicated
properties TagList and numberOfReads to filter on tags and sort
according to number of reads.

I then filter this list of BOOKS *in memory* by the friendKeys I
have.  Ill need some sort of algorithm to keep pulling chunks of BOOKS
from the database until I have a nice page of books  my friends have
read (20 books displayed per page) to pass to the GUI.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

RE: [google-appengine] Can not delete entity using Data Viewer and a GQL query.

2010-07-07 Thread test . siloka



--
Mobile message from Corporate Email powered by Remoba Inc.


Original Content Appended

--
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

---BeginMessage---
Date: Tue, 06 Jul 2010 07:52:04 -0700 (PDT)
Content-Type: text/plain


this error occur while trying to delete a row found through a search,
if you look for it on a paged table and you delete it, this won't
happen again

--
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

---End Message---

[google-appengine] Re: NeedIndexError: The index for this query is not ready to serve.

2010-07-07 Thread tjwebb

I'm getting this as well

On Jul 7, 11:02 am, Jeff Schwartz jefftschwa...@gmail.com wrote:
 Google announced that appengine would be undergoing maintenance today so
 that might be the reason.

 On Wed, Jul 7, 2010 at 10:05 AM, adamea adam.earns...@gmail.com wrote:
  Why is my index taking so long to build? I have 39 rows in my database
  and it's been going for a considerable amount of time!

  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group. To post to this group, send email 
  togoogle-appeng...@googlegroups.com.
  To unsubscribe from this group, send email 
  togoogle-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
  .
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

 --
 --
 Jeff

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: how to view all keys in memcache?

2010-07-07 Thread Toomore

Appstats for Python
http://code.google.com/appengine/docs/python/tools/appstats.html

On Jul 6, 3:01 pm, saintthor saintt...@gmail.com wrote:
 what is appstat?

 give me a link please.

 On 7月6日, 下午2时44分, djidjadji djidja...@gmail.com wrote:



  If you look with Appstat to requests that use memcache you see that an
  RPC is made for every memcache call.

  If your assumption is correct then many other apps should have a major bug.
  Instead of logging.debug() try using logging.info().

  Very likely that you have a problem in some other part of your code.
  Try to use Appstat to see what the local variables where at the
  different requests.
  Or log all relevant local variables.
  And log the path the code uses.

  2010/7/6 saintthor saintt...@gmail.com:

   are you sure?

   even in the cloud, should it show me defferent data in defferent get
   with same key?

   On 7月6日, 下午2时30分, djidjadji djidja...@gmail.com wrote:
   The memcache is not stored on the same machine as your python
   interpreters are running.
   The interpreter interacts with the memcache server by RPC (network 
   packages).
   And it could be that the two python interpreters are running at
   different machines in the cloud.

   2010/7/6 Andi Albrecht albrecht.a...@googlemail.com:

The actual instances are serialized when stored in memcache and
deserialized when retrieved from the cache. What you're seeing is a
different instance ID (as returned by id(myobj)) since a new object is
created. But the state of your Stock.IndexSet instance should be the
same before storing in memcache and after fetching it from the cache
again.

You should compare the actual data and not the repr() of your 
instances.

Hope that helps :)

Andi

On Tue, Jul 6, 2010 at 7:42 AM, saintthor saintt...@gmail.com wrote:
it seems there are too entities with same key im my memcache.

codes:

self.szz = memcache.get( MemKey )
if not self.szz:
   logging.debug( no szz in memcache )
   self.szz = IndexSet( data )
logging.debug( dida szz =  + repr( self.szz ))
memcache.set( MemKey, self.szz, 1 )

log:

07-05 10:04PM 41.838 dida szz = Stock.IndexSet object at
0xac27dca7f5d540
07-05 10:23PM 55.943 dida szz = Stock.IndexSet object at
0xcd9724f54f1dbb30

you see, the two szz is defferent, with no log of no szz in memcache
between them.

so i think there may be too entities with same key im my memcache.

--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.
To post to this group, send email to 
google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group 
athttp://groups.google.com/group/google-appengine?hl=en.

--
You received this message because you are subscribed to the Google 
Groups Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group 
athttp://groups.google.com/group/google-appengine?hl=en.

   --
   You received this message because you are subscribed to the Google Groups 
   Google App Engine group.
   To post to this group, send email to google-appeng...@googlegroups.com.
   To unsubscribe from this group, send email to 
   google-appengine+unsubscr...@googlegroups.com.
   For more options, visit this group 
   athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] High proportion of Request was aborted messages

2010-07-07 Thread tjwebb

Hello,

I'm working to deploy an application, but I'm noticing an extremely
high proportion (75%+) of requests being pre-empted by the app engine,
giving me the following message in my logs:

Request was aborted after waiting too long to attempt to service your
request. This may happen sporadically when the App Engine serving
cluster is under unexpectedly high or uneven load. If you see this
message frequently, please contact the App Engine team.

For a single request, often it is retried 5-10 times before it is able
to run. This is especially common in taskqueue tasks, where each task
has to be re-tried 5-10 times before it can run; since it takes 10
seconds before it fails and gets re-tried, this wastes a lot of time
on simple tasks. I'll include my logs if it helps diagnose the
problem. My app id is bustrackerfeed. Thanks.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] missing ) in parenthetical

2010-07-07 Thread René

Hello,

my problem is that my website runs locally without an error, but when
I deploy it to the appengine I become this error in the firefox
errorlog:

missing ) in parenthetical

why? here the link to my site http://renes-test.appspot.com/

I wrote the site with java and uses the gwt.

please help me and sorry for my bad English :D

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] I need help with my project

2010-07-07 Thread Hayx Hay

I currently have made a javascript, that constantly needs to refresh a
certain website  so that it can catch a change in the websites coding.
However I am not sure how to use the proxy server in google app
engine. Is it automatic? So as soon as I upload my javascript
application, the refreshes are automatically done on google servers?
So if I have a user who arrives at the site, and the page refreshes
the other website while he is on, will it use his IP or will it act as
a proxy? thanks

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] App Engine + Google Maps: templates to generate JS, AJAX to POST back? Really?

2010-07-07 Thread Webb S.

I am trying to write an app that displays a bunch of points, allows
the user to move them around, and then submit the changes back to the
server.

The only way I see to do this is to templates to generate JavaScript
making the map, then use JQuery to POST the results (new coordinates
queried from each marker) back to the application via POSTing to a
URL.

Is this really a decent way to go about things?  Should I really be
using templates to make the original map happen (I guess I could make
a URL to generate a KML feed)?  Is there a better way to make
coordinates complete the round trip back to the datastore?

This might be better posted on a maps group, but I will start here

(I guess I will be learning a lot of JavaScript here shortly...)

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Throttle_code=4

2010-07-07 Thread David Laing

I'm running some load tests use JMeter to get an idea of how my
application performs under load on GAE (Java).

When I hit around 100 virtual users my response time starts dropping,
and I notice throttle_code=4 appearing in the log files (see below).

Does anyone know what this means?  Is the fact that I'm making
multiple requests from the same IP hitting some kind of automatic DDOS
protection?

Thanks

David



 request withthrottle_code=4; when connecting from JMeter
07-05 05:11AM 58.917 /market/1234/history?pricebars=240 200 3651ms
19cpu_ms 35kb Java/1.5.0_16,gzip(gfe)
75.101.226.4 - - [05/Jul/2010:05:12:02 -0700] GET /market/1234/
history?pricebars=240 HTTP/1.1 200 35566 - Java/1.5.0_16,gzip(gfe)
ci-pricehistory.appspot.com ms=3652 cpu_ms=19 api_cpu_ms=0
cpm_usd=0.004527 pending_ms=3570 throttle_code=4
I 07-05 05:12AM 02.532
uk.co.cityindex.CandleServlet fetch: Loading 240 bars from cache...
I 07-05 05:12AM 02.558
uk.co.cityindex.CandleServlet fetch: time:47

 request without throttle log; when connecting from browser
07-05 06:28AM 10.993 /market/1234/history?pricebars=240 200 69ms
19cpu_ms 7kb Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US)
AppleWebKit/533.4 (KHTML, like Gecko) Chrome/5.0.375.99 Safari/
533.4,gzip(gfe)
80.169.172.178 - - [05/Jul/2010:06:28:11 -0700] GET /market/1234/
history?pricebars=240 HTTP/1.1 200 7572 - Mozilla/5.0 (Windows; U;
Windows NT 6.1; en-US) AppleWebKit/533.4 (KHTML, like Gecko) Chrome/
5.0.375.99 Safari/533.4,gzip(gfe) ci-pricehistory.appspot.com ms=69
cpu_ms=19 api_cpu_ms=0 cpm_usd=0.001423
I 07-05 06:28AM 11.031
uk.co.cityindex.CandleServlet fetch: Loading 240 bars from cache...
I 07-05 06:28AM 11.055
uk.co.cityindex.CandleServlet fetch: time:45

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: 5 transactional tasks

Thanks for the detail - pretty comfortable with the ins and outs of
the task queue - any ideas about the 5 task limit?

 Also, don't confuse transactional tasks with the task queue. Transactional
 tasks are the those that will all happen simultaneously or will graciously
 fail without any partial commits. Due to the implementation details you
 probably want to avoid intentionally doing lots of transaction updates on
 the same few objects, since it is possible (if you are kicking lots of
 simultaneous jobs off with the task queue) to shoot yourself in the foot and
 have a very small success rate.

I wasn't confused until I read this paragraph :) Transactional tasks
do not need to operate on the same entity group as the transaction in
which they are raised - this is one of their greatest strengths. They
are fast to raise, so you can actually include quite a lot of work in
a 'transaction' of this sort, all done in parallel.  Generally if I
want to do something in the same entity group as the originating
transaction, I would do it right there in the transaction and not
raise a task.  So at least for me (and I expect for many others),
transactional tasks are almost exclusively *not* operating on the same
entity group as the transaction in which they are raised, unless
perhaps they are being used in a continuation style bulk update, in
which case they are likely to be in series and not cause contention.

Anyway, question still there :) Is the 5 task limit a restriction that
is expected to remain indefinitely? Can I get around the restriction
by raising more in a single batch API call - i.e. is it a restriction
on API calls or actual tasks? Cheers,

Colin

On Jul 7, 4:46 pm, Nate Bauernfeind nate.bauernfe...@gmail.com
wrote:
 I have noticed that batch datastore calls run within a single transaction.
 The maximum number of entities that can be added or deleted (and probably
 modified, though I have not tried) was 500. I'm betting you could probably
 wrap them around a single transaction. Though, from my experience, I
 wouldn't really recommend doing this (since trying to commit two batches of
 500 to the datastore within the same call tended to time out for me).

 Also, don't confuse transactional tasks with the task queue. Transactional
 tasks are the those that will all happen simultaneously or will graciously
 fail without any partial commits. Due to the implementation details you
 probably want to avoid intentionally doing lots of transaction updates on
 the same few objects, since it is possible (if you are kicking lots of
 simultaneous jobs off with the task queue) to shoot yourself in the foot and
 have a very small success rate.

 Transactions work with the task queue in such a way that the task will only
 be added to the queue if no other piece of your commits fail. For example,
 you wouldn't really want your app to run the new user code if you couldn't
 create the new user account for that user because someone else registered
 that user name at the same time. I.E. Things on the task queue do not
 continue running within the same transaction if they were created within
 one.



 On Wed, Jul 7, 2010 at 4:22 AM, hawkett hawk...@gmail.com wrote:
  Hi,

    This page -
 http://code.google.com/appengine/docs/python/datastore/transactions.html
  - says that we cannot raise more than 5 transactional tasks in a
  single transaction, and I wanted to check if this was a limit that you
  were hoping to raise, or if this is likely to be a long term
  restriction?  Does this restriction limit API calls to the task queue
  or actual number of tasks -  e.g. could I raise more than 5 by doing
  them in batch with a single call to the task queue API? Cheers,

  Colin

  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To post to this group, send email to google-appeng...@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib 
  e...@googlegroups.com
  .
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] list-property, many to many, 5000 indexes...HELP!

2010-07-07 Thread Jeff Schwartz

I wouldn't put the list attribute in your book class due to serialization
issues and exploding indexes. I'd put the list in a sub class of book and
query the subclass to return a list of entity keys on a match. As child keys
contain parent keys as well, I'd use the list of keys returned to grab the
actual book entities. You can refine this as much as you like.

Jeff

On Wed, Jul 7, 2010 at 1:58 AM, stefoid stevenmath...@yahoo.com wrote:

Hi I think I have a fair handle on how Datastore works, but I need to
check, and I need some help with a design

lets say I have:
a very large list of BOOKS
the BOOKS are tagged- adventure+romance, historical+drama,
animation+sci-fi+comedy, etc...
and I have a very large list of USERS.
USERS can read a very large number of BOOKS
And I, as a USER, can have a very large number of USERS who are my
friend.

What I want , in english, is
; Return a list of all the BOOKS tagged with sci-fi and romance
that have been read by USERS who are my friend, sorted by Most
Frequently Read.

Now, I know I can model tags with a ListProperty, so that filtering is
easy = WHERE tag AND tag AND tag...
And I know that I can sort Books by Most Frequently Read quite easily

But due to the large number of BOOKS that could be read by a USER,
and the large number of USERS who could be my friend, I cant
practically model BOOKS READ BY USERS and USERS WHO ARE MY FRIEND as
ListProperties...

...Because I would blow the 5000 index limit per entity, because each
value of ListPropery generates its own index entry. Is that correct?

I cant find a way to handle this without resorting to filtering in
memory. Am I dumb, or is that just the way it is?

My solution is:

BOOK:
numerOfReads
TagList
otherStuff

Then I look up a relationship entity to find out everyone who is a
FRIEND of mine.
FRIENDS:
userKey
friendKey

Then I look up a relationship entity to find out which BOOKS that
USERS have read
BOOKSREAD:
userKey
bookKey
TagList
numberOfReads

So first I pull into memory the list of my particular friendKeys from
the FRIENDS table.

Then I churn through the table of BOOKSREAD, using the duplicated
properties TagList and numberOfReads to filter on tags and sort
according to number of reads.

I then filter this list of BOOKS *in memory* by the friendKeys I
have. Ill need some sort of algorithm to keep pulling chunks of BOOKS
from the database until I have a nice page of books my friends have
read (20 books displayed per page) to pass to the GUI.

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

--
--
Jeff

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: 5 transactional tasks

2010-07-07 Thread Robert Kluin

Just raise one transactional task that in turn spawns a series of
(non-transactional) _named_ sub-tasks.  Just remember to pass on a
TaskAlreadyExists error.

See Brett Slatkin's 2010 IO talk on pipelines for additional discussion.

Robert






On Wed, Jul 7, 2010 at 12:49 PM, hawkett hawk...@gmail.com wrote:
 Thanks for the detail - pretty comfortable with the ins and outs of
 the task queue - any ideas about the 5 task limit?

 Also, don't confuse transactional tasks with the task queue. Transactional
 tasks are the those that will all happen simultaneously or will graciously
 fail without any partial commits. Due to the implementation details you
 probably want to avoid intentionally doing lots of transaction updates on
 the same few objects, since it is possible (if you are kicking lots of
 simultaneous jobs off with the task queue) to shoot yourself in the foot and
 have a very small success rate.

 I wasn't confused until I read this paragraph :) Transactional tasks
 do not need to operate on the same entity group as the transaction in
 which they are raised - this is one of their greatest strengths. They
 are fast to raise, so you can actually include quite a lot of work in
 a 'transaction' of this sort, all done in parallel.  Generally if I
 want to do something in the same entity group as the originating
 transaction, I would do it right there in the transaction and not
 raise a task.  So at least for me (and I expect for many others),
 transactional tasks are almost exclusively *not* operating on the same
 entity group as the transaction in which they are raised, unless
 perhaps they are being used in a continuation style bulk update, in
 which case they are likely to be in series and not cause contention.

 Anyway, question still there :) Is the 5 task limit a restriction that
 is expected to remain indefinitely? Can I get around the restriction
 by raising more in a single batch API call - i.e. is it a restriction
 on API calls or actual tasks? Cheers,

 Colin

 On Jul 7, 4:46 pm, Nate Bauernfeind nate.bauernfe...@gmail.com
 wrote:
 I have noticed that batch datastore calls run within a single transaction.
 The maximum number of entities that can be added or deleted (and probably
 modified, though I have not tried) was 500. I'm betting you could probably
 wrap them around a single transaction. Though, from my experience, I
 wouldn't really recommend doing this (since trying to commit two batches of
 500 to the datastore within the same call tended to time out for me).

 Also, don't confuse transactional tasks with the task queue. Transactional
 tasks are the those that will all happen simultaneously or will graciously
 fail without any partial commits. Due to the implementation details you
 probably want to avoid intentionally doing lots of transaction updates on
 the same few objects, since it is possible (if you are kicking lots of
 simultaneous jobs off with the task queue) to shoot yourself in the foot and
 have a very small success rate.

 Transactions work with the task queue in such a way that the task will only
 be added to the queue if no other piece of your commits fail. For example,
 you wouldn't really want your app to run the new user code if you couldn't
 create the new user account for that user because someone else registered
 that user name at the same time. I.E. Things on the task queue do not
 continue running within the same transaction if they were created within
 one.



 On Wed, Jul 7, 2010 at 4:22 AM, hawkett hawk...@gmail.com wrote:
  Hi,

    This page -
 http://code.google.com/appengine/docs/python/datastore/transactions.html
  - says that we cannot raise more than 5 transactional tasks in a
  single transaction, and I wanted to check if this was a limit that you
  were hoping to raise, or if this is likely to be a long term
  restriction?  Does this restriction limit API calls to the task queue
  or actual number of tasks -  e.g. could I raise more than 5 by doing
  them in batch with a single call to the task queue API? Cheers,

  Colin

  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To post to this group, send email to google-appeng...@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib
   e...@googlegroups.com
  .
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email

[google-appengine] Re: Trouble Setting App Engine ID

2010-07-07 Thread Matthew Blain

I just tried this and it worked for me. You can send me the details of
the exact user name and error message you get privately and I'll try
to take a look.

On Jul 6, 11:24 pm, cwaldbieser cwaldbie...@gmail.com wrote:
 This does not appear to work for me.
 I have logged into the App Engine admin console using my gmail
 account.
 I try to create an app ID with the same name.  The program refuses.

 Thanks,
 Carl

 On Jul 6, 3:17 pm, Matthew Blain matthew.bl...@google.com wrote:



  You should be able to create an application ID which matches an
  existing gmail account, but only when logged in to the current user.

  For example, if you have exam...@gmail.com and want to create
  example.appspot.com, you must log in to the App Engine admin console
  as 'exam...@gmail.com' and then create the 'example' application. You
  can then add additional developers to the application.

  --Matthew

  On Jul 5, 12:16 am, l.denardo lorenzo.dena...@gmail.com wrote:

   I think there's no way to do it.
   Gmail names seem to be locked for anyone, including the owner of the
   account. This happened to me too, and seems to be a frequent request
   from many of us.

   Regards
   Lorenzo

   On Jul 2, 9:03 pm, cwaldbieser cwaldbie...@gmail.com wrote:

I read that if you have a GMail account, no one else can take that
name for an App Engine ID.
I created a GMail account with the name I wanted, but when I tried to
create an app with that account, I was told by the page the name is
taken!  It was not taken prior to me creating the new GMail account.
Am I blocking the name of the app ID I want?  How do I correct this?

Thanks,
Carl

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Tasks Queues still manual in 1.3.4?

2010-07-07 Thread Ryan Weber

Yes, this is still an issue for me in 1.3.5. Very frustrating.

On Wed, Jul 7, 2010 at 1:16 AM, Ryan W rwilli...@gmail.com wrote:

I just noticed this problem on the 1.3.5 version of the Mac OS
Launcher. I also run on Windows and it runs tasks automatically fine.

On Jun 15, 6:36 am, hawkett hawk...@gmail.com wrote:
I'm seeing this issue now in the dev environment. It looks to me
liketasksraised in batch are ignored - only individualtasksfire
automatically. Perhaps I've done something wrong though - can anyone
else confirm this behaviour? Cheers,

Colin

On Jun 2, 1:05 am, hawkett hawk...@gmail.com wrote:

The 'mac only' theory on the app engine launcher was a tad out of
date :) I was looking at the SDK download page (which only lists it
explicitly for mac)... sorry about that.

On Jun 1, 8:28 pm, Greg Tracy gtr...@gmail.com wrote:

I'm using the App Engine Launcher on XP and it works for me.

On May 31, 7:24 pm, hawkett hawk...@gmail.com wrote:

Slight possibility - looks like both Ryan and Nick are using the
app
engine launcher, which is a mac only application that contains a
copy
of the SDK. Are any of the people reporting it working using the
app
engine launcher? I'm on mac, but is has been a while since I
actually
ran my apps with the launcher - choosing instead to download to
download the linux SDK. You guys could try that and see if you
notice
any improvement. Perhaps the SDK inside the launcher isn't quite
right. Unlikely, but something to test out. Cheers,

Colin

On May 29, 6:49 am, Nick npd...@gmail.com wrote:

I'm in California (7-8 hours behind UTC) and also have Ryan's
problem.
Tasksdon't run automatically on the dev server, which is very
frustrating and as Ryan reported Istillsee the message Taskswill
not run automatically in the SDK console.

I'm using Python and the GoogleAppEngineLauncher 1.3.4.794, SDK
version: release: 1.3.4, timestamp: 1272392128, api_versions:
['1'].

Any thoughts on why some of us aren't seeing this new feature?

Thanks,
Nick

On May 28, 8:50 am, Tim Hoffman zutes...@gmail.com wrote:

So am I (8 hours) and autotaskrunning works fine,

Rgds

On May 28, 10:32 pm, djidjadji djidja...@gmail.com wrote:

I'm ahead a few hours of UTC and for me
theautomatictaskqueueworks.
I have not modified the1.3.4SDK code.

2010/5/27 Kenneth goo...@kmacleod.ie:

The problem with thetasknot running automatically is
because of this
bug:

http://code.google.com/p/googleappengine/issues/detail?id=2508

Basically it works fine in Mountain View, California, but
not for
anyone who is ahead of UTC since the eta will be in the
future.

Solution as described in the bug report is replace line 414
in
taskqueue.py:

def __determine_eta(eta=None, countdown=None,
now=datetime.datetime.now)
with
def __determine_eta(eta=None, countdown=None,
now=datetime.datetime.utcnow)

Hope that helps.

On May 22, 9:10 pm, andy stevko andy.ste...@gmail.com
wrote:
I see auto runtasksall the time in my dev environment. I
thought the docs
just were not up to date. I'm using the latest eclipse
plugin.

On May 22, 2010 12:42 PM, Ryan Weber
ryan.we...@gmail.com wrote:

Strange, because that's not what is happening for me. I
have tostill
manually run them. Can anyone think of any reason why mine
wouldstillbe
manual? When I saw all the features of the1.3.4release, I
was most looking
forward to the auto-run oftasks, so I wouldn't have to
click run every
time, but alas, no luck yet...

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: App Engine + Google Maps: templates to generate JS, AJAX to POST back? Really?

2010-07-07 Thread Darien Caldwell

The method you describe is basically the route I took. And I have to
say it works well.

You can take a peek at an early proof-of-concept I did, and maybe the
code will give you somewhere to start from. this version doesn't have
JQuery integrated for AJAX yet, but that's precisely what I ended up
using.

http://home.comcast.net/~volfin/drag/demo.html

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: MapReduce - less than half of the shards have items

2010-07-07 Thread Ben Nevile

I have a job with 8 shards but only one of the shards is processing
any entities. Think this is related?

mapreduce_id=159013376839436

Ben




On Jun 16, 8:28 am, Nick Johnson (Google) nick.john...@google.com
wrote:
 Hi Jason,

 It's possible to do that right now. You simply need to define your own
 InputReader - see the existing ones for examples 
 how:http://code.google.com/p/appengine-mapreduce/source/browse/trunk/pyth...

 The best option is probably to extend the existing DatastoreInputReader, and
 override the split_input method.

 -Nick Johnson





 On Wed, Jun 16, 2010 at 4:17 PM, Jason C jason.a.coll...@gmail.com wrote:
  Nick,

  It would be a great feature to allow us (developers) to define a
  custom partitioning function for the shards - unless you guys have
  some better magic in mind.

  It is very normal for us to see very poor distribution across our
  shards in practise - in fact, we've only seen poor distributions.

  j

  On Jun 15, 8:04 am, Nick Johnson (Google) nick.john...@google.com
  wrote:
   Hi Jason,

   The current implementation of the datastore mapper uses lexicographical
   sharding over keys to assign datastore shards. Unfortunately, this can
  lead
   to very inconsistent shard sizes, as you observe.

   -Nick Johnson

   On Fri, Jun 11, 2010 at 4:17 PM, Jason C jason.a.coll...@gmail.com
  wrote:
We've been using MapReduce for App Engine for a couple of different
jobs.

Typically, we use 8 shards (the default), but it seems that only 3,
sometime 4, of the shards have any items in them? E.g., we're
currently running one job and three of the shards have 218,000 items
processed, but the other 5 shards appear to have zero.

I can understand that a particular key distribution would have
different amounts in each shard, but with so many at zero, I suspect
there is something else happening?

BTW, we have applied the mapreduce-recommended __key__ DESC index, but
we still see this strange shard distribution.

Is anyone else seeing this?

j

--
You received this message because you are subscribed to the Google
  Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
  .
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib
 e...@googlegroups.comgoogle-appengine%2Bunsubscrib
  e...@googlegroups.com
.
For more options, visit this group at
   http://groups.google.com/group/google-appengine?hl=en.

   --
   Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd.
  ::
   Registered in Dublin, Ireland, Registration Number: 368047
   Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration
  Number:
   368047

  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To post to this group, send email to google-appeng...@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib 
  e...@googlegroups.com
  .
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

 --
 Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. ::
 Registered in Dublin, Ireland, Registration Number: 368047
 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
 368047

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: MapReduce - less than half of the shards have items

2010-07-07 Thread Ben Nevile

Just found the thread that talks about needing the descending index
for __key__ --- definitely seems like something that should be added
to the documentation!

Ben


On Jul 7, 12:56 pm, Ben Nevile ben.nev...@gmail.com wrote:
 I have a job with 8 shards but only one of the shards is processing
 any entities. Think this is related?

 mapreduce_id=159013376839436

 Ben

 On Jun 16, 8:28 am, Nick Johnson (Google) nick.john...@google.com
 wrote:



  Hi Jason,

  It's possible to do that right now. You simply need to define your own
  InputReader - see the existing ones for examples 
  how:http://code.google.com/p/appengine-mapreduce/source/browse/trunk/pyth...

  The best option is probably to extend the existing DatastoreInputReader, and
  override the split_input method.

  -Nick Johnson

  On Wed, Jun 16, 2010 at 4:17 PM, Jason C jason.a.coll...@gmail.com wrote:
   Nick,

   It would be a great feature to allow us (developers) to define a
   custom partitioning function for the shards - unless you guys have
   some better magic in mind.

   It is very normal for us to see very poor distribution across our
   shards in practise - in fact, we've only seen poor distributions.

   j

   On Jun 15, 8:04 am, Nick Johnson (Google) nick.john...@google.com
   wrote:
Hi Jason,

The current implementation of the datastore mapper uses lexicographical
sharding over keys to assign datastore shards. Unfortunately, this can
   lead
to very inconsistent shard sizes, as you observe.

-Nick Johnson

On Fri, Jun 11, 2010 at 4:17 PM, Jason C jason.a.coll...@gmail.com
   wrote:
 We've been usingMapReducefor App Engine for a couple of different
 jobs.

 Typically, we use 8 shards (the default), but it seems that only 3,
 sometime 4, of the shards have any items in them? E.g., we're
 currently running one job and three of the shards have 218,000 items
 processed, but the other 5 shards appear to have zero.

 I can understand that a particular key distribution would have
 different amounts in each shard, but with so many at zero, I suspect
 there is something else happening?

 BTW, we have applied themapreduce-recommended __key__ DESC index, but
 we still see this strange shard distribution.

 Is anyone else seeing this?

 j

 --
 You received this message because you are subscribed to the Google
   Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com
   .
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib
  e...@googlegroups.comgoogle-appengine%2Bunsubscrib
   e...@googlegroups.com
 .
 For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

--
Nick Johnson, Developer Programs Engineer, App Engine Google Ireland 
Ltd.
   ::
Registered in Dublin, Ireland, Registration Number: 368047
Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration
   Number:
368047

   --
   You received this message because you are subscribed to the Google Groups
   Google App Engine group.
   To post to this group, send email to google-appeng...@googlegroups.com.
   To unsubscribe from this group, send email to
   google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib
e...@googlegroups.com
   .
   For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.

  --
  Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. ::
  Registered in Dublin, Ireland, Registration Number: 368047
  Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
  368047

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Throttle_code=4

2010-07-07 Thread Ikai L (Google)

It looks like your request is taking 3500ms. We autoscale up the number of
instances servicing your requests as long as you maintain average
milliseconds/request of 1000ms or under (we recommend 800ms, sub 400ms is
optimal). If you run lots of long running requests, we will not spin up new
instances for you and you will hit a scaling ceiling.

On Mon, Jul 5, 2010 at 6:30 AM, David Laing mrdavidla...@gmail.com wrote:

 I'm running some load tests use JMeter to get an idea of how my
 application performs under load on GAE (Java).

 When I hit around 100 virtual users my response time starts dropping,
 and I notice throttle_code=4 appearing in the log files (see below).

 Does anyone know what this means?  Is the fact that I'm making
 multiple requests from the same IP hitting some kind of automatic DDOS
 protection?

 Thanks

 David



  request withthrottle_code=4; when connecting from JMeter
 07-05 05:11AM 58.917 /market/1234/history?pricebars=240 200 3651ms
 19cpu_ms 35kb Java/1.5.0_16,gzip(gfe)
 75.101.226.4 - - [05/Jul/2010:05:12:02 -0700] GET /market/1234/
 history?pricebars=240 HTTP/1.1 200 35566 - Java/1.5.0_16,gzip(gfe)
 ci-pricehistory.appspot.com ms=3652 cpu_ms=19 api_cpu_ms=0
 cpm_usd=0.004527 pending_ms=3570 throttle_code=4
 I 07-05 05:12AM 02.532
 uk.co.cityindex.CandleServlet fetch: Loading 240 bars from cache...
 I 07-05 05:12AM 02.558
 uk.co.cityindex.CandleServlet fetch: time:47

  request without throttle log; when connecting from browser
 07-05 06:28AM 10.993 /market/1234/history?pricebars=240 200 69ms
 19cpu_ms 7kb Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US)
 AppleWebKit/533.4 (KHTML, like Gecko) Chrome/5.0.375.99 Safari/
 533.4,gzip(gfe)
 80.169.172.178 - - [05/Jul/2010:06:28:11 -0700] GET /market/1234/
 history?pricebars=240 HTTP/1.1 200 7572 - Mozilla/5.0 (Windows; U;
 Windows NT 6.1; en-US) AppleWebKit/533.4 (KHTML, like Gecko) Chrome/
 5.0.375.99 Safari/533.4,gzip(gfe) ci-pricehistory.appspot.com ms=69
 cpu_ms=19 api_cpu_ms=0 cpm_usd=0.001423
 I 07-05 06:28AM 11.031
 uk.co.cityindex.CandleServlet fetch: Loading 240 bars from cache...
 I 07-05 06:28AM 11.055
 uk.co.cityindex.CandleServlet fetch: time:45

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Ikai Lan
Developer Programs Engineer, Google App Engine
Blog: http://googleappengine.blogspot.com
Twitter: http://twitter.com/app_engine
Reddit: http://www.reddit.com/r/appengine

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: MapReduce - less than half of the shards have items

2010-07-07 Thread Ben Nevile

I reduced the number of shards to 1, and it uses an ascending index,
but still only 44399 out of 500k+ entities are processed. Confused!

Ben


On Jul 7, 1:02 pm, Ben Nevile ben.nev...@gmail.com wrote:
 Just found the thread that talks about needing the descending index
 for __key__ --- definitely seems like something that should be added
 to the documentation!

 Ben

 On Jul 7, 12:56 pm, Ben Nevile ben.nev...@gmail.com wrote:



  I have a job with 8 shards but only one of the shards is processing
  any entities. Think this is related?

  mapreduce_id=159013376839436

  Ben

  On Jun 16, 8:28 am, Nick Johnson (Google) nick.john...@google.com
  wrote:

   Hi Jason,

   It's possible to do that right now. You simply need to define your own
   InputReader - see the existing ones for examples 
   how:http://code.google.com/p/appengine-mapreduce/source/browse/trunk/pyth...

   The best option is probably to extend the existing DatastoreInputReader, 
   and
   override the split_input method.

   -Nick Johnson

   On Wed, Jun 16, 2010 at 4:17 PM, Jason C jason.a.coll...@gmail.com 
   wrote:
Nick,

It would be a great feature to allow us (developers) to define a
custom partitioning function for the shards - unless you guys have
some better magic in mind.

It is very normal for us to see very poor distribution across our
shards in practise - in fact, we've only seen poor distributions.

j

On Jun 15, 8:04 am, Nick Johnson (Google) nick.john...@google.com
wrote:
 Hi Jason,

 The current implementation of the datastore mapper uses 
 lexicographical
 sharding over keys to assign datastore shards. Unfortunately, this can
lead
 to very inconsistent shard sizes, as you observe.

 -Nick Johnson

 On Fri, Jun 11, 2010 at 4:17 PM, Jason C jason.a.coll...@gmail.com
wrote:
  We've been usingMapReducefor App Engine for a couple of different
  jobs.

  Typically, we use 8 shards (the default), but it seems that only 3,
  sometime 4, of the shards have any items in them? E.g., we're
  currently running one job and three of the shards have 218,000 
  items
  processed, but the other 5 shards appear to have zero.

  I can understand that a particular key distribution would have
  different amounts in each shard, but with so many at zero, I suspect
  there is something else happening?

  BTW, we have applied themapreduce-recommended __key__ DESC index, 
  but
  we still see this strange shard distribution.

  Is anyone else seeing this?

  j

  --
  You received this message because you are subscribed to the Google
Groups
  Google App Engine group.
  To post to this group, send email to 
  google-appengine@googlegroups.com
.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib
   e...@googlegroups.comgoogle-appengine%2Bunsubscrib
e...@googlegroups.com
  .
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

 --
 Nick Johnson, Developer Programs Engineer, App Engine Google Ireland 
 Ltd.
::
 Registered in Dublin, Ireland, Registration Number: 368047
 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration
Number:
 368047

--
You received this message because you are subscribed to the Google 
Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib
 e...@googlegroups.com
.
For more options, visit this group at
   http://groups.google.com/group/google-appengine?hl=en.

   --
   Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. 
   ::
   Registered in Dublin, Ireland, Registration Number: 368047
   Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
   368047

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] 500 error when I try to deploy to app engine

2010-07-07 Thread tjwebb

I get this when I run 'ant update':

INFO: Unable to access
https://appengine.google.com/api/updatecheck?runtime=javarelease=1.3.5timestamp=1277158890api_versions=['1.0']
 [java] java.io.IOException: Server returned HTTP response code:
500 for URL: 
https://appengine.google.com/api/updatecheck?runtime=javarelease=1.3.5timestamp=1277158890api_versions=['1.0']

Just started happening around 5:30pm EDT

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: 5 transactional tasks

That's definitely an option - in my app it is common to reach the
transaction edge with a unpredictable number of tasks ready to be
raised transactionally - not heaps, but potentially more than 5. It
would be nice to be able to just put them on the queue.  I guess
serialising them into another task's payload which then raises them
isn't such a bad option - more complex though, and I wonder what the
difference in resource usage would be compared to just raising them in
a single batch API call - probably marginal, but being a common
pattern its worth trying to avoid complexity and/or overhead.  Anyway,
that was the main reason for the question - understanding the
restriction to try and make a choice of architecture. Cheers,

Colin

On Jul 7, 7:04 pm, Robert Kluin robert.kl...@gmail.com wrote:
 Just raise one transactional task that in turn spawns a series of
 (non-transactional) _named_ sub-tasks.  Just remember to pass on a
 TaskAlreadyExists error.

 See Brett Slatkin's 2010 IO talk on pipelines for additional discussion.

 Robert



 On Wed, Jul 7, 2010 at 12:49 PM, hawkett hawk...@gmail.com wrote:
  Thanks for the detail - pretty comfortable with the ins and outs of
  the task queue - any ideas about the 5 task limit?

  Also, don't confuse transactional tasks with the task queue. Transactional
  tasks are the those that will all happen simultaneously or will graciously
  fail without any partial commits. Due to the implementation details you
  probably want to avoid intentionally doing lots of transaction updates on
  the same few objects, since it is possible (if you are kicking lots of
  simultaneous jobs off with the task queue) to shoot yourself in the foot 
  and
  have a very small success rate.

  I wasn't confused until I read this paragraph :) Transactional tasks
  do not need to operate on the same entity group as the transaction in
  which they are raised - this is one of their greatest strengths. They
  are fast to raise, so you can actually include quite a lot of work in
  a 'transaction' of this sort, all done in parallel.  Generally if I
  want to do something in the same entity group as the originating
  transaction, I would do it right there in the transaction and not
  raise a task.  So at least for me (and I expect for many others),
  transactional tasks are almost exclusively *not* operating on the same
  entity group as the transaction in which they are raised, unless
  perhaps they are being used in a continuation style bulk update, in
  which case they are likely to be in series and not cause contention.

  Anyway, question still there :) Is the 5 task limit a restriction that
  is expected to remain indefinitely? Can I get around the restriction
  by raising more in a single batch API call - i.e. is it a restriction
  on API calls or actual tasks? Cheers,

  Colin

  On Jul 7, 4:46 pm, Nate Bauernfeind nate.bauernfe...@gmail.com
  wrote:
  I have noticed that batch datastore calls run within a single transaction.
  The maximum number of entities that can be added or deleted (and probably
  modified, though I have not tried) was 500. I'm betting you could probably
  wrap them around a single transaction. Though, from my experience, I
  wouldn't really recommend doing this (since trying to commit two batches of
  500 to the datastore within the same call tended to time out for me).

  Also, don't confuse transactional tasks with the task queue. Transactional
  tasks are the those that will all happen simultaneously or will graciously
  fail without any partial commits. Due to the implementation details you
  probably want to avoid intentionally doing lots of transaction updates on
  the same few objects, since it is possible (if you are kicking lots of
  simultaneous jobs off with the task queue) to shoot yourself in the foot 
  and
  have a very small success rate.

  Transactions work with the task queue in such a way that the task will only
  be added to the queue if no other piece of your commits fail. For example,
  you wouldn't really want your app to run the new user code if you 
  couldn't
  create the new user account for that user because someone else registered
  that user name at the same time. I.E. Things on the task queue do not
  continue running within the same transaction if they were created within
  one.

  On Wed, Jul 7, 2010 at 4:22 AM, hawkett hawk...@gmail.com wrote:
   Hi,

     This page -
  http://code.google.com/appengine/docs/python/datastore/transactions.html
   - says that we cannot raise more than 5 transactional tasks in a
   single transaction, and I wanted to check if this was a limit that you
   were hoping to raise, or if this is likely to be a long term
   restriction?  Does this restriction limit API calls to the task queue
   or actual number of tasks -  e.g. could I raise more than 5 by doing
   them in batch with a single call to the task queue API? Cheers,

   Colin

   --
   You received this message because you are subscribed to the

[google-appengine] Re: Help With BlobStore Upload Handler Redirect on Live

In firebug or chrome dev tools can you see the redirect response from
the image upload?

On Jul 6, 8:18 pm, tim.romanowski tim.romanow...@gmail.com wrote:
 I have followed the examples for uploading images using the
 blobstore.  I am able to upload images to the development server
 fine.  However when I deploy my code to the live servers the redirect
 after upload does not work.

 Here are some details:

 -- everything works fine on the development server ( version 1.3.5 )
 -- example url = /imgupload
 -- I use blobstore.create_upload_url(/imgupload)
 -- I can see the image in the blob viewer through the dashboard so the
 file upload works
 -- after the upload finishes I see my upload url the address bar /
 imgupload  but there is no source for the page
 -- there are not any logs created

 With the lack of logs / error messages / source I am having trouble
 debugging what is happening on the app engine server.

 Has anyone seen this before?

 Thanks for the help

 Tim

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: list-property, many to many, 5000 indexes...HELP!

Ah, well tagList is just the list of tags for that book, so its only
going to hold between 0-4 tags. Having that listProperty with book
at least makes filtering books by tag easy.

like 'gimmie all the books that are tagged 'sci-fi' and 'adventure' ,
sorted by 'number of reads'. That bit is a single query.

On Jul 8, 3:56 am, Jeff Schwartz jefftschwa...@gmail.com wrote:
I wouldn't put the list attribute in your book class due to serialization
issues and exploding indexes. I'd put the list in a sub class of book and
query the subclass to return a list of entity keys on a match. As child keys
contain parent keys as well, I'd use the list of keys returned to grab the
actual book entities. You can refine this as much as you like.

Jeff

On Wed, Jul 7, 2010 at 1:58 AM, stefoid stevenmath...@yahoo.com wrote:
Hi I think I have a fair handle on how Datastore works, but I need to
check, and I need some help with a design

What I want , in english, is
; Return a list of all the BOOKS tagged with sci-fi and romance
that have been read by USERS who are my friend, sorted by Most
Frequently Read.

Now, I know I can model tags with a ListProperty, so that filtering is
easy = WHERE tag AND tag AND tag...
And I know that I can sort Books by Most Frequently Read quite easily

...Because I would blow the 5000 index limit per entity, because each
value of ListPropery generates its own index entry. Is that correct?

I cant find a way to handle this without resorting to filtering in
memory. Am I dumb, or is that just the way it is?

My solution is:

BOOK:
numerOfReads
TagList
otherStuff

Then I look up a relationship entity to find out everyone who is a
FRIEND of mine.
FRIENDS:
userKey
friendKey

Then I look up a relationship entity to find out which BOOKS that
USERS have read
BOOKSREAD:
userKey
bookKey
TagList
numberOfReads

So first I pull into memory the list of my particular friendKeys from
the FRIENDS table.

Then I churn through the table of BOOKSREAD, using the duplicated
properties TagList and numberOfReads to filter on tags and sort
according to number of reads.

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

--
--
Jeff

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: list-property, many to many, 5000 indexes...HELP!

Hi, yeah I have watched that video numerous times, and I never quite
got where he says 'this will solve the million fan out problem' and
then goes on to say that you cant have more than 5000 values in a
listproperty.  but i get what you are saying, just somehow manage
multiple 'relationship entities' per user entity.  But is that going
to solve my particular example query?

If I do this (below) Im still stumped on how to answer my question
without pulling a potentially large number of keys into memory and
filtering them in memory.

USER
ListOfBooksIveReadLists
ListOfMyFriendsLists

BOOKSIVEREAD:  (child of User)
booksList

MYFRIENDS:   (child of user)
friendList

On Jul 8, 5:31 am, Darien Caldwell darien.caldw...@gmail.com wrote:
 On Jul 6, 10:58 pm, stefoid stevenmath...@yahoo.com wrote:

  But due to the large number of BOOKS that could be read by  a USER,
  and the large number of USERS who could be my friend, I cant
  practically model  BOOKS READ BY USERS and  USERS WHO ARE MY FRIEND as
  ListProperties...

  ...Because I would blow the 5000 index limit per entity, because each
  value of ListPropery generates its own index entry.  Is that correct?

 you can have multiple ListProperty Entities per User, all in the same
 entity group. When you query, it will return a key if, say, the BOOK
 is in any of the associated lists.  This is how I handle it. If one
 list approaches 5000 entries, I just spawn a new related list and
 start filling it instead.

 I really recommend you watch this I/O presentation closely. It
 basically spells out how to do this (better than I could hope to
 explain)http://sites.google.com/site/io/building-scalable-web-applications-wi...

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] App Engine scheduled downtime NOW

App Engine is in its read-only period NOW for scheduled maintenance.
Subscribe to the downtime notify group (link below) to be alerted of
these system activities.

Reading: http://bit.ly/cqMhGr
Subscribe: http://bit.ly/9xO5AJ

-- Wesley
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
Core Python Programming, Prentice Hall, (c)2007,2001
Python Fundamentals, Prentice Hall, (c)2009
   http://corepython.com

wesley.chun : wesc+api at google.com : @wescpy
developer relations :: google app engine
@app_engine :: googleappengine.blogspot.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: App Engine scheduled downtime NOW

2010-07-07 Thread Mike

Hi Wesley

Just some feedback - it isn't great when the downtime happens 30
minutes after the scheduled downtime.

For our website www.shoesofprey.com, we display a banner for 1.5 hours
after the scheduled downtime. Posting that message 30 minutes prior
makes us seem foolish, and it also means if the maintenance goes over,
then we don't have the proper banner up.

A solution would be to introduce a new API call: something like
appengine.in_maintenance_window()

That way we could just call that on every request, and display a
window alerting users that the website is offline - or even redirect
to a we're offline for a little while placeholder. That call should
be extremely fast - so calling it on every request should have no
overhead.

That's a much better solution than having to wait for a write to fail,
from a customer expectations point of view...

Thanks guys.

Mike



On Jul 8, 10:24 am, Wesley C (Google) wesc+...@google.com wrote:
 App Engine is in its read-only period NOW for scheduled maintenance.
 Subscribe to the downtime notify group (link below) to be alerted of
 these system activities.

 Reading:http://bit.ly/cqMhGr
 Subscribe:http://bit.ly/9xO5AJ

 -- Wesley
 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
 Core Python Programming, Prentice Hall, (c)2007,2001
 Python Fundamentals, Prentice Hall, (c)2009
   http://corepython.com

 wesley.chun : wesc+api at google.com : @wescpy
 developer relations :: google app engine
 @app_engine :: googleappengine.blogspot.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: App Engine scheduled downtime NOW

App Engine's scheduled downtime completed earlier than expected today.
The system went back to full read/write as of 5:53p PDT/1253 GMT/UTC.

Please stay tuned to this same channel for next week's scheduled downtime.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] list-property, many to many, 5000 indexes...HELP!

2010-07-07 Thread Martin Webb

The way to do it is if you think of books and friends as streams.

This way they are both the same model and you only need one model/api to handle 
both

A book i have read is a stream
and a friend is a stream.

All you now do is subscribe users to friends streams
and users to book streams or book tag streams. you can also map streams to 
streams which then allows tags to include other tags - if you really want to 
get 
nifty.

So the tag - Horror is like a stream and n number of users can subscribe to its 
stream. the stream can then have a path stream/books/horror which then can 
return the activity of that stream and the same for a user use a path as the 
stream name stream/user/martin - which of course would now be my activity 
stream.


This is basically done using the model that you have been give so far.
#parent
class stream(db.Model):
#key_name=path
Count=db.IntegerProperty(default=0) #how many lists we have used - n
 #child
class stream_index(db.Model):
subscribers = db.StringListProperty()  - dont use your user name use a 
stream path - like stream/user/martin


all you now do is create your stream and append your subscribers to it in the 
list property

BUT this brings a whole new contention issue. As the solution above allows 
streams to have millions of subscribers.If they all subscribe or unsubscribe 
you 
may have update issues on the same property - which is why we use sharded 
counters for counts. To work around this you use a pipeline. 2010 IO did a 
whole 
1.5hr chat on this and its good stuff. If you watch it a few times its simple 
to 
grasp and Brets solution can be used for this proposal.

basically rather than append your users to your steam as you would normally

subscribers.append(user.name)

You append them to a work-line - basically a pipe line of work that is picked 
off by a task queue and then batched for updation in your streams. the work is 
then removed from the work line.


class work_line(db.Model):
   
work_index=db.StringProperty() - the work index is a key that depicts the 
task that is fired and what stream that task is for
subscriber=db.StringProperty() #+martin or -martin

The above is a simple work line that simply stores the user name to be 
subscribed  + or unsubscribe -

This sounds all very complex and possibly it is - the good news as i am 
building 
a stream subscription service using a pipeline

view the latest 2010 IO PIPELINES and 2009 building scalable web apps - the 
links are posted all over this group.


Regards
 
 
Martin Webb
The information contained in this email is confidential and may contain 
proprietary information. It is meant solely for the intended recipient. Access 
to this email by anyone else is unauthorised. If you are not the intended 
recipient, any disclosure, copying, distribution or any action taken or omitted 
in reliance on this, is prohibited and may be unlawful. No liability or 
responsibility is accepted if information or data is, for whatever reason 
corrupted or does not reach its intended recipient. No warranty is given that 
this email is free of viruses. The views expressed in this email are, unless 
otherwise stated, those of the author 

 
 





From: Jeff Schwartz jefftschwa...@gmail.com
To: google-appengine@googlegroups.com
Sent: Wed, 7 July, 2010 18:56:10
Subject: Re: [google-appengine] list-property, many to many, 5000  
indexes...HELP!

I wouldn't put the list attribute in your book class due to serialization 
issues 
and exploding indexes. I'd put the list in a sub class of book and query the 
subclass to return a list of entity keys on a match. As child keys contain 
parent keys as well, I'd use the list of keys returned to grab the actual book 
entities. You can refine this as much as you like.

Jeff


On Wed, Jul 7, 2010 at 1:58 AM, stefoid stevenmath...@yahoo.com wrote:

Hi I think I have a fair handle on how Datastore works, but I need to
check, and I need some help with a design

lets say I have:
a very large list of BOOKS
the BOOKS are tagged- adventure+romance,   historical+drama,
animation+sci-fi+comedy, etc...
and I have a very large list of USERS.
USERS can read a very large number of BOOKS
And I, as a USER, can have a very large number of USERS who are my
friend.

What I want , in english, is
;  Return a list of all the BOOKS tagged with sci-fi and romance
that have been read by USERS who are my friend, sorted by Most
Frequently Read.

Now, I know I can model tags with a ListProperty, so that filtering is
easy = WHERE tag AND tag AND tag...
And I know that I can sort Books by Most Frequently Read  quite easily

But due to the large number of BOOKS that could be read by  a USER,
and the large number of USERS who could be my friend, I cant
practically model  BOOKS READ BY USERS and  USERS WHO ARE MY FRIEND as
ListProperties...

...Because I would blow the 5000 index limit per entity, because each
value of ListPropery generates its own index entry.  Is

Re: [google-appengine] Re: App Engine scheduled downtime NOW

mike,

we have this feature already... see the section entitled App Engine
Maintenance Behavior on our early warning post last week:

http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/a8131355d266b37f

related post:
http://groups.google.com/group/google-appengine-python/browse_thread/thread/2a74e6fdc79f5704

related docs:
http://code.google.com/appengine/docs/python/howto/maintenance.html
http://code.google.com/appengine/docs/java/howto/maintenance.html

related preso:
http://www.slideshare.net/jasonacooper/strategies-for-maintaining-app-engine-availability-during-read-only-periods

yes, it isn't documented well nor fully-featured yet, but it's a
start, and we hope to make improvements to it moving forward!

hope this helps!
-- wesley
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
Core Python Programming, Prentice Hall, (c)2007,2001
Python Fundamentals, Prentice Hall, (c)2009
   http://corepython.com

wesley.j.chun :: wesc+api-at-google.com :: @wescpy
developer relations :: google app engine
@app_engine :: googleappengine.blogspot.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: App Engine scheduled downtime NOW

2010-07-07 Thread Mike

Oh, that's perfect! Thanks Wesley. Sorry, I missed that.  I was just
looking at this page: 
http://code.google.com/appengine/docs/python/howto/maintenance.html

Thanks! I appreciate too that this maintenance was very short.

Given we rely on AppEngine for our livelihood, we appreciate short
maintenance windows! :-)

Cheers
Mike


On Jul 8, 12:06 pm, Wesley C (Google) wesc+...@google.com wrote:
 mike,

 we have this feature already... see the section entitled App Engine
 Maintenance Behavior on our early warning post last week:

 http://groups.google.com/group/google-appengine-downtime-notify/brows...

 related 
 post:http://groups.google.com/group/google-appengine-python/browse_thread/...

 related 
 docs:http://code.google.com/appengine/docs/python/howto/maintenance.htmlhttp://code.google.com/appengine/docs/java/howto/maintenance.html

 related 
 preso:http://www.slideshare.net/jasonacooper/strategies-for-maintaining-app...

 yes, it isn't documented well nor fully-featured yet, but it's a
 start, and we hope to make improvements to it moving forward!

 hope this helps!
 -- wesley
 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
 Core Python Programming, Prentice Hall, (c)2007,2001
 Python Fundamentals, Prentice Hall, (c)2009
   http://corepython.com

 wesley.j.chun :: wesc+api-at-google.com :: @wescpy
 developer relations :: google app engine
 @app_engine :: googleappengine.blogspot.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: App Engine scheduled downtime NOW

yes, like i said, it's not documented well. jason's presentation is
probably the best doc we have at the moment! we'll try and get
something official in the docs soon.

no one likes downtimes. i hope that one day we can get rid of them altogether!

cheers,
-- wesley
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
Core Python Programming, Prentice Hall, (c)2007,2001
Python Fundamentals, Prentice Hall, (c)2009
   http://corepython.com

wesley.chun : wesc+api at google.com : @wescpy
developer relations :: google app engine
@app_engine :: googleappengine.blogspot.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: list-property, many to many, 5000 indexes...HELP!

Youre right, it does sound complex.  Im not really sure what you're
talking about, but I have yet to view the IO pipeline video, so Ill do
that first.



On Jul 8, 11:22 am, Martin Webb spydre...@yahoo.co.uk wrote:
 The way to do it is if you think of books and friends as streams.

 This way they are both the same model and you only need one model/api to 
 handle
 both

 A book i have read is a stream
 and a friend is a stream.

 All you now do is subscribe users to friends streams
 and users to book streams or book tag streams. you can also map streams to
 streams which then allows tags to include other tags - if you really want to 
 get
 nifty.

 So the tag - Horror is like a stream and n number of users can subscribe to 
 its
 stream. the stream can then have a path stream/books/horror which then can
 return the activity of that stream and the same for a user use a path as the
 stream name stream/user/martin - which of course would now be my activity
 stream.

 This is basically done using the model that you have been give so far.
 #parent
 class stream(db.Model):
     #key_name=path
     Count=db.IntegerProperty(default=0) #how many lists we have used - n
  #child
 class stream_index(db.Model):
     subscribers = db.StringListProperty()  - dont use your user name use a
 stream path - like stream/user/martin

 all you now do is create your stream and append your subscribers to it in the
 list property

 BUT this brings a whole new contention issue. As the solution above allows
 streams to have millions of subscribers.If they all subscribe or unsubscribe 
 you
 may have update issues on the same property - which is why we use sharded
 counters for counts. To work around this you use a pipeline. 2010 IO did a 
 whole
 1.5hr chat on this and its good stuff. If you watch it a few times its simple 
 to
 grasp and Brets solution can be used for this proposal.

 basically rather than append your users to your steam as you would normally

 subscribers.append(user.name)

 You append them to a work-line - basically a pipe line of work that is picked
 off by a task queue and then batched for updation in your streams. the work is
 then removed from the work line.

 class work_line(db.Model):

     work_index=db.StringProperty() - the work index is a key that depicts the
 task that is fired and what stream that task is for
     subscriber=db.StringProperty() #+martin or -martin

 The above is a simple work line that simply stores the user name to be
 subscribed  + or unsubscribe -

 This sounds all very complex and possibly it is - the good news as i am 
 building
 a stream subscription service using a pipeline

 view the latest 2010 IO PIPELINES and 2009 building scalable web apps - the
 links are posted all over this group.

 Regards

 Martin Webb
 The information contained in this email is confidential and may contain
 proprietary information. It is meant solely for the intended recipient. Access
 to this email by anyone else is unauthorised. If you are not the intended
 recipient, any disclosure, copying, distribution or any action taken or 
 omitted
 in reliance on this, is prohibited and may be unlawful. No liability or
 responsibility is accepted if information or data is, for whatever reason
 corrupted or does not reach its intended recipient. No warranty is given that
 this email is free of viruses. The views expressed in this email are, unless
 otherwise stated, those of the author

 
 From: Jeff Schwartz jefftschwa...@gmail.com
 To: google-appengine@googlegroups.com
 Sent: Wed, 7 July, 2010 18:56:10
 Subject: Re: [google-appengine] list-property, many to many, 5000  
 indexes...HELP!

 I wouldn't put the list attribute in your book class due to serialization 
 issues
 and exploding indexes. I'd put the list in a sub class of book and query the
 subclass to return a list of entity keys on a match. As child keys contain
 parent keys as well, I'd use the list of keys returned to grab the actual book
 entities. You can refine this as much as you like.

 Jeff

 On Wed, Jul 7, 2010 at 1:58 AM, stefoid stevenmath...@yahoo.com wrote:

 Hi I think I have a fair handle on how Datastore works, but I need to



 check, and I need some help with a design

 lets say I have:
 a very large list of BOOKS
 the BOOKS are tagged- adventure+romance,   historical+drama,
 animation+sci-fi+comedy, etc...
 and I have a very large list of USERS.
 USERS can read a very large number of BOOKS
 And I, as a USER, can have a very large number of USERS who are my
 friend.

 What I want , in english, is
 ;  Return a list of all the BOOKS tagged with sci-fi and romance
 that have been read by USERS who are my friend, sorted by Most
 Frequently Read.

 Now, I know I can model tags with a ListProperty, so that filtering is
 easy = WHERE tag AND tag AND tag...
 And I know that I can sort Books by Most Frequently Read  quite easily

 But due to the large number of BOOKS that could be read by  a USER,
 and the

[google-appengine] Re: list-property, many to many, 5000 indexes...HELP!