[google-appengine] Re: Move data from one local app to another

[James X Nelson]

Ok, so I hex dumped my local file, and it has the app id all over the
place.

You may be able to try out the remote api between local installations,
or you're going to need to grep/cat find/replace the app ids in a copy
of your local ds

If you don't like either of these options, write a servlet that takes
a namespace, parent key, kind, id/name value, and a fields param.
You can loop through all namespaces, then all kinds/tables with
metadata queries.
http://code.google.com/appengine/docs/java/datastore/metadataqueries.html

Post each entity from one server of old app id, to a second server on
new appid.

Send all of the key data, and all of the fields.  You can say "any
request parameter that isn't a key value is a field", or use a
fields=name_of_other_fields, param to identify other request
params that are fields.

old server loops through all data, posts to new server, where a
listening servlet reconstructs and saves the entity.

Your only big worry would be field serialization / class cast problems
{putting a double where a long goes}.

If your data is simple, no worries.

Otherwise, I would prefix the field name with data type.

! NS : Parent/23 : Kind/Name = {
one: "data"
two: 1.0
three: [45,71,3]
}

example url:
/localhost_save?ns=NS &kind=Kind &name=Name &parent=Parent%2023
&str_fields=one &one=data &dbl_fields=two &two=1 ...

I will leave it to you to decide if this is worth your time and how to
properly serialize your data to urls.

A very lazy way to serialize would be to make a DeferredTask class
that takes your entities as a parameter, save them to typed,
serializable java fields,
then just use an object output stream to convert to byte[], encode
bytes in UTF-8, post to the other server that has same DeferredTask
class,
where it uses ObjectInputStream to deserialize the job, call .run(),
which just saves the entity/ies, and you don't have to deal with url
serialization.

public class DataPort implements DeferredTask{
YourPojo data;
public DataPort(YourPojo data){
this.data = data;
}

public void run(){
DatastoreServiceFactory.getDatastoreService().put(convertToEntity(data));
}
}


Note, you can probably send pojos, or you could save raw entities to a
bunch of HashMaps,
HashMap doubles, HashMap longs,
HashMap

This would also mean you could use a single class to do all your data.

Here is the code from TaskOptions.Builder.payload(DeferredTask task)


public TaskOptions payload(DeferredTask deferredTask) {
ByteArrayOutputStream stream = new ByteArrayOutputStream(1024);
ObjectOutputStream objectStream = null;
try {
  objectStream = new ObjectOutputStream(stream);
  objectStream.writeObject(deferredTask);
} catch (IOException e) {
  throw new DeferredTaskCreationException(e);
}
payload = stream.toByteArray();
if (getMethod() != Method.PULL) {
  header("content-type",
DeferredTaskContext.RUNNABLE_TASK_CONTENT_TYPE);
  method(Method.POST);
  if (getUrl() == null) {
url(DeferredTaskContext.DEFAULT_DEFERRED_URL);
  }
}
return this;
  }


You quite likely cannot post save tasks directly from one app to
another with task queue api,
but you can serialize that byte array, mimic the headers and use url
fetch to post to the /_ah/queue/deferred of your other app.


...Whatever you choose to use, you are to, never, ever upload a script
this insecure to production!
...just saying.

On Dec 3, 11:03 am, Vivek Puri  wrote:
> I have moved my app from MS to HRD and as a result the app name has
> changed. As a result all the local data is associated with the old app
> name and i have to keep switching back and forth between app names
> while deploying and developing. Would anyone know how to migrate data
> from one local app to another local app.
>
> Thank you

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Move data from one local app to another

[James X Nelson]

Have you tried copy-pasting the generated ds flat-file,
/war/WEB-INF/appengine-generated/local_db.bin ?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: The Performance of the SDK development server has become unbearable

[Vivek Puri]

I got the proxy working on my end and it has definitely helped. Local
pages are loading in around 20 seconds, which were earlier taking 60+
seconds.



On Nov 30, 2:20 pm, "Ikai Lan (Google)"  wrote:
> Vivek,
>
> I get you. There are definitely parts of the SDK and dev appserver that we
> can improve, and this is one of them.
>
> --
> Ikai Lan
> Developer Programs Engineer, Google App Engine
> plus.ikailan.com | twitter.com/ikai
>
>
>
>
>
>
>
> On Wed, Nov 30, 2011 at 10:49 AM, Vivek Puri  wrote:
> > Ikai,
>
> > Is it possible to bundle this into the sdk itself. All this is way too
> > much custom config to deal with. I already loose my email sending
> > capabilities from localhost(needed for testing purposes) every time i
> > upgrade to new version of sdk.
>
> > On Nov 29, 1:56 pm, "Ikai Lan (Google)"  wrote:
> > > Desmond, thanks for that! I think nginx is a bit lighter weight and
> > easier
> > > to configure:
>
> > >https://help.ubuntu.com/community/Nginx/ReverseProxy
>
> > > nginx is a bit easier to configure than Apache, especially if you're just
> > > using it for development. Here's a sample reverse proxy config:
>
> > > server {        listen   80;        server_name  foo.bar.no
> > > foo.bar.yes foo.bar.ok;        access_log  /var/log/nginx/access.log;
> > >       location / {                proxy_pass      http://172.27.0.2/;
> > >               include         /etc/nginx/proxy.conf;        }}
>
> > > --
> > > Ikai Lan
> > > Developer Programs Engineer, Google App Engine
> > > plus.ikailan.com | twitter.com/ikai
>
> > > On Fri, Nov 25, 2011 at 5:36 PM, Desmond Brand  > >wrote:
>
> > > > I wrote more detailed instructions for how to set this up:
>
> > > >http://desmondbrand.com/blog/2011/11/15/speed-up-your-app-engine-dev-.
> > ..
>
> > > > On 23 November 2011 18:43, Calvin  wrote:
>
> > > >> On Wednesday, November 23, 2011 4:38:48 PM UTC-8, PK wrote:
>
> > > >>> 3. Finally, this is not new and was already worked around in my
> > > >>> environment, but if you have a realistic application you need to
> > proxy the
> > > >>> serving of static content (images/javascript/css) if you want to get
> > any
> > > >>> work done. I use apache for that and a mini framework I have built. I
> > > >>> describe the issue more here<
> >http://www.gae123.com/articles/gaet/fir-tim-exp.html>.
> > > >>> It might also help in the long term, if you star issues 343<
> >http://code.google.com/p/googleappengine/issues/detail?id=343>,
> > > >>> 6005 and 4720.
>
> > > >>> Do you have more details on how you do this?  Do you just do a
> > redirect
> > > >> to the Apache server when a static asset is requested from
> > dev_appserver?
>
> > > >> --
> > > >> You received this message because you are subscribed to the Google
> > Groups
> > > >> "Google App Engine" group.
> > > >> To view this discussion on the web visit
> > > >>https://groups.google.com/d/msg/google-appengine/-/M5yP6ScsCC4J.
>
> > > >> To post to this group, send email to
> > google-appengine@googlegroups.com.
> > > >> To unsubscribe from this group, send email to
> > > >> google-appengine+unsubscr...@googlegroups.com.
> > > >> For more options, visit this group at
> > > >>http://groups.google.com/group/google-appengine?hl=en.
>
> > > >  --
> > > > You received this message because you are subscribed to the Google
> > Groups
> > > > "Google App Engine" group.
> > > > To post to this group, send email to google-appengine@googlegroups.com
> > .
> > > > To unsubscribe from this group, send email to
> > > > google-appengine+unsubscr...@googlegroups.com.
> > > > For more options, visit this group at
> > > >http://groups.google.com/group/google-appengine?hl=en.
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Move data from one local app to another

[Vivek Puri]

I have moved my app from MS to HRD and as a result the app name has
changed. As a result all the local data is associated with the old app
name and i have to keep switching back and forth between app names
while deploying and developing. Would anyone know how to migrate data
from one local app to another local app.


Thank you

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Timeouts to Paypal

[Vivek Puri]

Ikai

This is the production Paypal. Timeouts are happening in 1 out of 10
urlfetch calls.


Thank you

On Dec 2, 1:03 pm, "Ikai Lan (Google)"  wrote:
> Vivek, is this to the Paypal sandbox or the real Paypal API?
>
> The sandbox has been observed as being pretty slow, but the real API is
> supposed to be much better.
>
> --
> Ikai Lan
> Developer Programs Engineer, Google App Engine
> plus.ikailan.com | twitter.com/ikai
>
>
>
>
>
>
>
> On Wed, Nov 30, 2011 at 1:49 PM, Brandon Wirtz  wrote:
> > Pay pal throttles by IP, you should use their Call back method where you
> > submit the request, and they hit a url when the transaction is processed.
> > Also consider using a proxy to do the submission.
>
> > -Original Message-
> > From: google-appengine@googlegroups.com
> > [mailto:google-appengine@googlegroups.com] On Behalf Of Vivek Puri
> > Sent: Wednesday, November 30, 2011 1:28 PM
> > To: Google App Engine
> > Subject: [google-appengine] Timeouts to Paypal
>
> > For the past couple weeks, we have been getting timeouts on urlfetch
> > requests made to Paypal. We have set deadline of 55 seconds, and even then
> > the request times out. If anyone else is also facing similar issue, please
> > respond. Also, if anyone from GAE team has any ideas on this, please let me
> > know.
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Feature request for GoogleAppEngineLauncher (Mac)

[GAEfan]

Would be nice if GAELauncher remembered the window positions from last
time it was opened.  It's a bit of a pain to have to resize/reposition
the app window and log window each time I quit and restart the app.

Thanks.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Everything within quota still need to pay weekly spend if using blobstore

[Barry Hunter]

Exactly, you get 5G blobstore storage for free

http://www.google.com/enterprise/cloud/appengine/pricing.html
http://code.google.com/appengine/docs/quotas.html#Blobstore

Work on non billing enabled apps.

On Sat, Dec 3, 2011 at 3:51 PM, Romesh Soni  wrote:
> So does it mean:
>
> 1) I don't need to pay this $2.1 ?
> 2) If app engine goes out of preview. I can still use blobstore, but don't
> need to enable billing?
> 3) If I turn off billing now, the blobstore will get disabled?
>
> Please let me know if I can use appengine+blobstore (within limits) without
> paying any amount (weekly or monthly).
>
> Thanks
> TL
>
>
>
> On Sat, Dec 3, 2011 at 9:13 PM, Timofey Koolin  wrote:
>>
>> $2.1/week - minimum payments for google. It spend always if you enable
>> billing in application.
>> You can turn off billing. After appengine out of preview - all
>> applications can use blobstore.
>>
>> 2011/12/3 Romesh Soni :
>> > Dear Java lovers,
>> >
>> > I have a small application which is within free quota (and will remain).
>> > I
>> > am using blobstore for some small work and even this usage is free
>> > quota.
>> > But to use blobstore, I had to turn on billing. Now since the billing is
>> > turned on Google sent me a weekly Minimum spend Invoice. And Google is
>> > saying:
>> >
>> > If the account balance ($2.10) is not paid in full by 12/20/2011, this
>> > application's quotas may be reset to the free levels.
>> >
>> > So do I need to worry about this invoice? Or I can just keep using app
>> > engine?
>> >
>> > Thanks
>> > TL
>> >
>> > --
>> > You received this message because you are subscribed to the Google
>> > Groups
>> > "Google App Engine" group.
>> > To post to this group, send email to google-appengine@googlegroups.com.
>> > To unsubscribe from this group, send email to
>> > google-appengine+unsubscr...@googlegroups.com.
>> > For more options, visit this group at
>> > http://groups.google.com/group/google-appengine?hl=en.
>>
>>
>>
>> --
>> Blog: www.rekby.ru
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Everything within quota still need to pay weekly spend if using blobstore

[Romesh Soni]

So does it mean:

1) I don't need to pay this $2.1 ?
2) If app engine goes out of preview. I can still use blobstore, but don't
need to enable billing?
3) If I turn off billing now, the blobstore will get disabled?

Please let me know if I can use appengine+blobstore (within limits) without
paying any amount (weekly or monthly).

Thanks
TL


On Sat, Dec 3, 2011 at 9:13 PM, Timofey Koolin  wrote:

> $2.1/week - minimum payments for google. It spend always if you enable
> billing in application.
> You can turn off billing. After appengine out of preview - all
> applications can use blobstore.
>
> 2011/12/3 Romesh Soni :
> > Dear Java lovers,
> >
> > I have a small application which is within free quota (and will remain).
> I
> > am using blobstore for some small work and even this usage is free quota.
> > But to use blobstore, I had to turn on billing. Now since the billing is
> > turned on Google sent me a weekly Minimum spend Invoice. And Google is
> > saying:
> >
> > If the account balance ($2.10) is not paid in full by 12/20/2011, this
> > application's quotas may be reset to the free levels.
> >
> > So do I need to worry about this invoice? Or I can just keep using app
> > engine?
> >
> > Thanks
> > TL
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/google-appengine?hl=en.
>
>
>
> --
> Blog: www.rekby.ru
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Everything within quota still need to pay weekly spend if using blobstore

[Timofey Koolin]

$2.1/week - minimum payments for google. It spend always if you enable
billing in application.
You can turn off billing. After appengine out of preview - all
applications can use blobstore.

2011/12/3 Romesh Soni :
> Dear Java lovers,
>
> I have a small application which is within free quota (and will remain). I
> am using blobstore for some small work and even this usage is free quota.
> But to use blobstore, I had to turn on billing. Now since the billing is
> turned on Google sent me a weekly Minimum spend Invoice. And Google is
> saying:
>
> If the account balance ($2.10) is not paid in full by 12/20/2011, this
> application's quotas may be reset to the free levels.
>
> So do I need to worry about this invoice? Or I can just keep using app
> engine?
>
> Thanks
> TL
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.



-- 
Blog: www.rekby.ru

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Everything within quota still need to pay weekly spend if using blobstore

[Romesh Soni]

Dear Java lovers,

I have a small application which is within free quota (and will remain). I
am using blobstore for some small work and even this usage is free quota.
But to use blobstore, I had to turn on billing. Now since the billing is
turned on Google sent me a weekly Minimum spend Invoice. And Google is
saying:

If the account balance ($2.10) is not paid in full by 12/20/2011, this
application's quotas may be reset to the free levels.

So do I need to worry about this invoice? Or I can just keep using app
engine?

Thanks
TL

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] List property indexing question

[Mahron]

Hi,

if I have a list already stored and modify one of the items in that
list, will it re-index all the list or just the what has been
modified ? and does changing the order of the list have any effect on
indexing ?

>From what I understood every list item is considered as a property on
its own so it should only update indexes on property change, just
wanted to be certain of it.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Doom day

[Adrian Scott]

We're simply not going to 2.7 until it's no longer experimental. It's that
simple. We're doing enough other stuff that's experimental etc. It would
have made sense for Google to extend the 50% discount til one month after
2.7 leaving experimental, imho, and that would have created a nice little
incentive to the google team, and also better relationships with developers
after all that has gone on recently.

We're doing a bit of optimization as we go along, but putting a hefty
priority on improving functionality and ease of use over just minimizing
expense.

-A

-- 
Adrian Scott, Ph.D.
CEO, Founder
CoderBuddy
http://www.coderbuddy.com/ <-- Create a Facebook or Google App Engine app
in a minute without installing anything



On Sat, Dec 3, 2011 at 8:29 AM, Brandon Wirtz  wrote:

> I didn't mean to say that Alexis's bugs aren't real, just that the presence
> of 2 bugs shouldn't prevent someone from starting the conversion to the new
> system.
>
> You can't make the move without testing.  There are bugs in 2.5. Your odds
> of hitting a bug is higher on 2.7, but they are far from guaranteed. I
> would
> go so far as to say if your average request is less than 5 seconds, your
> move is most likely to be painless.
>
> Most of the issues that are cause by the high computation bug can be
> avoided
> by splitting task across more than one request, or offloading to a back end
> instance.  Not Ideal, but not insurmountable. Even with the changes
> necessary to avoid the scenarios that cause the high computation but 2.7 is
> significantly faster than 2.5 and more cost effective.  If you don't want
> to
> modify your code setting Min Idle Instance Higher will prevent most issues
> as well at the expense of more instance hours.
>
> 2.7 does occasionally have long start up times.  This can be avoided by
> using a warmup in the app.yaml and avoiding splitting your files across too
> many .py files (not sure why this matters but it seems to)
>
> 2.7 is also much happier if your initialization variables are pulled from
> mem-cache not datastore. Part of that whole you have to initialize quickly
> or things get really slow.  As a result it is not a bad idea to read and
> re-write any initialization variables to memcache at the start of each
> request.  Doing this using serialized data makes this VERY fast.  If you
> have to use DataStore (which you do) you should also serialize the
> initialization variables so that you need only make one call rather than 1
> for each value.
>
> 2.7 does seem to have some interesting potential security holes, but these
> are "by design" and are avoidable if you don't want them, and can be used
> for certain performance increase if you know what you are doing.  I believe
> there are also a few subtle difference in some of the Typing that may
> impact
> you if you are building non-english apps.
>
>
>
>
>
>
>
> -Original Message-
> From: google-appengine@googlegroups.com
> [mailto:google-appengine@googlegroups.com] On Behalf Of Brian Quinlan
> Sent: Saturday, December 03, 2011 4:16 AM
> To: google-appengine@googlegroups.com
> Subject: Re: [google-appengine] Re: Doom day
>
> Hi Brandon,
>
> On Sat, Dec 3, 2011 at 8:11 PM, Brandon Wirtz  wrote:
> > I run on 2.7. I have been rock solid and my costs are 1/10th what they
> > are on 2.5
>
> Wow, that's awesome!
>
> > I had very few code changes other than removing CGI handlers.
>
> Also good news.
>
> > I would recommend 2.7 without hesitation.
> >
> > Pointing out 2 bugs that aren't well documented, and (one of which I
> > can't
> > Repo) Is more of a "I'm too lazy to do the migration" than a real excuse.
> > If you aren't testing on 2.7 you are weeks from being deployed on it
> > anyway, and are just griping. Get a test version of your app on it,
> > find out where it fails and if you have bugs file them.  Don't be a
> > wuss unless you have the same code snippet that is listed in a bug in
> > your source code.  Then I might say you should test on 2.7 but not
> > invest time in adapting the code beyond removing 2.7 incompatible code.
>
> Both of the bugs that Alexis mentioned are significant and we can reproduce
> them - though the probability of being affected by
> http://code.google.com/p/googleappengine/issues/detail?id=6401 should be
> pretty low.
>
> Python 2.7 is still experimental and your good experiences aren't a
> guarantee that others won't encounter serious problems.
>
> Cheers,
> Brian
>
> > -Brandon
> >
> >
> >
> > -Original Message-
> > From: google-appengine@googlegroups.com
> > [mailto:google-appengine@googlegroups.com] On Behalf Of Alexis
> > Sent: Saturday, December 03, 2011 1:02 AM
> > To: Google App Engine
> > Subject: [google-appengine] Re: Doom day
> >
> > We are still using Python25 too and don't feel confident moving our
> > production apps to 2.7 when seeing issues like this:
> >
> > http://code.google.com/p/googleappengine/issues/detail?id=6401
> >
> > or this:
> >
> > http://code.google.com/p/googleappengin

Re: [google-appengine] db.get() on a list of keys being split into multiple get_async() calls as opposed to a single get_async() call

[Timofey Koolin]

Production get every entity too. But do it in parallel mode - at the same time.

2011/12/3 Bryce Cutt :
> Did the production server change the way it handles a db.get() on a
> list of keys? I believe it used to do a single get_async on the list
> of keys but now it appears that it is doing a get_async for each key
> (according to appstats). The development server is still doing a
> single get_async for the entire list.
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>



-- 
Blog: www.rekby.ru

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

RE: [google-appengine] Re: Doom day

[Brandon Wirtz]

I didn't mean to say that Alexis's bugs aren't real, just that the presence
of 2 bugs shouldn't prevent someone from starting the conversion to the new
system.

You can't make the move without testing.  There are bugs in 2.5. Your odds
of hitting a bug is higher on 2.7, but they are far from guaranteed. I would
go so far as to say if your average request is less than 5 seconds, your
move is most likely to be painless.

Most of the issues that are cause by the high computation bug can be avoided
by splitting task across more than one request, or offloading to a back end
instance.  Not Ideal, but not insurmountable. Even with the changes
necessary to avoid the scenarios that cause the high computation but 2.7 is
significantly faster than 2.5 and more cost effective.  If you don't want to
modify your code setting Min Idle Instance Higher will prevent most issues
as well at the expense of more instance hours.

2.7 does occasionally have long start up times.  This can be avoided by
using a warmup in the app.yaml and avoiding splitting your files across too
many .py files (not sure why this matters but it seems to)

2.7 is also much happier if your initialization variables are pulled from
mem-cache not datastore. Part of that whole you have to initialize quickly
or things get really slow.  As a result it is not a bad idea to read and
re-write any initialization variables to memcache at the start of each
request.  Doing this using serialized data makes this VERY fast.  If you
have to use DataStore (which you do) you should also serialize the
initialization variables so that you need only make one call rather than 1
for each value.

2.7 does seem to have some interesting potential security holes, but these
are "by design" and are avoidable if you don't want them, and can be used
for certain performance increase if you know what you are doing.  I believe
there are also a few subtle difference in some of the Typing that may impact
you if you are building non-english apps.







-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Brian Quinlan
Sent: Saturday, December 03, 2011 4:16 AM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Re: Doom day

Hi Brandon,

On Sat, Dec 3, 2011 at 8:11 PM, Brandon Wirtz  wrote:
> I run on 2.7. I have been rock solid and my costs are 1/10th what they 
> are on 2.5

Wow, that's awesome!

> I had very few code changes other than removing CGI handlers.

Also good news.

> I would recommend 2.7 without hesitation.
>
> Pointing out 2 bugs that aren't well documented, and (one of which I 
> can't
> Repo) Is more of a "I'm too lazy to do the migration" than a real excuse.
> If you aren't testing on 2.7 you are weeks from being deployed on it 
> anyway, and are just griping. Get a test version of your app on it, 
> find out where it fails and if you have bugs file them.  Don't be a 
> wuss unless you have the same code snippet that is listed in a bug in 
> your source code.  Then I might say you should test on 2.7 but not 
> invest time in adapting the code beyond removing 2.7 incompatible code.

Both of the bugs that Alexis mentioned are significant and we can reproduce
them - though the probability of being affected by
http://code.google.com/p/googleappengine/issues/detail?id=6401 should be
pretty low.

Python 2.7 is still experimental and your good experiences aren't a
guarantee that others won't encounter serious problems.

Cheers,
Brian

> -Brandon
>
>
>
> -Original Message-
> From: google-appengine@googlegroups.com 
> [mailto:google-appengine@googlegroups.com] On Behalf Of Alexis
> Sent: Saturday, December 03, 2011 1:02 AM
> To: Google App Engine
> Subject: [google-appengine] Re: Doom day
>
> We are still using Python25 too and don't feel confident moving our 
> production apps to 2.7 when seeing issues like this:
>
> http://code.google.com/p/googleappengine/issues/detail?id=6401
>
> or this:
>
> http://code.google.com/p/googleappengine/issues/detail?id=6323
>
> or the one Kaan linked to...
>
> --
> You received this message because you are subscribed to the Google 
> Groups "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>
> --
> You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
>

--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appen

Re: [google-appengine] Re: Please help me how to move my data to the cloud

[Nandar Wai Yee]

  I saw the following errors in the Logs...:(

   1. 2011-12-01 13:32:56.097 /bmiHistoryCalculate 500 180ms 0kb Mozilla/5.0
   (Windows NT 6.0; WOW64) AppleWebKit/535.2 (KHTML, like Gecko)
   Chrome/15.0.874.121 Safari/535.2

   129.234.230.69 - - [01/Dec/2011:13:32:56 -0800] "POST
/bmiHistoryCalculate HTTP/1.1" 500 0
"http://hz-uak-app.appspot.com/save_login"; "Mozilla/5.0 (Windows NT
6.0; WOW64) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.121
Safari/535.2" "hz-uak-app.appspot.com" ms=181 cpu_ms=47 api_cpu_ms=0
cpm_usd=0.001359 instance=00c61b117c3bee08d2ece9b139d1e4c70d8e77

   2.  W 2011-12-01 13:32:56.093

   /bmiHistoryCalculate
   java.lang.NumberFormatException: For input string: "1,8"
at 
sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1248)
at java.lang.Float.parseFloat(Float.java:439)
at 
ndwy.exercise.uak.controller.BMIHistoryCalculateServlet.doPost(BMIHistoryCalculateServlet.java:31)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at 
org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at 
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1166)
at 
com.google.apphosting.utils.servlet.ParseBlobUploadFilter.doFilter(ParseBlobUploadFilter.java:97)
at 
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
at 
com.google.apphosting.runtime.jetty.SaveSessionFilter.doFilter(SaveSessionFilter.java:35)
at 
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
at 
com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter(TransactionCleanupFilter.java:43)
at 
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
at 
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388)
at 
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at 
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at 
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)
at 
com.google.apphosting.runtime.jetty.AppVersionHandlerMap.handle(AppVersionHandlerMap.java:249)
at 
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at 
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at 
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:923)
at 
com.google.apphosting.runtime.jetty.RpcRequestParser.parseAvailable(RpcRequestParser.java:76)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at 
com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest(JettyServletEngineAdapter.java:135)
at 
com.google.apphosting.runtime.JavaRuntime$RequestRunnable.run(JavaRuntime.java:392)
at 
com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:449)
at 
com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:455)
at com.google.tracing.TraceContext.runInContext(TraceContext.java:695)
at 
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:333)
at 
com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:325)
at 
com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:453)
at 
com.google.apphosting.runtime.ThreadGroupPool$PoolEntry.run(ThreadGroupPool.java:162)
at java.lang.Thread.run(Thread.java:679)




On Thu, Dec 1, 2011 at 4:36 PM, Abhishek Mathur  wrote:

> Hi ,
>
> Please go to your application dashboard on GAE and on the left hand  side
> you will see a link to your logs. You can have a look at the logs there and
> if you find any error you can post it here.
>
> --Thanks
> Abhishek
>
>
>
> On Thu, Dec 1, 2011 at 12:33 PM, Nandar Wai Yee wrote:
>
>> hello
>> Sorry for my late reply coz of my exam 
>> My project hasn't any error message ...this is very strange for me
>> But I wanna to show  u my link to test i uploaded my project to
>> Google App Engine
>>
>> http://hz-uak-app.appspot.com/
>>
>> Please check my link ..pls
>> in ewb.xml, i set session-enable=true ...
>> but i didn't get answer ...:(  i don't know what i'm wrong ...
>> Waiting ur reply
>>
>>
>> On Wed, Oct 19, 2011 at 3:41 AM, Greg  wrote:
>>
>>> Please post the error message you get when you press the calculate
>>> button. You can find this in the log, which is in the admin dashboard.
>>>
>>> Without this information, no-one can help you.
>>>
>>> Cheers
>>> Gre

Re: [google-appengine] Status Update On "Sucking On"

[Leandro Rezende]

i just did it now =)

2011/12/3 Brandon Wirtz 

> Links in this Email are NSFW
>
> ** **
>
> Since I only created http://Suckingon.Appspot.com  To serve as a testing
> ground, I thought I would share some info about its status since going live.
> 
>
> ** **
>
> Yesterday it got its first traffic from search. Total of 7 visitors.
>
> ** **
>
> Google Bot 
>
> Googlebot activity Is the Majority of the traffic.  Crawling up to 5,616
>  pages a day. (that’s a lot) and averaging 1000.
>
> ** **
>
> I have done no link building.  Appspot apparently carries some domain
> authority out of the get got, (which is mildly scary)
>
> ** **
>
> So far Even though I have billing enabled I could have run on a free app.*
> ***
>
> ** **
>
> So far… I’ve served 12k pages to bots, and 12 to people from search
> results.  (I won’t tell you how many of You visited the site :-) )
>
> ** **
>
> *Pages crawled per day*
>
> High
>
> Average
>
> Low
>
> *5,616*
>
> *999*
>
> *181*
>
> *Time spent downloading a page (in milliseconds)*
>
> *High*
>
> *Average*
>
> *Low*
>
> *1,411*
>
> *993*
>
> *744*
>
> ** **
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Doom day

[Brian Quinlan]

Hi Brandon,

On Sat, Dec 3, 2011 at 8:11 PM, Brandon Wirtz  wrote:
> I run on 2.7. I have been rock solid and my costs are 1/10th what they are
> on 2.5

Wow, that's awesome!

> I had very few code changes other than removing CGI handlers.

Also good news.

> I would recommend 2.7 without hesitation.
>
> Pointing out 2 bugs that aren't well documented, and (one of which I can't
> Repo) Is more of a "I'm too lazy to do the migration" than a real excuse.
> If you aren't testing on 2.7 you are weeks from being deployed on it anyway,
> and are just griping. Get a test version of your app on it, find out where
> it fails and if you have bugs file them.  Don't be a wuss unless you have
> the same code snippet that is listed in a bug in your source code.  Then I
> might say you should test on 2.7 but not invest time in adapting the code
> beyond removing 2.7 incompatible code.

Both of the bugs that Alexis mentioned are significant and we can
reproduce them - though the probability of being affected by
http://code.google.com/p/googleappengine/issues/detail?id=6401 should
be pretty low.

Python 2.7 is still experimental and your good experiences aren't a
guarantee that others won't encounter serious problems.

Cheers,
Brian

> -Brandon
>
>
>
> -Original Message-
> From: google-appengine@googlegroups.com
> [mailto:google-appengine@googlegroups.com] On Behalf Of Alexis
> Sent: Saturday, December 03, 2011 1:02 AM
> To: Google App Engine
> Subject: [google-appengine] Re: Doom day
>
> We are still using Python25 too and don't feel confident moving our
> production apps to 2.7 when seeing issues like this:
>
> http://code.google.com/p/googleappengine/issues/detail?id=6401
>
> or this:
>
> http://code.google.com/p/googleappengine/issues/detail?id=6323
>
> or the one Kaan linked to...
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Status Update On "Sucking On"

[Brandon Wirtz]

Links in this Email are NSFW

 

Since I only created http://Suckingon.Appspot.com  To serve as a testing
ground, I thought I would share some info about its status since going live.

 

Yesterday it got its first traffic from search. Total of 7 visitors.

 

Google Bot 

Googlebot activity Is the Majority of the traffic.  Crawling up to 5,616
pages a day. (that's a lot) and averaging 1000.

 

I have done no link building.  Appspot apparently carries some domain
authority out of the get got, (which is mildly scary)

 

So far Even though I have billing enabled I could have run on a free app.

 

So far. I've served 12k pages to bots, and 12 to people from search results.
(I won't tell you how many of You visited the site :-) )

 


Pages crawled per day

High

Average

Low


5,616

999

181


Time spent downloading a page (in milliseconds)

High

Average

Low


1,411

993

744

 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

RE: [google-appengine] Re: Doom day

[Brandon Wirtz]

I run on 2.7. I have been rock solid and my costs are 1/10th what they are
on 2.5

I had very few code changes other than removing CGI handlers.  

I would recommend 2.7 without hesitation.

Pointing out 2 bugs that aren't well documented, and (one of which I can't
Repo) Is more of a "I'm too lazy to do the migration" than a real excuse.
If you aren't testing on 2.7 you are weeks from being deployed on it anyway,
and are just griping. Get a test version of your app on it, find out where
it fails and if you have bugs file them.  Don't be a wuss unless you have
the same code snippet that is listed in a bug in your source code.  Then I
might say you should test on 2.7 but not invest time in adapting the code
beyond removing 2.7 incompatible code.

-Brandon



-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Alexis
Sent: Saturday, December 03, 2011 1:02 AM
To: Google App Engine
Subject: [google-appengine] Re: Doom day

We are still using Python25 too and don't feel confident moving our
production apps to 2.7 when seeing issues like this:

http://code.google.com/p/googleappengine/issues/detail?id=6401

or this:

http://code.google.com/p/googleappengine/issues/detail?id=6323

or the one Kaan linked to...

--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

RE: [google-appengine] Doom day

[Brandon Wirtz]

Or this. 

 

http://www.xyhd.tv/2011/11/industry-news/setting-google-appengine-gae-perfor
mance-sliders-for-instance-and-latency/

 

 

From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Kaan Soral
Sent: Thursday, December 01, 2011 7:27 AM
To: google-appengine@googlegroups.com
Subject: [google-appengine] Doom day

 

"The 50% discount for frontend instance hours will expire on December 1st.
Please check your Billing History page and update your budget

if necessary."

Since Python 2.7 is problematic, we have already been paying a lot with %50
discounted prices ... My daily costs went up to 90$ from 40$ before new
pricing, now it will be ~160$s ... 4x ...

-- 
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/xd3yViF2pggJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Doom day

[Alexis]

We are still using Python25 too and don't feel confident moving our
production apps to 2.7 when seeing issues like this:

http://code.google.com/p/googleappengine/issues/detail?id=6401

or this:

http://code.google.com/p/googleappengine/issues/detail?id=6323

or the one Kaan linked to...

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Doom day

[Alexis]

You can look at this thread if you want more details about instances
settings:

http://groups.google.com/group/google-appengine/browse_thread/thread/260e7cefc6e5d482/bf9b4a4a804a3091


On 2 déc, 18:04, Gerald Tan  wrote:
> If you set Max Idle Instance to automatic you will always pay for the total
> number of instances.
> Looking at your chart I'd set Max Idle Instance to something between 20-25

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.