date:20110819

We're surfacing a bad error here. Basically, you get this error message if
you hold the file open too long; we recommend around 30 seconds.

I'll file a bug internally to get a better error message. Can you break this
up into multiple writes?

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai



On Wed, Aug 17, 2011 at 5:32 PM, Mike Prince m...@mikeprince.com wrote:

 I'm trying to write a Java serialized HashMapString,Long to the
 blobstore using the FileService and getting an Unknown error 10.
 I'm guessing there's 10,000+ items in the map.

 Below is the code I'm using, followed by the stack trace.

 Can someone clue me in on what I'm doing wrong?  And yes, it works
 fine in the development environment ;)

 Thanks,

 Mike


 public class Filer
 {
private static final FileService fileService =
 FileServiceFactory.getFileService();
private static final BlobstoreService blobstoreService =
 BlobstoreServiceFactory.getBlobstoreService();

public static String save( Object value )
throws IOException
{
if( value == null ) return null;

AppEngineFile file = fileService.createNewBlobFile(
 text/plain );
return save( file, value );
}

private static String save( AppEngineFile file, Object value )
throws IOException
{
// Open a channel and write out object
FileWriteChannel writeChannel =
 fileService.openWriteChannel( file,
 true );
ObjectOutputStream out = new
 ObjectOutputStream( Channels.newOutputStream( writeChannel ) );
out.writeObject( value );

// Close it up
out.close();
writeChannel.closeFinally();

return file.getFullPath();
}



 And here's the exception...


 org.apache.jsp.tasks.create_002duser_002dsegment_jsp _jspService:
 Failed to create user segment
 java.io.IOException
at

 com.google.appengine.api.files.FileServiceImpl.translateException(FileServiceImpl.java:
 501)
at

 com.google.appengine.api.files.FileServiceImpl.makeSyncCall(FileServiceImpl.java:
 479)
at
 com.google.appengine.api.files.FileServiceImpl.append(FileServiceImpl.java:
 426)
at
 com.google.appengine.api.files.FileServiceImpl.append(FileServiceImpl.java:
 171)
at

 com.google.appengine.api.files.FileWriteChannelImpl.write(FileWriteChannelImpl.java:
 49)
at

 com.google.appengine.api.files.FileWriteChannelImpl.write(FileWriteChannelImpl.java:
 41)
at java.nio.channels.Channels.write(Channels.java:80)
at java.nio.channels.Channels.access$000(Channels.java:64)
at java.nio.channels.Channels$1.write(Channels.java:151)
at java.io.ObjectOutputStream
 $BlockDataOutputStream.drain(ObjectOutputStream.java:1855)
at java.io.ObjectOutputStream
 $BlockDataOutputStream.setBlockDataMode(ObjectOutputStream.java:1764)
at
 java.io.ObjectOutputStream.writeFatalException(ObjectOutputStream.java:
 1558)
at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:
 346)
at
 com.yumyumlabs.foundation.appengine.util.Filer.save(Filer.java:42)
at
 com.yumyumlabs.foundation.appengine.util.Filer.save(Filer.java:33)
at
 com.yumyumlabs.server.recipe.model.UserSegment.saveUsers(UserSegment.java:
 51)
at

 org.apache.jsp.tasks.create_002duser_002dsegment_jsp._jspService(create_002duser_002dsegment_jsp.java:
 104)
at
 org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at
 org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:
 511)
at
 org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:
 390)
at
 org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:
 216)
at
 org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:
 182)
at
 org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:
 765)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:
 418)
at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:327)
at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:126)
at

 org.tuckey.web.filters.urlrewrite.NormalRewrittenUrl.doRewrite(NormalRewrittenUrl.java:
 213)
at
 org.tuckey.web.filters.urlrewrite.RuleChain.handleRewrite(RuleChain.java:
 171)
at
 org.tuckey.web.filters.urlrewrite.RuleChain.doRules(RuleChain.java:
 145)
at

 org.tuckey.web.filters.urlrewrite.UrlRewriter.processRequest(UrlRewriter.java:
 92)
at

 org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:
 381)
at org.mortbay.jetty.servlet.ServletHandler
 $CachedChain.doFilter(ServletHandler.java:1157)
at

Re: [appengine-java] datastore statistics vs quota usage (again)

2011-08-19 Thread mark-ns

Hi Ikai,

Thanks for the reply. 

Nope, the two indexed fields are a jodatime LocalDate (actually persisted as 
a string via an Objectify type converter) and a string. I've verified that 
the other properties are not indexed by trying to query against them in the 
datastore viewer console.

I have been quite concerned by this, so I actually created another project 
using the non-HFR datastore, but again I have very wacky statistics - 38Mb 
listed under Datastore Statistics, but 0.25Gb usage on Quote Details. The 
datastore hasn't been updated for at least a week now, so even if they are 
calculated asyncronously I would really expect them to be accurate by now.

I don't know if you have access to the admin console of users projects, but 
the non-HFR one is called mojointest if so.

Cheers,
Mark

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/D9-1DtuCKuMJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] Multi user chat room

2011-08-19 Thread MK Z

Hi,
Im very new to this GAE services. So far I managed to run my apps on
GAE. Im trying to add multi-user chat on my app. Ive been trying to
search how to implement this-both using XMPP and Channel API. Im
interested on the latter. The problem is I couldnt find any tutorial
or example to begin with.. the channel API look simpler but whe I
visited other people blog/tutorial it doesnt really show how to do
it.. can someone help me please. Thanks

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] DataStore exception during at commit: IllegalStateException: Transaction is in state COMPLETION_IN_PROGRESS

2011-08-19 Thread An Hong

Hi,
I'm using Objectify to write to the datastore.  Within a transaction I get 
an exception like below.  Can someone explains what the error means?
TIA
An Hong

pProblem accessing /resources/item/4/share. Reason:
preTransaction is in state COMPLETION_IN_PROGRESS.  There is no legal 
transition out of this state./pre/ph3Caused 
by:/h3prejava.lang.IllegalStateException: Transaction is in state 
COMPLETION_IN_PROGRESS.  There is no legal transition out of this state.
at 
com.google.appengine.api.datastore.TransactionImpl.ensureTxnStarted(TransactionImpl.java:204)
at 
com.google.appengine.api.datastore.TransactionImpl.rollbackAsync(TransactionImpl.java:116)
at 
com.google.appengine.api.datastore.TransactionImpl.rollback(TransactionImpl.java:112)
at com.kintris.kiim.entity.Element.share(Element.java:92)
at com.kintris.kiim.entity.Element.share(Element.java:55)
at 
com.kintris.kiim.rest.resources.ItemResource.shareItem(ItemResource.java:240)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at 
com.google.appengine.tools.development.agent.runtime.Runtime.invoke(Runtime.java:100)


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/aiLZw39ub_cJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] Announcing: Programming Google App Engine, 2nd Edition Rough Cuts

2011-08-19 Thread Dan Sanderson

Greetings all -

I'm pleased to announce that *Programming Google App Engine, 2nd Edition* is
now available through O'Reilly Media's early-access Rough Cuts program:
  http://oreilly.com/catalog/0636920017547

Book blog announcement:
  http://ae-book.appspot.com/blog/entry/The_2nd_Edition_Has_Begun

Rough Cuts gets you early access to drafts and online access to the final
draft, and O'Reilly also offers a print pre-order + Rough Cuts bundle.  We
did Rough Cuts for the 1st ed, and it was especially useful.  It was great
to hear from the community about what you wanted to see in the book, and
work that feedback into the text in real time.  I hope you'll consider
joining us for the 2nd ed.

Let me know if you have any questions, feedback on the 1st edition, or ideas
of what you want to see covered in the new edition.

Many thanks!
-- Dan

P.S.  Of course, the 1st edition is still available for purchase, in print,
Kindle, PDF + ePub + Mobi + DAISY, and iPhone editions.  The book is also
available in Japanese.  Check out the links in the sidebar of the book
website:
  http://ae-book.appspot.com/

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] Server Error : Deployment Failed

2011-08-19 Thread Shawn Brown

Hello,

I consistently get:

Unable to update:
java.io.IOException: Error posting to URL:
https://appengine.google.com/api/appversion/clonefiles?app_id=fluency-upversion=428;
500 Internal Server Error

On a related note, are uploads to appengine (meaning deploying) very
slow.  I was averaging around 32kbps which is well below what my
connection tests at 256kbps.  Well that is before deploying failed
completely.  Now all's I see is:


at 
com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServerConnection.java:249)
at 
com.google.appengine.tools.admin.AbstractServerConnection.post(AbstractServerConnection.java:207)
at 
com.google.appengine.tools.admin.AppVersionUpload.send(AppVersionUpload.java:639)
at 
com.google.appengine.tools.admin.AppVersionUpload.cloneFiles(AppVersionUpload.java:502)
at 
com.google.appengine.tools.admin.AppVersionUpload.beginTransaction(AppVersionUpload.java:462)
at 
com.google.appengine.tools.admin.AppVersionUpload.doUpload(AppVersionUpload.java:137)
at 
com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:300)
at 
com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java:52)
at 
com.google.appengine.tools.admin.AppCfg$UpdateAction.execute(AppCfg.java:598)
at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:157)
at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:65)
at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:61)


and

37% Cloning 1027 application files.
37%  on backend null.

So what do I need to do to reply?

Shawn

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] Re: Server Error : Deployment Failed

2011-08-19 Thread culov

havent been able to deploy in the last hour...

On Aug 19, 8:24 pm, Shawn Brown big.coffee.lo...@gmail.com wrote:
 Hello,

 I consistently get:

 Unable to update:
 java.io.IOException: Error posting to 
 URL:https://appengine.google.com/api/appversion/clonefiles?app_id=fluency...
 500 Internal Server Error

 On a related note, are uploads to appengine (meaning deploying) very
 slow.  I was averaging around 32kbps which is well below what my
 connection tests at 256kbps.  Well that is before deploying failed
 completely.  Now all's I see is:

         at 
 com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServ 
 erConnection.java:249)
         at 
 com.google.appengine.tools.admin.AbstractServerConnection.post(AbstractServ 
 erConnection.java:207)
         at 
 com.google.appengine.tools.admin.AppVersionUpload.send(AppVersionUpload.jav 
 a:639)
         at 
 com.google.appengine.tools.admin.AppVersionUpload.cloneFiles(AppVersionUplo 
 ad.java:502)
         at 
 com.google.appengine.tools.admin.AppVersionUpload.beginTransaction(AppVersi 
 onUpload.java:462)
         at 
 com.google.appengine.tools.admin.AppVersionUpload.doUpload(AppVersionUpload 
 .java:137)
         at 
 com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:30 0)
         at 
 com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java:52)
         at 
 com.google.appengine.tools.admin.AppCfg$UpdateAction.execute(AppCfg.java:59 8)
         at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:157)
         at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:65)
         at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:61)

 and

 37% Cloning 1027 application files.
 37%  on backend null.

 So what do I need to do to reply?

 Shawn

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] app identity API javadoc missing

2011-08-19 Thread Roberto Saccon

http://code.google.com/appengine/docs/java/javadoc/com/google/appengine/api/appidentity/package-summary.html

returns a 404

--
Roberto

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/vngFfxjOrGcJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

[appengine-java] Re: Server Error : Deployment Failed

2011-08-19 Thread BoulderGae

Me Too!

On Aug 19, 10:34 pm, culov cul...@gmail.com wrote:
 havent been able to deploy in the last hour...

 On Aug 19, 8:24 pm, Shawn Brown big.coffee.lo...@gmail.com wrote:







  Hello,

  I consistently get:

  Unable to update:
  java.io.IOException: Error posting to 
  URL:https://appengine.google.com/api/appversion/clonefiles?app_id=fluency...
  500 Internal Server Error

  On a related note, are uploads to appengine (meaning deploying) very
  slow.  I was averaging around 32kbps which is well below what my
  connection tests at 256kbps.  Well that is before deploying failed
  completely.  Now all's I see is:

          at 
  com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServ 
  erConnection.java:249)
          at 
  com.google.appengine.tools.admin.AbstractServerConnection.post(AbstractServ 
  erConnection.java:207)
          at 
  com.google.appengine.tools.admin.AppVersionUpload.send(AppVersionUpload.jav 
  a:639)
          at 
  com.google.appengine.tools.admin.AppVersionUpload.cloneFiles(AppVersionUplo 
  ad.java:502)
          at 
  com.google.appengine.tools.admin.AppVersionUpload.beginTransaction(AppVersi 
  onUpload.java:462)
          at 
  com.google.appengine.tools.admin.AppVersionUpload.doUpload(AppVersionUpload 
  .java:137)
          at 
  com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:30 
  0)
          at 
  com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java:52)
          at 
  com.google.appengine.tools.admin.AppCfg$UpdateAction.execute(AppCfg.java:59 
  8)
          at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:157)
          at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:65)
          at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:61)

  and

  37% Cloning 1027 application files.
  37%  on backend null.

  So what do I need to do to reply?

  Shawn

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

2011-08-19 Thread Stephen

On Thu, Aug 18, 2011 at 10:58 PM, thstart thst...@gmail.com wrote:


 I think Master/Slave is a lot faster in my case up to 10 times faster. I
 tested it with only read, no write operations,
 no transactions, nothing special for example I have a heavy use of this
 expression:

 e = MyList.get_profile(email)
 my_keys = e.my_keys
 my_members = db.get(my_keys)

 for member in my_members:
 member.property, etc. -- do something with the
 property


Try this:

e = MyList.get_profile(email)
 my_keys = e.my_keys
my_members = db.get(my_keys, config=db.create_config(
read_policy=db.EVENTUAL_CONSISTENCY))

for member in my_members:
member.property, etc. -- do something with the
property


It's a relatively new option:


http://code.google.com/intl/en/appengine/docs/python/datastore/functions.html#create_config

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Enabling billing on appengine

 wow cool fun stuff  http://j.gs/I9f  i think you will like it

On Fri, Aug 19, 2011 at 11:44 AM, Robert Kluin robert.kl...@gmail.comwrote:

 Did your order ever show up?

 If not, you might want to submit a billing issue:

 http://code.google.com/support/bin/request.py?contact_type=AppEngineBillingSupport






 On Thu, Aug 18, 2011 at 14:29, fedex1 fed...@gmail.com wrote:
  Hi
  I tried to enable billing on appspot id: race-timing
  And I see this error:  And now appengine shows that billing will be
 enabled
  and billing changes cannot be made for 30 minutes, even though I don't
 see a
  google checkout order?  Can someone help or let me know that it will
 clear
  itself.  Thanks, Ralph
 
Browse stores »
  Error
  Purchase HistoryError
  Help
 
  Oops!
  An error occurred while processing your request.
  To fix this issue:
  Try our quick troubleshooting tips -- users report these resolve most
  issues.
  Back to My Account
 
  Time when the error happened: 2011-08-18T18:20:25 (UTC) (4aacbb1d8)
 
 
 
 
 https://checkout.google.com/view/buy?o=shoppingcartshoppingcart=974369501494940pli=1
 
  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To view this discussion on the web visit
  https://groups.google.com/d/msg/google-appengine/-/Y9DD8h5IpuoJ.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.
 

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Bye TC

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

 wow cool fun stuff  http://j.gs/I9f  i think you will like it

On Fri, Aug 19, 2011 at 2:38 PM, Stephen sdeasey+gro...@gmail.com wrote:



 On Thu, Aug 18, 2011 at 10:58 PM, thstart thst...@gmail.com wrote:


 I think Master/Slave is a lot faster in my case up to 10 times faster. I
 tested it with only read, no write operations,
 no transactions, nothing special for example I have a heavy use of this
 expression:

 e = MyList.get_profile(email)
 my_keys = e.my_keys
 my_members = db.get(my_keys)

 for member in my_members:
 member.property, etc. -- do something with the
 property


 Try this:

 e = MyList.get_profile(email)
  my_keys = e.my_keys
 my_members = db.get(my_keys, config=db.create_config(
 read_policy=db.EVENTUAL_CONSISTENCY))

 for member in my_members:
 member.property, etc. -- do something with the
 property


 It's a relatively new option:


 http://code.google.com/intl/en/appengine/docs/python/datastore/functions.html#create_config

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Bye TC

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] 500 error usually occurs

wow cool fun stuff http://j.gs/I9f i think you will like it

On Fri, Aug 19, 2011 at 8:46 AM, Nick Johnson nickjohn...@google.comwrote:

App Engine is currently experiencing production issues. Please see this
thread on the downtime notify group for details:
http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/ff24c9b1ed5e39a2?hl=en

-Nick

On Fri, Aug 19, 2011 at 12:23 PM, saintthor saintt...@gmail.com wrote:

can not open my site http://djdqbbs.appspot.com, nor update, nor
console.

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

--
Nick Johnson, Developer Programs Engineer, App Engine

--
Bye TC

Re: [google-appengine] Website Spam posing by appid: aking-741 using IP 64.233.172.1

 wow cool fun stuff  http://j.gs/I9f  i think you will like it

On Fri, Aug 19, 2011 at 11:56 AM, Robert Kluin robert.kl...@gmail.comwrote:

 On Thu, Aug 18, 2011 at 20:32, Murray W mursem...@gmail.com wrote:
  What do you want to do, monitor a site and if some app is hitting it
  too frequently automatically report it to Google for abusing *your*
  ToS?

 terms-of-service

 
  (Not sure what you mean by ToS, must be a AppEngine code word.)
  Actually I do monitor my site. Doesn't everyone today monitor
  for pharmaceutical spam, SQL injection attempts and your classical
  bruteforce attacks?

 Probably.

  I'm not worry about an application hitting my sites. I see allot of good
  appid:'s . It's when an AppEngine application is used like an open proxy
 to
  spam sites. Then the scripts brings the hammer down.

 Yes, I personally very much agree with you on this.  All of the proxy
 sites on App Engine are extremely annoying, especially when they are
 'spoofing' legitimate sites on App Engine.  Excellent setup for a
 phishing attack.





  Aren't your applications a SaaS? (Software as a Service)
  Before you think, read what I have to say.
  If one of my sites picks up 20 or 30 spam posting attempts from a single
  AppEngine that's only my site. Add a few million other sites to the mix
 and
  your application just cost you a bundle in bandwidth to allow a spammer
 to
  use.  Not my bandwidth but your applications bandwidth.
  I've read the DDoS and Reached Quota forum posts and my guess it's
 just
  spammers. They tend to flock 50 or so at a time averaging from what I
 detect
  2 to 5 posts per second.
  I'm thinking if you all found a way to either get live abuse reports or
  updates it might actually save you money.
  I'm just trying to help you all, but if you have it handled then I'll
 just
  watch the apps eat your bandwidth and get posted on popular blacklists.
  Today's list includes:
  appengine-google; (+http://code.google.com/appengine; appid:
 domaintraker)
  IP: 209.85.224.84
  Contents: http alonsoalic3 . splinder . com Percocet Dose (blah blah
 blah)
  It's only spam to me.
  I wonder how much bandwidth that app is costing:
  Remember, I'm only one in a million websites and it's clear I'm the only
 one
  to bring up an issue that is costing you money.
  The appid listed above was reported by one site I monitor:
  First seen: Report Date: 8/7/2011 4:32:41 AM last visited Report Date:
  8/18/2011 1:33:25 AM
  Add 20 million and that's some good bandwidth for the appid:
 domaintraker.
  I'm sure there is a way to create a sub-routine to monitor POST / GET
  requests from your apps.
  I would believe that a Human wouldn't be sending Post and Get
 requests
  at 4 or more per second.
  I'd be glad to work with those that are willing to work on a application.
  I've opened up the NOC reports for visitors this week. You can find the
  Google IPs and Amazon listings. Look for the APPID: notice to see how
 often
  this happens.
   XCtM Project v2
 
  Good luck and thanks for answering my questions.
 
  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To view this discussion on the web visit
  https://groups.google.com/d/msg/google-appengine/-/ZuOOAgJ6VuUJ.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.
 

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Bye TC

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: SDK 1.5.3 - deployment fails with the message Found interface com.google.appengine.tools.admin.Application, but class was expected.

 wow cool fun stuff  http://j.gs/I9f  i think you will like it

On Fri, Aug 19, 2011 at 10:16 AM, MindRaider ultradvo...@gmail.com wrote:

 Great! Thank you for logging the defect.

 -- martin

 On Aug 18, 9:59 pm, Ikai Lan (Google) ika...@google.com wrote:
  Yep, we're on it:
 
  http://code.google.com/p/googleappengine/issues/detail?id=5612
 
  We might end up releasing a new SDK for this.
 
  --
  Ikai Lan
  Developer Programs Engineer, Google App Engine
  plus.ikailan.com | twitter.com/ikai
 
 
 
 
 
 
 
  On Wed, Aug 17, 2011 at 3:28 PM, MindRaider ultradvo...@gmail.com
 wrote:
   I have a problem with the deployment of my application with SDK 1.5.3.
   It compiles without any problems, but it fails just before the
   deployment with message:
 
Found interface com.google.appengine.tools.admin.Application, but
   class was expected
 
   OS: Win7 64b; Eclipse Helios; GAE SDK 1.5.3; application
  http://web.mindforger.com
 
   After downgrade everything works perfectly.
 
   Any suggestions?
 
   --
   You received this message because you are subscribed to the Google
 Groups
   Google App Engine group.
   To post to this group, send email to google-appengine@googlegroups.com
 .
   To unsubscribe from this group, send email to
   google-appengine+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Bye TC

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] redirection to HTTPS is not working for Python app.yaml

 wow cool fun stuff  http://j.gs/I9f  i think you will like it

On Fri, Aug 19, 2011 at 12:22 PM, Gopal Patel patelgo...@gmail.com wrote:

 as of now this only works on appspot domains. for custom domain, https is
 still coming soon.


 On Fri, Aug 19, 2011 at 11:09 AM, Robert Kluin robert.kl...@gmail.comwrote:

 Are you testing on the development server or production?







 On Thu, Aug 18, 2011 at 16:43, thstart thst...@gmail.com wrote:
  to my Python app.yaml I added
  - url: /.*
script: main.py
secure: always
  BUT
  I don't get automatically redirected to the HTTPS
 
  What is wrong?
  According:
 
 http://code.google.com/appengine/docs/python/config/appconfig.html#Secure_URLs
 
  handlers:
 
  - url: /youraccount/.*
script: accounts.py
login: required
secure: always
 
  always. Requests for a URL that match this handler that do not use HTTPS
 are
  automatically redirected to the HTTPS URL with the same path. Query
  parameters are preserved for the redirect.
 
  --
  You received this message because you are subscribed to the Google
 Groups
  Google App Engine group.
  To view this discussion on the web visit
  https://groups.google.com/d/msg/google-appengine/-/3AK1D939P5sJ.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.
 

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Bye TC

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Status of federated logins

 wow cool fun stuff  http://j.gs/I9f  i think you will like it

On Fri, Aug 19, 2011 at 7:06 AM, gwstuff gwsa...@gmail.com wrote:

 Hi everyone,

 We are going to release a new app engine-based paid service and pitch it to
 the substantial user base of our mobile apps in the coming weeks. We are
 very excited to see how this pans out. One thing we are a bit nervous about
 however is that we have used the federated login framework for identity
 management.

 Once our users create their accounts, we will be irrevocable committed to
 supporting them. At the same time, federated login is marked as an
 experimental feature - and we are wondering if this means that there's a
 chance that it might get dropped in a future release. Federated login is a
 really cool feature so we do want to keep it, but if it's too risky then we
 will opt to be safe and just use custom service-specific accounts.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/ZbAyxzjPbuoJ.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Bye TC

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] lazy: way to auto-add descending index on key?

2011-08-19 Thread Mark Bucciarelli

Hi,

Is there a way to add the descending
index to all models?

Or is editing index.yaml the only way?

Probably a 30% chance I'll forget to add
it next time I add a model.  And they clutter
my daily ereporter output.

Thanks,

Mark

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] C2DM Questions

2011-08-19 Thread Selig Arkin

Have you guys considered making C2DM be a service that is provided by
appengine natively instead of having to implement the service
ourselves and upload the auth token to the appengine app?

I am a bit daunted at C2DM right now, and am thinking of using it for
an app I have instead of polling every time the app starts.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] 500 Server Error

2011-08-19 Thread Kuang Elmo

https://appengine.google.com/

Error: Server ErrorThe server encountered an error and could not complete 
your request.

If the problem persists, please 
reporthttp://code.google.com/appengine/community.html your 
problem and mention this error message and the query that caused it.


anyone knows whats the problem with gae at the moment?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/PoPa4CYaaTcJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] trying to understand some concepts

2011-08-19 Thread red_z

Hello,

I was hoping to get a few questions answered to help me better understand 
development on the Google App Engine platform (and webapp dev in general).

1. Do I have to declare all of my data tables/classes in the main script?  
Also, I'm a little confused because the data is stored in the datastore, but 
it's a class.  If someone could explain how that works that'd be great.
2. How does my webapp data persist when I upload new versions?  Does GAE 
know not to create new tables whenever I upload a new version of the main 
script?
3. How do I have a piece of code running continuously or on a schedule?  and 
where would it go in terms of in the script?
4. How do I call other scripts, for when I want a link to go to a new page?

Sorry to clog the group with my noob questions but I figured I would 
understand better if I could get an actual answer instead of tutorials upon 
tutorials that don't quite answer my questions.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/_xE4P9IEG1UJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Query and GqlQuery

2011-08-19 Thread woit company

What are better Query or GqlQuery? And why?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] ReferenceProperty

2011-08-19 Thread woit company

What do better to use ReferenceProperty or StringListProperty?
first example:
class UserCMS(db.Model):
nickname = db.StringProperty()
email = db.StringProperty()
user_id = db.StringProperty()
federated_identity = db.StringProperty()
federated_provider = db.StringProperty()
created_date = db.DateTimeProperty(auto_now_add=True)
timestamp = db.DateTimeProperty(auto_now=True)

class Role(db.Model):
name = db.StringProperty()
description = db.TextProperty()

class UsRole(db.Model):
user = db.ReferenceProperty(UserCMS)
role_user = db.ReferenceProperty(Role)


and second:
class UserCMS(db.Model):
nickname = db.StringProperty()
email = db.StringProperty()
user_id = db.StringProperty()
federated_identity = db.StringProperty()
federated_provider = db.StringProperty()
created_date = db.DateTimeProperty(auto_now_add=True)
timestamp = db.DateTimeProperty(auto_now=True)
roles = db.StringListProperty() # list of roles

class Role(db.Model):
name = db.StringProperty()
description = db.TextProperty()

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] SMS verification issues

2011-08-19 Thread Michael

Hi,

I am trying to create a Google Apps Engine account and get an error
saying 'The phone number has been sent too many messages or has
already been used to confirm an account.'

This cannot be true since I never created a GAE account before. There
is no other option how I can resolve this issue. So, maybe you can
help!?

My carrier is in the list of supported ones. I already saw the
suggestion to describe my issues at the 
http://appengine.google.com/waitlist/sms_issues
page but whenever I press the submit button there it says 'There were
errors:Comments' without further explanation. So, neither the
account creation pages works for me nor does the page where I am
supposed to submit my issues. Running out of alternatives...

Thank you for your help!

Regards,
Michael

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Datastore info

2011-08-19 Thread ESPR!T

Hi there, I am little bit confused regarding the numbers in my
datastore statistics screen. I use the free (non-billable) for my app
now and I almost ran of the space today. The datastore screen shows
me:

Size of all entities:  112,461 / 63 MBytes

The Quote details screen shows:

Total Stored Data82% 0.82 of 1.00 GBytes Okay
Blobstore Stored Data   40%  0.40 of 1.00 GBytes Okay

According to this it seems like mu app is using 0.42GB for the
datastore entities (and not 63Mbytes) - is my assumption correct or am
I missing something?

Thanks for any clarification!

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] 回复：erroring

2011-08-19 Thread 蔡荣

My app is down too (appid:shouleme).

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/kmkbfJ54FYQJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Firewall blocks new goog.appengine.Channel(token);

2011-08-19 Thread steve

After a day of combing the web, I couldn't figure out why goog was
undefined in my javascript on a particular client.  Turns out my
customer's firewall blocks Google's talkgadget.google.com which is
where /_ah/channel/jsapi goes to.  I use just about every other
component of appengine and haven't found any other problems through
this firewall.

To solve the problem, I have to check if(goog == undefined) then use
an alternative to Channel.  If anyone else has a better solution, I'm
all ears.  Otherwise, sounds like a production ready app will need to
be prepared for firewall gotcha's when using Channel.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Huge difference in cpu_ms reported in log and found using QuotaService

2011-08-19 Thread Sunny Gupta

Hello

I'm observing huge difference in CPU usage as reported in logs (and on
dashboard) and what I see from QuotaService based CPU usage profiling
in code. Here're the details:

investment-advisor.appspot.com ms=9272 cpu_ms=95562 api_cpu_ms=90569
cpm_usd=2.662842 loading_request=1
instance=00c61b117cca086cac52d0dadb5205551cafea7d

As per log (above), CPU_MS=95562

However, as reported by QuotaService: CPU_MS  3000.

This code basically URLFetch some data, and writes to datastore. It
writes about 2262 entries into datastore. Is such a high CPU usage
expected in writing ~2k entries? Here're the reported cpu_ms by
QuotaService for each fragment of code (below):

2011-08-18 20:40:28.517
com.myco.finance.financialanalyst.server.admin.worker.FinanceDataDownloader
downloadDayEndData: CPU usage before fetching data: 0.86
I 2011-08-18 20:40:32.689
com.myco.finance.financialanalyst.server.admin.worker.FinanceDataDownloader
downloadDayEndData: CPU usage in fetching historical stock data: ^NSEI
1.28583334
I 2011-08-18 20:40:32.768
com.myco.finance.financialanalyst.server.admin.worker.FinanceDataDownloader
downloadDayEndData: Historical data present and hence not downloaded
for GOLDBEES.NS
I 2011-08-18 20:40:32.769
com.myco.finance.financialanalyst.server.admin.worker.FinanceDataDownloader
downloadDayEndData: Historical data present and hence not downloaded
for LT.NS
I 2011-08-18 20:40:32.769
com.myco.finance.financialanalyst.server.admin.worker.FinanceDataDownloader
downloadDayEndData: Historical data present and hence not downloaded
for SBIN.NS
I 2011-08-18 20:40:32.904
com.myco.finance.financialanalyst.server.admin.worker.FinanceDataDownloader
downloadDayEndData: CPU usage in fetching EOD stock data:
0.005834
I 2011-08-18 20:40:32.964
com.myco.finance.financialanalyst.server.admin.worker.FinanceDataDownloader
downloadDayEndData: CPU usage in writing EOD stock data:
0.005
I 2011-08-18 20:40:32.965
com.myco.finance.financialanalyst.server.admin.cron.CronJobHttpServlet
cronDownloadDailyData: cronDownloadDailyData: Successfully downloaded
EOD financial data: 2262 entries

here's the code -

// Profiling CPU usage
QuotaService qs = QuotaServiceFactory.getQuotaService();

// Profiling CPU usage
long start = qs.getCpuTimeInMegaCycles();

// Search the list of securities in datastore currently
FinancialSecurityDAO financialSecurityDAO = new
FinancialSecurityDAO();
QueryResultIteratorFinancialSecurity securityKeyIterator =
 
financialSecurityDAO.ofy().query(FinancialSecurity.class).fetch().iterator();

// Create a single list, keep adding
ListFinancialSecurity financialSecurityList = new
ArrayListFinancialSecurity();
while (securityKeyIterator.hasNext()) {
  FinancialSecurity security = securityKeyIterator.next();
  financialSecurityList.add(security);
}

// If there're no elements in list, generate a new one
if (financialSecurityList.size() == 0) {
  financialSecurityList =
initialiseDefaultSecurityList(financialSecurityDAO);
}

// Obtain data from Data provider
StockDataProvider stockDataProvider = new
YahooStockDataProvider();
CandleStickDAO candleStickDAO = new CandleStickDAO();

// Profiling CPU usage
long end = qs.getCpuTimeInMegaCycles();
log.info(CPU usage before fetching data:  +
Double.toString(qs.convertMegacyclesToCpuSeconds(end -
start)));

ListCandleStick candleStickList = new ArrayListCandleStick();
ListFinancialSecurity stockFinancialSecurityList = new
ArrayListFinancialSecurity();
Date incidesDate = getYesterdayDate();
int addedCount = 0;
for (FinancialSecurity security : financialSecurityList) {
  // Download if historical data not downloaded already, or if
INDEX
  if (security.getFinancialSecurityType() ==
FinancialSecurityType.INDEX ||
  !security.hasHistoricalDataDownloadedAlready()) {
// Add immediately to avoid timeout, since historical data can
be large

// Profiling CPU usage
start = qs.getCpuTimeInMegaCycles();

int count = candleStickDAO.putAll(
 
stockDataProvider.getAllDailyCandleStickData(security)).size();

// Profiling CPU usage
end = qs.getCpuTimeInMegaCycles();
log.info(CPU usage in fetching historical stock data:  +
security.getTickerSymbol() +   +
Double.toString(qs.convertMegacyclesToCpuSeconds(end -
start)));

// Update, if NOT index
if (count  0) {
  security.historicalDataDownloaded();
  financialSecurityDAO.put(security);
}

addedCount += count;
  } else {
// Add to EOD list
log.info(Historical data present and hence not downloaded for
 + security.getTickerSymbol());
stockFinancialSecurityList.add(security);
  }

  /*
  // For indices, since only historical index data available
  if () {
// This may fail, so add check, and we're ok with the failure

[google-appengine] Re: Datastore info

HI

Size of all entities doesn't take into account indexes and other metadata.  
Indexes typically take up a lot more of your quota than the data, 
unless you use lots of Blobs, or Text.

Rgds

Tim

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/cOi4_tiXc3QJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: trying to understand some concepts




Classes aren't stored in the datastore, properties/attributes of an instance 
of a class are stored in the datastore.
Hi

On Friday, August 19, 2011 2:29:13 PM UTC+8, red_z wrote:

 Hello,

 I was hoping to get a few questions answered to help me better understand 
 development on the Google App Engine platform (and webapp dev in general).

 I would start out be reading the overviews in the docs (for java or 
python), they tell you a lot (though assume you have some basic knowledge)
 

 1. Do I have to declare all of my data tables/classes in the main script?  
 Also, I'm a little confused because the data is stored in the datastore, but 
 it's a class.  If someone could explain how that works that'd be great.


there are no tables (if you read the getting started it will explain this).  
You need to have imported modules (python) with the classes before you can 
retrieve an entity otherise the underlying datastore api doesn't no how to 
reconstitute the entity.

 

 2. How does my webapp data persist when I upload new versions?  Does GAE 
 know not to create new tables whenever I upload a new version of the main 
 script?

 
Versions of code have generally nothing to do with what data is persisted 
unless you have to update data with the new version of the code.
Read the docs do the tutorials you will gain a greater understanding.
 

 3. How do I have a piece of code running continuously or on a schedule?  
 and where would it go in terms of in the script?


cron, tasks, or backends - see services in the docs 

4. How do I call other scripts, for when I want a link to go to a new page?

 Now we are getting to really basic web 101 questions.  I think you really 
should do some more reading.
 

 Sorry to clog the group with my noob questions but I figured I would 
 understand better if I could get an actual answer instead of tutorials upon 
 tutorials that don't quite answer my questions.


Your questions suggest that your also new to python or java (which ever you 
are choosing) as well as web oriented developement and appengine.
I would startout by getting a good handle of the fundamentals of basic web 
apps on your language of choice, by doing the basic tutorials
then move up to the datastore.

Rgds

Tim
 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Y3YsdgVh-8UJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Cron job

2011-08-19 Thread ramesh

Hi,

I have couple of cron jobs in my application.

I have 5 cron jobs which are going to invoke in 15 mins interval.

Out of 5 cron jobs, one cron is taking so much time to execute and it
is giving exception.

I have few question on this scenario..

1) What was default time allowed to execute cron job.

2) When one cron job fails why it is removing other cron jobs


Thanks
Ramesh

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Cron job

2011-08-19 Thread Simon Knott

The answer to question 1 is 10 minutes.  I don't know the answer to question 
2 I'm afraid!

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/bBtdQKskpaIJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: SMS verification issues

2011-08-19 Thread Drew Spencer

Hmm... that's strange.

I'm guessing you've read my previous thread. I think just posting here 
should get one of the appengine team to activate your account.

I got an email saying my account had been activated but i think it was 
probably because someone read my post on here rather than someone responding 
to the form, because although I didn't get an error, I didn't get a 
confirmation page either, which leads me to believe the form didn't work.

Hope you get it sorted soon.

Drew

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/LbJOiNh4oVgJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: full text search and/or external search services

2011-08-19 Thread andreas schmid

ok after a while of using bill katzs full text search solution i switched to 
indextank.
and im really impressed how fast it is. ill be more than ok till GAEs full text 
search will be ready.
... and then we'll see if ill continue with indextank or GAEs solution.


On Aug 11, 2011, at 11:13 PM, PandaSuit wrote:

 From Ikai's post it sounds like we are a ways away from having
 Google's search on GAE and I need some features that are going to be
 annoying to add to Bill Katz solution so I decided to try out
 indextank.com as Jon Romero Vlachogiannis suggested.
 
 I am really impressed. It is easy to integrate and runs fast. All your
 search and indexing processing is offloaded from your app and if you
 have less than 10 documents to index it is free.
 
 I am in the process of converting my app over to using IndexTank right
 now.
 
 
 On Aug 3, 12:32 am, andreas schmid a.schmi...@gmail.com wrote:
 i tried whoosh-appengine and as i mentioned before it fails after indexing a 
 few 1000 because the way it works and it exceeds the soft process limit size.
 
 never tried it on a backend. right now i customized bill katz's simple full 
 text search and im really surprised how simple it is implemented and how 
 easy it is to modify it to your needs.
 i think ill go on with this solution until gaes full text search will be 
 released.
 
 thx
 
 On Aug 3, 2011, at 7:17 AM, Robert Kluin wrote:
 
 
 
 
 
 
 
 Have you tried running whoosh (not whoosh-appengine) on a backend?
 Backends are expensive, but might help you out a bit.
 
 Robert
 
 On Thu, Jul 28, 2011 at 11:19, andreas schmid a.schmi...@gmail.com wrote:
 hi guys,
 
 i really need to have a full text search on my app and i wanted to know 
 what kind of external services you are using on your apps. or how you 
 implement such a service.
 i tried whoosh-appengine but first its a really old version and second it 
 has huge issues with 1000+ indexed entities.
 
 we don't know when the full text search will be released for GAE right?
 
 thx
 
 --
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group 
 athttp://groups.google.com/group/google-appengine?hl=en.
 
 --
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group 
 athttp://groups.google.com/group/google-appengine?hl=en.
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.
 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Query Limit Problem/Question

2011-08-19 Thread See The Light

I have moved this to the API v3 group.

Thanks.

On Aug 18, 7:59 pm, Robert Kluin robert.kl...@gmail.com wrote:
 You know this is the App Engine list, not a Maps or gdata list, right?

 On Thu, Aug 18, 2011 at 22:37, See The Light envisas...@gmail.com wrote:







  The Geocoding API v3. I am using the Xml response.

  I just hit thelimittonight testing some changes that needed to be
  implemented.  I had 698 addresses to geocode. I pulled them from the
  database and submit each address using:

 http://maps.googleapis.com/maps/api/geocode/xml?address={0}sensor=false

  I then write back some of the data in the response. I checked and 26
  came up empty. I reran the code and 2 came back with the
  OVER_QUERY_LIMIT. So, it took 3 passes to geocode 698 addresses. I had
  to use 726 calls.  Luckily this is only one of the tables that needs
  updating and we only submit it to geocoding when the address changes.
  We keep track of all our calls when geocoding on the server side as
  stated previously.

  Thanks again for the help.

  On Aug 17, 9:19 am, Ikai Lan (Google) ika...@google.com wrote:
  Is this the maps API you're referring to?

  --
  Ikai Lan
  Developer Programs Engineer, Google App Engine
  plus.ikailan.com | twitter.com/ikai

  On Tue, Aug 16, 2011 at 9:28 AM, See The Light envisas...@gmail.com 
  wrote:

   Over the past couple of weeks I have noticed an increase in the number
   of OVER_QUERY_LIMIT responses we have been receiving.  Currently
   whenever we make a call to be geocoded we keep track of that call and
   decrease a counter on our end.  I have historical data that shows we
   usually end the day with at least 300 queries left.  This AM, I cannot
   even make aqueryoff the server because it returns thelimitmessage,
   and I show in our table that we have some 2300 call left.

   Is there a call that can be made to get your currentquerylimit? If
   not, does the 2500 calls allowed happen in a sliding window? Are there
   hourly limits to prevent flooding?

   This would be greatly helpful provided our search mechanism first
   attempts to get relevant geocoded data from the server before actually
   calling over to Google for an unknown geocode.

   Thanks.

   --
   You received this message because you are subscribed to the Google Groups
   Google App Engine group.
   To post to this group, send email to google-appengine@googlegroups.com.
   To unsubscribe from this group, send email to
   google-appengine+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.

  --
  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] GAE data store benchmark

2011-08-19 Thread Bruce Aloe

Hello,

I have defined some models(tables) in GAE data store and upload little
amount of data to each of them using GAE bulkloader. I have also
written a system in Java to query the data stored in the models of
GAE. Now i want to test the scalability of my system. Therefore i need
a benchmark to generate big amount of data for the model i defined in
GAE.

Is there any such benckmark from GAE? What are your suggestions?

Any help is very appreciated.


Thanks a lot!

Bruce

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Problem putting/retrieving from datastore

2011-08-19 Thread Matt

Thank you so much.. that was it!!

I cleared the datastore for this app and tried again. Out came a
random number!
It was my mistake must have read the docs wrong because I thought I
had read that .get() returns the most recent record, not the first
that it finds (key order).
Thank you again! I learned a few things that I can utilize in the
future.
Matt

On Aug 18, 11:30 pm, Tim Hoffman zutes...@gmail.com wrote:
 Hi

 WHen you retrieve the record are you sure your getting the one you think you
 are ?
 Each time you put you create a new record.

 You get is returning the first record it finds (key order)
 If you wrote some Answer entities early on with no value, then you wont get
 a value in the Answer object.

 Probably should include your current code state, so we can see where you are
 up to.

 T

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Pending queue in the scheduler.

2011-08-19 Thread de Witte

Question about the scheduler.

I got several user request a day which include the message :

This request caused a new process to be started for your application, and 
thus caused your application code to be loaded for the first time. This 
request may thus take longer and use more CPU than a typical request for 
your application.

It seems that this user request triggers the start of a new instance, gets 
on hold for 2 to 3 seconds, and then being processed by the new instance.

To me it is more logical that the request, triggers a new instance, but in 
the meantime can be processed by the other instances.

The average latency is 2.0ms, with 2249 requests per instance.

Or do I miss something. I don't want that any user has to wait 2 to.. 8 
seconds for a startup.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/9EkcwYXjKxcJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Large number of small apps / AWS Integration

2011-08-19 Thread brad

Hello app engine. I am a big time user of Amazon Web Services.

I find that a lot of times I would like to have a simple python script
or module run on demand rather than spinning up a big expensive EC2
server.

I feel like App Engine could be great for this!  Unfortunately, it
seems totally geared towards building big flahsy web apps, when all I
want to build are tiny little web services.

I am actually already doing this.  My static website http://www.bluepines.org
is being served by Amazon S3 (which is cheap) and the email part for
contacts uses Google App Engine (which is free).

So my question is, are people using app engine to build a bunch of
small web services, and is there any way to pay google more money to
get the app limit raised or get some of kind of Enterprise Account set
up with them.

Cheers

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] File Upload

2011-08-19 Thread Prabha Jadhav

Hi,
   I want to upload file using google app engine django.django file
upload code is not working in google app engine python.Please provide
sample example.that how to upload file...


Thanks
Prabha

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

On Fri, Aug 19, 2011 at 1:38 AM, Stephen sdeasey+gro...@gmail.com wrote:



 On Thu, Aug 18, 2011 at 10:58 PM, thstart thst...@gmail.com wrote:


 I think Master/Slave is a lot faster in my case up to 10 times faster. I
 tested it with only read, no write operations,
 no transactions, nothing special for example I have a heavy use of this
 expression:

 e = MyList.get_profile(email)
 my_keys = e.my_keys
 my_members = db.get(my_keys)

 for member in my_members:
 member.property, etc. -- do something with the
 property


 Try this:

 e = MyList.get_profile(email)
  my_keys = e.my_keys
 my_members = db.get(my_keys, config=db.create_config(
 read_policy=db.EVENTUAL_CONSISTENCY))


If you don't want to give you eventual consistency, try this:

my_members = db.get(my_keys,
 config=db.create_config(max_entity_groups_per_rpc=1))


Similarly, in Java you can set max entity groups per RPC:
- Set  the appengine.datastore.defaultMaxEntityGroupsPerRpc system property
to 1
- Use
http://code.google.com/appengine/docs/java/javadoc/com/google/appengine/api/datastore/DatastoreServiceConfig.html#maxEntityGroupsPerRpc(int)





 for member in my_members:
 member.property, etc. -- do something with the
 property


 It's a relatively new option:


 http://code.google.com/intl/en/appengine/docs/python/datastore/functions.html#create_config

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Fred Sauer
Developer Advocate
Google Inc.
1600 Amphitheatre Parkway
Mountain View, CA 94043
fre...@google.com

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

On Fri, Aug 19, 2011 at 10:46 AM, Fred Sauer fre...@google.com wrote:

On Fri, Aug 19, 2011 at 1:38 AM, Stephen sdeasey+gro...@gmail.com wrote:

On Thu, Aug 18, 2011 at 10:58 PM, thstart thst...@gmail.com wrote:

I think Master/Slave is a lot faster in my case up to 10 times faster. I
tested it with only read, no write operations,
no transactions, nothing special for example I have a heavy use of this
expression:

e = MyList.get_profile(email)
my_keys = e.my_keys
my_members = db.get(my_keys)

for member in my_members:
member.property, etc. -- do something with the
property

Try this:

e = MyList.get_profile(email)
my_keys = e.my_keys
my_members = db.get(my_keys, config=db.create_config(
read_policy=db.EVENTUAL_CONSISTENCY))

If you don't want to give you eventual consistency, try this:

my_members = db.get(my_keys,
config=db.create_config(max_entity_groups_per_rpc=1))

Also, for reference, here's what this does:
@ConfigOption
def max_entity_groups_per_rpc(value):
The maximum number of entity groups that can be represented in one
rpc.

For a non-transactional operation that involves more entity groups than
the
maximum, the operation will be performed by executing multiple,
asynchronous
rpcs to the datastore, each of which has no more entity groups
represented
than the maximum. So, if a put() operation has 8 entity groups and the
maximum is 3, we will send 3 rpcs, 2 with 3 entity groups and 1 with 2
entity groups. This is a performance optimization - in many cases
multiple, small, concurrent rpcs will finish faster than a single large
rpc. The optimal value for this property will be application-specific,
so
experimentation is encouraged.

Similarly, in Java you can set max entity groups per RPC:
- Set the appengine.datastore.defaultMaxEntityGroupsPerRpc system property
to 1
- Use
http://code.google.com/appengine/docs/java/javadoc/com/google/appengine/api/datastore/DatastoreServiceConfig.html#maxEntityGroupsPerRpc(int)

for member in my_members:
member.property, etc. -- do something with the
property

It's a relatively new option:

http://code.google.com/intl/en/appengine/docs/python/datastore/functions.html#create_config

--
Fred Sauer
Developer Advocate
Google Inc.
1600 Amphitheatre Parkway
Mountain View, CA 94043
fre...@google.com

Re: [google-appengine] Re: SDK 1.5.3 - deployment fails with the message Found interface com.google.appengine.tools.admin.Application, but class was expected.

We've pushed a new SDK here:

http://googleappengine.googlecode.com/files/appengine-java-sdk-1.5.3a.zip

I'm working on updating the docs, but this build should resolve the error.
When the docs are updated, I'll do a wider groups post.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai



On Thu, Aug 18, 2011 at 9:16 PM, MindRaider ultradvo...@gmail.com wrote:

 Great! Thank you for logging the defect.

 -- martin

 On Aug 18, 9:59 pm, Ikai Lan (Google) ika...@google.com wrote:
  Yep, we're on it:
 
  http://code.google.com/p/googleappengine/issues/detail?id=5612
 
  We might end up releasing a new SDK for this.
 
  --
  Ikai Lan
  Developer Programs Engineer, Google App Engine
  plus.ikailan.com | twitter.com/ikai
 
 
 
 
 
 
 
  On Wed, Aug 17, 2011 at 3:28 PM, MindRaider ultradvo...@gmail.com
 wrote:
   I have a problem with the deployment of my application with SDK 1.5.3.
   It compiles without any problems, but it fails just before the
   deployment with message:
 
Found interface com.google.appengine.tools.admin.Application, but
   class was expected
 
   OS: Win7 64b; Eclipse Helios; GAE SDK 1.5.3; application
  http://web.mindforger.com
 
   After downgrade everything works perfectly.
 
   Any suggestions?
 
   --
   You received this message because you are subscribed to the Google
 Groups
   Google App Engine group.
   To post to this group, send email to google-appengine@googlegroups.com
 .
   To unsubscribe from this group, send email to
   google-appengine+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: SDK 1.5.3 - deployment fails with the message Found interface com.google.appengine.tools.admin.Application, but class was expected.

Use this link instead:

http://code.google.com/p/googleappengine/downloads/detail?name=appengine-java-sdk-1.5.3.zipcan=2

It's the same file, but named to prevent confusion.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai

On Fri, Aug 19, 2011 at 10:50 AM, Ikai Lan (Google) ika...@google.comwrote:

We've pushed a new SDK here:

http://googleappengine.googlecode.com/files/appengine-java-sdk-1.5.3a.zip

I'm working on updating the docs, but this build should resolve the error.
When the docs are updated, I'll do a wider groups post.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai

On Thu, Aug 18, 2011 at 9:16 PM, MindRaider ultradvo...@gmail.com wrote:

Great! Thank you for logging the defect.

-- martin

On Aug 18, 9:59 pm, Ikai Lan (Google) ika...@google.com wrote:
Yep, we're on it:

http://code.google.com/p/googleappengine/issues/detail?id=5612

We might end up releasing a new SDK for this.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai

On Wed, Aug 17, 2011 at 3:28 PM, MindRaider ultradvo...@gmail.com
wrote:
I have a problem with the deployment of my application with SDK 1.5.3.
It compiles without any problems, but it fails just before the
deployment with message:

Found interface com.google.appengine.tools.admin.Application, but
class was expected

OS: Win7 64b; Eclipse Helios; GAE SDK 1.5.3; application
http://web.mindforger.com

After downgrade everything works perfectly.

Any suggestions?

--
You received this message because you are subscribed to the Google
Groups
Google App Engine group.
To post to this group, send email to
google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

*+Ikai Lan 
*
*+Fred Sauer*
*+Stephen*
*
*
Thank you, I need to rethink again with this information: it is useful. I am 
fine
with new technologies, in my case the product is very sophisticated and the 
balance
between new Google technology and what my business requires was tilted to 
business
side - e.g. less new technology and techniques, more pro business solution. 

Definitely an extension to the book, an update to the excellent Brett 
Slatkin (he explains very well) 
materials will be of much help and am awaiting them and am wondering how i 
will know if they are ready?

There is some practical questions: these changes obviously have to be 
tested, I am fine to set up a second
app just for that, but still it would be not the real thing in real 
situations. Right now I have a group of trusted people 
who are already using it and looking at the logs I can see real life 
situations which never pop up in test accounts.
So my question is - I obviously will want to implement the changes one by 
one and see the effect, being right now
on M/S could this be done in M/S environment and then move my users to HR?

Also I suppose when Google goes full HR and obviously wants we to move out 
of M/S, do Google has benchmarks 
for this kind of usage as I described in order to have a good motivation to 
move to HR?

Thanks to all!



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/cmDqAoiZDiwJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] redirection to HTTPS is not working for Python app.yaml

I am testing it on production: e.g. uploaded to Google cloud, but don't see 
the redirection
to https in the browser address bar.

I am using Python+Django+appengine_django helper

my actual app.yaml:
- url: /.*
  script: main.py
  secure: always

probably appengine_django helper is the culprit?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/n-l_VrHM260J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] redirection to HTTPS is not working for Python app.yaml

only works on appspot domains
yes I know, but it don't works on appspot - no redirection, it stays with 
http

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/sMi2W9XUipAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

2011-08-19 Thread Stephen

On Fri, Aug 19, 2011 at 6:49 PM, Fred Sauer fre...@google.com wrote:

 If you don't want to give you eventual consistency, try this:

 my_members = db.get(my_keys,
              config=db.create_config(max_entity_groups_per_rpc=1))

 Also, for reference, here's what this does:

   @ConfigOption
   def max_entity_groups_per_rpc(value):
     The maximum number of entity groups that can be represented in one
 rpc.
     For a non-transactional operation that involves more entity groups than
 the
     maximum, the operation will be performed by executing multiple,
 asynchronous
     rpcs to the datastore, each of which has no more entity groups
 represented
     than the maximum.  So, if a put() operation has 8 entity groups and the
     maximum is 3, we will send 3 rpcs, 2 with 3 entity groups and 1 with 2
     entity groups.  This is a performance optimization - in many cases
     multiple, small, concurrent rpcs will finish faster than a single large
     rpc.  The optimal value for this property will be application-specific,
 so
     experimentation is encouraged.
     

It feels like you'd always want to set this to 1. What situations
might make 1 perform better?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] GAE request latency is higher than expected.

2011-08-19 Thread Mikael Grev

Hello,

First, I'm not a HTTP guy, as you might understand.

I thought I'd use GAE as a simple but scalable key/value pair
database. So I just did a quick latency check since latency is key for
performance in my scenario.

I was very surprised that the latency is in average around 280ms for
the simplest kind of request. Basically it's two lines of code that
just returns the IP of the requesting host, so there's absolutely
nothing that takes CPU time.

The ping is constantly around 35ms so it's not a problem with lag in
the network. I have a 100Mb/s line that's extremely fast on my side
(Sweden) and it's always very fast to make requests to other hosts in
US west cost.

I have performance set to 10ms and 1 instance so that shouldn't be a
problem either. I have also tried to make several requests in a row to
warm it up, but the lag only gets slightly better, from 400ms to start
with down to the 280ms I was referring to.

Is this normal for HTTP requests or is GAE slow?

I guess to make it faster I need a dedicated server and communicate
through TCP directly?

Cheers,
Mikael

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: GAE request latency is higher than expected.

2011-08-19 Thread Philip

Every request will be routed to the USA. The ping has no meaning at
all because you only hit a european datacenter which acts as a proxy
for the GAE datacenter in the USA.

On Aug 19, 9:11 pm, Mikael Grev mikael.g...@gmail.com wrote:
 Hello,

 First, I'm not a HTTP guy, as you might understand.

 I thought I'd use GAE as a simple but scalable key/value pair
 database. So I just did a quick latency check since latency is key for
 performance in my scenario.

 I was very surprised that the latency is in average around 280ms for
 the simplest kind of request. Basically it's two lines of code that
 just returns the IP of the requesting host, so there's absolutely
 nothing that takes CPU time.

 The ping is constantly around 35ms so it's not a problem with lag in
 the network. I have a 100Mb/s line that's extremely fast on my side
 (Sweden) and it's always very fast to make requests to other hosts in
 US west cost.

 I have performance set to 10ms and 1 instance so that shouldn't be a
 problem either. I have also tried to make several requests in a row to
 warm it up, but the lag only gets slightly better, from 400ms to start
 with down to the 280ms I was referring to.

 Is this normal for HTTP requests or is GAE slow?

 I guess to make it faster I need a dedicated server and communicate
 through TCP directly?

 Cheers,
 Mikael

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Serious problem: Rollback of data on HRD

2011-08-19 Thread Tom Phillips

I'm seeing the same since moving to HR last week. It happens rarely,
and the only clue is a ConcurrentModification in the logs (java in my
case).

Pure speculation, but it looks to me like some sort of background
transaction retry might overwrite the entity with stale data, rather
than a rollback.

Scenario for me is like:
pre) Entity bob has property height=70
1) thread 1, transaction X, height=75-commit() [appears to succeed]
2) Meanwhile (within a second or so) thread 2, transaction Y height=80-
commit() [ConcurrentModificationException] - I pause 500ms and retry
- commit() [appears to succeed this time]
3) For a while (up to a minute or so, but possibly much longer) all
get-by-key on bob show height==80 (ok)
4) Another while later all get-by-key on bob suddenly show height==75,
as per transaction X (not good!)

My speculation is that the ConcurrentModification could sometimes
indicate there was disruption of BOTH transaction X and Y, even though
reported for Y.  Perhaps X had gotten past commit() call but hadn't
yet reached milestone A of 
http://code.google.com/appengine/articles/transaction_isolation.html,
and was also (temporarily) aborted due to the contention.

Then some sort of background retry on X sometimes (rarely) re-inserts
it into the transaction queue BEHIND my explicit retry on Y, and
eventually overwrites with the whole entity state from X in 1)

And it appears that sometimes the background retry of X may not even
happen till a good while later.

Any chance something like this is happening?

/Tom

On Aug 16, 10:11 pm, Greg g.fawc...@gmail.com wrote:
 Please check your logs for a warning Transaction collision.
 Retying

 Something very similar is happening on my app, where DB put()s
 silently fail (equivalent to the entity being rolled back) very
 occasionally. This has only started happening after moving to HR.

 In my app, I get this warning very consistently (every time) at
 exactly the time the entity is supposed to be stored. I would be very
 interested to hear if you find this warning too. If so, I think it
 points to a bug in the transaction collision handler in put(). Please
 let me know!

 See my earlier post 
 here:http://groups.google.com/group/google-appengine/browse_thread/thread/...

 Cheers
 Greg.

 On Aug 14, 10:21 pm, Raymond C. windz...@gmail.com wrote:

  I have recently ran into a problem after migrating to HRD:

  My application is a social online game which I have recently migrated from
  M/S to HR Datastore around 3 weeks ago.  Since 2 weeks ago I have started
  receiving reports from players which their game progress are rolled back
  suddenly while playing, which progress made in the recent few days are
  missing.  I have verified the problem through data on other entities (in
  different entity group) that the reports are actually legit and at least
  several days of progress are actually rolled back (with updates to the
  entities in the last few days are all missing).

  Player's data in the game are retrieved through id (
  Player.get_by_id(player_id) ) and because the gap is so large (days) I
  believe it is not a problem on my code (nowhere in my code cache player's
  data).

  It has never happened before for nearly 1 year so I am guessing if it is
  related to HRD.  I remember there was a thread here before which reported
  data being rolled back on HRD but I can not find it anymore.

  As you know with AppEngine datastore's distributed nature, it is so hard to
  monitor this kind of problem to ensure the problem exist.  I would like to
  ask if anyone has ran into this problem as well or suspect that you have had
  this problem before with your HRD application?



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Building index for on entity taking over 8 hours?

2011-08-19 Thread Mike Schlanser

Hello,

We've had one index building for over 8 hours now.  The entity has
only about 5 fields and has only one entity currently in it.

Is there anything we can do / appengine team can do to help with
this?  This is blocking a feature that is supposed to go out today.

Thanks,
Mike

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

2011-08-19 Thread Per

Simon, you are my hero!!

I had been deploying the classes and the html raw, e.g. from web-inf/
classes, but it turns out it's 20 to 100 times slower this way!! I
packaged everything up in one neat jar, and now my application flies
again. Even deployment is faster than before.

I guess it wasn't such a problem prior to 1.5.2 because the 3 resident
instances would warm up rather quickly, but the new post 1.5.2 scheme
spins up new instances all the time, so you get this problem all the
time.

Hello Googlers, in case your reading, IMO this belongs in the manual.
The difference between the local devserver and the actual production
system is really massive in this respect, and it's been haunting me
for a while now. A simple bullet-point please deploy jars only would
be nice.

Cheers,
Per



On Aug 16, 5:30 pm, Simon Knott knott.si...@gmail.com wrote:
 Have you tried deploying the classes as a JAR?  I only ask, because I seem
 to remember someone posting recently who was complaining that file reading
 on GAE appeared to be slow - maybe it's not the classloading which is
 actually taking the time, but reading the class files from disk (which seems
 a bit ridiculous really).

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

2011-08-19 Thread Simon Knott

Wow, glad it worked so well!  

Time to go and Jar my classes up as well...

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/-WlJUmVddaYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

We suspected this was the case but this is good information. Do you have
specific numbers? If not, that's fine. I'll do the measurements myself. If
it's significant, it could even be worth building into the deployment tool
itself.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai



On Fri, Aug 19, 2011 at 1:35 PM, Simon Knott knott.si...@gmail.com wrote:

 Wow, glad it worked so well!

 Time to go and Jar my classes up as well...

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/-WlJUmVddaYJ.

 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Automated way to switch from M/S to HR?

If you guys haven't seen Johan's community update, here's a link to sign up
for early access to the migration tool:

https://docs.google.com/a/google.com/spreadsheet/viewform?authkey=CLXR0LMNformkey=dERMcDZuMnlycHoyZDd4Vy1PNXlhWlE6MQ#gid=0

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai

On Fri, Aug 5, 2011 at 12:30 PM, Robert Kluin robert.kl...@gmail.comwrote:

On Fri, Aug 5, 2011 at 07:17, Joops john.b...@gmail.com wrote:
Hi all,

Just to through my migration hat in the ring.

I migrated my (non-production app) from MS to HR and it worked fine.
(or at least it seems to have worked fine)
I had used the Key ID's instead of Keys to handle references between
entities.

Am i correct in saying that the only benefit of using key's over id's
is that you get the nice syntactic sugar way of fetching things?

Keys can also encode the namespace and any partent-child relationship
data; if those two things are not a concern then there is effectively
no difference.

Storing the ids directly is also not-bad because you will not
accidentally dereference it leading to lots of inadvertent datastore
calls. Your code will be nice and explicit.

Robert

Thanks very much,

On Aug 5, 5:45 am, Robert Kluin robert.kl...@gmail.com wrote:
So here are my thoughts regarding this: if I have to map over all of
my data re-writing it to prepare it for the tool to convert, why not
just migrate to the other app while I'm doing that? Otherwise I'm
going to pay to read and write it to fix it, then pay again to read
it, transfer it, and rewrite it. This adds up fast if you've got much
data.

Aside from the cost factor, the migration to HR is an opportunity to
fix or improve your schemas. Things like long field names, unused
indexes, entity groups, etc All of those items that require
rewriting all of your data to adjust -- the migration is a great time
to do it. On a migration I've recently been working on, I estimate I
can reduce our storage use by about 50% with very minor changes (field
names and indexes!).

I've already migrated a couple apps, each time I've setup a job to map
over my data, maybe do some conversions, put it in some suitable
format (like csv or json) then send batches to the new app. On the
new app side I write a simple 'receiver' handler that does any needed
conversions and then writes the entities (in batches or one-by-one
transactionally, depending on the case).

Writing the sender and receiver handlers has usually been pretty quick
for me, even with very complex data. The other advantage is that you
may not need to move all of your data. Some items like stats that are
computed from your original data, may be able to be recomputed by the
exact same code as it comes in.

Would love to hear other people's thoughts on this.

Robert

On Thu, Aug 4, 2011 at 21:28, Greg Darke da...@google.com wrote:
Yes, this is the correctwayto perform this operation. I would
suggest adding a new property to the model to store the keys and
update your code to use this new property. This will allow you to
continue using your application while you are performing your schema
migration.

For example:

# Old model definition
class MyModel(db.Model):
links = db.StringListProperty()

# New model definition
class MyModel(db.Model):
links = db.StringListProperty()
link_keys = db.ListProperty(db.Key) # You may also want to set
indexed = False

def apply_schema_change(self):
if not links:
# There is nothing to update
return
self.link_keys = [db.Key(str_key) for str_key in self.links]
self.links = [] # We don't use this anymore, so delete the data

Then you would call the apply_schema_change method after reading the
model in from datastore, ensuring that the data is now in the new
format.

Then I would use the mapper framework to apply the new schema to all
of the entities in your datastore.

On 5 August 2011 10:53, Tim Hoffman zutes...@gmail.com wrote:
Hi John
I have a db.ListProperty(db.String) or db.StringListProperty and I
have
stored keys in it, which of course will be in the str(key) form.
The conversion tools doesn't convert this sort of thing mainly
because
unless there is an additional mechanism for
describing what this field holds the conversion tools can't know.
So you would need to something like
Convert all the strings back to keys
keys = [db.Key(i) for i in obj.some_list_property]
then stick them in some property that is defined as
db.ListProperty(db.Key)
Now the trick will be working out the order of events and possibly
performing multiple stages
so you can get you data converted and make the sites work before and
after
transfer/conversion
Haven't really worked out the order of events I have to go through.

Re: [google-appengine] Re: Automated way to switch from M/S to HR?

2011-08-19 Thread Will Reiher

I ended up just moving it all manually to a new HR app. Is it still possible 
to create an alias from the old app to the new app - rather than shutting it 
down? Right now I've turned off datastore writes and I have it redirecting 
all secure traffic to the new appspot url.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Dh4eMoGew64J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Why no service disruption listed on system status page?

2011-08-19 Thread Garett

In the system status page, I'm wondering why there is no service 
disruption listed anywhere for yesterday.  I would have thought what 
happened was serious enough to show something other than a green checkmark?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/vcfHqA-RizAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

2011-08-19 Thread Per

The classes above took anything from 100ms to 500ms under normal
conditions, and could take up to several seconds when things got
really pear-shaped. Now that everything is jarred up, the classloading
happens in 20ms to 30ms on average, pretty much as it does on the
local devserver. I am sure it will also be slower under big stress,
but still, that's a substantial improvement already.

Adding it to the deployment tool would be great IMO. I was worried
that jarring everything up would make deployment slow (always
deploying a big 1MB jar instead of a couple classfiles only) but to my
surprise it's a lot faster this way. Deployments are fun again! :)


On Aug 19, 10:38 pm, Ikai Lan (Google) ika...@google.com wrote:
 We suspected this was the case but this is good information. Do you have
 specific numbers? If not, that's fine. I'll do the measurements myself. If
 it's significant, it could even be worth building into the deployment tool
 itself.

 --
 Ikai Lan
 Developer Programs Engineer, Google App Engine
 plus.ikailan.com | twitter.com/ikai







 On Fri, Aug 19, 2011 at 1:35 PM, Simon Knott knott.si...@gmail.com wrote:
  Wow, glad it worked so well!

  Time to go and Jar my classes up as well...

  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/-WlJUmVddaYJ.

  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Why no service disruption listed on system status page?

2011-08-19 Thread Vinuth Madinur

That is always the case. It's a green mark all the time.


On Fri, Aug 19, 2011 at 10:36 PM, Garett goot...@gmail.com wrote:

 In the system status page, I'm wondering why there is no service
 disruption listed anywhere for yesterday.  I would have thought what
 happened was serious enough to show something other than a green checkmark?

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/vcfHqA-RizAJ.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: full text search and/or external search services

2011-08-19 Thread Bryce C

I finished my conversion over to IndexTank and it has been running in
production for a few days now. It is too early to make grand
pronouncements but I am really happy with the performance so far,
especially compared to what I was using before. The faceting abilities
are really nice for generating reports on the types of data I am
storing. I used their jQuery auto-complete plugin to give my users a
better search experience and it was really easy to get integrated.

I am still definitely looking forward to the official GAE full text
search and especially how it will integrate with models and queries.


On Aug 19, 6:43 am, andreas schmid a.schmi...@gmail.com wrote:
 ok after a while of using bill katzs full text search solution i switched to 
 indextank.
 and im really impressed how fast it is. ill be more than ok till GAEs full 
 text search will be ready.
 ... and then we'll see if ill continue with indextank or GAEs solution.

 On Aug 11, 2011, at 11:13 PM, PandaSuit wrote:







  From Ikai's post it sounds like we are a ways away from having
  Google's search on GAE and I need some features that are going to be
  annoying to add to Bill Katz solution so I decided to try out
  indextank.com as Jon Romero Vlachogiannis suggested.

  I am really impressed. It is easy to integrate and runs fast. All your
  search and indexing processing is offloaded from your app and if you
  have less than 10 documents to index it is free.

  I am in the process of converting my app over to using IndexTank right
  now.

  On Aug 3, 12:32 am, andreas schmid a.schmi...@gmail.com wrote:
  i tried whoosh-appengine and as i mentioned before it fails after indexing 
  a few 1000 because the way it works and it exceeds the soft process limit 
  size.

  never tried it on a backend. right now i customized bill katz's simple 
  full text search and im really surprised how simple it is implemented and 
  how easy it is to modify it to your needs.
  i think ill go on with this solution until gaes full text search will be 
  released.

  thx

  On Aug 3, 2011, at 7:17 AM, Robert Kluin wrote:

  Have you tried running whoosh (not whoosh-appengine) on a backend?
  Backends are expensive, but might help you out a bit.

  Robert

  On Thu, Jul 28, 2011 at 11:19, andreas schmid a.schmi...@gmail.com 
  wrote:
  hi guys,

  i really need to have a full text search on my app and i wanted to know 
  what kind of external services you are using on your apps. or how you 
  implement such a service.
  i tried whoosh-appengine but first its a really old version and second 
  it has huge issues with 1000+ indexed entities.

  we don't know when the full text search will be released for GAE right?

  thx

  --
  You received this message because you are subscribed to the Google 
  Groups Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=en.

  --
  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=en.

  --
  You received this message because you are subscribed to the Google Groups 
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to 
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group 
  athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

2011-08-19 Thread Jose Montes de Oca

Hi Peter,

I think we don't make this for you behind the scenes because there is an 
specific use case where this would not work: For files that you want to 
override that are already in a jar file, this files should remain in the 
WEB-INF/classes folder.

one alternative would be to modified the jar you are overriding and replace 
the clase with your own.

Best,
Jose Montes de Oca

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/_Egj21a2SPAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

A bit from business side reality - today my partners where on a meeting 
with a BIG customer representatives. Functionality and speed especially 
(M/S currently) impressed them so much that they wanted to add 500 users 
immediately
to our app and paid for it to be sure they get an access. 

Our app is with Billing On so I don't see this High Replication vs. Master/ 
Slave 
thing as an issue for Google -  we are paying customers. 

So now the question is open before me and my partners especially:
1) Things are moving very fast from business side and I will mark the app 
from Alpha
to Beta soon after looking how it works with more simultaneous users.
2) The users are already feeling the speed and any speed decrease will be 
mentioned
immediately. That is because the app is actually a mobile HTML5 app and used 
in 
all kind of devices: Android, iPhone, Blackberry. For such kind of app the 
speed is of
1st priority and any decision about functionality is rejected if the speed 
is slowed down.
3) Now the question is what benefit we will get (if any) moving from M/S to 
HR WITHOUT
disrupting the current functionality and speed? Does the amount of time, 
effort and cost 
which need to be invested in migration to HR is justified? As a start-up 
this is critical for us.
Every day we have a NEW list of priorities which are business related - 
users need more and more -
we get this from the feedback. Nobody cares about underlying technology if 
it works good enough.

Best,
--Constantine



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/iDQzYaVOSioJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] https for mydomain.com?

2011-08-19 Thread Phil McDonnell

Can I use https for mydomain.com?  I know that I can configure app engine to
use https for the myapp.appspot.com, but can I require https for
mydomain.com?  I'm on Java and my domain is with godaddy.

I think I remember this being a recent (within the last year) feature added,
but I can't quite figure out how to make it work.

Thanks so much,
Phil

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: https for mydomain.com?

Nope

Sorry not here yet, lots of us hanging out for  it

T

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/h0vRLd6u1n4J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Large number of small apps / AWS Integration

Its trivial to write small web services in appengine, 
be they xmlrpc, jsonrpc, simple rest services.  (SOAP is a lot harder ;-)

You don't have to have multiple appengine instances. You could easily run a 
bunch of different services
out of the same instance. 

If you need to make sure individual web services in an instance can't share 
data then 
use names spaces.  Have a read up on multitenancy  
http://code.google.com/appengine/docs/python/multitenancy/

Rgds

T

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/17114U2h-NsJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Firewall blocks new goog.appengine.Channel(token);

2011-08-19 Thread steve

Aha!  I starred the issue (see link below).  The first law of posts,
you figure it out immediately following your post.

http://code.google.com/p/googleappengine/issues/detail?id=4764


On Aug 18, 2:47 pm, steve bonham.st...@gmail.com wrote:
 After a day of combing the web, I couldn't figure out why goog was
 undefined in my javascript on a particular client.  Turns out my
 customer's firewall blocks Google's talkgadget.google.com which is
 where /_ah/channel/jsapi goes to.  I use just about every other
 component of appengine and haven't found any other problems through
 this firewall.

 To solve the problem, I have to check if(goog == undefined) then use
 an alternative to Channel.  If anyone else has a better solution, I'm
 all ears.  Otherwise, sounds like a production ready app will need to
 be prepared for firewall gotcha's when using Channel.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

Fred on my Android.
On Aug 19, 2011 11:18 AM, thstart thst...@gmail.com wrote:

 +Ikai Lan
 +Fred Sauer
 +Stephen

 Thank you, I need to rethink again with this information: it is useful. I
am fine
 with new technologies, in my case the product is very sophisticated and
the balance
 between new Google technology and what my business requires was tilted to
business
 side - e.g. less new technology and techniques, more pro business
solution.

 Definitely an extension to the book, an update to the excellent Brett
Slatkin (he explains very well)
 materials will be of much help and am awaiting them and am wondering how i
will know if they are ready?

 There is some practical questions: these changes obviously have to be
tested,

You can also deploy another app version for testing.

I am fine to set up a second
 app just for that, but still it would be not the real thing in real
situations. Right now I have a group of trusted people
 who are already using it and looking at the logs I can see real life
situations which never pop up in test accounts.
 So my question is - I obviously will want to implement the changes one by
one and see the effect, being right now
 on M/S could this be done in M/S environment and then move my users to HR?

The impact of these changes are material on HRD, and may have limited
performance impact on M/S.

Test where you like, but test the scenario which you plan to use.

Above all else, migrate to HRD as soon as practical.


 Also I suppose when Google goes full HR and obviously wants we to move out
of M/S, do Google has benchmarks
 for this kind of usage as I described in order to have a good motivation
to move to HR?

While you should care that your app has acceptable performance, and you
should use the suggested tips to get optimal performance out of HRD, your
primary concern or reasons for migrating off of M/S are
1 Avoiding scheduled read-only periods
2 Avoiding unscheduled outages and maintenance periods
3 Avoiding datastore latency spikes

Every developer who I've communicated with has been happy with their app on
HRD and none want to go back. In particular the 3rd point I mentioned often
weighs the heaviest for developers.

To put it another way: I have yet to find a use case, when the whole app is
considered, where M/S is preferable to HRD.

Hope that helps.
Fred


 Thanks to all!



 --
 You received this message because you are subscribed to the Google Groups
Google App Engine group.
 To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/cmDqAoiZDiwJ.

 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

Feel free to set the default to 1 for your apps.

Fred on my Android.
On Aug 19, 2011 11:52 AM, Stephen sdeasey+gro...@gmail.com wrote:
 On Fri, Aug 19, 2011 at 6:49 PM, Fred Sauer fre...@google.com wrote:

 If you don't want to give you eventual consistency, try this:

 my_members = db.get(my_keys,
  config=db.create_config(max_entity_groups_per_rpc=1))

 Also, for reference, here's what this does:

   @ConfigOption
   def max_entity_groups_per_rpc(value):
 The maximum number of entity groups that can be represented in one
 rpc.
 For a non-transactional operation that involves more entity groups
than
 the
 maximum, the operation will be performed by executing multiple,
 asynchronous
 rpcs to the datastore, each of which has no more entity groups
 represented
 than the maximum.  So, if a put() operation has 8 entity groups and
the
 maximum is 3, we will send 3 rpcs, 2 with 3 entity groups and 1 with
2
 entity groups.  This is a performance optimization - in many cases
 multiple, small, concurrent rpcs will finish faster than a single
large
 rpc.  The optimal value for this property will be
application-specific,
 so
 experimentation is encouraged.
 

 It feels like you'd always want to set this to 1. What situations
 might make 1 perform better?

 --
 You received this message because you are subscribed to the Google Groups
Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

You should mirate to HRD if you care about consistent, predictable speed,
performance and reliability. Your app will be happier. You will be happier.
Your customers will be happier.

The advice to migrate to HRD is unqualified: you should migrate.

Fred on my Android.
On Aug 19, 2011 3:51 PM, thstart thst...@gmail.com wrote:
 A bit from business side reality - today my partners where on a meeting
 with a BIG customer representatives. Functionality and speed especially
 (M/S currently) impressed them so much that they wanted to add 500 users
 immediately
 to our app and paid for it to be sure they get an access.

 Our app is with Billing On so I don't see this High Replication vs.
Master/
 Slave
 thing as an issue for Google - we are paying customers.

 So now the question is open before me and my partners especially:
 1) Things are moving very fast from business side and I will mark the app
 from Alpha
 to Beta soon after looking how it works with more simultaneous users.
 2) The users are already feeling the speed and any speed decrease will be
 mentioned
 immediately. That is because the app is actually a mobile HTML5 app and
used
 in
 all kind of devices: Android, iPhone, Blackberry. For such kind of app the

 speed is of
 1st priority and any decision about functionality is rejected if the speed

 is slowed down.
 3) Now the question is what benefit we will get (if any) moving from M/S
to
 HR WITHOUT
 disrupting the current functionality and speed? Does the amount of time,
 effort and cost
 which need to be invested in migration to HR is justified? As a start-up
 this is critical for us.
 Every day we have a NEW list of priorities which are business related -
 users need more and more -
 we get this from the feedback. Nobody cares about underlying technology if

 it works good enough.

 Best,
 --Constantine



 --
 You received this message because you are subscribed to the Google Groups
Google App Engine group.
 To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/iDQzYaVOSioJ.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: https for mydomain.com?

2011-08-19 Thread Phil McDonnell

This is pretty disappointing.  I was sure it had long since been done.  I
remember it being on the Q4 2010 roadmap.  Is there some work around for
this?

Thanks,
Phil

On Fri, Aug 19, 2011 at 4:30 PM, Tim Hoffman zutes...@gmail.com wrote:

 Nope

 Sorry not here yet, lots of us hanging out for  it

 T

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/h0vRLd6u1n4J.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: https for mydomain.com?

2011-08-19 Thread Phil McDonnell

I wasn't trying to differentiate mydomain.com vs. www.mydomain.com.  I
realize there might be issues with naked domains and I'd probably need to
have godady forward them to the www equivalent.  Does that help at all?

On Fri, Aug 19, 2011 at 5:33 PM, Phil McDonnell
phil.a.mcdonn...@gmail.comwrote:

 This is pretty disappointing.  I was sure it had long since been done.  I
 remember it being on the Q4 2010 roadmap.  Is there some work around for
 this?

 Thanks,
 Phil


 On Fri, Aug 19, 2011 at 4:30 PM, Tim Hoffman zutes...@gmail.com wrote:

 Nope

 Sorry not here yet, lots of us hanging out for  it

 T

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/h0vRLd6u1n4J.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: https for mydomain.com?

Nope, doesn't help at all.

Just not available yet.

T

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/g0-tfqOzUSMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] lazy: way to auto-add descending index on key?

Do a query somewhere in code once. It'll autopopulate the index file.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai



On Thu, Aug 18, 2011 at 2:45 PM, Mark Bucciarelli mkb...@gmail.com wrote:

 Hi,

 Is there a way to add the descending
 index to all models?

 Or is editing index.yaml the only way?

 Probably a 30% chance I'll forget to add
 it next time I add a model.  And they clutter
 my daily ereporter output.

 Thanks,

 Mark

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] C2DM Questions

It's not on our roadmap, but we're look at ways we can better support stuff
like this:

http://code.google.com/appengine/docs/roadmap.html

I think one way is extending the Google Plugin for Eclipse. I think it'll do
a lot of the boilerplate for you if you install the beta. Ultimately, it's
probably still best if you still understand how it works underneath the
hood, in my opinion.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai



On Thu, Aug 18, 2011 at 4:05 PM, Selig Arkin seligar...@gmail.com wrote:

 Have you guys considered making C2DM be a service that is provided by
 appengine natively instead of having to implement the service
 ourselves and upload the auth token to the appengine app?

 I am a bit daunted at C2DM right now, and am thinking of using it for
 an app I have instead of polling every time the app starts.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] ReferenceProperty

StringList, because you don't have to do an additional query for roles.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai



On Thu, Aug 18, 2011 at 11:06 PM, woit company woitcomp...@gmail.comwrote:

 What do better to use ReferenceProperty or StringListProperty?
 first example:
 class UserCMS(db.Model):
nickname = db.StringProperty()
email = db.StringProperty()
user_id = db.StringProperty()
federated_identity = db.StringProperty()
federated_provider = db.StringProperty()
created_date = db.DateTimeProperty(auto_now_add=True)
timestamp = db.DateTimeProperty(auto_now=True)

 class Role(db.Model):
name = db.StringProperty()
description = db.TextProperty()

 class UsRole(db.Model):
user = db.ReferenceProperty(UserCMS)
role_user = db.ReferenceProperty(Role)


 and second:
 class UserCMS(db.Model):
nickname = db.StringProperty()
email = db.StringProperty()
user_id = db.StringProperty()
federated_identity = db.StringProperty()
federated_provider = db.StringProperty()
created_date = db.DateTimeProperty(auto_now_add=True)
timestamp = db.DateTimeProperty(auto_now=True)
roles = db.StringListProperty() # list of roles

 class Role(db.Model):
name = db.StringProperty()
description = db.TextProperty()

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Query and GqlQuery

Query because it's better to programmatically generate the query than
assemble a string by hand. Generally results in cleaner code without you
having to worry about spaces or quotations.

--
Ikai Lan
Developer Programs Engineer, Google App Engine
plus.ikailan.com | twitter.com/ikai



On Thu, Aug 18, 2011 at 10:59 PM, woit company woitcomp...@gmail.comwrote:

 What are better Query or GqlQuery? And why?

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Announcing: Programming Google App Engine, 2nd Edition Rough Cuts

2011-08-19 Thread Dan Sanderson

Greetings all -

I'm pleased to announce that *Programming Google App Engine, 2nd Edition* is
now available through O'Reilly Media's early-access Rough Cuts program:
  http://oreilly.com/catalog/0636920017547

Book blog announcement:
  http://ae-book.appspot.com/blog/entry/The_2nd_Edition_Has_Begun

Rough Cuts gets you early access to drafts and online access to the final
draft, and O'Reilly also offers a print pre-order + Rough Cuts bundle.  We
did Rough Cuts for the 1st ed, and it was especially useful.  It was great
to hear from the community about what you wanted to see in the book, and
work that feedback into the text in real time.  I hope you'll consider
joining us for the 2nd ed.

Let me know if you have any questions, feedback on the 1st edition, or ideas
of what you want to see covered in the new edition.

Many thanks!
-- Dan

P.S.  Of course, the 1st edition is still available for purchase, in print,
Kindle, PDF + ePub + Mobi + DAISY, and iPhone editions.  The book is also
available in Japanese.  Check out the links in the sidebar of the book
website:
  http://ae-book.appspot.com/

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

RE: [google-appengine] Should Google deprecate Master/Slave data store option?

2011-08-19 Thread Brandon Wirtz

I have a set of apps that Run very well on MS and unless MS is all the way
down (which has happened) they ran just fine during maintenance, and
No-Write periods.  They are cheaper and faster on MS.  

 

HR is definitely the best for many situation, but there may be times when MS
is better especially if you are fighting costs.

 

 

From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Fred Sauer
Sent: Friday, August 19, 2011 5:31 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Should Google deprecate Master/Slave data
store option?

 

You should mirate to HRD if you care about consistent, predictable speed,
performance and reliability. Your app will be happier. You will be happier.
Your customers will be happier.

The advice to migrate to HRD is unqualified: you should migrate.

Fred on my Android. 

On Aug 19, 2011 3:51 PM, thstart thst...@gmail.com wrote:
 A bit from business side reality - today my partners where on a meeting 
 with a BIG customer representatives. Functionality and speed especially 
 (M/S currently) impressed them so much that they wanted to add 500 users 
 immediately
 to our app and paid for it to be sure they get an access. 
 
 Our app is with Billing On so I don't see this High Replication vs.
Master/ 
 Slave 
 thing as an issue for Google - we are paying customers. 
 
 So now the question is open before me and my partners especially:
 1) Things are moving very fast from business side and I will mark the app 
 from Alpha
 to Beta soon after looking how it works with more simultaneous users.
 2) The users are already feeling the speed and any speed decrease will be 
 mentioned
 immediately. That is because the app is actually a mobile HTML5 app and
used 
 in 
 all kind of devices: Android, iPhone, Blackberry. For such kind of app the

 speed is of
 1st priority and any decision about functionality is rejected if the speed

 is slowed down.
 3) Now the question is what benefit we will get (if any) moving from M/S
to 
 HR WITHOUT
 disrupting the current functionality and speed? Does the amount of time, 
 effort and cost 
 which need to be invested in migration to HR is justified? As a start-up 
 this is critical for us.
 Every day we have a NEW list of priorities which are business related - 
 users need more and more -
 we get this from the feedback. Nobody cares about underlying technology if

 it works good enough.
 
 Best,
 --Constantine
 
 
 
 -- 
 You received this message because you are subscribed to the Google Groups
Google App Engine group.
 To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/iDQzYaVOSioJ.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
mailto:google-appengine%2bunsubscr...@googlegroups.com .
 For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
 

-- 
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Serious problem: Rollback of data on HRD

2011-08-19 Thread Alfred Fuller

Are your transactions idempotent? It is possible that the transaction is
being run (and succeeding) twice in this case. What other request is
colliding with first? You are not using any non-ancestor queries or setting
read_policy=EVENTUAL on any reads correct?

On Fri, Aug 19, 2011 at 12:42 PM, Tom Phillips tphill0...@gmail.com wrote:

 I'm seeing the same since moving to HR last week. It happens rarely,
 and the only clue is a ConcurrentModification in the logs (java in my
 case).

 Pure speculation, but it looks to me like some sort of background
 transaction retry might overwrite the entity with stale data, rather
 than a rollback.

 Scenario for me is like:
 pre) Entity bob has property height=70
 1) thread 1, transaction X, height=75-commit() [appears to succeed]
 2) Meanwhile (within a second or so) thread 2, transaction Y height=80-
 commit() [ConcurrentModificationException] - I pause 500ms and retry
 - commit() [appears to succeed this time]
 3) For a while (up to a minute or so, but possibly much longer) all
 get-by-key on bob show height==80 (ok)
 4) Another while later all get-by-key on bob suddenly show height==75,
 as per transaction X (not good!)

 My speculation is that the ConcurrentModification could sometimes
 indicate there was disruption of BOTH transaction X and Y, even though
 reported for Y.  Perhaps X had gotten past commit() call but hadn't
 yet reached milestone A of
 http://code.google.com/appengine/articles/transaction_isolation.html,
 and was also (temporarily) aborted due to the contention.

 Then some sort of background retry on X sometimes (rarely) re-inserts
 it into the transaction queue BEHIND my explicit retry on Y, and
 eventually overwrites with the whole entity state from X in 1)

 And it appears that sometimes the background retry of X may not even
 happen till a good while later.

 Any chance something like this is happening?

 /Tom

 On Aug 16, 10:11 pm, Greg g.fawc...@gmail.com wrote:
  Please check your logs for a warning Transaction collision.
  Retying
 
  Something very similar is happening on my app, where DB put()s
  silently fail (equivalent to the entity being rolled back) very
  occasionally. This has only started happening after moving to HR.
 
  In my app, I get this warning very consistently (every time) at
  exactly the time the entity is supposed to be stored. I would be very
  interested to hear if you find this warning too. If so, I think it
  points to a bug in the transaction collision handler in put(). Please
  let me know!
 
  See my earlier post here:
 http://groups.google.com/group/google-appengine/browse_thread/thread/...
 
  Cheers
  Greg.
 
  On Aug 14, 10:21 pm, Raymond C. windz...@gmail.com wrote:
 
   I have recently ran into a problem after migrating to HRD:
 
   My application is a social online game which I have recently migrated
 from
   M/S to HR Datastore around 3 weeks ago.  Since 2 weeks ago I have
 started
   receiving reports from players which their game progress are rolled
 back
   suddenly while playing, which progress made in the recent few days are
   missing.  I have verified the problem through data on other entities
 (in
   different entity group) that the reports are actually legit and at
 least
   several days of progress are actually rolled back (with updates to the
   entities in the last few days are all missing).
 
   Player's data in the game are retrieved through id (
   Player.get_by_id(player_id) ) and because the gap is so large (days) I
   believe it is not a problem on my code (nowhere in my code cache
 player's
   data).
 
   It has never happened before for nearly 1 year so I am guessing if it
 is
   related to HRD.  I remember there was a thread here before which
 reported
   data being rolled back on HRD but I can not find it anymore.
 
   As you know with AppEngine datastore's distributed nature, it is so
 hard to
   monitor this kind of problem to ensure the problem exist.  I would like
 to
   ask if anyone has ran into this problem as well or suspect that you
 have had
   this problem before with your HRD application?
 
 

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Upload errors

2011-08-19 Thread Sekhar

Getting upload errors...anyone else?

Unable to update:
java.io.IOException: Error posting to URL: 
https://appengine.google.com/api/appversion/clonefiles?app_id=wellaho-sanitasversion=1;
500 Internal Server Error

htmlhead
meta http-equiv=content-type content=text/html;charset=utf-8
title500 Server Error/title
/head
body text=#00 bgcolor=#ff
h1Error: Server Error/h1
h2The server encountered an error and could not complete your 
request.pIf the problem persists, please A 
HREF=http://code.google.com/appengine/community.html;report/A your 
problem and mention this error message and the query that caused it./h2
h2/h2
/body/html

at 
com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServerConnection.java:249)
at 
com.google.appengine.tools.admin.AbstractServerConnection.post(AbstractServerConnection.java:207)
at 
com.google.appengine.tools.admin.AppVersionUpload.send(AppVersionUpload.java:639)
at 
com.google.appengine.tools.admin.AppVersionUpload.cloneFiles(AppVersionUpload.java:502)
at 
com.google.appengine.tools.admin.AppVersionUpload.beginTransaction(AppVersionUpload.java:462)
at 
com.google.appengine.tools.admin.AppVersionUpload.doUpload(AppVersionUpload.java:137)
at 
com.google.appengine.tools.admin.AppAdminImpl.doUpdate(AppAdminImpl.java:300)
at 
com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java:52)
at 
com.google.appengine.eclipse.core.proxy.AppEngineBridgeImpl.deploy(AppEngineBridgeImpl.java:401)
at 
com.google.appengine.eclipse.core.deploy.DeployProjectJob.runInWorkspace(DeployProjectJob.java:149)
at 
org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorkspaceJob.java:38)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/dV432H2jQTMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] GAE Deployment slow again

2011-08-19 Thread Nathan Oen

Been working on GAE codes for 2 weeks now. Noticed that around Friday
the deployments were getting slow. First on Aug 12 last week for the
whole weekends I can't deploy a thing. Then today I started getting
409 Conflict
Another transaction by user admin is already in progress for app:
s~efilingrjo-dev, backend: erjofileprocessor. That user can undo the
transaction with appcfg backends rollback. There we go again, busy
weekend is coming.

The good thing maybe this is the sign not to work on GAE from Fri
through Sun ;-) ;-(

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Why no service disruption listed on system status page?

2011-08-19 Thread Jeffrey Rosen

I've opened a ticket here: 
http://code.google.com/p/googleappengine/issues/detail?id=5642

On Aug 19, 10:06 am, Garett goot...@gmail.com wrote:
 In the system status page, I'm wondering why there is no service
 disruption listed anywhere for yesterday.  I would have thought what
 happened was serious enough to show something other than a green checkmark?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: https for mydomain.com?

2011-08-19 Thread scott

Not an app engine expert -- just here getting up-to-speed, but I read that 
www.cloudflare.com can be used to provide ssl termination for GAE apps. 
Cloudflare SSL termination capabilities requires a paid account with their 
service -- $20 per month, but it might be worth it for some users -- 
especially given the other benefits. I haven't used the CloudFlare service 
yet, so I can't comment on how well it works but I've heard good things.

See this post: SSL on Custom Domains for AppEngine and Other Cloud 
Serviceshttp://blog.cloudflare.com/ssl-on-custom-domains-for-appengine-and-other


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/KxaVT27z9RUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: Why no service disruption listed on system status page?

2011-08-19 Thread Gregory D'alesandre

While the front page shows green checks, it because our algorithm to
determine what to show on the front does not match our description.  If you
click through on the day you can see more details about when there were
issues and the resolution to them.  Thanks for filing the issue, this is
indeed a bug that should be fixed.

Greg

On Fri, Aug 19, 2011 at 7:22 PM, Jeffrey Rosen jef...@gmail.com wrote:

 I've opened a ticket here:
 http://code.google.com/p/googleappengine/issues/detail?id=5642

 On Aug 19, 10:06 am, Garett goot...@gmail.com wrote:
  In the system status page, I'm wondering why there is no service
  disruption listed anywhere for yesterday.  I would have thought what
  happened was serious enough to show something other than a green
 checkmark?

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

+Fred Sauer

Test where you like, but test the scenario which you plan to use.

the question is if these changes suggested will work on M/S because I will 
not change everything
in one time, but gradually on M/S and if it works to move it to HR.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/2oNR9zcNUh0J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Should Google deprecate Master/Slave data store option?

+Fred Sauer

To put it another way: I have yet to find a use case, when the whole app is 
considered, where M/S is preferable to HRD.

My only concern if I will get the same speed. I don't want to spend all this 
effort
costing me money and time and at the end to find it will be slower than M/S.

By the way while I was on HR (about 2 months) I mentioned there was a time I 
cannot upload
my app, had to try 10 times, sometimes to wait 1 hour. This happened very 
often.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/lO4CgTrqmZIJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] Re: Announcing: Programming Google App Engine, 2nd Edition Rough Cuts