[appengine-java] Re: Eclipse (GWT) problem running project.

2011-11-17 Thread Oswin
Nope, problem still excists. Thx for the hint anyway. Any other
possibilities?

On 14 nov, 15:00, Markus Zywitza markus.zywi...@gmail.com wrote:
 I had a similar problem in Eclipse 3.7. I solved it by downgrading to JRE
 1.6.

 -Markus

 This mail was written on a mobile device. Please bear with me for any typos.
 Am 14.11.2011 11:39 schrieb Oswin osw-...@hotmail.com:



  I've installed Eclipse (Indigo) 3.5, and installed Java jdk1.7.0_01. I
  also installed the google plugin for Eclipse with the GWT SDK 2.4.0 and the
  App Engine SDK 1.5.5 for Eclipse.
  The Java JDK has been checked in the preferences at the installed JRE's.

  When I create a new google webapplication with an example code. It appears
  to be working normally and the new webapplication is being created as a new
  project.
  But when I try to run the project. The console comes up with the following
  anouncement:

  Loading modules

  com.demo.Demo

  [ERROR] Unable to find 'com/demo/Demo.gwt.xml' on your classpath; could be
  a typo, or maybe you forgot to include a classpath entry for source?

  [ERROR] shell failed in doStartup method

  When I try to ignore this error by unchecking this error in google
  settings. When I run the program and when I execute the demo, I get this
  error message:

  *nov 14, 2011 10:25:53 AM com.google.apphosting.utils.jetty.JettyLogger
  info INFO: Logging to JettyLogger(null) via
  com.google.apphosting.utils.jetty.JettyLogger nov 14, 2011 10:25:53 AM
  com.google.apphosting.utils.config.AppEngineWebXmlReader
  readAppEngineWebXml INFO: Successfully processed
  C:\Users\Oswin\workspace2\demo\war\WEB-INF/appengine-web.xml nov 14, 2011
  10:25:53 AM com.google.apphosting.utils.config.AbstractConfigXmlReader
  readConfigXml INFO: Successfully processed
  C:\Users\Oswin\workspace2\demo\war\WEB-INF/web.xml nov 14, 2011 11:25:55 AM
  com.google.appengine.tools.development.DevAppServerImpl start INFO: The
  server is running athttp://localhost:/nov14, 2011 10:26:11 AM
  com.google.apphosting.utils.jetty.JettyLogger warn WARNING: Error for
  /demo/greet java.lang.VerifyError: Expecting a stackmap frame at branch
  target 17 in method
  com.googleapp.demo.server.GreetingServiceImpl.greetServer(Ljava/lang/String­;)Ljava/lang/String;
  at offset 4 at java.lang.Class.getDeclaredConstructors0(Native Method) at
  java.lang.Class.privateGetDeclaredConstructors(Class.java:2404) at
  java.lang.Class.getConstructor0(Class.java:2714) at
  java.lang.Class.newInstance0(Class.java:343) at
  java.lang.Class.newInstance(Class.java:325) at
  org.mortbay.jetty.servlet.Holder.newInstance(Holder.java:153) at
  org.mortbay.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:428)
  at
  org.mortbay.jetty.servlet.ServletHolder.getServlet(ServletHolder.java:339)
  at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:487)
  at
  org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle­r.java:1166)
  at
  com.google.appengine.tools.development.HeaderVerificationFilter.doFilter(He­aderVerificationFilter.java:35)
  at
  org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle­r.java:1157)
  at
  com.google.appengine.api.blobstore.dev.ServeBlobFilter.doFilter(ServeBlobFi­lter.java:58)
  at
  org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle­r.java:1157)
  at
  com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter(Trans­actionCleanupFilter.java:43)
  at
  org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle­r.java:1157)
  at
  com.google.appengine.tools.development.StaticFileFilter.doFilter(StaticFile­Filter.java:122)
  at
  org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle­r.java:1157)
  at
  com.google.appengine.tools.development.BackendServersFilter.doFilter(Backen­dServersFilter.java:97)
  at
  org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle­r.java:1157)
  at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388)
  at
  org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
  at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
  at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
  at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418) at
  com.google.apphosting.utils.jetty.DevAppEngineWebAppContext.handle(DevAppEn­gineWebAppContext.java:70)
  at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
  at
  com.google.appengine.tools.development.JettyContainerService$ApiProxyHandle­r.handle(JettyContainerService.java:351)
  at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
  at org.mortbay.jetty.Server.handle(Server.java:326) at
  org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at
  org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java­:938)
  at 

[appengine-java] Re: JDO embedded object not being initialized after JDO query

2011-11-17 Thread djd
IF there won't be anyone answering such a simple question, I take it is not 
that simple. Or not working, so please take it out of the documentation 
(googlers). Thanks.
I haven't fixed it yet.

Still, I produced a stripped-down version that replicates the issue. And I 
also checked bugs lists, for both appengine and datanucleus-appengine ... 
no luck

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/dM77KKc4RnAJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.


import javax.jdo.JDOHelper;
import javax.jdo.PersistenceManager;
import javax.jdo.PersistenceManagerFactory;
import javax.jdo.annotations.Embedded;
import javax.jdo.annotations.EmbeddedOnly;
import javax.jdo.annotations.IdGeneratorStrategy;
import javax.jdo.annotations.PersistenceCapable;
import javax.jdo.annotations.Persistent;
import javax.jdo.annotations.PrimaryKey;

import org.junit.After;
import org.junit.Assert;
import org.junit.Before;
import org.junit.Test;

import com.google.appengine.api.datastore.Key;
import com.google.appengine.tools.development.testing.LocalDatastoreServiceTestConfig;
import com.google.appengine.tools.development.testing.LocalServiceTestHelper;



public class EmbeddedTest {
	// Nothing special here besides 
	// 'datanucleus.appengine.allowMultipleRelationsOfSameType' = true 
	private static final PersistenceManagerFactory pmfInstance =
		JDOHelper.getPersistenceManagerFactory(transactions-optional);	
	
	// Stripped down version, only having an id and embedded object
	@PersistenceCapable
	public static class User {
		@Persistent(valueStrategy=IdGeneratorStrategy.IDENTITY)
		@PrimaryKey
		Key id;
		
		@Persistent
		@Embedded
		UserDetails details;
		
		public User (String name) {
			this.details = new UserDetails(name);
		}
	}
	
	// The embedded object
	@PersistenceCapable
	@EmbeddedOnly
	public static class UserDetails {
		@Persistent
		String name;

		public UserDetails(String name) {
			this.name = name;
		}
	}
	
	LocalServiceTestHelper helper = new LocalServiceTestHelper(
			new LocalDatastoreServiceTestConfig());

	@Before
	public void setUp () {
		helper.setUp();
	}
	
	@After
	public void tearDown () {
		helper.tearDown();
	}
	
	@Test
	public void shouldHaveEmbeddedInfo () {
		final String name = nameForTest; 
		final User u = new User (name);
		
		PersistenceManager pm = pmfInstance.getPersistenceManager();
		final User uPersisted = pm.makePersistent(u);
		pm.close();
		
		Assert.assertNotNull(uPersisted);
		Assert.assertNotNull(uPersisted.details);
		// Make sure id is not null, we will fetch an User entity using it.
		Assert.assertNotNull(uPersisted.id);
		
		pm = pmfInstance.getPersistenceManager();
		final User uFetched = pm.getObjectById(User.class, uPersisted.id);
		
		Assert.assertNotNull(uFetched);
		Assert.assertNotNull(uFetched.id);
		Assert.assertNotNull(uFetched.details);
	}
}


[appengine-java] Re: JDO embedded object not being initialized after JDO query

2011-11-17 Thread datanucleus
 IF there won't be anyone answering such a simple question, I take it ...

Or maybe people have other things to do?

Some comments on your test :-
1. You flagrantly access public fields, ignoring the fact that JDO
would never know about such access hence cannot load fields. Use
getters, or make annotate the calling class with @PersistenceAware (as
per the JDO spec)

2. You pass objects between PMs ignoring the fact that unless you have
set the persistence property datanucleus.retainValues (or
javax.jdo.option.RetainValues) any non-PK fields will NOT have their
field values present (since the object is now in HOLLOW state).

A review of the JDO spec and in particular object lifecycle would make
sense.


Using v2 of the datanucleus-appengine plugin (the only version I have
any interest in), such an operation works fine.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Re: JDO embedded object not being initialized after JDO query

2011-11-17 Thread djd
Thanks for the harsh reply, but I had no intention to be stressful in any 
way. Just pointed out this example 
http://code.google.com/appengine/docs/java/datastore/jdo/dataclasses.html#Embedded_Classes
 is 
not clear at all.

I'll review the spec (350 pages for JDO v3 spec).

2), I don't pass objects between PMs. I just get the object in another PM 
by its PK, is that wrong (always close the PM after you're done with it?). 
Besides, when you move away from @PersistenceCapable objects, you're done 
with JDO lifecycle specs (I can reuse the Key id value without having a 
PM nearby, no?). Other fields are saved to the specified values without any 
problems (Integer, String, Key, etc). But again, great suggestion with the 
JDO specs.

Alex.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/_rfWq_U2qh8J.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Re: JDO embedded object not being initialized after JDO query

2011-11-17 Thread datanucleus
 2), I don't pass objects between PMs.

Well I can only comment on your example, which closes the PM after
persist (so the object goes to hollow then to transient), and *then*
you check on field values. Things will be nulled unless retainValues
is set. See
http://www.datanucleus.org/products/accessplatform/jdo/object_lifecycle.html
for a more user friendly abbreviated form of the JDO spec object
lifecycle.


  I just get the object in another PM by its PK, is that wrong

Closing the PM is correct, and nothing wrong with getting an object by
its id. The thing is though, once you've got the object by the id, you
must access the values via getters otherwise they will be null ;-) And
you could easily look in the db viewer to see if things were persisted
in the first place

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Gql4J, gql for appengine java sdk

2011-11-17 Thread Max
Hi all,  

I am actually  a bit surprised after realized that no query language is 
supported on datastore low level API directly. So I spend some time to 
migrate GQL to Java SDK and just deployed one version to 
http://code.google.com/p/gql4j/

Here is the usage

 DatastoreService? http://code.google.com/p/gql4j/w/edit/DatastoreService 
datastore = DatastoreServiceFactory? 
http://code.google.com/p/gql4j/w/edit/DatastoreServiceFactory.getDatastoreService();
 GqlQuery? http://code.google.com/p/gql4j/w/edit/GqlQuery gql = new GqlQuery? 
http://code.google.com/p/gql4j/w/edit/GqlQuery(SELECT * WHERE ANCESTOR IS 
KEY(:1, :2) LIMIT 100 OFFSET 1000, Person, Amy);
 IterableEntity result = 
datastore.prepare(gql.query()).asIterable(gql.fetchOptions());


Simply download jar to your project and try it! No maven repo is setup for 
this one but there is a workaround documented on project homepage. 

Any feedback is welcome!

Cheers, 
Max

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/h16ZUObl3X0J.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Re: Gql4J, gql for appengine java sdk

2011-11-17 Thread Max
Re-paste usage again, don't know why there are some strange style on first 
one

 DatastoreService datastore = DatastoreServiceFactory.getDatastoreService();
 GqlQuery gql = new GqlQuery(SELECT * WHERE ANCESTOR IS KEY(:1, :2) LIMIT 
100 OFFSET 1000, Person, Amy);
 IterableEntity result = 
datastore.prepare(gql.query()).asIterable(gql.fetchOptions());

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/ipqs1kZhykYJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Re: JDO embedded object not being initialized after JDO query

2011-11-17 Thread djd
Things work if I keep the PM open. Still not happy about that, but at least 
I've narrowed down the issue. Thanks and sorry again.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/PNiETAUVOEQJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Eclipse Update for App Engine SDK 1.6.0?

2011-11-17 Thread esorf
Prior updates to the App Engine SDK have been automatically installed when 
I choose Check for Updates in Eclipse. (Helios on OSX)

The new 1.6.0 SDK is out of preview but does not show up in the available 
updates.  Will it?  When?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/hrWirLHdm8UJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Re: Eclipse Update for App Engine SDK 1.6.0?

2011-11-17 Thread esorf
Dup.  Sorry. 
 
http://code.google.com/appengine/forum/java-forum.html?place=topic%2Fgoogle-appengine-java%2FyyWgQeqfmDk%2Fdiscussion

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/TenaCH-cgFwJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



Re: [appengine-java] Re: Improved query planner in SDK 1.6.0

2011-11-17 Thread Alfred Fuller
What is Siena?
zig zag is built into the datastore and always on, if it is not working
it is a miss-match between the indexes available and the query executed.
The index error will tell you what index is needed. Can you give me your
app id and the index suggested?

On Wed, Nov 16, 2011 at 5:59 PM, Emanuele Ziglioli 
theb...@emanueleziglioli.it wrote:

 zig zag doesn't work for me, using the Siena API

 What's worse, an 'index error' was created and I had to cleanup the
 index error on the production server, a real PITA

 On Nov 17, 5:23 am, Alfred Fuller arfuller+appeng...@google.com
 wrote:
  That is referring only to the transient 'NeedIndex' error that popped up
  sometimes when a query was executed using zigzag in production:
  NeedIndexError: The built-in indices are not efficient enough for this
  query and your data. Please add a composite index for this query.
 
  This will no longer ever be thrown.
 
 
 
 
 
 
 
  On Wed, Nov 16, 2011 at 4:54 AM, Mos mosa...@googlemail.com wrote:
   Hello Alfred,
 
   thanks for clarification!
 
   I will report the issue below if it happens again.
 
   My confusion started when reading the presentation:
 
  http://whiteship.me/wp-content/uploads/2011/11/getting_the_most_out_o.
 ..
 
   On page 51, regarding the advanced query planner you can read No
 more
   'needs index' errors (although some may timeout).
 
   I thought and hoped no more need for managing indexes manually ..
 
   Cheers
   Mos
 
   On Tue, Nov 15, 2011 at 6:46 PM, Alfred Fuller 
   arfuller+appeng...@google.com wrote:
 
   On Wed, Nov 9, 2011 at 1:42 AM, Mos mosa...@googlemail.com wrote:
 
   Does the improved query planner reduce the need of managing indexes
   manually in the datastore-index.xml file?
 
   It increases the need to manage indexes manually
 
   I'm a bit confused.
   The documentation is not obvious for me.
 
   In local development mode  I set autoGenerate=false and delete the
   datastore-index-auto.xml.
   My application runs fine.
 
   Deploying on GAE I've got the annoying
 
   com.google.appengine.api.datastore.DatastoreNeedIndexException: no
   matching index found.
 
   exception.
 
   This should not happen
 
   Hence, how does the improved query planner change the workflow of a
 GAE
   developer?
 
   Basically you have to turn off auto generate and manage the indexes
   manually.
 
   Cheers
   Mos
 
--
   You received this message because you are subscribed to the Google
   Groups Google App Engine for Java group.
   To post to this group, send email to
   google-appengine-java@googlegroups.com.
   To unsubscribe from this group, send email to
   google-appengine-java+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine-java?hl=en.
 
--
   You received this message because you are subscribed to the Google
 Groups
   Google App Engine for Java group.
   To post to this group, send email to
   google-appengine-java@googlegroups.com.
   To unsubscribe from this group, send email to
   google-appengine-java+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine-java?hl=en.
 
--
   You received this message because you are subscribed to the Google
 Groups
   Google App Engine for Java group.
   To post to this group, send email to
   google-appengine-java@googlegroups.com.
   To unsubscribe from this group, send email to
   google-appengine-java+unsubscr...@googlegroups.com.
   For more options, visit this group at
  http://groups.google.com/group/google-appengine-java?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine-java?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Uploading byte stream to blobstore using JAVA API.

2011-11-17 Thread Nirzari Bhatt
Hi,

I am new to GAE.

I am createing a web service producer in GAE using java api.

One of my web methods is receiving byte array (byte[]). This byte
steram may contain any kind of data (i.e. word doc, excel file, image
etc).

I need to upload this byte stream on the blob store.

I looked into sample  given on following link :
http://code.google.com/appengine/docs/java/blobstore/overview.html

but it all describes about uploading the file selected by user from
jsp.

do we have any way where in we can upload byte streams directly to
blob store without user intervention?

Kindly let me know if I need to provide any more information in this
regard.

Thanks in advance.

Regards,
Nirzari

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[appengine-java] Re: Improved query planner in SDK 1.6.0

2011-11-17 Thread Emanuele Ziglioli


On Nov 18, 7:24 am, Alfred Fuller arfuller+appeng...@google.com
wrote:
 What is Siena?

Siena is an ORM API, similar but smaller than Objectify and Twig, the
only one that supports both SQL and noSQL databases:
http://www.sienaproject.com/index.html

 zig zag is built into the datastore and always on, if it is not working
 it is a miss-match between the indexes available and the query executed.
 The index error will tell you what index is needed. Can you give me your
 app id and the index suggested?

Thank you for your offer. I'll deploy a test version and will post the
id here.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



Re: [appengine-java] Uploading byte stream to blobstore using JAVA API.

2011-11-17 Thread Amy Unruh
Nirzari,

You may want to use the (experimental) Files API (
http://code.google.com/appengine/docs/java/blobstore/overview.html#Writing_Files_to_the_Blobstore),
which allows you to programmatically create blobstore blobs.

  -Amy

On Thu, Nov 17, 2011 at 10:36 PM, Nirzari Bhatt nirzari.bh...@accenture.com
 wrote:

 Hi,

 I am new to GAE.

 I am createing a web service producer in GAE using java api.

 One of my web methods is receiving byte array (byte[]). This byte
 steram may contain any kind of data (i.e. word doc, excel file, image
 etc).

 I need to upload this byte stream on the blob store.

 I looked into sample  given on following link :
 http://code.google.com/appengine/docs/java/blobstore/overview.html

 but it all describes about uploading the file selected by user from
 jsp.

 do we have any way where in we can upload byte streams directly to
 blob store without user intervention?

 Kindly let me know if I need to provide any more information in this
 regard.

 Thanks in advance.

 Regards,
 Nirzari

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine-java?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



Re: [appengine-java] Re: Reading a Google Doc from google app engine code

2011-11-17 Thread Vik
hi

plz update on this?

Thankx and Regards

Vik
Founder
http://www.sakshum.org
http://blog.sakshum.org


On Wed, Nov 16, 2011 at 7:03 PM, Vik vik@gmail.com wrote:

 No I did not used that.  Do i need that one?  I thought no. Please confirm.

 And it is strange if google api gives me access to get handle to the doc
 but need third party libraries to read it,


 Thankx and Regards

 Vik
 Founder
 http://www.sakshum.org
 http://blog.sakshum.org


 On Mon, Nov 14, 2011 at 1:10 PM, Amit Pandey amit.s...@gmail.com wrote:

 Have you used *org.apache.poi.hwpf.HWPFDocument* API ?

 Thanks,
 Amit

 On Sat, Nov 12, 2011 at 7:04 PM, Vik vik@gmail.com wrote:

 Hie Amit

 Thanks however when i read the input stream using:
 String content = CharStreams.toString(new InputStreamReader(inStream));

 It prints all boxed characters rather plain english text. Please advise

 Thankx and Regards

 Vik
 Founder
 http://www.sakshum.org
 http://blog.sakshum.org


 On Fri, Nov 11, 2011 at 5:46 PM, Amit Pandey amit.s...@gmail.comwrote:

 Mistakenly send wrong code. Here is correct code.

 On Fri, Nov 11, 2011 at 5:35 PM, Amit Pandey amit.s...@gmail.comwrote:

 Hi ViK,

 I did the same before and I use *org.apache.poi.hwpf.HWPFDocument*API. 
 Following code snippet may be useful for you. Let me know if this
 works.

 for (DocumentListEntry entry : resultFeed.getEntries()) {

 String docId = entry.getDocId();
 String docType = entry.getType();
 URL exportUrl =
   new URL(https://docs.google.com/feeds/download/; +
 docType
   + s/Export?docID= + docId + exportFormat=doc);
 MediaContent mc = new MediaContent();
 mc.setUri(exportUrl.toString());
 MediaSource ms = client.getMedia(mc);
 InputStream inStream = ms.getInputStream();
 // Now read the content from input stream.
 break;

 }

 Thanks,
 Amit

 On Thu, Nov 10, 2011 at 4:09 PM, Vik vik@gmail.com wrote:

 Hie

 Thanks I went through it and could at least get the handle to the
 google text doc i needed. I am now stuck at how to read the contents.
 My code looks like:


  GoogleOAuthParameters oauthParameters = new
 GoogleOAuthParameters();
 oauthParameters.setOAuthConsumerKey(Constants.CONSUMER_KEY);
  oauthParameters.setOAuthConsumerSecret(Constants.CONSUMER_SECRET);
 oauthParameters.setOAuthToken(Constants.ACCESS_TOKEN);
  oauthParameters.setOAuthTokenSecret(Constants.ACCESS_TOKEN_SECRET);

 DocsService client = new DocsService(sakshum-YourAppName-v1);
  client.setOAuthCredentials(oauthParameters, new
 OAuthHmacSha1Signer());
 URL feedUrl = new URL(
 https://docs.google.com/feeds/default/private/full/;);
  DocumentQuery dquery = new DocumentQuery(feedUrl);
 dquery.setTitleQuery(blood_donor_verification_template_dev);
  dquery.setTitleExact(true);
 dquery.setMaxResults(10);
 DocumentListFeed resultFeed = client.getFeed(dquery,
 DocumentListFeed.class);
  System.out.println(feed size: + resultFeed.getEntries().size());
 String emailBody = ;
  for (DocumentListEntry entry : resultFeed.getEntries()) {
  System.out.println(entry.getPlainTextContent());
  emailBody = entry.getPlainTextContent();
 }

 Plz note that entry.getPlainTextContent() does not work and throws
 object not TextContent type exception

 Thankx and Regards

 Vik
 Founder
 http://www.sakshum.org
 http://blog.sakshum.org


 On Sun, Nov 6, 2011 at 10:24 PM, Vik vik@gmail.com wrote:

 Thanks for replying

 actually i just googled and could not really find matching to my
 needs. thanks for the pointer this should be helpful.

 Thankx and Regards

 Vik
 Founder
 http://www.sakshum.org
 http://blog.sakshum.org


 On Fri, Nov 4, 2011 at 12:01 AM, Ikai Lan (Google) 
 ika...@google.com wrote:

 Have you read this? What are your thoughts? What have you tried?

 http://code.google.com/apis/documents/

 Vik, your posts would be a lot more useful if you:

 1. List what you have tried
 2. Describe what didn't work
 3. Describe what it is you are trying to do

 I like the fact that you keep emails short, but I suspect other
 people on this list have tuned you out because you're just not 
 providing
 enough information when you ask for help and it's too much detective 
 work
 for people who would actually help out otherwise.

 --
 Ikai Lan
 Developer Programs Engineer, Google App Engine
 plus.ikailan.com | twitter.com/ikai



 On Thu, Nov 3, 2011 at 10:42 AM, Vik vik@gmail.com wrote:

  someone please help on this.

 Thankx and Regards

 Vik
 Founder
 http://www.sakshum.org
 http://blog.sakshum.org


 On Mon, Oct 31, 2011 at 7:11 PM, Vik vik@gmail.com wrote:

 Hie

 Can someone please guide on how to read a google doc from my gae
 code?

 Thankx and Regards

 Vik
 Founder
 http://www.sakshum.org
 http://blog.sakshum.org


  --
 You received this message because you are subscribed to the Google
 Groups Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-java@googlegroups.com.
 To unsubscribe from this group, send email to
 

[google-appengine] What max size of Datastore stat?

2011-11-17 Thread Timofey Koolin
My datastore stat have more volume than my data: 67% of 46MB.

-- 
Blog: www.rekby.ru

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

attachment: appengine-datastore-stats.png

[google-appengine] NullPointerException with Eclipse 3.7

2011-11-17 Thread Xi Shen
Hi,

I was using Eclipse 3.7, with the latest GPE/GWT package. I was trying to 
create a HTML file by right-clicking on the package-New-HTML Page, then I 
filled in the name and clicked on the 'Finish' button. The file is not 
created, and the dialog does not response. And below exception was occurred.

Is it a bug?

java.lang.NullPointerException
at 
com.google.gdt.eclipse.core.ResourceUtils.getResourceAsString(ResourceUtils.java:655)
at 
com.google.gdt.eclipse.core.ResourceUtils.getResourceAsString(ResourceUtils.java:467)
at 
com.google.gwt.eclipse.core.wizards.NewHostPageWizard.getDocType(NewHostPageWizard.java:216)
at 
com.google.gwt.eclipse.core.wizards.NewHostPageWizard.getInitialContents(NewHostPageWizard.java:148)
at 
com.google.gwt.eclipse.core.wizards.AbstractNewFileWizard.createNewFile(AbstractNewFileWizard.java:130)
at 
com.google.gwt.eclipse.core.wizards.AbstractNewFileWizard.performFinish(AbstractNewFileWizard.java:94)
at 
com.google.gwt.eclipse.core.wizards.NewHostPageWizard.performFinish(NewHostPageWizard.java:115)
at 
org.eclipse.jface.wizard.WizardDialog.finishPressed(WizardDialog.java:827)
at 
org.eclipse.jface.wizard.WizardDialog.buttonPressed(WizardDialog.java:432)
at org.eclipse.jface.dialogs.Dialog$2.widgetSelected(Dialog.java:624)
at 
org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:240)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4165)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3754)
at org.eclipse.jface.window.Window.runEventLoop(Window.java:825)
at org.eclipse.jface.window.Window.open(Window.java:801)
at 
org.eclipse.ui.internal.actions.NewWizardShortcutAction.run(NewWizardShortcutAction.java:135)
at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)
at 
org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584)
at 
org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501)
at 
org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4165)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3754)
at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2696)
at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2660)
at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2494)
at org.eclipse.ui.internal.Workbench$7.run(Workbench.java:674)
at 
org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
at 
org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:667)
at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149)
at 
org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:123)
at 
org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
at 
org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110)
at 
org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79)
at 
org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:344)
at 
org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:622)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:577)
at org.eclipse.equinox.launcher.Main.run(Main.java:1410)

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/0qIOBqNeqPUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Manage Google App Engine Apps quickly and easily in linux

2011-11-17 Thread suatatan
A bash script for running locally your appgeninge app, downloading
source code and updating in ubuntu. (Tested in Ubuntu 11.10)
http://suatatan.wordpress.com/2011/11/17/manage-google-app-engine-apps-quickly-and-easily-in-linux-without-terminal-hell/

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Using bulkloader to load 13k entities from 1 kind consume all Datastore Write Operations free quota and load only 2k entities on a Master/Slave datastore

2011-11-17 Thread Mathieu Clavel
Here is the error log (using only 1 thread instead of default 10) :

Uploading data records.
[INFO] Logging to bulkloader-log-2017.113920
[INFO] Throttling transfers:
[INFO] Bandwidth: 25 bytes/second
[INFO] HTTP connections: 8/second
[INFO] Entities inserted/fetched/modified: 1000/second
[INFO] Batch Size: 1000
[INFO] Opening database: bulkloader-progress-2017.113920.sql3
[INFO] Connecting to altergaz-oav.appspot.com/remote_api
[INFO] Starting import; maximum 1000 entities per post
.[INFO] [WorkerThread-0] Backing off due to errors: 1.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 2.0 seconds
[ERROR   ] [WorkerThread-0] WorkerThread:
Traceback (most recent call last):
  File 
C:\Dev\sdk\pyActuel\google\appengine\tools\adaptive_thread_pool.py, line 
176, in WorkOnItems
status, instruction = item.PerformWork(self.__thread_pool)
  File C:\Dev\sdk\pyActuel\google\appengine\tools\bulkloader.py, line 
764, in PerformWork
transfer_time = self._TransferItem(thread_pool)
  File C:\Dev\sdk\pyActuel\google\appengine\tools\bulkloader.py, line 
935, in _TransferItem
self.request_manager.PostEntities(self.content)
  File C:\Dev\sdk\pyActuel\google\appengine\tools\bulkloader.py, line 
1420, in PostEntities
datastore.Put(entities)
  File C:\Dev\sdk\pyActuel\google\appengine\api\datastore.py, line 602, 
in Put
return PutAsync(entities, **kwargs).get_result()
  File C:\Dev\sdk\pyActuel\google\appengine\datastore\datastore_rpc.py, 
line 783, in get_result
result = rpc.get_result()
  File C:\Dev\sdk\pyActuel\google\appengine\api\apiproxy_stub_map.py, 
line 592, in get_result
return self.__get_result_hook(self)
  File C:\Dev\sdk\pyActuel\google\appengine\datastore\datastore_rpc.py, 
line 1547, in __put_hook
self.check_rpc_success(rpc)
  File C:\Dev\sdk\pyActuel\google\appengine\datastore\datastore_rpc.py, 
line 1182, in check_rpc_success
rpc.check_success()
  File C:\Dev\sdk\pyActuel\google\appengine\api\apiproxy_stub_map.py, 
line 558, in check_success
self.__rpc.CheckSuccess()
  File C:\Dev\sdk\pyActuel\google\appengine\api\apiproxy_rpc.py, line 
156, in _WaitImpl
self.request, self.response)
  File 
C:\Dev\sdk\pyActuel\google\appengine\ext\remote_api\remote_api_stub.py, 
line 248, in MakeSyncCall
handler(request, response)
  File 
C:\Dev\sdk\pyActuel\google\appengine\ext\remote_api\remote_api_stub.py, 
line 391, in _Dynamic_Put
'datastore_v3', 'Put', put_request, put_response)
  File 
C:\Dev\sdk\pyActuel\google\appengine\ext\remote_api\remote_api_stub.py, 
line 177, in MakeSyncCall
self._MakeRealSyncCall(service, call, request, response)
  File 
C:\Dev\sdk\pyActuel\google\appengine\ext\remote_api\remote_api_stub.py, 
line 199, in _MakeRealSyncCall
raise UnknownJavaServerError(An unknown error has occured in the 
UnknownJavaServerError: An unknown error has occured in the Java remote_api 
handler for this call.
[INFO] An error occurred. Shutting down...
[ERROR   ] Error in WorkerThread-0: An unknown error has occured in the 
Java remote_api handler for this call.

[INFO] 13320 entities total, 0 previously transferred
[INFO] 2000 entities (3920912 bytes) transferred in 162.3 seconds
[INFO] Some entities not successfully transferred

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/mfL3HlrjEccJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Using bulkloader to load 13k entities from 1 kind consume all Datastore Write Operations free quota and load only 2k entities on a Master/Slave datastore

2011-11-17 Thread Simon Knott
How many properties do you have indexed on your types?

Remember that for each new entity it will consume 1 write for the entity, 2 
writes for each property which is indexed and then 1 write for each custom 
query index.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/GGHHej2PYrsJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Using bulkloader to load 13k entities from 1 kind consume all Datastore Write Operations free quota and load only 2k entities on a Master/Slave datastore

2011-11-17 Thread Mathieu Clavel
52 indexes...
I'm vaccuming old indexes, I though it was done when uploading a new 
version.
I will try again when it will be clean.

Thanks, now I know why all quota is used.

Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/oxOvDawyPcAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Git Deploy

2011-11-17 Thread Roch Delsalle
Hi,

I would like to know why Google App Engine isn't proposing an alternative
deploy workflow using Git.
That would save a lot of bandwidth.

Roch

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] 3 days to get moderated

2011-11-17 Thread Nicolo Zanetti
Mr Ikai, with full respect, don't you think this make it harsh to new
users to approach the GAE technology if after 3 days they don't even
get the possibility to see their question in the list?
We all have timelines…
Best regards.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] What it metadata in datastore stats?

2011-11-17 Thread Timofey Koolin
I know about app name, king name and every property name for each entity.

-- 
Blog: www.rekby.ru

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Git Deploy

2011-11-17 Thread Barry Hunter
Because nobody has suggested it in the Issue Tracker (aka Feature
Request tracking)

http://code.google.com/p/googleappengine/issues/list?q=GIT

Although #480 is close.

On Thu, Nov 17, 2011 at 11:10 AM, Roch Delsalle rdelsa...@gmail.com wrote:
 Hi,
 I would like to know why Google App Engine isn't proposing an alternative
 deploy workflow using Git.
 That would save a lot of bandwidth.
 Roch

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Confused. Questions about the billings.

2011-11-17 Thread Tapir
Oh, yes, you charged me from one my another app, which is discarded
for a long long time.

On Nov 17, 2:05 pm, Ikai Lan (Google) ika...@google.com wrote:
 It should deduct from the application first. Do you have another billed
 application?

 What is the application ID you expect to be billed for, and what is the
 Google checkout # on the bill (you can email to me directly if you like)?

 --
 Ikai Lan
 Developer Programs Engineer, Google App Engine
 plus.ikailan.com | twitter.com/ikai







 On Thu, Nov 17, 2011 at 2:21 PM, Tapir tapir@gmail.com wrote:
  I just received a billing notification which says google just charged
  me for $2.10 from my credit card I set in google checkout directly. Is
  this the cost for Paid account's $9/app/month listed here:
 http://www.google.com/enterprise/cloud/appengine/pricing.html?
  But the $50 coupon for my app has not been used up yet. Why don't you
  charge me from the coupon pool?

  In fact, the billing history page shows you exactly charged me some
  money from the coupon pool.

  So the question: when do you charge me from the credit card and when
  do you charge me from the coupon pool?

  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: What it metadata in datastore stats?

2011-11-17 Thread Max
usually index will consume more space than actual data, and index are part 
of metadata

next time search the group to see if anyone has posted a similar issue.. 
This has been answered for many times

Cheers, 
Max

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/7w_fDrOIfzMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Migration tool reversibility

2011-11-17 Thread Joshua Smith
What I did was use the migration tool all the way up to, but NOT including the 
alias step.

Then I switched my domain settings around so that users go to the new app.


On Nov 16, 2011, at 5:12 PM, Kyle Baley wrote:

 I tried the datastore migration tool today from one test environment to 
 another and it went through smoothly. But it doesn't appear it can be done 
 more than once. I was hoping to test it out a few times before doing it in 
 our production environment. But two things lead me to believe it's not 
 possible:
 
 1) It creates an alias from the old app ID to the new one and I don't see any 
 way of reversing this
 2) When you go to the migration tool after it's done, it shows the results 
 from the previous migration but no way to restart it.
 
 Assuming it can be done only once, I don't feel comfortable enough to use it. 
 If something goes wrong during the migration (like, for instance, we miss 
 something in testing that doesn't show up until after we migrate), we'd like 
 an easy way to go back to the old app and continue on with it until the issue 
 has been resolved.
 
 What that in mind, has anyone tried the Copy Data to Another Application 
 feature in the Datastore Admin console? Does that do the same thing as the 
 migration tool (at least from a data perspective)?
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/6mgN7qV7UF4J.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Memcache values

2011-11-17 Thread Jamil Rzayev
I am working with App Engine Memcache service. Recently I noticed that
memcache service doesn't store value for a long time or I don't
actually know how to store the value for a long (specified) time.

Could you please help me in that kind of question.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: The Performance of the SDK development server has become unbearable

2011-11-17 Thread Robert Schuppenies
Thanks PK. Do you happen to have a appstats screenshot for things like
that?

From what I read so far, it seems the speed issues are either related to
serving static content or datastore, so that's already some valuable
insight.

For datastore, 'vladdrac' already did some sleuthing and put his results in
http://code.google.com/p/googleappengine/issues/detail?id=6005. Do you
think what you are seeing could be related?

For the slow serving of static content, is that an issue for only Windows
or are people seeing this on other platforms, too? If so, could you
elaborate and maybe provide a reproducible test scenario?


On Wed, Nov 16, 2011 at 7:51 PM, PK p...@gae123.com wrote:

 But, what is even more annoying and new with 1.6.0 is that very often the
 datastore decides to go out for lunch in the middle of executing a query.
 Look for example at this one: about a minute to run a really simple query
 that returns one entity, in a datastore that I just created and maybe it
 has 200 entities of about 15 kinds. The Domain kind has two entities!!!

 INFO 2011-11-17 *03:39:47*,371 query.py:260] SWQ: Executing 'SELECT
 *  FROM Domain WHERE dom_names = :1' ['ls']
 INFO 2011-11-17 *03:40:38*,751 query.py:264] SWQ: 1

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/nE4DRRHUdC8J.

 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: The Performance of the SDK development server has become unbearable

2011-11-17 Thread Matt Jibson
I saw equivalent behavior with the SDK on Windows and OpenBSD when
serving images from the datastore. I had a page with multiple
images.get_serving_url (with and without resizing) uses, and those
increased page load times by some seconds per image in the SDK.

On Thu, Nov 17, 2011 at 9:37 AM, Robert Schuppenies schu...@google.com wrote:
 Thanks PK. Do you happen to have a appstats screenshot for things like
 that?
 From what I read so far, it seems the speed issues are either related to
 serving static content or datastore, so that's already some valuable
 insight.
 For datastore, 'vladdrac' already did some sleuthing and put his results
 in http://code.google.com/p/googleappengine/issues/detail?id=6005. Do you
 think what you are seeing could be related?
 For the slow serving of static content, is that an issue for only Windows or
 are people seeing this on other platforms, too? If so, could you elaborate
 and maybe provide a reproducible test scenario?

 On Wed, Nov 16, 2011 at 7:51 PM, PK p...@gae123.com wrote:

 But, what is even more annoying and new with 1.6.0 is that very often the
 datastore decides to go out for lunch in the middle of executing a query.
 Look for example at this one: about a minute to run a really simple query
 that returns one entity, in a datastore that I just created and maybe it has
 200 entities of about 15 kinds. The Domain kind has two entities!!!

 INFO 2011-11-17 03:39:47,371 query.py:260] SWQ: Executing 'SELECT *
 FROM Domain WHERE dom_names = :1' ['ls']
 INFO 2011-11-17 03:40:38,751 query.py:264] SWQ: 1

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/nE4DRRHUdC8J.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Git Deploy

2011-11-17 Thread Jeff Schnitzer
Hah!

Git is a tool for programmers that work on teams with more than 1 person.
 Seriously, while Git has its flaws, after you get used to the different
workflow you will never want to go back to subversion again.  It really has
nothing to do with the size of your project - the benefits of git are that
the entire revision history is stored in each working copy and that
branching and merging is *sane*.

Jeff

On Thu, Nov 17, 2011 at 8:29 AM, Brandon Wirtz drak...@digerat.com wrote:

 Why would that save a lot of bandwidth?

 ** **

 Personally I hate GIT.  It has to be one of the single worst ideas of all
 time.  

 ** **

 Git is the tool for programmers who think they work in companies/project
 bigger than they do.  

 ** **

 Git only comes in to usefulness if your code is measured in Gigabytes.
  Since your limit on GAE is something like 150 megs, you aren’t ever going
 to be a size that you need Git to deal with the huge code base and
 incrementals.

 ** **

 ** **

 ** **

 *From:* google-appengine@googlegroups.com [mailto:
 google-appengine@googlegroups.com] *On Behalf Of *Roch Delsalle
 *Sent:* Thursday, November 17, 2011 3:11 AM
 *To:* google-appengine@googlegroups.com
 *Subject:* [google-appengine] Git Deploy

 ** **

 Hi,

 ** **

 I would like to know why Google App Engine isn't proposing an alternative
 deploy workflow using Git.

 That would save a lot of bandwidth.

 ** **

 Roch

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Ancestor queries / indexes

2011-11-17 Thread johnP

Second try...  Wondering if anyone has an answer to these questions.
Thanks!


On Nov 14, 8:14 am, johnP j...@thinkwave.com wrote:
 My data currently on MS is organized into entities.
   - For example, let's say that each Organization is it's own entity
 group.

 Most of my queries are within an entity/organization.  An example of a
 typical query is:
  - Employee.all().filter('organization =', org).filter('position =',
 manager).fetch(1000)

 This same query can also be done using an ancestor query:
  - Employee.all().ancestor(org_key).filter('position =',
 manager).fetch(1000)

 The first version of the query does not require a custom index, but
 the second version does.

 My questions:
 1.  Will moving from the first version to the the second version of
 the query require adding custom indexes? Or am I missing something?
 2.  Clarification on Strong Consistency in HR:  Is it necessary to use
 the ancestor() operator, or is simply querying within an entity group
 strongly consistent?  My assumption has been that for queries that
 must be strongly consistent, it will be necessary to migrate from the
 first format to the second format (increasing the number of custom
 indexes I need to carry).  Is this assumption correct?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] XG Transactions and development server

2011-11-17 Thread PK
I see the following on the dev server:

BadRequestError: can't operate on multiple entity groups in a single 
transaction

I think that it happens because although all my entity activity is in the 
same TG, I also use blobs that behind the scenes access the datastore at 
the non ancestor TG. This is something I had not thought of but I am 
wondering whether it should now be an issue at all with the HRD? Is it just 
one more dev server limitation?  (I do have the --high_replication option 
in the command line).

Thanks


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/WJe52YwhPxEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Git Deploy

2011-11-17 Thread Brandon Wirtz
Git is one of the worse Revision Tracking solutions there is though.  I have
worked projects with over 1k dev's dealing with trunks and branches, revs
and regressions.  And yes we used GIT some of the time and SubVersion some
of the time, and other tools some of the time, but that isn't the point.

 

GIT has no place in the Deployment chain.  You would never integrate the
push to your live environment with GIT, and GAE is just the live
environment .

GIT's advantage is supposed to be that it doesn't have to store 100 copies
of the same file for every version and sub version of your code. But the
truth is it doesn't do a good job of this.

 

But I digress from the point which isn't GIT SUCKS it is that GIT is not a
deployment tool.  Using GIT to push files to GAE would only end in much
heart ache when it does one of its infamous I didn't think white space
matters or what do you mean I can't much with the line feeds or you mean
GAE Python27 and 25 and 27beta all detect as PYTHON?  Let me GIT 'the'
Python version for you.

 

As a deployment tool GIT would only save up to 150MB of bandwidth if you had
the maximum size app, and only changed 1 line of code.  As someone who does
my debugging on GAE not on a local instance, I get that it would save me 45
seconds each iteration.  But the one time GIT screwed up. And it would. I
would lose any efficiencies.

 

From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Jeff Schnitzer
Sent: Thursday, November 17, 2011 9:13 AM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Git Deploy

 

Hah!

 

Git is a tool for programmers that work on teams with more than 1 person.
Seriously, while Git has its flaws, after you get used to the different
workflow you will never want to go back to subversion again.  It really has
nothing to do with the size of your project - the benefits of git are that
the entire revision history is stored in each working copy and that
branching and merging is *sane*.

 

Jeff

 

On Thu, Nov 17, 2011 at 8:29 AM, Brandon Wirtz drak...@digerat.com wrote:

Why would that save a lot of bandwidth?

 

Personally I hate GIT.  It has to be one of the single worst ideas of all
time.  

 

Git is the tool for programmers who think they work in companies/project
bigger than they do.  

 

Git only comes in to usefulness if your code is measured in Gigabytes.
Since your limit on GAE is something like 150 megs, you aren't ever going to
be a size that you need Git to deal with the huge code base and
incrementals.

 

 

 

From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Roch Delsalle
Sent: Thursday, November 17, 2011 3:11 AM
To: google-appengine@googlegroups.com
Subject: [google-appengine] Git Deploy

 

Hi,

 

I would like to know why Google App Engine isn't proposing an alternative
deploy workflow using Git.

That would save a lot of bandwidth.

 

Roch

-- 
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
mailto:google-appengine%2bunsubscr...@googlegroups.com .
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

 

-- 
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Googlebot hitting my app once every minute

2011-11-17 Thread Ian Marshall
Hello Everyone,

About 26 hours ago, my application (which normally receives almost no
traffic since it is an orphaned developer app) started receiving
Googlebot hits (and a few Microsoft Bing ones) at a rate of around
once per minute.

I can understand trawling daily, but not at this frequency. I am
worried that my other application which has billing enabled might get
affected too in the future.

Is there anyone I can ask at Google to get this Googlebot frequency
reduced to around once per day?

I set out a log extract of a few minutes below so that people can see
what is hitting my app.


2011-11-17 19:05:21.234 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkAbout::ILinkListener:: 200 257ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - [17/Nov/2011:11:05:21 -0800]
GET /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkAbout::ILinkListener:: HTTP/1.1 200
2539 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/
2.1; +http://www.google.com/bot.html) [My app ID].appspot.com
ms=257 cpu_ms=588 api_cpu_ms=238 cpm_usd=0.016715
instance=00c61b117c68264d536600a9a7ff7f003466ec


2011-11-17 19:01:07.517 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:166:lnkHome::ILinkListener:: 200 501ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - [17/Nov/2011:11:01:07 -0800]
GET /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:166:lnkHome::ILinkListener:: HTTP/1.1 200
2543 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/
2.1; +http://www.google.com/bot.html) [My app ID].appspot.com
ms=502 cpu_ms=635 api_cpu_ms=238 cpm_usd=0.018012
instance=00c61b117c68264d536600a9a7ff7f003466ec


2011-11-17 18:57:17.929 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:71:lnkLogOn::ILinkListener:: 200 7291ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - [17/Nov/2011:10:57:17 -0800]
GET /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:71:lnkLogOn::ILinkListener:: HTTP/1.1 200
2542 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/
2.1; +http://www.google.com/bot.html) [My app ID].appspot.com
ms=7291 cpu_ms=3038 api_cpu_ms=238 cpm_usd=0.084771 loading_request=1
pending_ms=3544 instance=00c61b117c68264d536600a9a7ff7f003466ec


2011-11-17 18:57:15.034 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkHome2::ILinkListener:: 200 662ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - [17/Nov/2011:10:57:15 -0800]
GET /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkHome2::ILinkListener:: HTTP/1.1 200
2541 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/
2.1; +http://www.google.com/bot.html) [My app ID].appspot.com
ms=663 cpu_ms=448 api_cpu_ms=238 cpm_usd=0.012826 pending_ms=407
instance=00c61b117c02585f95ad6983e337a35b3fad33


2011-11-17 18:57:14.204 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkLogOn::ILinkListener:: 200 4556ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - [17/Nov/2011:10:57:14 -0800]
GET /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkLogOn::ILinkListener:: HTTP/1.1 200
2544 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/
2.1; +http://www.google.com/bot.html) [My app ID].appspot.com
ms=4556 cpu_ms=2992 api_cpu_ms=238 cpm_usd=0.083475 loading_request=1
instance=00c61b117c02585f95ad6983e337a35b3fad33

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: URGENT: google checkout for usage i dont know where it comes from.

2011-11-17 Thread andrew
Plus one for identifying source of charges (appid).

I have many appid for development, test and production and I just got
a bill and have no idea what caused it. Compounded by the fact my main
appid shows $0 although I am sure it is generating costs due to
resident instances.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Googlebot hitting my app once every minute

2011-11-17 Thread Brandon Wirtz
Do you have the IP of the traffic?   GB Mobile doesn't usually hit things
more than once a day and doesn't typically do a deep crawl, it just checks
if pages are different from the Non-mobile version of the page.  But we
recently discovered that the Insert derogatory swear words who makes the
Google DOT crawler has been presenting as GB Mobile, in which case the only
way to get it fixed is to stalk him in the parking lot.  (I'm only half
kidding.  But this guy and the guy who screwed up the Adsense payment
processing should be fired or relocated to Google Siberia and given a dialup
connection to limit how much money they can cost users)

I am not some where I can easily check but I believe the email for the
Google Dot guy is in the archive, search it, and send him a QUIT BANGING ON
MY SITE email.  I thought after BlackWater got law enforcement involved the
first time he did this to a bunch of our clients he'd have stopped.

In case you check the IP and it isn't a Google IP disregard the above
message.  Sometimes when an idiot has screwed up enough times I mistakingly
start blaming him for things he didn't actually cause.  In those rare cases
the scolding still serves to remind the idiot how big their previous screw
up was and makes me feel better, which helps until the real culprit can be
found.

-Brandon



-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Ian Marshall
Sent: Thursday, November 17, 2011 11:37 AM
To: Google App Engine
Subject: [google-appengine] Googlebot hitting my app once every minute

Hello Everyone,

About 26 hours ago, my application (which normally receives almost no
traffic since it is an orphaned developer app) started receiving Googlebot
hits (and a few Microsoft Bing ones) at a rate of around once per minute.

I can understand trawling daily, but not at this frequency. I am worried
that my other application which has billing enabled might get affected too
in the future.

Is there anyone I can ask at Google to get this Googlebot frequency reduced
to around once per day?

I set out a log extract of a few minutes below so that people can see what
is hitting my app.


2011-11-17 19:05:21.234 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkAbout::ILinkListener:: 200 257ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - [17/Nov/2011:11:05:21 -0800] GET
/;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkAbout::ILinkListener:: HTTP/1.1 200
2539 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/ 2.1;
+http://www.google.com/bot.html) [My app ID].appspot.com
ms=257 cpu_ms=588 api_cpu_ms=238 cpm_usd=0.016715
instance=00c61b117c68264d536600a9a7ff7f003466ec


2011-11-17 19:01:07.517 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:166:lnkHome::ILinkListener:: 200 501ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - [17/Nov/2011:11:01:07 -0800] GET
/;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:166:lnkHome::ILinkListener:: HTTP/1.1 200
2543 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/ 2.1;
+http://www.google.com/bot.html) [My app ID].appspot.com
ms=502 cpu_ms=635 api_cpu_ms=238 cpm_usd=0.018012
instance=00c61b117c68264d536600a9a7ff7f003466ec


2011-11-17 18:57:17.929 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:71:lnkLogOn::ILinkListener:: 200 7291ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - [17/Nov/2011:10:57:17 -0800] GET
/;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:71:lnkLogOn::ILinkListener:: HTTP/1.1 200
2542 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/ 2.1;
+http://www.google.com/bot.html) [My app ID].appspot.com
ms=7291 cpu_ms=3038 api_cpu_ms=238 cpm_usd=0.084771 loading_request=1
pending_ms=3544 instance=00c61b117c68264d536600a9a7ff7f003466ec


2011-11-17 18:57:15.034 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkHome2::ILinkListener:: 200 662ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - [17/Nov/2011:10:57:15 -0800] GET
/;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkHome2::ILinkListener:: HTTP/1.1 200
2541 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/ 2.1;
+http://www.google.com/bot.html) [My app ID].appspot.com
ms=663 cpu_ms=448 api_cpu_ms=238 cpm_usd=0.012826 pending_ms=407
instance=00c61b117c02585f95ad6983e337a35b3fad33


2011-11-17 18:57:14.204 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
wicket:interface=wicket-0:70:lnkLogOn::ILinkListener:: 200 4556ms 2kb
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html)

66.249.71.88 - - 

RE: [google-appengine] Memcache values

2011-11-17 Thread Brandon Wirtz
Memcache is a Cache, not a storage.  Write to it often, try your reads from
it first, but never assume there is anything in it.

It's a FIFO buffer it is not a fixed size.  If you have a value that never
expires that you want to store in it, touch it every time you read the
value by writing the value back to memcache.



-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Jamil Rzayev
Sent: Thursday, November 17, 2011 8:19 AM
To: Google App Engine
Subject: [google-appengine] Memcache values

I am working with App Engine Memcache service. Recently I noticed that
memcache service doesn't store value for a long time or I don't actually
know how to store the value for a long (specified) time.

Could you please help me in that kind of question.

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Significant performance degradation on the SDK server with 1.5.3

2011-11-17 Thread PK
R.S. in another 
threadhttps://groups.google.com/d/topic/google-appengine/CBIsXJQn-f0/discussionwas
 kind enough to point me to the issue and workaround reported in issue 
6005 http://code.google.com/p/googleappengine/issues/detail?id=6005. I 
rerun the test using the workaround. It indeed is responsible for the 
majority of the performance regression i have been experiencing:

SDK:1.6.0
real   *0m53*
user  0m23
sys   0m6

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/ee32hipCgbUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Googlebot hitting my app once every minute

2011-11-17 Thread Ian Marshall
Is the IP of the traffic 66.249.71.88 (as extracted from my logs
above)? (I know that when I access my app myself, I get a different IP
address which I presume is the one allocated to my wireless router by
my ISP.)

Visiting GoogleBot, it looks like they state that they might crawl
once every few seconds. I would expect this frequency when scanning
for a first military strike - not for scanning non-offensive
commercial web sites.

Oh well. Thanks, Brandon.


On Nov 17, 8:26 pm, Brandon Wirtz drak...@digerat.com wrote:
 Do you have the IP of the traffic?   GB Mobile doesn't usually hit things
 more than once a day and doesn't typically do a deep crawl, it just checks
 if pages are different from the Non-mobile version of the page.  But we
 recently discovered that the Insert derogatory swear words who makes the
 Google DOT crawler has been presenting as GB Mobile, in which case the only
 way to get it fixed is to stalk him in the parking lot.  (I'm only half
 kidding.  But this guy and the guy who screwed up the Adsense payment
 processing should be fired or relocated to Google Siberia and given a dialup
 connection to limit how much money they can cost users)

 I am not some where I can easily check but I believe the email for the
 Google Dot guy is in the archive, search it, and send him a QUIT BANGING ON
 MY SITE email.  I thought after BlackWater got law enforcement involved the
 first time he did this to a bunch of our clients he'd have stopped.

 In case you check the IP and it isn't a Google IP disregard the above
 message.  Sometimes when an idiot has screwed up enough times I mistakingly
 start blaming him for things he didn't actually cause.  In those rare cases
 the scolding still serves to remind the idiot how big their previous screw
 up was and makes me feel better, which helps until the real culprit can be
 found.

 -Brandon







 -Original Message-
 From: google-appengine@googlegroups.com

 [mailto:google-appengine@googlegroups.com] On Behalf Of Ian Marshall
 Sent: Thursday, November 17, 2011 11:37 AM
 To: Google App Engine
 Subject: [google-appengine] Googlebot hitting my app once every minute

 Hello Everyone,

 About 26 hours ago, my application (which normally receives almost no
 traffic since it is an orphaned developer app) started receiving Googlebot
 hits (and a few Microsoft Bing ones) at a rate of around once per minute.

 I can understand trawling daily, but not at this frequency. I am worried
 that my other application which has billing enabled might get affected too
 in the future.

 Is there anyone I can ask at Google to get this Googlebot frequency reduced
 to around once per day?

 I set out a log extract of a few minutes below so that people can see what
 is hitting my app.

 2011-11-17 19:05:21.234 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
 wicket:interface=wicket-0:70:lnkAbout::ILinkListener:: 200 257ms 2kb
 DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
 +http://www.google.com/bot.html)

 66.249.71.88 - - [17/Nov/2011:11:05:21 -0800] GET
 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
 wicket:interface=wicket-0:70:lnkAbout::ILinkListener:: HTTP/1.1 200
 2539 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/ 2.1;
 +http://www.google.com/bot.html) [My app ID].appspot.com
 ms=257 cpu_ms=588 api_cpu_ms=238 cpm_usd=0.016715
 instance=00c61b117c68264d536600a9a7ff7f003466ec

 2011-11-17 19:01:07.517 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
 wicket:interface=wicket-0:166:lnkHome::ILinkListener:: 200 501ms 2kb
 DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
 +http://www.google.com/bot.html)

 66.249.71.88 - - [17/Nov/2011:11:01:07 -0800] GET
 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
 wicket:interface=wicket-0:166:lnkHome::ILinkListener:: HTTP/1.1 200
 2543 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/ 2.1;
 +http://www.google.com/bot.html) [My app ID].appspot.com
 ms=502 cpu_ms=635 api_cpu_ms=238 cpm_usd=0.018012
 instance=00c61b117c68264d536600a9a7ff7f003466ec

 2011-11-17 18:57:17.929 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
 wicket:interface=wicket-0:71:lnkLogOn::ILinkListener:: 200 7291ms 2kb
 DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
 +http://www.google.com/bot.html)

 66.249.71.88 - - [17/Nov/2011:10:57:17 -0800] GET
 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
 wicket:interface=wicket-0:71:lnkLogOn::ILinkListener:: HTTP/1.1 200
 2542 - DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/ 2.1;
 +http://www.google.com/bot.html) [My app ID].appspot.com
 ms=7291 cpu_ms=3038 api_cpu_ms=238 cpm_usd=0.084771 loading_request=1
 pending_ms=3544 instance=00c61b117c68264d536600a9a7ff7f003466ec

 2011-11-17 18:57:15.034 /;jsessionid=OgMqQSTfpLQ4XYJTwHb09Q?
 wicket:interface=wicket-0:70:lnkHome2::ILinkListener:: 200 662ms 2kb
 DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
 +http://www.google.com/bot.html)

 66.249.71.88 - - [17/Nov/2011:10:57:15 -0800] GET
 

Re: [google-appengine] Git Deploy

2011-11-17 Thread solsTiCe d'Hiver
You're on a good path to open a site called 'git haters'.

Even if you make good points, it's sound like troll most of the time.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/DCNmtxz1DkEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: 3 days to get moderated

2011-11-17 Thread Kaan Soral
I don't know what you mean by getting moderated but I have filled 2 
AppEngineCpuRequest quota forms up to now, and the replies I get are really 
stupid, the replies ask me questions that are not related to my request, 
and the answers that I sent to those emails always remains unanswered

I am very unsatisfied too ...

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/AhtzAY-cNNwJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Git Deploy

2011-11-17 Thread Brandon Wirtz
It's not meant as a Troll.  People often make feature requests to make
things work more like they are used to working.  If you have lived in GIT
for the last X years, you know GIT and you think it is awesome because you
have learned it's quirks.  I had a classic MG Roadster same deal, I loved it
even though it was quirky and I could work around its issues, but you
couldn't loan the car to anyone because they wouldn't make it 5 miles
without something going wrong.

 

GIT solves problems that shouldn't be part of the deployment process. And
GAE shouldn't be part of the Dev Process, that will make it more proprietary
and create more work flow issues overall not less.

 

All the parts are there, if you want to build a script to have the APPCFG
tool use the a given GIT build it is about 6 lines of code to do this
integration.  You won't save bandwidth but you can have the checkout
process be part of your deployment workflow.

 

And Eclipse has GIT integration so if you are working on Java you can do the
same thing in 20 lines of code.  

 

But having there be a button in your dash board that fires git, to place the
code in to production will end in heart break.

 

-Brandon

 

 

From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of solsTiCe d'Hiver
Sent: Thursday, November 17, 2011 1:29 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Git Deploy

 

You're on a good path to open a site called 'git haters'.

Even if you make good points, it's sound like troll most of the time.

-- 
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/DCNmtxz1DkEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: How to detect a Google Apps domain?

2011-11-17 Thread Matthew Blain
I'm not sure if you can easily identify this from a Federated Login
account.
If you are using Google Accounts for your app, you can see the
information in the USER_ORGANIZATION for the currently logged in user.
The article at http://code.google.com/appengine/articles/auth.html
should be updated soon to reflect this.

On Nov 16, 11:06 am, Timofey Koolin timo...@koolin.ru wrote:
 For example header Server: Google Frontend in http-response
 or cname to ghs.google.com be dns request for domain.

 2011/11/16 Daniel Florey daniel.flo...@gmail.com









  Hi,
  I'd like to find a proper approach how to detect a Google Apps user/domain
  name.
  I'm using OpenID and users are logging in with transitioned Google Apps
  accounts.

  Any ideas?

  Thanks,
  Daniel

  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/BH_ypgMu0UUJ.
  To post to this group, send email to google-appengine@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.com.
  For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

 --
 Blog:www.rekby.ru

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: The Performance of the SDK development server has become unbearable

2011-11-17 Thread Mickey
Robert: I posted the following comment to 
http://code.google.com/p/googleappengine/issues/detail?id=5134, but it may 
be more useful here...

I didn't notice this until after 1.6.0 came out. It seems as if the 
following two lines of code is a lot slower than before.

The first runs fast (1/10th of a second): a query that looks for child 
Books of the_user entity.
The second runs much slower (4 seconds): a query that looks for Books in 
which the_user is in the Book's ReferenceProperty

DEBUG2011-11-17 05:44:02,299 main.py:483] 1
some_books = Book.all().ancestor(the_user).filter('good =', True).fetch(30)
DEBUG2011-11-17 05:44:02,336 main.py:485] 2
other_book = the_user.books.filter('good =', False).get()
DEBUG2011-11-17 05:44:06,661 main.py:487] 3

plus it seems like writing to the datastore takes a lot longer than 
before.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/1RxDMDUOyK8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Appengine returns Content-Length: 0 for valid requests

2011-11-17 Thread Shashi Kant Sharma
We are facing a very strange problem.

We are doing 10 - 20 QPS on appengine with 150-250 instances running at any 
point of time and paying around ~650$ per day.

The problem that we are facing is that many a times the server returns a 
*Content-Length: 
0 *in the response header with no content.

This is the response header that we get

HTTP/1.1 200 OK
 Date: Thu, 17 Nov 2011 11:17:11 GMT
 Content-Type: text/html
 Server: Google Frontend
 Content-Length: 0


This is intermittent - Happens for around 15% of the the calls. There is no 
log on AppEngine that shows any anomaly.  

 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/75j5aos41NkJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Google App Engine's Team Dishonesty

2011-11-17 Thread trilok
Google app engine hello,

Let me first specify that I am a paying app engine user for about 1.5
years. We, at my company, have developed an online restaurant takeout/
delivery ordering service running completely on the appengine. We
currently serve over 50 restaurants in my home country, and are now
expanding abroad with restaurants in Canada, Hungary, Belgium, UK, and
more.

Ever since the appengine's release from production a week ago, there
has been 3 (!!!) major disruptions - On 7th for 45 minutes, yesterday
for 30 minutes, and right now. I understand that failures occur, but
specifying a 99.95% and being so far from it is to me a major
failure on the part of Google.

To make matters worse, we, AppEngine's paying users, NEVER receive any
explanations or descriptions of the cause of the failure, the solution
and Google's efforts to prevent its returning occurance. Not by any
means to compare, but EC2's team constantly admit and report ALL of
the failures and their debriefing!

And now for the cherry on the top, and the reason I used the word
'dishonesty' - You remove any note of the disruption from System
Status. For example, yesterday there was a disruption causing 40 secs
(!!!) of latency in response. Today viewing the System Status,
yesterday is marker with No significant issues. That to me is
dishonesty and a clear cut lie.

Unfortunately, our service is now so deeply connect to the AppEngine
framework that leaving this service is currently not an option, but I
would definitively not advise or recommend anyone to use the AppEngine
today, and my next product will definitely not run on the AppEngine.

Regards,

 - Yoav.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Can not disable App Engine service (app) from Google Apps

2011-11-17 Thread Federico Elles
I wanted to use a custom domain for my App Engine project using Google Apps.
I added my project kunstanprobe to the custom domain 
http://www.artfittingroom.com;
However, if I call the URL, an empty Google Sites page is displayed, not my 
kunstanprobe app (I disabled Google Sites for the domain).
If I try to disable the service, an empty error message is displayed.
If I try to delete the www domain, the error: We are unable to process your 
request at this time. Please try again later. (Error #1000) is displayed.
I waited for 2 weeks, but still same error.

Help!

Thanks,
Federico.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/D4NEmG1fbaoJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Adding domain is broken

2011-11-17 Thread IZ
Today when I tried to add a domain to my app, I keep getting

Server error We are unable to process your request at this time,
please try again later.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] automated deployment

2011-11-17 Thread Ron
We have an automated deployment using Jenkins that checks for GIT
commits and automatically deploys to our testing app.

This has been working fine, but today we got the message

Please go to
https://www.google.com/accounts/DisplayUnlockCaptcha
and verify you are a human.  Then try again.

Is it not possible to do automated deployments?

Thanks
Ron

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Running some code immediately before a Datastore put()?

2011-11-17 Thread Eric Feng
I also found Nick Johnson's (google guy) post on this to be very useful. 
 Honestly, his whole blog is useful - App Engine tips from a guy on the 
inside.

http://blog.notdot.net/2009/9/Custom-Datastore-Properties-1-DerivedProperty

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Si2ySLfz_noJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] How to run some piece of code on the app engine server always?

2011-11-17 Thread kesar
Hi,

I build the appengine project using python sdk. I released the
product. I created tables for the project. My product getting hits. I
am storing some date in to the tables. Now problem i want analysis
data. how to retrieve the 10 tuples at time (i tried  using
request url but problem connection timed out error that means when
ever we request to the appserver it should be finish some amount of
time 30sec or 1mint but my case it may take 15 to 30 mints)

How should i get all data ??

we should write some code, that code independent of the request
mechanism.
I tried dump the entire data from the server to my desktop. It didn't
work.

Thank you
kesar

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Large difference between datastore quota detail and appstat.

2011-11-17 Thread Simon Knott
How many entities are you pulling back in your queries?  Each query costs 1 
read for the query, plus one read for each entity returned (I believe).

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/4NruFnQsNmAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Git Deploy

2011-11-17 Thread Aaron C. de Bruyn
On Thu, Nov 17, 2011 at 13:43, Brandon Wirtz drak...@digerat.com wrote:

 GIT solves problems that shouldn’t be part of the deployment process. And GAE 
 shouldn’t
 be part of the Dev Process

Really?  If your production app is on GAE, you're telling me that you
should have a staging or test area on GAE?

And if GIT solves problems that shouldn't be part of the deployment
process is correct, git is still solving a problem--even if you don't
think it's the correct way.  Make a better deployment process for the
people who have solved their deployment process using GIT and get 'em
to switch.

I personally use a combination of fabric and whatever VCS my project
is in to deploy applications to staging and production.  But you
appear to be telling me that if I tag a release in git, then use
fabric to update the git repos on my servers to that tagged
version--that my deployment process is wrong because a VCS named 'git'
is involved?

Would you tell me the same thing if my VCS was subversion or cvs
or...etc?  How do you get your code out of a VCS into production?

-A

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Google App Engine's Team Dishonesty

2011-11-17 Thread Brandon Wirtz
Are you on High Rep or Master Slave?   I have not had an outage in something
like 10 months. 

-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of trilok
Sent: Thursday, November 17, 2011 6:25 AM
To: Google App Engine
Subject: [google-appengine] Google App Engine's Team Dishonesty

Google app engine hello,

Let me first specify that I am a paying app engine user for about 1.5 years.
We, at my company, have developed an online restaurant takeout/ delivery
ordering service running completely on the appengine. We currently serve
over 50 restaurants in my home country, and are now expanding abroad with
restaurants in Canada, Hungary, Belgium, UK, and more.

Ever since the appengine's release from production a week ago, there has
been 3 (!!!) major disruptions - On 7th for 45 minutes, yesterday for 30
minutes, and right now. I understand that failures occur, but specifying a
99.95% and being so far from it is to me a major failure on the part of
Google.

To make matters worse, we, AppEngine's paying users, NEVER receive any
explanations or descriptions of the cause of the failure, the solution and
Google's efforts to prevent its returning occurance. Not by any means to
compare, but EC2's team constantly admit and report ALL of the failures and
their debriefing!

And now for the cherry on the top, and the reason I used the word
'dishonesty' - You remove any note of the disruption from System Status. For
example, yesterday there was a disruption causing 40 secs
(!!!) of latency in response. Today viewing the System Status, yesterday is
marker with No significant issues. That to me is dishonesty and a clear
cut lie.

Unfortunately, our service is now so deeply connect to the AppEngine
framework that leaving this service is currently not an option, but I would
definitively not advise or recommend anyone to use the AppEngine today, and
my next product will definitely not run on the AppEngine.

Regards,

 - Yoav.

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: How to run some piece of code on the app engine server always?

2011-11-17 Thread pdknsk
http://code.google.com/appengine/docs/python/backends/

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Git Deploy

2011-11-17 Thread Jeff Schnitzer
FWIW, the Resin appserver has a distributed deployment system based on git.
 I haven't tried it, but the Caucho folks seem to like it.

http://blog.caucho.com/2009/09/22/an-alternate-deployment-model-based-on-a-git-repository-in-resin-402/

Shrug.

Jeff

On Thu, Nov 17, 2011 at 6:20 PM, Aaron C. de Bruyn aa...@heyaaron.comwrote:

 On Thu, Nov 17, 2011 at 13:43, Brandon Wirtz drak...@digerat.com wrote:

  GIT solves problems that shouldn’t be part of the deployment process.
 And GAE shouldn’t
  be part of the Dev Process

 Really?  If your production app is on GAE, you're telling me that you
 should have a staging or test area on GAE?

 And if GIT solves problems that shouldn't be part of the deployment
 process is correct, git is still solving a problem--even if you don't
 think it's the correct way.  Make a better deployment process for the
 people who have solved their deployment process using GIT and get 'em
 to switch.

 I personally use a combination of fabric and whatever VCS my project
 is in to deploy applications to staging and production.  But you
 appear to be telling me that if I tag a release in git, then use
 fabric to update the git repos on my servers to that tagged
 version--that my deployment process is wrong because a VCS named 'git'
 is involved?

 Would you tell me the same thing if my VCS was subversion or cvs
 or...etc?  How do you get your code out of a VCS into production?

 -A

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: SMS verification fails

2011-11-17 Thread Jose Montes de Oca
Hi,

Please fill out this form to get your verification 
done: https://appengine.google.com/waitlist/sms_issues

Best,
Jose Montes de Oca

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/pIVnyhnjkUMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: The Performance of the SDK development server has become unbearable

2011-11-17 Thread PK
Robert:

1. The static content issue I know about is an issue on all platforms and 
has primarily to do with the single threaded nature of the dev server. See 
here about what I mean: http://www.gae123.com/articles/gaet/fir-tim-exp.html

2. Issue 6005 is definitely part of the what I see, I updated the bug, 
thanks for pointing me to that direction

3. However, the issue of the dev server being extremely slow on certain 
queries that appears to be new in 1.6.0 is a separate issue. I filed issue 
6355 to track this.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/xwo_zPqOU-sJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Directions by Google Maps

2011-11-17 Thread Ricardo Guerra
Is it possible to have multiple instances of the Directions by Google
Maps gadget (all with different addresses) on the same page? It
doesn't seem to work...

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Git Deploy

2011-11-17 Thread Brandon Wirtz
How do you get your code out of a VCS into production?

Actually, The Release manager pushes to our Staging App.
Testing is done with the staging data.
Appcfg sucks the code down from Staging. A script renames the App in the
APP.Yaml
AppCFG pushes the Code to a non-default version on the live APP. More
testing is done
Version is made live.  More Testing is done.

In so doing no code is ever pushed to the Live app that hasn't been tested
first.

In our case we actually have 2 live apps, one supports a smaller volume of
traffic that is not from our clients.  It runs latest
And the primary app runs release.  This allows us to load test before the
final deployment.  

So it is actually Staging - Test Pass - Live non-default - Test Pass -
Live Default - real word testing - Primary Live non-default - Test Pass
- Primary Default 




-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Aaron C. de Bruyn
Sent: Thursday, November 17, 2011 2:20 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Git Deploy

On Thu, Nov 17, 2011 at 13:43, Brandon Wirtz drak...@digerat.com wrote:

 GIT solves problems that shouldn't be part of the deployment process. 
 And GAE shouldn't be part of the Dev Process

Really?  If your production app is on GAE, you're telling me that you should
have a staging or test area on GAE?

And if GIT solves problems that shouldn't be part of the deployment
process is correct, git is still solving a problem--even if you don't think
it's the correct way.  Make a better deployment process for the people who
have solved their deployment process using GIT and get 'em to switch.

I personally use a combination of fabric and whatever VCS my project is in
to deploy applications to staging and production.  But you appear to be
telling me that if I tag a release in git, then use fabric to update the git
repos on my servers to that tagged version--that my deployment process is
wrong because a VCS named 'git'
is involved?

Would you tell me the same thing if my VCS was subversion or cvs or...etc?
How do you get your code out of a VCS into production?

-A

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Directions by Google Maps

2011-11-17 Thread Brandon Wirtz
Yes, but you can't use the Gadget you have to use the Google Maps API.
http://code.google.com/apis/maps/index.html and it may be easier to do with
iframes.

But this isn't the forum for answering this issue, consider 
http://code.google.com/apis/maps/forum/
instead.

-Original Message-
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Ricardo Guerra
Sent: Thursday, November 17, 2011 3:51 PM
To: Google App Engine
Subject: [google-appengine] Directions by Google Maps

Is it possible to have multiple instances of the Directions by Google Maps
gadget (all with different addresses) on the same page? It doesn't seem to
work...

--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Git Deploy

2011-11-17 Thread Nick Johnson
Hi Roch,

I presume you're referring to Git's ability to send patches and only
transfer file modifications. In fact, App Engine's deploy process already
does this; whenever you deploy, only files that have never been seen before
are uploaded. For instance, if you were to download a popular open-source
app, modify the configuration file, and upload your app, likely only the
configuration file and your app's configuration would be uploaded when you
do this. App Engine doesn't upload diffs in the way git does, but this
isn't practical given that App Engine can't rely on having other versions
of the code to base a diff on.

-Nick Johnson

On Thu, Nov 17, 2011 at 10:10 PM, Roch Delsalle rdelsa...@gmail.com wrote:

 Hi,

 I would like to know why Google App Engine isn't proposing an alternative
 deploy workflow using Git.
 That would save a lot of bandwidth.

 Roch

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Nick Johnson, Developer Programs Engineer, App Engine

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Git Deploy

2011-11-17 Thread GordonHo
hi brandon,

i am curious - is your system a custom solution or available to others?

i've been looking for something like this for appengine, but never had the 
time to write something and haven't found something.

cheers

gordon

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/c6yfOakb1FwJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Large difference between datastore quota detail and appstat.

2011-11-17 Thread Timofey Koolin
...
Othen request can read up to 30 entity it execute about 350 times for
screenshots in first email.

2011/11/18 Timofey Koolin timo...@koolin.ru

 In query I always fetch only keys (about 40-60), then I fetch every entity
 by get_by_id, and almost all fetched from memcache (I use ndb).
 My code:
 db_keys = EMail.query(EMail.Status != 'Complete').fetch(keys_only=True)
 keys = []
 for key in db_keys:
 keys.append(key.id())
 res = []
 for key in keys:
   res.append(EMail.get_by_id(key))

 app-stat timeline in attached screenshot.
 It sync request execute every one minute.

 Othen request can read up to 30 entity it execute about 350 times for this
 screenshot. Code:
 channels = ChannelInfo.query()
 for channel in channels:
   ...

 2011/11/18 Simon Knott knott.si...@gmail.com

 How many entities are you pulling back in your queries?  Each query costs
 1 read for the query, plus one read for each entity returned (I believe).

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To view this discussion on the web visit
 https://groups.google.com/d/msg/google-appengine/-/4NruFnQsNmAJ.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




 --
 Blog: www.rekby.ru




-- 
Blog: www.rekby.ru

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



RE: [google-appengine] Git Deploy

2011-11-17 Thread Brandon Wirtz
 

It's just a bit of script. This is from memory, but the logic should hold.

 

 

appcfg.py update sandboxapp

//bwcurl is my curl command that I use for firing the test app

//Test app compares expected outputs vs actual output on a long list of
functions

// if the test run passes you get a pass result

bwcurl http://testversion.testapp.appspot.com/testseries1

 

Once the Release Manager is satisfied that the First test series has run and
is passed sets the default App to the new version in the dashboard, and runs
the curl aginst that version.  Once satisfied the next script runs

 

appcfg.py download_app -A sandboxapp -V application-version
tempapplicationholder

//appnamer does a rename of the app to the LiveLimited Production version

Appnamer predeployment

appcfg.ph update tempapplicationholder

bwcurl http://testversion.predeployment.appspot.com/testseries1

 

Once the Release Manager is satisfied that the First test series has run and
is passed sets the default App to the new version in the dashboard, and runs
the curl aginst that version.  We bake the release for a few days of
realworld traffic then.

 

appcfg.py download_app -A predeployment -V application-version
deploymentapplicationholder

//appnamer does a rename of the app to the LiveLimited Production version

Appnamer production

appcfg.ph update deploymentapplicationholder

bwcurl http://testversion.deployment.appspot.com/testseries1

 

Once the release manager is satisfied it is ready for release they make the
app live in the dashboard, run the test pass one more time, and every thing
continues on.

 

The re-download of the deployed code may not seem necessary but it does mean
that files don't sit around for weeks between rounds which is a really
crappy security system but it does reduce the chance that what you tested,
and what you push forward is the same thing exactly.

 

 

 

 

 

From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of GordonHo
Sent: Thursday, November 17, 2011 6:46 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Git Deploy

 

hi brandon,

 

i am curious - is your system a custom solution or available to others?

 

i've been looking for something like this for appengine, but never had the
time to write something and haven't found something.

 

cheers

 

gordon

-- 
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/c6yfOakb1FwJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] GAE Bulkloader

2011-11-17 Thread Saurabh S
Hi , i have developed my application in python using web2py
framework ,
i had some previous data which was supposed to be imported into the
datastore .
i tried the inbuilt import functionality provided by web2py on GAE but
the problem is when we import the table into GAE , the id's associated
with my entries are changing automatically. i don't want the id's to
be changed.

therefore i opted for import via command line (GAE bulkloader) , the
same problem is here too , when we import the file , the id's
associated with entries changes automatically



Please provide your suggestions on how can i import my data into the
datastore without any change in the id's.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Asynchronous urlfetch limit?

2011-11-17 Thread working
Hi All,
The PUT/POST limit for urlfetch is 8M.
But when I do asynchronous request, I continuously get the error (code
runs fine with 1M files):


The request to API call urlfetch.Fetch() was too large.
Traceback (most recent call last):
  File /base/python_runtime/python_lib/versions/1/google/appengine/
ext/webapp/_webapp25.py, line 703, in __call__
handler.post(*groups)
  File /base/data/home/apps//2011.354764050417538199/upload.py,
line 121, in post
result = rpc.get_result()
  File /base/python_runtime/python_lib/versions/1/google/appengine/
api/apiproxy_stub_map.py, line 592, in get_result
return self.__get_result_hook(self)
  File /base/python_runtime/python_lib/versions/1/google/appengine/
api/urlfetch.py, line 355, in _get_fetch_result
rpc.check_success()
  File /base/python_runtime/python_lib/versions/1/google/appengine/
api/apiproxy_stub_map.py, line 558, in check_success
self.__rpc.CheckSuccess()
  File /base/python_runtime/python_lib/versions/1/google/appengine/
api/apiproxy_rpc.py, line 133, in CheckSuccess
raise self.exception
RequestTooLargeError: The request to API call urlfetch.Fetch() was too
large.


Any suggestion?
Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: The Performance of the SDK development server has become unbearable

2011-11-17 Thread PK
Hi Robert,

I Updated issue 6355 with appstats data, let me know if this is what you 
want to see.

Thanks,
PK

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/gXic3t67u7UJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.