[appengine-java] UnknownJavaServerError when bulkloading to dev appserver
Hi all, I've seen a few other people asking about this around the internet (eg. http://www.mail-archive.com/google-appengine@googlegroups.com/msg34608.html, http://markmail.org/message/o35btiibcsqurenv) but it appears that no one has got to the bottom of it yet. I need to use the bulkloader to load a largish file (14.4Mb), the configuration works ok as sometimes I will be able to load the file successfully, but more often that not I get the UnknownJavaServerError shown in the log file below... which really doesn't tell me anything. I've tried reducing and increasing the batch size (set to 100 in log below), but that doesn't seem to have any impact. Could anyone please explain the inconsistent behaviour, and suggest a solution? Many thanks, Mark Uploading data records. [INFO] Logging to bulkloader-log-20110716.140518 [INFO] Throttling transfers: [INFO] Bandwidth: 25 bytes/second [INFO] HTTP connections: 8/second [INFO] Entities inserted/fetched/modified: 20/second [INFO] Batch Size: 100 [INFO] Opening database: bulkloader-progress-20110716.140518.sql3 [INFO] Connecting to localhost:8080/remote_api [INFO] Starting import; maximum 100 entities per post Password for marknuttallsm...@gmail.com: .[INFO] [WorkerThread-0] Backing off due to errors: 1.0 seconds .[INFO] Resetting backoff to 0.0 ..[ERROR ] [WorkerThread-2] WorkerThread: Traceback (most recent call last): File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/adaptive_thread_pool.py, line 176, in WorkOnItems status, instruction = item.PerformWork(self.__thread_pool) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py, line 764, in PerformWork transfer_time = self._TransferItem(thread_pool) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py, line 935, in _TransferItem self.request_manager.PostEntities(self.content) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py, line 1418, in PostEntities datastore.Put(entities) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore.py, line 467, in Put return PutAsync(entities, **kwargs).get_result() File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/datastore/datastore_rpc.py, line 658, in get_result results = self.__rpcs[0].get_result() File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/apiproxy_stub_map.py, line 592, in get_result return self.__get_result_hook(self) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/datastore/datastore_rpc.py, line 1385, in __put_hook self.check_rpc_success(rpc) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/datastore/datastore_rpc.py, line 1072, in check_rpc_success rpc.check_success() File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/apiproxy_stub_map.py, line 558, in check_success self.__rpc.CheckSuccess() File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/apiproxy_rpc.py, line 156, in _WaitImpl self.request, self.response) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py, line 249, in MakeSyncCall handler(request, response) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py, line 387, in _Dynamic_Put 'datastore_v3', 'Put', put_request, put_response) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py, line 178, in
[appengine-java] Cannot to read the file under /WEB-INF/classes/
I want to read the config.xml in my webRoot /WEB-INF/classes/ config.xml. All is OK in localhost. but when deploying to GAE, it cannot find the xml： /base/data/home/apps/mainloveplay/4.35187093106408/base/data/home/ apps/mainloveplay/4.35187093106408/WEB-INF/classes/config.xml (No such file or directory) the code to get path is： String rootPath = ConfigRepository.class.getResource(/).getPath().substring(1); Document document = reader.read(new File(rootPath + config.xml)); so how can I get my config.xml -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: UnknownJavaServerError when bulkloading to dev appserver
Ok, a bit of ignorance on my part here - it didn't quite click that the bulkloader would be subject to the 30 second timeout when running against the dev appserver. Lo and behold when I increased the log level on the appserver, there were the errors. However, I will say that tuning of the bulkloader seems to be a bit of a black art at the moment. I managed to get the data loaded by setting batch_size to 100 and rps_limit to 5000, but I can't find any clear guidelines on how to improve the efficiency of the upload. If something like that could be added to the documentation I'm sure it would be appreciated by people coming fresh to the platform. Cheers, Mark -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/aXiq53fCBboJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: [google-appengine] Re: CMS for GAE
Hi All, Claymus is close to its (first) preview release. Only few bug fixes and minor modifications are remaining. Check out the live demo at http://demo.claymus.com . -- Prashant claymus.googlecode.com On Wed, May 25, 2011 at 10:29 AM, Jeff Schnitzer j...@infohazard.orgwrote: On Mon, May 23, 2011 at 11:17 AM, Brandon Wirtz drak...@digerat.com wrote: That's more deployed, not spoken. Every Blogger and IT guy on the planet can hack together a PHP Plugin for their CMS. Very Few can do that in Python or Java. ...and even fewer can do it in Ruby or C#. Truly, PHP is in a class by itself. Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Experimental blobstore api returning null keys on blob creation
Hello all, I have code that uses the new blobstore fileservice api to write data submitted by POST to a blob. This code hasn't changed in around 2 months and has been working reliably, but suddenly its failing. No exceptions or anything, but the AppEngineFile.getBlobKey() call returns null, even though I can see that the blob has been created in the blobstore without problems. It doesn't fail reliably, but frequently. This is critical code for me, and its really a problem. In addition to this error, I've been getting lots of other random errors as others have been reporting. I use GAE as a backend for a mobile app, and just recently one of these bursts of errors hapenned while one version of my app was going through appstore approval. Naturally, the app recovers gracefully, but the user still sees a nice sync failed error message. So, this instability is affecting me in multiple ways. I really hope that with the new pricing we get some better accountability, and also some more transparency to see if GAE really is living up to that SLA we're supposed to get. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: HashMap within an Embedded Class
I'm still trying to figure it out, but I appear to have the same problem. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/th0atdR-LKEJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Experimental blobstore api returning null keys on blob creation
Assuming you're talking about new blobs, please check this issue: http://code.google.com/p/googleappengine/issues/detail?id=4872. I think there is no good workaround yet. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/nHGG3gfSqwgJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: [google-appengine] Re: CMS for GAE
What's the unique advantage of having a CMS in GAE? thanks, Maneesh http://mightytext.net On Sat, Jul 16, 2011 at 11:25 AM, Prashant antsh...@gmail.com wrote: Hi All, Claymus is close to its (first) preview release. Only few bug fixes and minor modifications are remaining. Check out the live demo at http://demo.claymus.com . -- Prashant claymus.googlecode.com On Wed, May 25, 2011 at 10:29 AM, Jeff Schnitzer j...@infohazard.orgwrote: On Mon, May 23, 2011 at 11:17 AM, Brandon Wirtz drak...@digerat.com wrote: That's more deployed, not spoken. Every Blogger and IT guy on the planet can hack together a PHP Plugin for their CMS. Very Few can do that in Python or Java. ...and even fewer can do it in Ruby or C#. Truly, PHP is in a class by itself. Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: [google-appengine] Re: CMS for GAE
What's the unique advantage of having a CMS in GAE? thanks, Maneesh http://mightytext.net On Sat, Jul 16, 2011 at 11:25 AM, Prashant antsh...@gmail.com wrote: Hi All, Claymus is close to its (first) preview release. Only few bug fixes and minor modifications are remaining. Check out the live demo at http://demo.claymus.com . -- Prashant claymus.googlecode.com On Wed, May 25, 2011 at 10:29 AM, Jeff Schnitzer j...@infohazard.orgwrote: On Mon, May 23, 2011 at 11:17 AM, Brandon Wirtz drak...@digerat.com wrote: That's more deployed, not spoken. Every Blogger and IT guy on the planet can hack together a PHP Plugin for their CMS. Very Few can do that in Python or Java. ...and even fewer can do it in Ruby or C#. Truly, PHP is in a class by itself. Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
