[google-appengine] Re: HR datastore is in readonly but there are no errors?
I'm having problems with my Datastore as well. I tried to rebuild my index with vacuum_indexes (didn't know it was a general problem) and got: Apr 10, 2015 5:17:53 PM com.google.appengine.tools.admin.AbstractServerConnection send1 WARNING: Error posting to URL: https://appengine.google.com/api/datastore/index/delete?app_id=myid; 500 Internal Server Error htmlheadmeta http-equiv=content-type content=text/html;charset=utf-8title500 Server Error/title/headbody text=#00 bgcolor=#ffh1Error: Server Error/h1h2The server encountered an error and could not complete your request.pPlease try again in 30 seconds./h2h2/h2/body/html This is try #0 On Friday, April 10, 2015 at 4:38:09 PM UTC-3, Matija wrote: Are we only one with this problem? For the last one hour it is like HR datastore is in some kind read only state but datastore put statements don't return any errors? We have noticed that they are testing 1.9.19 java GAE version on some instances. Anybody??? What to do? Where to report? Koju posluku porati? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/b7b3c73d-e15b-4234-aa86-85574feb3351%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Where to submit BigQuery performance issues?
Hi, Today BigQuery is taking far more time to complete query jobs than usual. Two days ago a query of my system used to be executed within 6 seconds, today it is taking from 1 to 6 minutes (without any increase of the dataset). The BigQuery Google Groups https://groups.google.com/forum/#!forum/bigquery-discuss is disabled for new posts, StackOverflow is just not suitable for this kind of questions, the BigQuery announce https://groups.google.com/forum/#!forum/bigquery-announce and BigQuery Downtime Notify https://groups.google.com/forum/#!forum/bigquery-downtime-notify groups are read-only. I'm posting here to the App Engine groups because I didn't find the right place to go. Where should I post about it and get answers? Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] How to increase Task Queue Execution timing
I've used MapReduce myself for while, and I can say it to you: 100+MB of keys means A LOT of keys at the shuffle stage. And the real limitations of MapReduce are: The total size of all the instances of Mapper, InputReader, OutputWriter and Counters must be less than 1MB between slices. This is because these instances are serialized and saved to the datastore between slices. Source https://github.com/GoogleCloudPlatform/appengine-mapreduce/wiki/2.6-The-Java-MapReduce-Library The real problem of MapReduce, in my opinion, is the latency of the operations and huge amount of read/writes to the datastore to maintain the things working between slices (which considerably increases costs). You can't rely on MapReduce to do real time or near real time work as you could with pure tasks queues. And it actually only shines when you can afford a large number of machines to run your logic - running MapReduce in few machines is sometimes worse than pure sequential brute force. Fitting your problem in a MapReduce process is actually good for your code - even if you don't use the library itself. It forces you to think on how can you split your huge tasks into smaller, more manageable and more scalable pieces. It's a good exercise - sometimes you think you can't parallelize your problem, but when you're forced to the MapReduce workflow, you might find you were actually wrong, and by the end of the day you have a better code. On Wednesday, December 10, 2014 6:22:17 PM UTC-2, Emanuele Ziglioli wrote: It all comes at a cost: increased complexity. You can't beat the simplicity of task queues and the 10m limit seems artificially imposed to me. I mean, we pay for CPU time, as we would pay for 20m, 30m, 1h tasks. I've got a simple task that takes a long time, looping through hundreds of thousands of rows to produced ordered files in output. The current code is simple and elegant but I have to keep increasing the CPU size in order to finish the task within 10m. A solution could be using MapReuce, but I haven't figured out yet how MapReduce would solve my problem without hitting the memory limit: with my simple task there are only 1000 rows in memory at any given time (of course, minus the GC). A MapReduce shuffle stage would require all entities, or at least their keys, to be kept in memory, and that's impossible with F1s or F2s. Emanuele On Wednesday, 10 December 2014 19:24:30 UTC+13, Vinny P wrote: On Sat, Dec 6, 2014 at 5:58 AM, Maneesh Tripathi maneesh@razaonline.info wrote: I have Created an task queue which stop working after 10 Min. I want to increase the timing. Please help me on this Task queue requests are limited to 10 minutes of execution time: https://cloud.google.com/appengine/docs/java/taskqueue/overview-push#task_deadlines If you need to go past the 10 minute deadline, you're better off using a manual or basic scaled module: https://cloud.google.com/appengine/docs/java/modules/#scaling_types - -Vinny P Technology Media Consultant Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: como voltar para a conta gratis ?
(English below) -- Português Caro Contato Recompa, você está no fórum errado. Essa lista de discussão refere-se ao Google App Engine, produto da linha do Google Cloud Platform, que em nada tem a ver com o Google Apps, que parece ser o que você está se referindo. De qualquer maneira acredito que esse link https://support.google.com/a/answer/2855120?hl=pt-BR pode ajudar a sanar a sua dúvida. -- English Dear Contact Recompa, you are at the wrong forum. This group refers to the Google App Engine, a product of Google Cloud Platform line, which has nothing to do with Google Apps, which seems to be what you are referring to. Anyway I this this link https://support.google.com/a/answer/2855120?hl=en can help you out in your question. On Sunday, December 7, 2014 6:31:39 PM UTC-2, Contato Recompa wrote: Minha cota era Gratis GMAIL APPS se que era gratis , como é que faço para voltar para o GMAIL APPS (GRATIS ) * visite nosso Site : www.recompa.com.br http://www.recompa.com.br* -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Trying to query the datastore
Here is the native datastore query for your problem if you want to try it
out:
DatastoreService ds = DatastoreServiceFactory.getDatastoreService();
Query query = new Query(Member.class.getSimpleName());
query.setFilter(new FilterPredicate(name, FilterOperator.EQUAL,
nameParam));
ListEntity list =
ds.prepare(query).asList(FetchOptions.Builder.withDefaults());
In my opinion, if you are building a new application right now, you should
consider other options on accessing the Datastore, such as Objectify
https://code.google.com/p/objectify-appengine/ or even the raw Datastore
API. JDO is pretty heavyweight for the App Engine model.
On Sunday, December 7, 2014 7:12:47 AM UTC-2, ajg...@gmail.com wrote:
Hello,
I am using eclipse+google plugin to develop a simple API with Cloud
Endpoints. I just have a member entity with JDO annotations, and I
generated the Endpoint class.
My Member entity only has 2 fields: the Long id and String name.
I would like to use a getMemberByName(String name) method to retrieve
easily a member instead of having to know its id.
So I added this method to the Endpoint class generated:
@SuppressWarnings({“unchecked”})
@ApiMethod(name = “getMemberByName”,path=”/member/byname/{name}”)
public List getMemberByName(@Named(“name”) String name) {
PersistenceManager mgr = getPersistenceManager();
List candidates = null;
Query q=mgr.newQuery(Member.class);
q.setFilter(“name == nameParam”);
q.declareParameters(“String nameParam”);
try {
candidates = (List) q.execute(nom);
} finally {
mgr.close();
}
return candidates;
}
When I call this API method and give it a name parameter (which does exist
in my datastore) it sends me nothing back but a 404 error.
I thought maybe you could tell me if my code got any error, I’m not an
expert with JDO.
Thank you.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: How to Increase Task queue Execution time
That's the default behavior of tasks: they execute over 10 minutes max. To increase that you need to setup a backend and make your tasks execute in that backend. I don't know which language you are using, but I'll link the java documentation about that: https://cloud.google.com/appengine/docs/java/taskqueue/ https://cloud.google.com/appengine/docs/java/modules/ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] How to increase Task Queue Execution timing
Actually I just migrated my statistics job from MapReduce to BigQuery (using the Datastore - Cloud Storage - BigQuery pattern) =) I strongly recommend the book Google BigQuery Analytics from Jordan Tigani and Siddartha Naidu if you plan to use or know more about BigQuery. I got mine at I/O this year (the last book in the box) =) BigQuery is awesome but have its quirks - the append-only tables is just one of them. You have to shape your business logic to handle that before starting to heavily use it. If you don't need statistics, you probably don't need BigQuery. The sad part is that I spent more than 2 months tweaking and improving my whole pipeline stack trying to get a better performance (or cost-effectiveness), when I could just be using BigQuery to solve my problems. Anyway, it was a good lesson. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] A question about the future cloud monitoring (powered by Stackdriver)
Hi, I'd like to know if with the new monitoring tool for App Engine, powered by Stackdriver, I will be able to measure the performance of my mapreduce jobs, to help me finding out, for instance: - the ideal number of mapper/reducer shards, suitable for each kind of job I run; - the ideal number of backend machines to run the jobs; - the ideal machine configuration of each backend machine; - the ideal configuration of the task queue where the jobs are posted. Today I try to find the most cost-effective setup completely empirically, since it's impossible to simulate the exact conditions in a development environment. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Will cloud Dataflows replace the MapReduce/Pipeline API?
Hi, At the keynote of the Google I/O this year was mentioned about a new API/service called Cloud Dataflow. Will it replace the current (and still in preview) MapReduce API? I don't want to have to refactory my code suddenly. Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: Error deploying application: loop at 87% on sending batch files
It seems to be fixed on 1.9.5. I just sent my multi-module project to App Engine (using Maven!) with no issues. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: unable to compile MapReduceSpecification.of
Hi Pravanjan, Can you post the compiler error message? By the way, this kind of question is perfect to ask at StackOverflow ;-) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: Error deploying application: loop at 87% on sending batch files
Confirmed: appcfg.sh update on 1.9.3 works as intended. I hope it gets fixed on next update. On Monday, May 5, 2014 8:48:50 PM UTC-3, Gilberto Torrezan Filho wrote: Hi Fernando, Thanks for your message (I was feeling lonely here =P). I'll check it out. Gilberto -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Can google app engine support servlet 3.0?
Until the sun rises in the west and sets in the east. Until the rivers run dry, and the mountains blow in the wind like leaves… - Daenerys Targaryenhttp://en.wikipedia.org/wiki/Daenerys_Targaryenabout the Servlet 3.0 support on App Engine. On Sunday, May 4, 2014 11:11:40 AM UTC-3, 이찬형 wrote: If it can't still support, when it update to servlet 3.0 ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Error deploying application: loop at 87% on sending batch files
Well, removing the symbolic links *helps* solving the issue, but sometimes the deployment still fails. It's like 1 success in 3-4 attempts. Always with the same symptom: stuck at 87% and sending files till the hard limit of 1 is reached. Deploying an app has become a painful experience. Is anybody else with the same issue? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: Error deploying application: loop at 87% on sending batch files
Hi Fernando, Thanks for your message (I was feeling lonely here =P). I'll check it out. Gilberto -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Error deploying application: loop at 87% on sending batch files
Hi, I'm having a weird problem when trying to deploy my application to App Engine. I'm running a Java application, and using Maven with Modules. My project structure was created by the skeleton-archetype, described here: https://developers.google.com/appengine/docs/java/tools/maven I have the default and only one more module. The default uses F1 automatic scaling and the second module uses B2 basic scaling. My application is not a new one (I'm trying to update it on production), and it is billing-enabled. From the root directory (where the super project resides) I executed: mvn clean install With no issues. The project was built and everything was ok. But when executing: mvn appengine:update -e From my EAR directory (below the root), I got this strange behavior: Beginning interaction for module default... 0% Created staging directory at: '/tmp/appcfg4856430756419614536.tmp' 5% Scanning for jsp files. 20% Scanning files on local disk. 25% Scanned 250 files. 28% Scanned 500 files. 31% Scanned 750 files. 33% Scanned 1000 files. 34% Scanned 1250 files. 35% Scanned 1500 files. 36% Scanned 1750 files. 37% Initiating update. 37% Cloning 395 static files. 37% Cloning 1545 application files. 40% Uploading 696 files. 52% Sending batch containing 53 blob(s) totaling 3024KB. 61% Sending batch containing 54 blob(s) totaling 3221KB. 68% Sending batch containing 55 blob(s) totaling 3259KB. 73% Sending batch containing 56 blob(s) totaling 3304KB. 77% Sending batch containing 57 blob(s) totaling KB. 80% Sending batch containing 58 blob(s) totaling 3345KB. 82% Sending batch containing 59 blob(s) totaling 3357KB. 84% Sending batch containing 60 blob(s) totaling 3368KB. 85% Sending batch containing 61 blob(s) totaling 3374KB. 86% Sending batch containing 62 blob(s) totaling 3503KB. 87% Sending batch containing 63 blob(s) totaling 3508KB. 87% Sending batch containing 64 blob(s) totaling 3549KB. 87% Sending batch containing 65 blob(s) totaling 3598KB. 87% Sending batch containing 66 blob(s) totaling 3626KB. 87% Sending batch containing 67 blob(s) totaling 3639KB. 87% Sending batch containing 68 blob(s) totaling 3650KB. 87% Sending batch containing 69 blob(s) totaling 3661KB. 87% Sending batch containing 70 blob(s) totaling 3667KB. 87% Sending batch containing 71 blob(s) totaling 3796KB. 87% Sending batch containing 72 blob(s) totaling 3801KB. 87% Sending batch containing 73 blob(s) totaling 3842KB. 87% Sending batch containing 74 blob(s) totaling 3891KB. 87% Sending batch containing 75 blob(s) totaling 3919KB. 87% Sending batch containing 76 blob(s) totaling 3932KB. 87% Sending batch containing 77 blob(s) totaling 3944KB. 87% Sending batch containing 78 blob(s) totaling 3954KB. 87% Sending batch containing 79 blob(s) totaling 3961KB. 87% Sending batch containing 80 blob(s) totaling 4089KB. (and so on... till...) 87% Exception in flushing batch payload, so sending 1 by 1...Error posting to URL: https://appengine.google.com/api/appversion/addfiles?=module=defaultapp_id=(myproject)version=3 400 Bad Request Max number of files and blobs is 1. 87% Rolling back the update. com.google.appengine.tools.admin.HttpIoException: Error posting to URL: https://appengine.google.com/api/appversion/addfile?module=defaultpath=META-INF%2FMANIFEST.MFapp_id=(myproject)version=3 400 Bad Request Max number of files and blobs is 1. Unable to update app: Error posting to URL: https://appengine.google.com/api/appversion/addfile?module=defaultpath=META-INF%2FMANIFEST.MFapp_id=(myproject)version=3 400 Bad Request Max number of files and blobs is 1. Please see the logs [/tmp/appcfg2488967039807633573.log] for further information. And the log /tmp/appcfg2488967039807633573.log shows: Unable to update: com.google.appengine.tools.admin.HttpIoException: Error posting to URL: https://appengine.google.com/api/appversion/addfile?module=defaultpath=META-INF%2FMANIFEST.MFapp_id=(myproject)version=3 400 Bad Request Max number of files and blobs is 1. at com.google.appengine.tools.admin.AbstractServerConnection.send1(AbstractServerConnection.java:293) at com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServerConnection.java:253) at com.google.appengine.tools.admin.AbstractServerConnection.post(AbstractServerConnection.java:216) at com.google.appengine.tools.admin.LoggingClientDeploySender.send(LoggingClientDeploySender.java:33) at com.google.appengine.tools.admin.AppVersionUpload.send(AppVersionUpload.java:997) at com.google.appengine.tools.admin.AppVersionUpload$UploadBatcher.flush(AppVersionUpload.java:1306) at com.google.appengine.tools.admin.AppVersionUpload$UploadBatcher.addToBatch(AppVersionUpload.java:1330) at com.google.appengine.tools.admin.AppVersionUpload.uploadFile(AppVersionUpload.java:761) at
[google-appengine] Re: Error deploying application: loop at 87% on sending batch files
Continuing with my struggle to make it work: The file which the error log complains about varies among deployment attempts. So it is not related to the file itself. I tried to change the application version, using a new version (called 4). No luck. I tried to deploy only the default module, instead of the entire EAR. No luck, same behavior. I tried to deploy only the default module, using the appcfg.sh script directly (instead of mvn appengine:update), and still no luck. I'm running out of options. =/ On Friday, May 2, 2014 1:25:03 PM UTC-3, Gilberto Torrezan Filho wrote: Hi, I'm having a weird problem when trying to deploy my application to App Engine. I'm running a Java application, and using Maven with Modules. My project structure was created by the skeleton-archetype, described here: https://developers.google.com/appengine/docs/java/tools/maven I have the default and only one more module. The default uses F1 automatic scaling and the second module uses B2 basic scaling. My application is not a new one (I'm trying to update it on production), and it is billing-enabled. From the root directory (where the super project resides) I executed: mvn clean install With no issues. The project was built and everything was ok. But when executing: mvn appengine:update -e From my EAR directory (below the root), I got this strange behavior: Beginning interaction for module default... 0% Created staging directory at: '/tmp/appcfg4856430756419614536.tmp' 5% Scanning for jsp files. 20% Scanning files on local disk. 25% Scanned 250 files. 28% Scanned 500 files. 31% Scanned 750 files. 33% Scanned 1000 files. 34% Scanned 1250 files. 35% Scanned 1500 files. 36% Scanned 1750 files. 37% Initiating update. 37% Cloning 395 static files. 37% Cloning 1545 application files. 40% Uploading 696 files. 52% Sending batch containing 53 blob(s) totaling 3024KB. 61% Sending batch containing 54 blob(s) totaling 3221KB. 68% Sending batch containing 55 blob(s) totaling 3259KB. 73% Sending batch containing 56 blob(s) totaling 3304KB. 77% Sending batch containing 57 blob(s) totaling KB. 80% Sending batch containing 58 blob(s) totaling 3345KB. 82% Sending batch containing 59 blob(s) totaling 3357KB. 84% Sending batch containing 60 blob(s) totaling 3368KB. 85% Sending batch containing 61 blob(s) totaling 3374KB. 86% Sending batch containing 62 blob(s) totaling 3503KB. 87% Sending batch containing 63 blob(s) totaling 3508KB. 87% Sending batch containing 64 blob(s) totaling 3549KB. 87% Sending batch containing 65 blob(s) totaling 3598KB. 87% Sending batch containing 66 blob(s) totaling 3626KB. 87% Sending batch containing 67 blob(s) totaling 3639KB. 87% Sending batch containing 68 blob(s) totaling 3650KB. 87% Sending batch containing 69 blob(s) totaling 3661KB. 87% Sending batch containing 70 blob(s) totaling 3667KB. 87% Sending batch containing 71 blob(s) totaling 3796KB. 87% Sending batch containing 72 blob(s) totaling 3801KB. 87% Sending batch containing 73 blob(s) totaling 3842KB. 87% Sending batch containing 74 blob(s) totaling 3891KB. 87% Sending batch containing 75 blob(s) totaling 3919KB. 87% Sending batch containing 76 blob(s) totaling 3932KB. 87% Sending batch containing 77 blob(s) totaling 3944KB. 87% Sending batch containing 78 blob(s) totaling 3954KB. 87% Sending batch containing 79 blob(s) totaling 3961KB. 87% Sending batch containing 80 blob(s) totaling 4089KB. (and so on... till...) 87% Exception in flushing batch payload, so sending 1 by 1...Error posting to URL: https://appengine.google.com/api/appversion/addfiles?=module=defaultapp_id=(myproject)version=3 400 Bad Request Max number of files and blobs is 1. 87% Rolling back the update. com.google.appengine.tools.admin.HttpIoException: Error posting to URL: https://appengine.google.com/api/appversion/addfile?module=defaultpath=META-INF%2FMANIFEST.MFapp_id=(myproject)version=3 400 Bad Request Max number of files and blobs is 1. Unable to update app: Error posting to URL: https://appengine.google.com/api/appversion/addfile?module=defaultpath=META-INF%2FMANIFEST.MFapp_id=(myproject)version=3 400 Bad Request Max number of files and blobs is 1. Please see the logs [/tmp/appcfg2488967039807633573.log] for further information. And the log /tmp/appcfg2488967039807633573.log shows: Unable to update: com.google.appengine.tools.admin.HttpIoException: Error posting to URL: https://appengine.google.com/api/appversion/addfile?module=defaultpath=META-INF%2FMANIFEST.MFapp_id=(myproject)version=3 400 Bad Request Max number of files and blobs is 1. at com.google.appengine.tools.admin.AbstractServerConnection.send1(AbstractServerConnection.java:293) at com.google.appengine.tools.admin.AbstractServerConnection.send(AbstractServerConnection.java:253) at com.google.appengine.tools.admin.AbstractServerConnection.post
[google-appengine] Re: Error deploying application: loop at 87% on sending batch files
Ok, since I'm the only talking in this thread (is the keyword Java the problem around here?), I'll describe what I did to kinda get it to work. Using an webapp directory, generated or not by Maven, I have the following structure: root (war) | - WEB-INF | | - classes (directory with bytecode data) | | - lib (jars) | | - web.xml | | - appengine-web.xml | | - (other config files) | - static files, such as htmls, images and so on | - folders with static files as well When using appcfg.sh to update my application, it copies the entire structure to a temporary folder, and then starts the upload of files. The structure of the temporary folder is sightly different from the original folder: root (temp) | - WEB-INF | | - classes (directory with bytecode data) | | - lib (jars) | | - web.xml | | - appengine-web.xml | | - (other config files) | - __static__ | - static files, such as htmls, images and so on | - folders with static files as well So, in other words, it copies all static files and folders to a __static__ directory. Nothing fancy so far. The problem is, in my setup, I don't know why, the appcfg.sh is generating symbolic links of the static files at the root temporary folder. Something like this: root (temp) | - WEB-INF | | - * | - __static__ | | - image.png | | - index.html | - image.png - /home/user/workspace/myapp/myapp-war/target/image.png | - index.html - /home/user/workspace/myapp/myapp-war/target/index.html So I thought: why the heck does it need these symbolic links AND the __static__ folder? And then I made one of worst workarounds with the poorly supported Maven-Java-App-Engine-Modules so far: after running appcfg.sh update myapp, I paused the process (ctrl+z) right after it created the temporary folder, and right before it started scanning the files. With the paused process, I went to the temp folder and removed all those weird symbolic links, leaving only the __static__ and the WEB-INF directories. After that, I resumed the process (fg), and there you go, problem solved. I don't know if it is a bug, but it is a really annoying situation. Next time I'll fake my input to look like python's to see if I get some support =P See you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Request to not use Maven in GAE
I'd like to express my opinion about Maven as well: please continue supporting it to make the development and deployment as much IDE agnostic as possible. ... and make the GPE work seamlessly with Maven projects - today we have configuration issues and workarounds to make everything work together. On Monday, April 21, 2014 3:51:16 PM UTC-3, Mike D wrote: It seems like Maven is working its way into GAE. I would like to make my preference known to the GAE team. I prefer to not use Maven. I find it better to expand upon the GPE and simply provide documentation for how to set up a configuration. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Google Cloud Endpoint initialization
Let me see if I understood correctly: are you saying a instance of my entire VM are launched every time a request is handled by the GCE engine? All my singleton classes (DAOs, default values, some utilities) are reinstantiated each request? I don't save sensitive state in memory (I use Memcache/Datastore for that), but some objects cloud be reused among requests, the way it works on regular GAE frontend requests. On Wednesday, April 23, 2014 4:13:52 AM UTC-3, Vinny P wrote: On Wed, Apr 16, 2014 at 8:37 PM, Mike D mdichi...@fittrace.comjavascript: wrote: I have some initialization stuff that I'd like to do before GCE can be used. How would I do this? I tried creating a ServletContextListener and then calling a static method on my GCE but that doesn't work. In debugging I can see that the GCEs static variables are not set when a method is invoked. Endpoints applications are slightly different than normal web applications; as you remarked in your post, static variables don't retain their values. If you need to do initialization, you should handle init separately (perhaps as part of a cron job) and save the results into the datastore/cloud storage/cloud SQL. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Dev workflow for Modules + Maven
Hi, If you're using Eclipse, take a look at this topic: https://groups.google.com/forum/#!topic/google-plugin-eclipse/9K0RkQID740 Maven + app engine modules doesn't work quite well with Eclipse right now, and judging by the volume of messages in the topic above, I don't think we will see any improvement in a near future. While there is a Google I/O coming up, there is hope for a big capital letters announcement: Behold, Servlets 3, Java 8 and better Maven + Modules + Eclipse integration for App Engine!. Do you think local testing is hard the way it is now? Try adding GWT to the mix and you'll end with more white strands of hair in your head... ;-) On Sunday, April 20, 2014 8:27:46 PM UTC-3, aloo wrote: Hi all, I'm curious how others have setup their dev workflow when using appengine modules + maven? In order to run the local dev server I need to rebuild my entire project and then run mvn appengine:devserver in my ear directory. This typically takes a minute for a simple code change. I'm having a hard time iterating during local testing due to this. I'm using the same project structure as the sample modules app here: https://github.com/GoogleCloudPlatform/appengine-modules-sample-java -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: What is the most efficient way to compute a rolling median on appengine?
I miss some Redis functionality in App Engine as well. Memcache is just an unreliable cache to hold some data for while... nothing more. To make such calculations which iterate over large sets of data, I use backends with in-memory processing: loading part of the data from datastore into memory, spawn multiple threads (if applicable) and iterate over data. Ugly, strange, error-prone and sometimes slow, but it works. A bomb-to-kill-an-ant solution would be using Google BigQuery. I don't like like the idea, but depending on your problem it can solve it for you. You can try to use some MapReduce processing as well. But since I'm using Java (a not so loved language in App Engine, see servlet 3.0 discussionhttp://code.google.com/p/googleappengine/issues/detail?id=3091) MapReduce (Mapper, actually http://code.google.com/p/appengine-mapreduce/) is too experimental to put in production (after the Conversion and Files API, I learned my lesson: never ever ever use an experimental API in App Engine). Anyway, you have several options to try. I just recommend you to avoid storing large datasets on Memcache, since it's just a cache and can wipe your data at any time - invalidating your calculations. On Tuesday, November 12, 2013 6:07:34 PM UTC-2, Mathieu Simard wrote: Since there is no appengine solution available such as the Redis atomic list, I'm left wondering how to implement a cost effective rolling median. Has anyone come up with a solution that would be more convenient than running a redis instance on Google Compute Engine? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: billing: credit card card declined... for which account?!
The App Engine billing is messed up (I really think they just merged the code from the Google Wallet tested on Google I/O 2013 registration to the App Engine billing system). More info: https://groups.google.com/forum/#!topic/google-appengine/2KBxFeCGacA On Tuesday, August 20, 2013 7:32:11 PM UTC-3, Adam Sah wrote: found one of them... now more fun: https://appengine.google.com/billing/billing_profile?app_id=s~my app idversion_id=version id == You are not authorized to access this page. even though that same page reports that I'm the billing administrator. adam On Tuesday, August 20, 2013 3:12:36 PM UTC-7, Adam Sah wrote: how do I find out which of my several dozen cloud platform services/apps is affected? I've been hunting for hours... (I'm 99% sure it's an expired credit card) thanks, adam -- Forwarded message -- From: billing...@google.com javascript: Date: Tue, Aug 20, 2013 at 3:01 PM Subject: Google Cloud Platform: Payment declined, your Google API Services are in danger of being suspended To: me We couldn't process a payment with your Visa ... for $12.53 on Aug 17, 2013. Your bank or credit institution gave the following details about the decline: No reason provided by your financial institution. We have tried to charge your account but the payment has been declined. Please go to update your form of payment. Your account will be deactivated in 30 days if payment is not received. Please contact your bank or credit institution to resolve the issue. Soon, we'll try to process the payment with your MasterCard ... Learn more about credit card declines at http://support.google.com/cloudbilling/answer/2987884?hl=en-US. -- This message was sent from a notification-only email address that does not accept incoming email. Please do not reply to this message. You can opt out of billing emails for this customer by visiting url This link will expire 7 days after the date of this email. This message may be confidential or privileged. If you received this email by mistake, please don't forward it to anyone else and delete all copies and attachments. -- Billing ID: number -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: GAE BILLING IS SERIOUSLY MESSED UP
I just received an e-mail of failed payment today, for the second time in one week. There's nothing wrong with my card, according to my bank (I even received a SMS about the payment to GAE - I receive a SMS everytime the card is used). I reenabled the card waiting for it to succeed. Let's see what happens. My theory: you guys just merged the code from Google Wallet you tested at Google I/O 2013 registration to the app engine billing system, corrupting any form of payment =P Jokes aside, this kind of issue is really critical. What's the use of multiple datacenters, with high replication datastore, with high availability and so on... if everything goes down due to lack of payment? On Monday, August 19, 2013 1:07:22 PM UTC-3, Rae Wang wrote: Update: Our billing team has found the issue and fixed it. New charges should succeed now. Our engineers are looking into retrying/recovering the failed ones. As usual, your feedback on the forum is helping us to improve our system. We really appreciate it. Thank you. On Friday, August 16, 2013 11:53:31 PM UTC-7, Rae Wang wrote: Thank you for bringing these issues to our attention. We are seeing a number of payment failures on GAE accounts recently and are actively investigating issues on our side. Sorry about the inconvenience it has caused you. We are working on resolving the issues. On Friday, August 16, 2013 12:55:57 PM UTC-7, Ken Bowen wrote: I also got couldn't process a payment with your Visa…...for $0.02 on Aug 4, 2013. It's a Citicard that has been on the GAE account for many months (and the card has be in continual use for over 10 years). I only got the email yesterday (8/15). I called Citibank. They checked and stated that the charge was presented on Aug 3, and that it was approved, and there were no presentations or transactions showing on the 4th. I managed to fix it by going to Billing Billing Settings, and clicking the Edit next to the Primary (and only form of payment), then clicking OK, and then clicking Activate this … (or whatever it actually said.) In 5-10 minutes, the Billing Settings and Billing Status pages looked correct, and I was able to make a manual payment (for 0.03) which showed on Billing Transactions. So I got over it. But this is NOT that way an organization which claims to be world-class should treat it's customers. I can't prove it, but I believe that my setup for running our GAE app off a custom domain was broken by this. But I'll post that separately. --Ken -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] GAE/J: Error creating a DatastoreServiceFactory with remote API 1.8.3
Hi there, I'm having problems starting a DatastoreServiceFactory with the remote API provided by the 1.8.3 SDK, using a standalone client. I'm using the code provided herehttps://developers.google.com/appengine/docs/java/tools/remoteapito authenticate, and simply calling DatastoreServiceFactory.getDatastoreService() after that. This is the error: java.lang.IllegalArgumentException: No provider was registered for com. google.appengine.api.datastore.IDatastoreServiceFactory at com.google.appengine.spi.ServiceFactoryFactory.getFactory( ServiceFactoryFactory.java:64) at com.google.appengine.api.datastore.DatastoreServiceFactory.getFactory (DatastoreServiceFactory.java:78) at com.google.appengine.api.datastore.DatastoreServiceFactory. getDatastoreService(DatastoreServiceFactory.java:20) at com.google.appengine.api.datastore.DatastoreServiceFactory. getDatastoreService(DatastoreServiceFactory.java:40) The very same code works as expected using the v.1.8.2 SDK. Any ideas? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] GAE Blobstore file-like API deprecation timeline (py 2.7 runtime) [XPOST from StackOverflow]
Ok, and how about the GCS client API itself? Is it experimental as well? (aka. are we going to be annoyed next month because the GAE Team took too much coffee and started to randomly break things just to annoy developers worldwide)? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] GAE Blobstore file-like API deprecation timeline (py 2.7 runtime) [XPOST from StackOverflow]
Oh, I feel much safer now... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] GAE/J - Completely lost on migrating from Files API to GCS Client Library
Hi Vinny P, Thank you for your reply. Indeed I'm having problems to activate the cloud integration for my project, due to this issuehttp://code.google.com/p/googleappengine/issues/detail?id=9602. I'll wait for a position from Google about it (a patch?) before creating more projects or trying workarounds. Kaan Soral, I'm worried about the migration of existing blobstore as well. I think (and I want to believe) Google will make some migration magic button similar to when they migrated to HRD. I simply can't rely on a structure which makes me migrate data and rework code at every release, though. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] GAE/J - Completely lost on migrating from Files API to GCS Client Library
Hi everyone, I'm very confused about what do I have to do to migrate from the now deprecated Files API to GCS Client Library. Before anything I'd like to express my complete dissatisfaction with the fact that I have to manage a second service from now on just to write files on the server. Anyway, let's stick to the problem: I have this piece of code which is working very well for years: FileService fileService = FileServiceFactory.getFileService(); AppEngineFile file = fileService.createNewBlobFile(text/plain); FileWriteChannel writeChannel = fileService.openWriteChannel(file, true); Writer writer = Channels.newWriter(writeChannel, UTF8); //write my file writeChannel.closeFinally(); BlobKey blobKey = fileService.getBlobKey(file); //I got my BlobKey and I'm happy But FileService is now deprecated. When I try to use the GCS client library (after discovering that the library isn't part of the GAE SDK just to make me even more happy), I got this situation: GcsService gcsService = GcsServiceFactory.createGcsService(); //no problems GcsFilename gcsFileName = new GcsFilename(bucketName, objectName); //I have to create this object to create the file below gcsService.createOrReplace(gcsFileName, gcsFileOptions); //I really miss the day when file.createNewFile(); was sufficient The problem is the second line. As it seems now I have to provide a file name. Ok, I can gerente a random one, just to keep the API satisfied. Now the problem is the bucket name. I don't even know what it means. I just want to save a file. After searching a bit I found that it is something related to the Google Cloud Storage service. Ok, let's signup another service, accept another terms, and so on (... and I just want to save a file). When logging on the Cloud Console https://cloud.google.com/console, I can see my App Engine project, with the following options: App Engine (which links to the App Engine Dashboard https://appengine.google.com/dashboard), BigQuery (not using) and Cloud Datastore (which links to a view of my stored entities). No Cloud Storage. Following this activation guidehttps://developers.google.com/appengine/docs/java/googlecloudstorageclient/activate, I have to create another project (!!!). So no Cloud Storage dashboard or console anywhere, nowhere to configure or get that bucket name and no, I'm not going to drop my 2-years project to create another one just to enable file writing. What do I have to do to just-save-a-file on the server? Why is that so hard? Thank you. (Sorry for the text but I'm really upset with this situation) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Error enabling cloud integration in existing application
Is the error described here on StackOverflowhttp://stackoverflow.com/questions/17365964/error-enabling-cloud-integration-in-existing-application-gaeaffecting anyone else? I'm worried about this issue and I'm starting to think it has something to do with my own application. I really don't want to create a new project just to add APIs =/ The error is registered here: http://code.google.com/p/googleappengine/issues/detail?id=9602 . Please star if you have the same problem. Quoting the issue: I am trying to add APIs to my existing application but the option does not appear. I have tried creating a 'Google Cloud Project' in APPLICATION SETTING CLOUD INTEGRATION but this returns an error after I refresh the page: An error ocurred when creating the project. Please retry. (Google typo for occurred) I keep retrying with no success. Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
