[google-appengine] Re: Suddenly App Engine not Serving Anymore: Error code 123
I also see some outages from my logs The worst part is that the SLA refunds are not automatic, I have too many things on my plate and the SLA refund/request process is too criptic On Wednesday, June 17, 2015 at 8:01:36 PM UTC+3, Karl-Heinz Müller wrote: I have a few app engines running, serving different domain names using the same application code php. Two of them suddenly stopped serving content. In the log file I see the following error message: I 12:56:46.855 This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application. E 12:56:46.855 Process terminated because the request deadline was exceeded. (Error code 123) I have another app engine running the same application without any issues and accessing the same data storage unit. Wondering why two shut down and the other not. No changes have been done. The incident started today 12:00 Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/7c8c0cc9-31af-465b-bdf5-d1d81cc17ef1%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Google Cloud Datastore Incremental Backups
I will process your PIT later today. Unfortunately there is no way to do incremental backups at this time. On Thursday, June 18, 2015 at 1:02:25 AM UTC-4, Gubbi wrote: I have created a new feature request here: https://code.google.com/p/googleappengine/issues/detail?id=12071 starred the old feature request as well. Are there any strategies I can use now for incremental backups? On Wed, Jun 17, 2015 at 12:56 AM, Jason Collins jason.a.coll...@gmail.com wrote: I have an old feature request here if you want to star it: https://code.google.com/p/googleappengine/issues/detail?id=7428 On Tuesday, 16 June 2015 08:37:46 UTC-7, Ryan (Cloud Platform Support) wrote: Salutations Gubbi, This Feature Request would best be posted in the Public Issue Tracker https://code.google.com/p/googleappengine/issues/entry?template=Feature%20request. When you fill out the report let me know on this thread and I will process it for you. On Tuesday, June 16, 2015 at 10:53:47 AM UTC-4, Gubbi wrote: Hi, The official backup method only supports full backup as of now. I don't know when, if at all, it'll support incremental backup. It'll be wasteful to take full backups every time. What strategies are you using for taking incremental backups of your datastore? Thanks, Vinuth. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/06f79b85-be73-4dc4-a774-07dfc6cf9cb0%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Issues with Cloud SQL query parsing
Thank you all for bringing this to our attention. @All who posted messages to me you should be working now. If you still experience this error (even those who already messaged me) please go to the PIT https://code.google.com/p/googleappengine/issues/detail?id=12066thanks=12066ts=1434572430and fill out the template. On Wednesday, June 17, 2015 at 4:21:35 PM UTC-4, Ryan (Cloud Platform Support) wrote: If anyone else runs into this issue please see this PIT. https://code.google.com/p/googleappengine/issues/detail?id=12066thanks=12066ts=1434572430 On Tuesday, June 16, 2015 at 12:09:20 AM UTC-4, Glenn Molnar wrote: Hi, We are suddenly seeing SQLExceptions when attempting to execute a Cloud SQL query, in a particular application environment as follows: java.sql.SQLException: Wrong number of parameters: expected 0, was given 1 Query: delete from ppq.channel where clientId = ? Parameters: [7a8261ef-a3ff-480b-8024-05f959ccd762] The error message does not make a whole lot of sense, as clearly the query has a ? parameter. This stopped working all of a sudden without any new code being deployed, but only in a single app engine application. The exact same code is running OK in other environments. The only difference we have been able to spot is that the environment we are getting the error on is running appengine 1.9.23, but the others are are still working are running 1.9.22. Has something changed that we need to be aware of? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5b6b2338-2e16-4476-ac22-184a3b07a094%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Replacing local blobstore with cloud storage, what is the replacement for BlobstoreLineInputReader?
Salutations Emlun, There is work on LineInput Readers here https://github.com/rbruyere/appengine-mapreduce. It is still Beta and has not been accepted by the master thread yet so be careful using it. On Thursday, June 18, 2015 at 3:44:26 AM UTC-4, Emlyn wrote: This is a python appengine question, mapreduce 1.9.21 I have code writing lines to a blob in the local blobstore, then processing that using mapreduce BlobstoreLineInputReader. Given that the files api is going away, I thought I'd retarget all my processing to cloud storage. I would expect to find a class called GoogleCloudStorageLineInputReader, but there isn't anything like that. Is there something way I can use GoogleCloudStorageInputReader to read lines? Another possibility is using GoogleCloudStorageRecordInputReader, but for that my input file needs to be in LevelDB format and I don't know how to create that except with a GoogleCloudStorageConsistentRecordOutputWriter, which I don't know how to use outside a mapreduce context. How might I do that? Or am I doing this all wrong, is there some other possibility I've missed? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/aed62252-a74a-4170-b1c4-283bd9f62851%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Data storage on appengine
I am facing shortage of storage for data on appengine. The application gets disconnected and resumes again after 24 hours and that too is for few minutes only. It doesn't even allow me sufficient time to delete the old forms and make room for new ones. Someone please suggest me a short-term solution to this issue. Thanks, Aziz -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/042adbe0-47e4-43d6-9ec9-8421c16c8aa6%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Cant delete old applications
Salutations Anton, Please reply privately with your App-ID's and I will look into it. On Thursday, June 18, 2015 at 2:31:45 AM UTC-4, Anton Danilchenko wrote: Hello. I'm trying to delete my old apps (on both Master/Slave and High Replication). But when I Disable App - the button Delete appear. When I press on Delete button - the error message appear: Server Error A server error has occurred. Url address is: https://appengine.google.com/disabling/delete.do -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/a4258dd5-7f77-4d32-ac7c-25f23f737c67%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: I lost the source code of my application from eclipse, I have deployed it on google app engine
Hello! If you are the developer who uploaded the application, you can download the full compiled application/source code by running the appcfg tool with the download_app action. More runtime-specific information can be found in the following documentations: Here https://cloud.google.com/appengine/docs/java/tools/uploadinganapp#Downloading_an_Application for Java Here https://cloud.google.com/appengine/docs/python/tools/uploadinganapp#Python_Downloading_source_code for Python Here https://cloud.google.com/appengine/docs/php/tools/uploadinganapp#PHP_Downloading_source_code for PHP Here https://cloud.google.com/appengine/docs/go/tools/uploadinganapp#Go_Downloading_source_code for Go Cheers! On Thursday, June 18, 2015 at 1:08:27 AM UTC-4, nav...@senspan.com wrote: I lost the source code of my application from eclipse, but I have deployed it on google app engine, can i get the files back , is their any way to download them ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/daa8a43f-34be-4d87-91c8-4b349cd68790%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Push Task Queue: Process terminated because the request deadline was exceeded during a loading request.
I created a support ticket with the Google Support Center, and the rep
suggested this was not the cause of the issue I'm seeing:
I do not see a close correlation with your issue, for two reasons: the
incident lasted several hours, but your issue occurred at a precise point
in time (admittedly during the incident); and the issue signature doesn't
seem to resemble your issue.
I also load tested again yesterday, and continually saw the same issue
occur, mostly corresponding with large spikes in traffic.
So, the support team is looking into things on the backend server logs.
But if anyone has had this problem, and pin pointed any code problems that
might cause it, or even off chance things to consider, your feedback would
be much appreciated!
On Tuesday, June 16, 2015 at 7:55:51 PM UTC-4, Clint Doriot wrote:
I have a push task queue that, even with relatively small load, produces a
lot of the following error: Process terminated because the request
deadline was exceeded during a loading request.
Tasks that produce these errors run the full 600s before they time out,
tie up the task queue, and don't seem to call any of my handler code*. When
they do finally run, they typically take 1-60 seconds (probably average
closer to 20s).
* I'm assuming its not running any of my main handler code because the
first line of my handler code is a print statement, and it never gets
logged. Also one of the early steps is hitting an external server, which
also never logs the hit.
I'm also noticing that these errors seem to be generated by a subset of
the same instances. Its like the instance gets tripped up and doesn't
process any of the requests that get sent to it. Those instances seem to
have no valid requests that have gone through.
This is the main error I'm seeing:
E 2015-06-16 17:42:27.108 500 0 B 605.3s E 17:42:27.105
/tasks/sync-twitter/friends/tw:944039 0.1.0.2 - - [16/Jun/2015:14:42:27
-0700] POST /tasks/sync-twitter/friends/tw:944039 HTTP/1.1 500 0
https://my-app.appspot.com/api/user; AppEngine-Google;
(+http://code.google.com/appengine) sync-twitter.my-app.appspot.com
ms=605304 cpu_ms=2 queue_name=sync-twitter-1 task_name=873919997852904174
pending_ms=5754 exit_code=125
instance=00c61b117cfd2005f05f45857103617298e8e508 app_engine_release=1.9.22 E
17:42:27.105 Process terminated because the request deadline was exceeded
during a loading request.
But I also get a lot of similar deadline errors from seemingly random
points in the code:
Traceback (most recent call last): File
/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
line 240, in Handle handler =
_config_handle.add_wsgi_middleware(self._LoadHandler()) File
/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
line 299, in _LoadHandler handler, path, err = LoadObject(self._handler)
File
/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
line 85, in LoadObject obj = __import__(path[0]) File
/base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/sync_twitter.py,
line 18, in module from project.tasks import queue_sync_twitter_network
File
/base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/common/project/tasks.py,
line 12, in module import project.models File
/base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/common/project/models/__init__.py,
line 3, in module import leaderboards File
/base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/common/project/models/leaderboards.py,
line 16, in module import project.game_date as game_date File
/base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/common/project/game_date.py,
line 11, in module PROJECT_TZ_INFO = pytz.timezone('Pacific/Honolulu')
File
/base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/lib/pytz/__init__.py,
line 171, in timezone _tzinfo_cache[zone] = build_tzinfo(zone,
open_resource(zone)) File
/base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/lib/pytz/__init__.py,
line 86, in open_resource return loader.open_resource(name)
DeadlineExceededError
...or...
Traceback (most recent call last): File
/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
line 240, in Handle handler =
_config_handle.add_wsgi_middleware(self._LoadHandler()) File
/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
line 299, in _LoadHandler handler, path, err = LoadObject(self._handler)
File
/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py,
line 85, in LoadObject obj = __import__(path[0]) File
/base/data/home/apps/s~project-test/sync-twitter:v2.385068030814249794/sync_twitter.py,
line 18, in module
[google-appengine] Re: My billing account google compute engine inexplicably been disabled
Hi Ryan and Dan in effect before writing here I had tried to contact with Billing team support, I wanted to keep trying these days but i do not receive any of any kind answer, I'm a little desperate because I have 6 days with this situation and they have not answered me, I had to open a second ticket as the first left me talking to myself and turned out that second ticket was worse, I have send around 17 messages imploring aid and practically was alone in the desert, and worse not even achievement know the reason for the suspension. Two executives have assigned to me one for each ticket me and both the executive Jorge as the executive Nadaine simply left the conversation. I fear that only seriously cater to customers platinium or gold, as they require them to pay $ 400 monthly, and really seems unfair to have to pay this much just to be heard. It's sad but true, no one to turn to. El sábado, 13 de junio de 2015, 14:14:47 (UTC-4:30), Raul Obagi escribió: Inexplicably without warning my google compute engine billing account was disabled, and I made more intense search and investigation I followed the steps as described so support page https://support.google.com/cloud/answer/3540854?hl=en (Disable or enable billing) in which they explain the following: Enable billing 1. Sign in to the Google Developers Console. 2. From the *Select a project* drop-down list, select a project name. 3. In the upper right, select the *Settings* icon. 4. From the menu, click *Project billing settings*. 5. On the Billing page, click the *Enable billing* button. and the referred button Enable button billing to which they refer in step 5 does not appear, I find no way to enable it again. to rule out problems, I opened another account billing using the same credit card and my instance is activated but after a few minutes turns to disable my account billing again *Maybe I can be helpful with the following information:* Yesterday make a payment, there is a probability that is generated authentication problem with my main credit card? I completely solvent with my payments My situation is very urgent because my business depends on this server and now all my services are fallen thank you very much for help. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/c27dc425-bdbc-4f04-868c-3c0bc4236356%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Cant delete old applications
It's impossible now to delete old projects from the old dashboard. Deleting from the new console has no effect on the old dashboard. I had already filed a bug report about this some weeks ago. (It is marked private now.) https://code.google.com/p/googleappengine/issues/detail?id=11998 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/7c723927-8c76-4924-b3de-ca5b4b6f61bd%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Best solution / practice for temp files with App Engine PHP?
Thanks Stuart, good to have that reassurance. My code does do that, but in the event a file can't be created in vfs:// it saves it out to Cloud Storage. I can't find details anywhere on how soon after a file is written to Cloud Storage it becomes available for reading again, and also what costs would be accured for momentarily stored files (I'd be deleting it again straight away), do you happen to know anything about those? Many thanks, Alex On Wednesday, June 17, 2015 at 10:36:58 PM UTC+1, Stuart Langley wrote: If you're doing images a few hundred K in size I seriously doubt you'll hit memory limits using vfs:// - I'd start there. On Thursday, 18 June 2015 03:17:58 UTC+10, Alex Kerr wrote: Thanks. No problems with tempnam, but I'm capacity planning for what is likely to be a heavily loaded site with many users hitting simultaneously. I want to avoid (or plan for) a situation where there is no spare memory in a particular instance for another temp file to be created because it's serving so many other users at the same time. I'm not sure if this is a likely scenario or not because I don't know what the potential temp folder capacity is and the maximum users one instance is likely to be serving simultaneously. Current strategy is to try and create a temp file in vfs:// and if that fails create one in Cloud Storage - but is it suitable for that kind of momentary usage and would I incur significant cost (I realise no cost for bandwidth if in the same region) or what's the minimum cost for each momentary usage of Cloud Storage - is it billed by the second, hour or day? (i.e. if used for 1 second, I get billed for a day?) Many thanks, Alex On Sunday, June 14, 2015 at 11:22:13 PM UTC+1, Stuart Langley wrote: Have you tried using tempnam http://php.net/manual/en/function.tempnam.php? If so, what problems did you see? That seems to be the obvious solution. On Sunday, 14 June 2015 05:11:03 UTC+10, Alex Kerr wrote: Hi, What's generally accepted wisdom/tech solution for temp files on GAE using PHP, please? I need to store and process an image (a few hundred K in size) using PHP that momentarily (e.g. 1 second) needs to exist as a temp file somewhere before it's sent on elsewhere and the temp file can be deleted. My site will need to autoscale for potentially large numbers of users (using GAE as standard) - i.e. so site may need to be doing this for many users simultaneously (all for different images) on however many GAE instances are running. My idea was to attempt to store the temp file in memory (using tempnam() etc) and if that failed (e.g. mem full on that instance), immediately try and use some other storage instead on the fly. Question is what? Image has to be available as a file for CURL to access it (I think?) and send elsewhere, so Memcache is not an option (can't access the data as a file to pass into CURL - or can I?), but e.g. Cloud Storage is (via 'gs://[bucket-name]/...'). Thing is, if I've just written the file to storage, is it immediately available for reading? That's also a significant cost incurred... Or Cloud Datastore? But again is file available for reading immediately, and is there a file wrapper for access...? Any help much appreciated! Thanks, Alex -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/9377c240-4eb3-49dc-a99d-69b28b46c970%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Best solution / practice for temp files with App Engine PHP?
Yes, the pricing details were my first port of call :) But they say nothing about costs accrued for data stored for very short periods of time... On Wednesday, June 17, 2015 at 9:13:31 PM UTC+1, Mars Lan wrote: You can find the pricing details for GCS at https://cloud.google.com/storage/pricing -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/66c0c8b1-e279-4bff-b804-8760dbbcf4b1%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: Issues with Cloud SQL query parsing
Now, it works fine. Thanks a lot for your quick reaction. Yann Le Bihan | y...@lebihan.bzh | +1 (415) 606-4890 2015-06-18 6:27 GMT-07:00 Ryan (Cloud Platform Support) rbruy...@google.com : Thank you all for bringing this to our attention. @All who posted messages to me you should be working now. If you still experience this error (even those who already messaged me) please go to the PIT https://code.google.com/p/googleappengine/issues/detail?id=12066thanks=12066ts=1434572430and fill out the template. On Wednesday, June 17, 2015 at 4:21:35 PM UTC-4, Ryan (Cloud Platform Support) wrote: If anyone else runs into this issue please see this PIT. https://code.google.com/p/googleappengine/issues/detail?id=12066thanks=12066ts=1434572430 On Tuesday, June 16, 2015 at 12:09:20 AM UTC-4, Glenn Molnar wrote: Hi, We are suddenly seeing SQLExceptions when attempting to execute a Cloud SQL query, in a particular application environment as follows: java.sql.SQLException: Wrong number of parameters: expected 0, was given 1 Query: delete from ppq.channel where clientId = ? Parameters: [7a8261ef-a3ff-480b-8024-05f959ccd762] The error message does not make a whole lot of sense, as clearly the query has a ? parameter. This stopped working all of a sudden without any new code being deployed, but only in a single app engine application. The exact same code is running OK in other environments. The only difference we have been able to spot is that the environment we are getting the error on is running appengine 1.9.23, but the others are are still working are running 1.9.22. Has something changed that we need to be aware of? Thanks -- You received this message because you are subscribed to a topic in the Google Groups Google App Engine group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/Oc-wJvvCXgE/unsubscribe . To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5b6b2338-2e16-4476-ac22-184a3b07a094%40googlegroups.com https://groups.google.com/d/msgid/google-appengine/5b6b2338-2e16-4476-ac22-184a3b07a094%40googlegroups.com?utm_medium=emailutm_source=footer . For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CADiHwC5fsgU6ui_YUxf2Ya919Bj7ytsq0UFD-ur%3DA_2xCmpi1g%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Best solution / practice for temp files with App Engine PHP?
No way to create it - you'll need a new app instead. On Friday, 19 June 2015 08:13:46 UTC+10, Alex Kerr wrote: That's helpful thanks. Only problem is I deleted the default bucket using the cloud console, is it possible to recreate it? (I tried and it's asking me to verify the bucket name). Or do any buckets under a project count for the 5 GB free? On Thursday, June 18, 2015 at 10:27:43 PM UTC+1, Stuart Langley wrote: Cloud storage read-after-write is strongly consistent so the file would be available immediately after it is written: https://cloud.google.com/storage/docs/concepts-techniques#consistency I'm not certain about the costs for temporary files - If the files are 100kb and the cost per GB per month is $0.026 then I can't imagine it would be much. Plus you have the default bucket for the app which is 5GB for free from memory. On Friday, 19 June 2015 03:28:15 UTC+10, Alex Kerr wrote: Thanks Stuart, good to have that reassurance. My code does do that, but in the event a file can't be created in vfs:// it saves it out to Cloud Storage. I can't find details anywhere on how soon after a file is written to Cloud Storage it becomes available for reading again, and also what costs would be accured for momentarily stored files (I'd be deleting it again straight away), do you happen to know anything about those? Many thanks, Alex On Wednesday, June 17, 2015 at 10:36:58 PM UTC+1, Stuart Langley wrote: If you're doing images a few hundred K in size I seriously doubt you'll hit memory limits using vfs:// - I'd start there. On Thursday, 18 June 2015 03:17:58 UTC+10, Alex Kerr wrote: Thanks. No problems with tempnam, but I'm capacity planning for what is likely to be a heavily loaded site with many users hitting simultaneously. I want to avoid (or plan for) a situation where there is no spare memory in a particular instance for another temp file to be created because it's serving so many other users at the same time. I'm not sure if this is a likely scenario or not because I don't know what the potential temp folder capacity is and the maximum users one instance is likely to be serving simultaneously. Current strategy is to try and create a temp file in vfs:// and if that fails create one in Cloud Storage - but is it suitable for that kind of momentary usage and would I incur significant cost (I realise no cost for bandwidth if in the same region) or what's the minimum cost for each momentary usage of Cloud Storage - is it billed by the second, hour or day? (i.e. if used for 1 second, I get billed for a day?) Many thanks, Alex On Sunday, June 14, 2015 at 11:22:13 PM UTC+1, Stuart Langley wrote: Have you tried using tempnam http://php.net/manual/en/function.tempnam.php? If so, what problems did you see? That seems to be the obvious solution. On Sunday, 14 June 2015 05:11:03 UTC+10, Alex Kerr wrote: Hi, What's generally accepted wisdom/tech solution for temp files on GAE using PHP, please? I need to store and process an image (a few hundred K in size) using PHP that momentarily (e.g. 1 second) needs to exist as a temp file somewhere before it's sent on elsewhere and the temp file can be deleted. My site will need to autoscale for potentially large numbers of users (using GAE as standard) - i.e. so site may need to be doing this for many users simultaneously (all for different images) on however many GAE instances are running. My idea was to attempt to store the temp file in memory (using tempnam() etc) and if that failed (e.g. mem full on that instance), immediately try and use some other storage instead on the fly. Question is what? Image has to be available as a file for CURL to access it (I think?) and send elsewhere, so Memcache is not an option (can't access the data as a file to pass into CURL - or can I?), but e.g. Cloud Storage is (via 'gs://[bucket-name]/...'). Thing is, if I've just written the file to storage, is it immediately available for reading? That's also a significant cost incurred... Or Cloud Datastore? But again is file available for reading immediately, and is there a file wrapper for access...? Any help much appreciated! Thanks, Alex -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/51b8cb78-e2e7-4bc9-a06a-a1ccbca2a667%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Issues with Cloud SQL query parsing
Hi, I experience EXACTLY the same issue, newly deployed GAE apps (running newer appengine version) stopped working suddenly. The only way I was able to fix the issue was to roll back to an older version of my app (a 30+ days old version). That caused a hell of a mess, our apps simply stopped working. Phil On Tuesday, June 16, 2015 at 12:09:20 AM UTC-4, Glenn Molnar wrote: Hi, We are suddenly seeing SQLExceptions when attempting to execute a Cloud SQL query, in a particular application environment as follows: java.sql.SQLException: Wrong number of parameters: expected 0, was given 1 Query: delete from ppq.channel where clientId = ? Parameters: [7a8261ef-a3ff-480b-8024-05f959ccd762] The error message does not make a whole lot of sense, as clearly the query has a ? parameter. This stopped working all of a sudden without any new code being deployed, but only in a single app engine application. The exact same code is running OK in other environments. The only difference we have been able to spot is that the environment we are getting the error on is running appengine 1.9.23, but the others are are still working are running 1.9.22. Has something changed that we need to be aware of? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/fbdfedcb-680b-4050-99ed-fb3758d093cf%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: Replacing local blobstore with cloud storage, what is the replacement for BlobstoreLineInputReader?
Thanks very much Ryan, I'll give it a shot. If I hit any walls or notice any issues, I'll let you know. On 18 June 2015 at 23:21, Ryan (Cloud Platform Support) rbruy...@google.com wrote: Salutations Emlun, There is work on LineInput Readers here. It is still Beta and has not been accepted by the master thread yet so be careful using it. On Thursday, June 18, 2015 at 3:44:26 AM UTC-4, Emlyn wrote: This is a python appengine question, mapreduce 1.9.21 I have code writing lines to a blob in the local blobstore, then processing that using mapreduce BlobstoreLineInputReader. Given that the files api is going away, I thought I'd retarget all my processing to cloud storage. I would expect to find a class called GoogleCloudStorageLineInputReader, but there isn't anything like that. Is there something way I can use GoogleCloudStorageInputReader to read lines? Another possibility is using GoogleCloudStorageRecordInputReader, but for that my input file needs to be in LevelDB format and I don't know how to create that except with a GoogleCloudStorageConsistentRecordOutputWriter, which I don't know how to use outside a mapreduce context. How might I do that? Or am I doing this all wrong, is there some other possibility I've missed? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/aed62252-a74a-4170-b1c4-283bd9f62851%40googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- Emlyn http://point7.wordpress.com - My blog https://plus.google.com/u/0/100281903174934656260 - Google+ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CAMp1VPBsUMJqCwUtCb8k_a8peniGeOBPbCiCDPaxngQHhi06qQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: Replacing local blobstore with cloud storage, what is the replacement for BlobstoreLineInputReader?
I'm trying this library here as pointed to by Ryan: https://github.com/rbruyere/appengine-mapreduce But I'm getting an odd mismatch between it and the Cloud Storage client library; it's looking for file_name on GCSFileStat objects, but in the library these only have filename I'm using version 1.9.21.0 of the cloud storage client library. Is there some other version I should be using? On 19 June 2015 at 10:57, Emlyn emlynore...@gmail.com wrote: Thanks very much Ryan, I'll give it a shot. If I hit any walls or notice any issues, I'll let you know. On 18 June 2015 at 23:21, Ryan (Cloud Platform Support) rbruy...@google.com wrote: Salutations Emlun, There is work on LineInput Readers here. It is still Beta and has not been accepted by the master thread yet so be careful using it. On Thursday, June 18, 2015 at 3:44:26 AM UTC-4, Emlyn wrote: This is a python appengine question, mapreduce 1.9.21 I have code writing lines to a blob in the local blobstore, then processing that using mapreduce BlobstoreLineInputReader. Given that the files api is going away, I thought I'd retarget all my processing to cloud storage. I would expect to find a class called GoogleCloudStorageLineInputReader, but there isn't anything like that. Is there something way I can use GoogleCloudStorageInputReader to read lines? Another possibility is using GoogleCloudStorageRecordInputReader, but for that my input file needs to be in LevelDB format and I don't know how to create that except with a GoogleCloudStorageConsistentRecordOutputWriter, which I don't know how to use outside a mapreduce context. How might I do that? Or am I doing this all wrong, is there some other possibility I've missed? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/aed62252-a74a-4170-b1c4-283bd9f62851%40googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- Emlyn http://point7.wordpress.com - My blog https://plus.google.com/u/0/100281903174934656260 - Google+ -- Emlyn http://point7.wordpress.com - My blog https://plus.google.com/u/0/100281903174934656260 - Google+ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CAMp1VPBJXKEMUsGM2xxrOg7vRkNk6-ONCiP0t%2BN%2BE6cRi7C1vg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: Replacing local blobstore with cloud storage, what is the replacement for BlobstoreLineInputReader?
oh, update: In the cloudstorage library, in common.py, I added this: @property def file_name(self): return self.filename to the class GCSFileStat, and now GoogleCloudStorageLineInputReader appears to be working. Woohoo! On 19 June 2015 at 13:52, Emlyn emlynore...@gmail.com wrote: I'm trying this library here as pointed to by Ryan: https://github.com/rbruyere/appengine-mapreduce But I'm getting an odd mismatch between it and the Cloud Storage client library; it's looking for file_name on GCSFileStat objects, but in the library these only have filename I'm using version 1.9.21.0 of the cloud storage client library. Is there some other version I should be using? On 19 June 2015 at 10:57, Emlyn emlynore...@gmail.com wrote: Thanks very much Ryan, I'll give it a shot. If I hit any walls or notice any issues, I'll let you know. On 18 June 2015 at 23:21, Ryan (Cloud Platform Support) rbruy...@google.com wrote: Salutations Emlun, There is work on LineInput Readers here. It is still Beta and has not been accepted by the master thread yet so be careful using it. On Thursday, June 18, 2015 at 3:44:26 AM UTC-4, Emlyn wrote: This is a python appengine question, mapreduce 1.9.21 I have code writing lines to a blob in the local blobstore, then processing that using mapreduce BlobstoreLineInputReader. Given that the files api is going away, I thought I'd retarget all my processing to cloud storage. I would expect to find a class called GoogleCloudStorageLineInputReader, but there isn't anything like that. Is there something way I can use GoogleCloudStorageInputReader to read lines? Another possibility is using GoogleCloudStorageRecordInputReader, but for that my input file needs to be in LevelDB format and I don't know how to create that except with a GoogleCloudStorageConsistentRecordOutputWriter, which I don't know how to use outside a mapreduce context. How might I do that? Or am I doing this all wrong, is there some other possibility I've missed? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/aed62252-a74a-4170-b1c4-283bd9f62851%40googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- Emlyn http://point7.wordpress.com - My blog https://plus.google.com/u/0/100281903174934656260 - Google+ -- Emlyn http://point7.wordpress.com - My blog https://plus.google.com/u/0/100281903174934656260 - Google+ -- Emlyn http://point7.wordpress.com - My blog https://plus.google.com/u/0/100281903174934656260 - Google+ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CAMp1VPCnbwDQpqdiimFMVsD_h%3Dh6NJZfr31fgs7%2BF2ep6DFATg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Kill back end instance when not in use - php module
Hey guys, so i have a module that is used as the back end and it is constantly running eating up my backend instance hours. I only need it to start at 12:30 am every day and then shutdown when the task queue is empty. The tasks currently take 1-2 min and there aren't too many of them so it will be done by 1-2 am. There must be a way to achieve this dynamically? I would settle for stop at this time and start at this time if it isn't possible to be more intricate. Thanks in advance guys, George - Flavible -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/fbd127e8-f717-4e6a-ba32-9834cf498a74%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] [Python] NDB Update taking long time
Hello; I have an entity with some attributes is a list of objects, but i noticed that when i update the object it takes about 1 day to update. Why this happens? What can i do? Regards -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/eb251732-bbd9-4d58-9546-b04700c00a39%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: Site security maintenance for a Python app on GAE: Easy?
Sounds good, Tom. If you've got any more specific questions about security, I'd recommend consulting the Google Cloud Security Whitepaper https://cloud.google.com/security/whitepaper or cloud.google.com/security, as these are much more thorough in their explanation than I could be. Have a great day On Wednesday, June 17, 2015 at 8:24:04 PM UTC-4, Tom Campbell wrote: However, some aspects of security are up to you as a developer: Yep, got that part--web2py happens to be super awesome at this stuff and I'm also aware of these issues. Does this help answer your question? Do you have any more specific questions about security? It all sounds almost too good to be true, thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/0d5550e8-956b-4521-a67e-c10f9d6c2633%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Data storage on appengine
Hey Aziz, Google Groups isn't really the right place to look for 1-on-1 support. Generally, a question like this should either be answered through opening a support ticket http://cloud.google.com/support, or through posting to stackoverflow http://stackoverflow.com/questions/tagged/google-app-engine with enough information that somebody could begin to understand the problem. In this case, that information might be: * What do you mean by facing a shortage of storage for data on appengine? (I think you mean something else since there's more storage available in the cloud (if you can pay for it) than most developers even think) * What do you mean by the application gets disconnected? * What do you mean by delete the old forms and make room for new ones? * What does a short term solution look like? If you ask a good question, you'll get a good answer, generally. I wish you the best of luck in moving forward to either post to stackoverflow or to ask a Technical Solutions Representative through a support ticket. Sincerely, Nick On Thursday, June 18, 2015 at 7:43:04 AM UTC-4, Azizullah Baig wrote: I am facing shortage of storage for data on appengine. The application gets disconnected and resumes again after 24 hours and that too is for few minutes only. It doesn't even allow me sufficient time to delete the old forms and make room for new ones. Someone please suggest me a short-term solution to this issue. Thanks, Aziz -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/949667a5-272d-4ad9-9493-d66bcea88c7e%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Best solution / practice for temp files with App Engine PHP?
Cloud storage read-after-write is strongly consistent so the file would be available immediately after it is written: https://cloud.google.com/storage/docs/concepts-techniques#consistency I'm not certain about the costs for temporary files - If the files are 100kb and the cost per GB per month is $0.026 then I can't imagine it would be much. Plus you have the default bucket for the app which is 5GB for free from memory. On Friday, 19 June 2015 03:28:15 UTC+10, Alex Kerr wrote: Thanks Stuart, good to have that reassurance. My code does do that, but in the event a file can't be created in vfs:// it saves it out to Cloud Storage. I can't find details anywhere on how soon after a file is written to Cloud Storage it becomes available for reading again, and also what costs would be accured for momentarily stored files (I'd be deleting it again straight away), do you happen to know anything about those? Many thanks, Alex On Wednesday, June 17, 2015 at 10:36:58 PM UTC+1, Stuart Langley wrote: If you're doing images a few hundred K in size I seriously doubt you'll hit memory limits using vfs:// - I'd start there. On Thursday, 18 June 2015 03:17:58 UTC+10, Alex Kerr wrote: Thanks. No problems with tempnam, but I'm capacity planning for what is likely to be a heavily loaded site with many users hitting simultaneously. I want to avoid (or plan for) a situation where there is no spare memory in a particular instance for another temp file to be created because it's serving so many other users at the same time. I'm not sure if this is a likely scenario or not because I don't know what the potential temp folder capacity is and the maximum users one instance is likely to be serving simultaneously. Current strategy is to try and create a temp file in vfs:// and if that fails create one in Cloud Storage - but is it suitable for that kind of momentary usage and would I incur significant cost (I realise no cost for bandwidth if in the same region) or what's the minimum cost for each momentary usage of Cloud Storage - is it billed by the second, hour or day? (i.e. if used for 1 second, I get billed for a day?) Many thanks, Alex On Sunday, June 14, 2015 at 11:22:13 PM UTC+1, Stuart Langley wrote: Have you tried using tempnam http://php.net/manual/en/function.tempnam.php? If so, what problems did you see? That seems to be the obvious solution. On Sunday, 14 June 2015 05:11:03 UTC+10, Alex Kerr wrote: Hi, What's generally accepted wisdom/tech solution for temp files on GAE using PHP, please? I need to store and process an image (a few hundred K in size) using PHP that momentarily (e.g. 1 second) needs to exist as a temp file somewhere before it's sent on elsewhere and the temp file can be deleted. My site will need to autoscale for potentially large numbers of users (using GAE as standard) - i.e. so site may need to be doing this for many users simultaneously (all for different images) on however many GAE instances are running. My idea was to attempt to store the temp file in memory (using tempnam() etc) and if that failed (e.g. mem full on that instance), immediately try and use some other storage instead on the fly. Question is what? Image has to be available as a file for CURL to access it (I think?) and send elsewhere, so Memcache is not an option (can't access the data as a file to pass into CURL - or can I?), but e.g. Cloud Storage is (via 'gs://[bucket-name]/...'). Thing is, if I've just written the file to storage, is it immediately available for reading? That's also a significant cost incurred... Or Cloud Datastore? But again is file available for reading immediately, and is there a file wrapper for access...? Any help much appreciated! Thanks, Alex -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/12c15b7b-25f6-4886-ab46-cd763905eedb%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Best solution / practice for temp files with App Engine PHP?
That's helpful thanks. Only problem is I deleted the default bucket using the cloud console, is it possible to recreate it? (I tried and it's asking me to verify the bucket name). Or do any buckets under a project count for the 5 GB free? On Thursday, June 18, 2015 at 10:27:43 PM UTC+1, Stuart Langley wrote: Cloud storage read-after-write is strongly consistent so the file would be available immediately after it is written: https://cloud.google.com/storage/docs/concepts-techniques#consistency I'm not certain about the costs for temporary files - If the files are 100kb and the cost per GB per month is $0.026 then I can't imagine it would be much. Plus you have the default bucket for the app which is 5GB for free from memory. On Friday, 19 June 2015 03:28:15 UTC+10, Alex Kerr wrote: Thanks Stuart, good to have that reassurance. My code does do that, but in the event a file can't be created in vfs:// it saves it out to Cloud Storage. I can't find details anywhere on how soon after a file is written to Cloud Storage it becomes available for reading again, and also what costs would be accured for momentarily stored files (I'd be deleting it again straight away), do you happen to know anything about those? Many thanks, Alex On Wednesday, June 17, 2015 at 10:36:58 PM UTC+1, Stuart Langley wrote: If you're doing images a few hundred K in size I seriously doubt you'll hit memory limits using vfs:// - I'd start there. On Thursday, 18 June 2015 03:17:58 UTC+10, Alex Kerr wrote: Thanks. No problems with tempnam, but I'm capacity planning for what is likely to be a heavily loaded site with many users hitting simultaneously. I want to avoid (or plan for) a situation where there is no spare memory in a particular instance for another temp file to be created because it's serving so many other users at the same time. I'm not sure if this is a likely scenario or not because I don't know what the potential temp folder capacity is and the maximum users one instance is likely to be serving simultaneously. Current strategy is to try and create a temp file in vfs:// and if that fails create one in Cloud Storage - but is it suitable for that kind of momentary usage and would I incur significant cost (I realise no cost for bandwidth if in the same region) or what's the minimum cost for each momentary usage of Cloud Storage - is it billed by the second, hour or day? (i.e. if used for 1 second, I get billed for a day?) Many thanks, Alex On Sunday, June 14, 2015 at 11:22:13 PM UTC+1, Stuart Langley wrote: Have you tried using tempnam http://php.net/manual/en/function.tempnam.php? If so, what problems did you see? That seems to be the obvious solution. On Sunday, 14 June 2015 05:11:03 UTC+10, Alex Kerr wrote: Hi, What's generally accepted wisdom/tech solution for temp files on GAE using PHP, please? I need to store and process an image (a few hundred K in size) using PHP that momentarily (e.g. 1 second) needs to exist as a temp file somewhere before it's sent on elsewhere and the temp file can be deleted. My site will need to autoscale for potentially large numbers of users (using GAE as standard) - i.e. so site may need to be doing this for many users simultaneously (all for different images) on however many GAE instances are running. My idea was to attempt to store the temp file in memory (using tempnam() etc) and if that failed (e.g. mem full on that instance), immediately try and use some other storage instead on the fly. Question is what? Image has to be available as a file for CURL to access it (I think?) and send elsewhere, so Memcache is not an option (can't access the data as a file to pass into CURL - or can I?), but e.g. Cloud Storage is (via 'gs://[bucket-name]/...'). Thing is, if I've just written the file to storage, is it immediately available for reading? That's also a significant cost incurred... Or Cloud Datastore? But again is file available for reading immediately, and is there a file wrapper for access...? Any help much appreciated! Thanks, Alex -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/20c5fc39-42dd-4f96-af8e-bf83af0904e2%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Cant delete old applications
Hello. I'm trying to delete my old apps (on both Master/Slave and High Replication). But when I Disable App - the button Delete appear. When I press on Delete button - the error message appear: Server Error A server error has occurred. Url address is: https://appengine.google.com/disabling/delete.do -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/2ff0c8a9-9bc4-4b5d-9429-6aa1bb51a00c%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Replacing local blobstore with cloud storage, what is the replacement for BlobstoreLineInputReader?
This is a python appengine question, mapreduce 1.9.21 I have code writing lines to a blob in the local blobstore, then processing that using mapreduce BlobstoreLineInputReader. Given that the files api is going away, I thought I'd retarget all my processing to cloud storage. I would expect to find a class called GoogleCloudStorageLineInputReader, but there isn't anything like that. Is there something way I can use GoogleCloudStorageInputReader to read lines? Another possibility is using GoogleCloudStorageRecordInputReader, but for that my input file needs to be in LevelDB format and I don't know how to create that except with a GoogleCloudStorageConsistentRecordOutputWriter, which I don't know how to use outside a mapreduce context. How might I do that? Or am I doing this all wrong, is there some other possibility I've missed? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/062df9e9-c3ff-4cec-b454-6ceafd5c62a8%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
