[google-appengine] Re: Broken blobstore files - what to do?
Can you contact me with some more info? (The blob key, etc.) On Thursday, August 29, 2013 1:16:44 PM UTC-7, Alex Burgel wrote: I've noticed a bunch of images that my users have uploaded to blobstore are inaccessible. When I try to view the file in the dashboard Blob Viewer, I get a 500 error. I can't download or access the data in any way. I've filed a production issue on this but have not heard back. I've only recently become aware of this issue, so I do not know how wide spread it is. Things I've discovered: 1. Some images that were recently uploaded (past 24 hours) are inaccessible (500 errors). 2. I know of at least 1 image that was uploaded 18 months ago, which was accessible, has become inaccessible. I know it worked in the past because I can still see a cropped version that as created by the Image Service. 3. When I say inaccessible, I mean that I can't download the blob data. I am able to see the blob meta data (file size, creation date, etc.) in the Blob Viewer Has anyone else had experience with this issue? Even if my users are uploading broken/invalid images or other files, I feel like I should be able to download that file from blobstore to examine it. I would appreciate any help on this. Thanks! --Alex -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Redirect loop logging in
Hi Nathan, This is typically an issue with the Admin Console. You can file a production bug as Sebastian Kreft suggested in the Stack Overflow thread; if you do so, please specify the time when it happened as close as possible so we can debug it more easily. (Or reply here.) I have reset some state with your 'nathan.toone' account; if that works please note that; I do not expect it to resolve the issue but it may. --Matthew On Friday, August 2, 2013 2:53:57 PM UTC-7, toonetown wrote: I am having a problem logging in to the appengine console using certain accounts on my google apps domain (but not others). No matter what browser I use (Firefox, Chrome, Safari, IE), I get a too many redirects error on https://appengine.google.com/start when I try to log in using a specific account. I have tried resetting all the browsers as well (clearing all cookies, cache, etc - even trying it on a clean install of an OS) - with no luck. Going directly to https://appengine.google.com/a/domain.name causes the same loop for those accounts. The same thing happens when running the browsers with privacy mode enabled. One of the accounts having problems is the user nathan.toone on the k9webprotection.com google apps domain - however we can log in with the user admin or the user build-agent on the same domain just fine (but not build.agent or user2). It seems to be all over the place as to which accounts are able to log in without the redirect loop and which ones aren't. I have contacted google apps for your domain support, and they have said that it is outside their scope. They very helpfully pointed me to https://developers.google.com/appengine/kb/general - which didn't help *AT ALL*. :( Again - the odd thing is that there are some of the accounts on the same domain that are able to log in just fine. Does anyone have any idea what could be happening, or have a way for me to contact someone to get this worked out? I have found a couple of other people saying they have had this problem, but have not been able to encounter a solution. -Nathan -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: saving google user details to datastore... but will they be kept to update?
Unfortunately no. I recommend never storing a UserProperty in the datastore. Instead, record the user_id and also you may wish to save the last email address/nickname/etc information you have seen for the user. You may be interested in https://developers.google.com/+/features/sign-in although this is independent of the Users API. On Thursday, July 25, 2013 6:06:50 AM UTC-7, Aidan Mack wrote: Hi, If I save details to the datastore with something like User user = userService.getCurrentUser(); Entity greeting = new Entity(Greeting, guestbookKey); greeting.setProperty(user, user); That user then changers their nickname, I then query the datastore for that greeting entity. I then display properties from the user object I saved will those details be up to date? so will it now show the users new nickname? If not can I save the userID and then is their an api to get user details based on an ID? Thanks Aidan -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: Frustrated by logs
The instance is available today in the logs you can download. I recently updated logparser.py to not fail when it shows up in the logs. https://code.google.com/p/google-app-engine-samples/source/browse/trunk/logparser/logparser.py (Looks like I didn't update the docstring for this, but the fundamentals are correct.) On Friday, May 24, 2013 12:24:24 PM UTC-7, Takashi Matsuo (Google) wrote: As Vinny said, certainly BigQuery is something you can consider. Here is another project for ingesting App Engine logs into BigQuery: https://code.google.com/p/log2bq -- Takashi On Fri, May 24, 2013 at 11:49 AM, Vinny P vinn...@gmail.com javascript: wrote: Hello Kristopher, On Friday, May 24, 2013 10:51:23 AM UTC-5, Kristopher Giesing wrote: I'm getting enormously frustrated by this. Am I missing something about the admin console, or is its search function really this broken? Is there some way to get more verbose logging from the logs-download feature of appcfg.sh? Yup, you're correct. Searching logs can be a PITA. Personally, I use a combination of a homebuilt logging inspector (a backend using the Logging API to inspect error logs) and Google BigQuery to analyze my logs. Streak wrote up a blog entry about using Google BQ to inspect logging, you can read it here: http://blog.streak.com/2012/07/export-your-google-app-engine-logs-to.html . - -Vinny P Technology Media Advisor Chicago, IL My Go side project: http://invalidmail.com/ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com javascript:. To post to this group, send email to google-a...@googlegroups.comjavascript: . Visit this group at http://groups.google.com/group/google-appengine?hl=en . For more options, visit https://groups.google.com/groups/opt_out. -- Takashi Matsuo | Developers Programs Engineer | tma...@google.comjavascript: -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: All my users are getting Please use https://accounts.google.com/ServiceLogin instead. Infinite loop
I'm not seeing this on test app. To debug futher, more details are needed. * What is the URL you are seeing this message on? * Does it happen for all browsers? (Well, more specifically what browser are you seeing it on?) * Maybe other info, like what appid, etc. * Are you seeing any useful information in your debug logs? On Friday, January 18, 2013 6:50:08 AM UTC-8, Matt Sullivan wrote: https://dl.dropbox.com/u/2334191/Screen%20Shot%202013-01-18%20at%209.46.09%20AM.png I have an app that has been stable and running for some time and starting sometime at about 12am EST yesterday all my users started getting a accounts message / infinite loop. I am using the pythons api to generate the login url: from google.appengine.api import users.create_login_url any ideas? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/CpKY-xZS8eYJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Datastore Admin problem - too long name
The simplest workaround is to replace -dot-latest-dot- with just -dot-. On Monday, December 31, 2012 3:36:49 AM UTC-8, Oleg Bashtenko wrote: Hi guys! I've got a big problem with Datastore Admin. I have two Java applications with IDs '*dev-tcs*' and '*teamwork-client-services*'. Both of them have a non-default Python version for Datastore Admin purposes. In the first one, Datastore Admin works perfectly. But in the second one, I can't access it due to DNS error. It seems to be that an automatically generated URL, * ' ah-builtin-python-bundle-dot-latest-dot-teamwork-client-services.appspot.com '*, is too long for DNS lookup (it has more than 63 characters). I can't rename the application or change its ID, I can't manually set an alias for it, copying application to another ID is not an option too (I have billing set up for this app!). So is there any way to access Datastore Admin for my application? I need it to import my data to datastore, and I'm stuck with this. Or why the limit for application ID is still 30 chars while Datastore Admin fails if there are more than 10 ? Could anyone help me please? Thanks in advance, Oleg -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/gcg7fxWfZ-AJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Unable to use bulkloader
The simple workaround is to use --url and not specify the application flag at all. Or the directory (which in turn loads the appid from the app.yaml file). I'll go update the docs to suggest that instead of the others--it does some of each now. On Jun 26, 1:14 am, LaFolle fghj...@gmail.com wrote: Thanks a lot. That did solve the problem. On Tuesday, 26 June 2012 04:34:51 UTC+5:30, pdknsk wrote: This bug was introduced with HRD. I'm surprised Google has still not fixed or at least documented it. The fix is posted at the following link. https://groups.google.com/group/google-appengine/msg/092f97bd2ec83bbd -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: I am getting 409 Conflict error during deployment
Hi, This is probably a known issue we should have fixed soon. It relates to the new feature where we raised the Application Code Limits from 150MB/version to 1 GB/application. --Matthew On Jun 27, 12:29 am, openentry openent...@gmail.com wrote: *Here is the full deployment process console message* * * Deploying frontend *Preparing to deploy:* Created staging directory at: 'C:\Users\Sambhu\AppData\Local\Temp\appcfg6689186614854915385.tmp' Scanning for jsp files. Compiling jsp files. Scanning files on local disk. Scanned 250 files. Scanned 500 files. Scanned 750 files. Scanned 1000 files. Scanned 1250 files. Scanned 1500 files. Scanned 1750 files. Scanned 2000 files. Scanned 2250 files. Scanned 2500 files. Scanned 2750 files. Initiating update. Cloning 1112 static files. Cloned 100 files. Cloned 200 files. Cloned 300 files. Cloned 400 files. Cloned 500 files. Cloned 600 files. Cloned 700 files. Cloned 800 files. Cloned 900 files. Cloned 1000 files. Cloned 1100 files. Cloning 1764 application files. Cloned 100 files. Cloned 200 files. Cloned 300 files. Cloned 400 files. Cloned 500 files. Cloned 600 files. Cloned 700 files. Cloned 800 files. Cloned 900 files. Cloned 1000 files. Cloned 1100 files. Cloned 1200 files. Cloned 1300 files. Cloned 1400 files. Cloned 1500 files. Cloned 1600 files. Cloned 1700 files. *Deploying:* Uploading 0 files. Initializing precompilation... Deploying new version. on backend null. java.io.IOException: Error posting to URL:https://appengine.google.com/api/appversion/isready?app_id=goecatalog... 409 Conflict *Deployment of this version has not yet started.* * * I have tried deploying to a new version, updating old version as well as deployed after rollback but same problem, plz help. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: I am getting 409 Conflict error during deployment
The fix should now be live. On Jun 27, 4:08 pm, Takashi Matsuo tmat...@google.com wrote: Hi openentry, We're aware of this issue and working on the fix. Can you file an issue with your app-id? Sorry for the convenience. -- Takashi On Jun 27, 2012 1:02 PM, openentry openent...@gmail.com wrote: *Here is the full deployment process console message* * * Deploying frontend *Preparing to deploy:* Created staging directory at: 'C:\Users\Sambhu\AppData\Local\Temp\appcfg6689186614854915385.tmp' Scanning for jsp files. Compiling jsp files. Scanning files on local disk. Scanned 250 files. Scanned 500 files. Scanned 750 files. Scanned 1000 files. Scanned 1250 files. Scanned 1500 files. Scanned 1750 files. Scanned 2000 files. Scanned 2250 files. Scanned 2500 files. Scanned 2750 files. Initiating update. Cloning 1112 static files. Cloned 100 files. Cloned 200 files. Cloned 300 files. Cloned 400 files. Cloned 500 files. Cloned 600 files. Cloned 700 files. Cloned 800 files. Cloned 900 files. Cloned 1000 files. Cloned 1100 files. Cloning 1764 application files. Cloned 100 files. Cloned 200 files. Cloned 300 files. Cloned 400 files. Cloned 500 files. Cloned 600 files. Cloned 700 files. Cloned 800 files. Cloned 900 files. Cloned 1000 files. Cloned 1100 files. Cloned 1200 files. Cloned 1300 files. Cloned 1400 files. Cloned 1500 files. Cloned 1600 files. Cloned 1700 files. *Deploying:* Uploading 0 files. Initializing precompilation... Deploying new version. on backend null. java.io.IOException: Error posting to URL: https://appengine.google.com/api/appversion/isready?app_id=goecatalog... 409 Conflict *Deployment of this version has not yet started.* * * I have tried deploying to a new version, updating old version as well as deployed after rollback but same problem, plz help. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/HPOU67iMhTIJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: lost access to appengine projects
It looks like you using a Google Apps account. Has it gone through the transition to the new accounts infrastructure? ( http://support.google.com/a/bin/answer.py?hl=enanswer=182075 )? If not, I suspect you've hit a recent bug which should be fixed soon. The workarounds are: a) Transition your account. This will make it work immediately; I'm uncertain as to what cases you wouldn't want to do this. b) Send me (privately) your apps and an alternate account (e.g. a gmail account) and we can add that account as an additional admin to the apps. Once the bug fix is rolled out, you can remove the alternate account as an admin. --Matthew On May 16, 10:57 am, Chris Snyder casny...@pennswoods.net wrote: Thank you. I have tried that. Clearing all the cookies, different browsers, different computers, I still get the same bizarre (to me) error message. The application Admin Console is requesting permission to access your Google Account. Please select an account that you would like to use. I get this even if I've cleared all the cookies from the browser and then go directly tohttps://appengine.google.com/a/pennswoods.net. If I go tohttps://appengine.google.comit will let me sign in just fine, but _that_ account is empty of projects. On Wed, May 16, 2012 at 1:52 PM, Barry Hunter barrybhun...@gmail.com wrote: Can someone please suggest something? Suggest logging out, clearing all your google.com cookies, and then trying again. Sounds like your multi-logon has got confused. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Connect GAE with CLOUD account?
https://developers.google.com/appengine/docs/python/googlestorage/overview On May 2, 11:35 pm, James Gilliam jimgill...@gmail.com wrote: Has nobody done a GAE backup to the google cloud storage ? On May 2, 12:02 am, James Gilliam jimgill...@gmail.com wrote: I created a google cloud account for storage and a bucket ... When I enter the bucket in the Datastore Admin after I indicate I want to backup to Cloud, I get a message that the bucket is not accessible ... So, how do I connect my gae account with the google cloud account ... ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: URGENT main url path: /, not serving.. but getting 200 response
Typically a 204 with nothing run is simply a signal that your content has been cached elsewhere in Google's network. If you responded with cache-control: public with a max-age of something, it may be cached until that expires. Without futher info (such as an appid or the domain), it's hard to tell what's going on. On Apr 27, 11:34 am, Gregory Nicholas faction.greg...@gmail.com wrote: really need help.. i'm at a place where i can't really fix this on my own.. it's 11:00am.. been trouble shooting this since 9pm last night (thank god for adderall) *Preface (kinda):* - we've been working with appengine for a couple years now (haven't seen everything, but been through a lot of troubleshooting) - python 2.7, webapp 2.3, django 1.2, HRD - absolutely NO issues with local dev environ, production issue only *Issue / Symptoms:* - only the main url path: / for my app domain is not serving the request to my app - essentially breaks down to only the home page not working on http://www.domainname.com - the main url path for the appspot domain: http://domainname.appspot.com serves - request is routed properly from the app.yaml to my request handler - on http://domainname.com, any request to a subpath STILL WORKS! - ex: http:// domainname .com/user/login serves, works - the request IS hitting my application: - attached is a screen shot of my app logs, where the main path serves - not hitting my app.yaml file, and not routed to any request handlers - appears as though my code is never being executed for the request *What I've tried:* - i telnet'ed and tracerouted the domain name to rule out it being a DNS issue - see attached terminal screenshot - i've redeployed my app several times - i reverted the default version to a previous version - i've shutdown any instances several times - i switched from automatic instance allocation to manual, switching from F1 to F2 classes PLEASE HELP!!! Screen Shot 2012-04-27 at 11.14.15 AM.png 193KViewDownload Screen Shot 2012-04-27 at 11.31.23 AM.png 156KViewDownload -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Disabled application has not been deleted for over a year. How to get it removed?
Something must have happened when the app was supposed to have been deleted and it didn't complete the process. You can revert the deletion request then click the 'delete' button again, which should trigger deletion 3 days from when you do that. On Apr 1, 12:01 pm, Sologoub peter.solog...@gmail.com wrote: I have an application that I disabled and requested permanent deletion over a year ago. It's still showing up and nothing has been deleted. When I go into Application Settings and go to the deletion menu, I see the following note: Deletion of this application has been requested by my google account. *This application will be deleted after September 17, 2010 21:23 PM (US/Pacific time).* Until then you can still revert the deletion request. Do you want to revert the deletion request? I need the extra space to start new application. What should I do now? Thanks for any help. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: fastest way to serialize db.Model(s) to json?
the most concise code is probably db.to_dict. this is roughly the same code path used in db.model_to_protobuf On Jan 17, 9:37 am, Andreas a.schmi...@gmail.com wrote: so i tried to port my app to python 2.7 but atm it is too complex to do and i really dont think there will be a massive speed improvement. think ill pre-serialize my objects (somehow like gregory suggested) which should bring the serialization down a few seconds. On Jan 16, 2012, at 8:46 PM, Kyle Finley wrote: aschmid, Are you running python27? If so you should see some improvement by importing json instead of simplejson. http://stackoverflow.com/a/8191970/236564 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visithttps://groups.google.com/d/msg/google-appengine/-/GFQ13LeHVP4J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: How to detect a Google Apps domain?
I'm not sure if you can easily identify this from a Federated Login account. If you are using Google Accounts for your app, you can see the information in the USER_ORGANIZATION for the currently logged in user. The article at http://code.google.com/appengine/articles/auth.html should be updated soon to reflect this. On Nov 16, 11:06 am, Timofey Koolin timo...@koolin.ru wrote: For example header Server: Google Frontend in http-response or cname to ghs.google.com be dns request for domain. 2011/11/16 Daniel Florey daniel.flo...@gmail.com Hi, I'd like to find a proper approach how to detect a Google Apps user/domain name. I'm using OpenID and users are logging in with transitioned Google Apps accounts. Any ideas? Thanks, Daniel -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/BH_ypgMu0UUJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Blog:www.rekby.ru -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[appengine-java] Re: Automatically increment version number
Or you could simply use the -V flag in appcfg. (Recently added to Java.) On Oct 4, 10:31 am, Ronoaldo José de Lana Pereira rpere...@beneficiofacil.com.br wrote: Since you are using a shell script, you may want to try something smaller that don't require you to add Ant to your deploy proccess (i.e., if your app is in Python): sed -e s/@version/$(hg id -i)/g appengine-web.xml.in appengine-web.xml This is just a in-mind-one-liner script, not sure about this particular sed syntax ;) Best Regards, -Ronoaldo -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: Remote API: how to find out the app ID of the server??
With the Python version if you don't pass the appid at all when you configure the remote_api, it will set it for you--possibly in the environment variable which app_identity.get_application_id will recognize. though you actually want the full appid (from the APPLICATION_ID environment variable) if you're creating datastore keys. With Java, I'm not sure but it's the same idea. On Sep 11, 12:35 pm, andrew andrew.macken...@bcntouch.com wrote: Hi Fred, This week we planned to look at something very similar, so maybe we can share notes. I notice that if you enable datastore admin, there seems to be an option to export datastore to another appid. To be seen how it handles keys, namespaces, etc. That won't cover export to local though. Andrew -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: How can I use app_identity to auth between two apps?
Indeed there is no way at this time to request the token for the scope of another app engine app. While this is a very valuable use case, it's also a tricky one. However there is another mechanism you can use--the same one used by datastore_admin to copy data between apps. In many situations, App Engine will set a X-AppEngine-Inbound-AppId header when one app calls another app; if this is set, it should be trustworthy. More info: http://groups.google.com/group/google-appengine/browse_thread/thread/ef494f245c9e8076 http://code.google.com/appengine/docs/adminconsole/datastoreadmin.html#Grant_Permission_to_Write_to_the_Target_App --Matthew On Aug 31, 6:21 pm, pdknsk pdk...@googlemail.com wrote: I've figured it out: it doesn't work like that, but IMO it should. That'd be quite nice. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: SDK Upgrade 1.5.2: --datastore_path ignored?
That's a clever way to update the appid. I do not know if it works for all cases (e.g. it may not work for all reference properties (stored keys)) but is a neat trick. Another way to deal with it is to use the --default_partition= flag rather than using an older version of the sdk. --Matthew On Jul 22, 12:17 pm, c h how...@umich.edu wrote: hi all, i *think* that it is honoring your datastore location (though the log message is incorrect), but the change to rename your application to dev~your appname in development has just rendered all of our test data useless. after re-importing my test data it does look like it is stored where i ask it to be, but under the new application name. if you are lucky enough to be using sqlite you can connect to the db and rename some tables to get it to work: sqlite3 local_appname_dev_sqlite.datastore sqlite .tables Apps IdSeq Namespaces appname!!Entities appname!!EntitiesByProperty appname!namespace!Entities appname!namespace!EntitiesByProperty sqlite alter table `appname!!Entities` rename to `dev~appname!!Entities`; sqlite alter table `appname!!EntitiesByProperty` rename to `dev~appname!!EntitiesByProperty`; sqlite alter table `appname!namespace!Entities` rename to `dev~appname!namespace!Entities`; sqlite alter table `appname!namespace!EntitiesByProperty` rename to `dev~appname!namespace!EntitiesByProperty`; where you substitute 'appname' for your application's name, and 'namespace' for your datanamespace. cfh -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 1.5.2 SDK Prerelease
Hi PK, The dev~ prefix is there to more closely replicate what happens for many apps running on the App Engine servers: they have a s~ in the APPLICATION_ID environment variable. (Specifically, the ones running on the High Replication Datastore). This will help developers identify where they're relying on it. You should use the new (and possibly not yet included in our docs--if not, it will be soon) app_identity API. from google.appengine.api import app_identity appid = app_identity.get_application_id() Is this what is causing you issues? As a workaround (or if you want to simulate the behavior of the Master/ Slave datastore), you can use --default_partition= on the command line, but you should move your application to use the API method. Also note that if you have existing information in your dev appserver datastore, it will appear to have flushed when the full appid changes (from appid to dev~appid); you can use the flag to keep it as before, or use the bulkloader to dump/restore across app ids. --Matthew On Jul 13, 1:06 am, PK p...@gae123.com wrote: A lot of great long expected features. Thanks!! I just started to experiment and the dev~ prefix is breaking scripts and processes I have been using. What motivated this change? Thanks PK -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 1.5.2 SDK Prerelease
Hi PK, You shouldn't do any sort of special checks. Instead, use the API. In the case of remote_api, don't specify the appid at all. Instead, specify the endpoint (e.g. a.appspot.com/_ah/remote_api or localhost: 8080/_ah/remote_api). The tool will look up the app id. --Matthew On Jul 13, 1:51 pm, PK p...@gae123.com wrote: Matthew, thanks for the reply. In our tests we use remote API extensively. The same datastore is updated from either the server or remote API code. The remote API scripts need to be given the appid and we have an environment variable defining it. Of course this is now broken. I am retreating to a mechanism that says if you are operating agains the dev datastore then the APPID is dev~ + real_app_id else it is real_app_id, I am hopeful this will fix the issues. Between working around this issue and the further regression of 3643 (see my comment there) I have not yet been able to pass our automated tests with 1.5.2_prerelease Anyway, I am optimistic, and look forward to starting simplifying some of my indexes next. I have been waiting for more than a year for that :-) Thanks, PK -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Why did my appcfg.py command fail after upgrade from 1.4.3 to 1.5.0?
I cannot reproduce this but could see what may be happening. What is new in 1.5.0 is that we try to autodetect the appid in more cases, what exact command line were you useing? If you change remote_api_stub.py, line 502 from this: if app_info['rtok'] != remote_token: to this: if str(app_info['rtok']) != remote_token: then it should work--let me know. --Matthew On May 23, 1:13 pm, Hans-Joachim Belz flusskontro...@googlemail.com wrote: Hi! I had the same error. After adding --application app-id to the appcfg.py download_data command every thing worked fine again. Something seems to go wrong when appcfg.py attempts to look up the app id by itself. Seehttp://code.google.com/intl/de-DE/appengine/docs/python/tools/uploadi... for all options. Regards, Achim. On 11 Mai, 21:26, 종덕 안 human.z...@gmail.com wrote: Here is error message.. Uploading data records. [INFO ] Logging to bulkloader-log-20110512.041821 [INFO ] Throttling transfers: [INFO ] Bandwidth: 25 bytes/second [INFO ] HTTP connections: 8/second [INFO ] Entities inserted/fetched/modified: 20/second [INFO ] Batch Size: 10 Please enter login credentials for eztripon.appspot.com Email: human.z...@gmail.com Password for human.z...@gmail.com: Traceback (most recent call last): File /usr/local/bin/appcfg.py, line 76, in module run_file(__file__, globals()) .. File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/ GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/ google/appengine/ext/remote_api/remote_api_stub.py, line 502, in GetRemoteAppIdFromServer repr(app_info['rtok']))) google.appengine.ext.remote_api.remote_api_stub.ConfigurationError:Tokenval idationfailedduringapp_idlookup. (sent '612758995518', got 612758995518) because of my mail-id format? e.g .x...@gmail.com.. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: i deleted my app , but still its working
This should not happen--when you disable an app, it should stop working within seconds. (Or in certain unusual cases, within minutes.) When you request deletion, it takes a few days, but you can only do that after the app is disabled. As Brandon notes, there are a variety of caches which may cache data, but 'cache busting' techniques like ?123 should demonstrate that. I just tested this with a test app so the system in general appears to be working. We'd need more information to debug a particular problem. On May 8, 11:11 am, Brandon Wirtz drak...@digerat.com wrote: Look at that level of Uptime. You ask for it to be up for 8 hours it's up for 24. That's 300% uptime. No other platform delivers that. How long has it been? I have seen Google Edge Cached versions of static files work for 24 hours after they stopped existing. I could believe that the same would be true for a deleted app, but I'd have thought that if you put ?123 at the end of the url to cache break they'd be gone. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of trabzony gt Sent: Sunday, May 08, 2011 1:37 AM To: google-appengine@googlegroups.com Subject: [google-appengine] i deleted my app , but still its working hello , I deleted my app from the administration panel , but still i can see it live . i dont see it in the administration panel now . any ideas . ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Prerelease SDK 1.5.0 available for download
Hi Felippe, Thanks for asking. I've updated that bug with the following comment: In 1.5.0 (prerelease available today), we have added the functionality to get the application ID from the URL more easily. The recommendation is to, instead of specifying an application, specify a URL to remote_api. The tool will then read the application ID from remote_api. This also works well for applications behind custom domains (e.g. if you've set up yourapp.example.com/_ah/ remote_api, you can simply use that.) For appcfg.py (or bulkloader.py) specify --url http://yourapplicationid.appspot.com/_ah/remote_api . For remote_api_shell.py specify -s yourapplicationid.appspot.com . (I'm not sure what appengine_console.py is, if it's the example in the remote_api article you can consider using remote_api_shell instead). For custom usage, if you pass the 'servername' to ConfigureRemoteApi you can pass None for the app_id. --Matthew On May 3, 11:26 am, Felippe Bueno felippe.bu...@gmail.com wrote: Really great job :) Congrats Appengine Team. Ikai, any news abouthttp://code.google.com/p/googleappengine/issues/detail?id=4374(HR Datastore Applications cannot use remote_api, appengine_console.py or Bulkloader due to s~ App ID) ?? I did not test it again. Thanks. On Tue, May 3, 2011 at 2:20 PM, Ikai Lan (Google) ikai.l+gro...@google.comwrote: Hey everyone, Prerelease SDK 1.5.0 is ready for download! There are a ton of bug fixes in this release as well as some pretty big features. Check it out. You can get the SDKs here: http://code.google.com/p/googleappengine/downloads/list The release notes are below. You'll notice that they're much longer than usual. We've listed out many of the bugs in the public issues tracker we've addressed. Python == - Support for Backends which allow developers to create infrastructure components that complement the existing dynamic apps which App Engine already provides. Instances of a backend can maintain state, be addressed individually, and are not subject to per-request time limits. They can also be configured to consume more memory and CPU than ordinary dynamic instances. - Task Queues support pull mode, allowing for more control over task queue work rates. To use pull queues, include the 'mode' argument in your queue.yaml. - Pull queues are supported by a REST API, allowing access from outside App Engine. To use the REST API, you must also include a valid ACL section specifying which users can lease tasks from the pull queue. - Task Queue payload limits have been increased. Push queues now support 100KB per task, pull queues support 1MB per task. Within App Engine, the new limit is 32 MB per batch of tasks. With the REST API the limit is 1 MB per batch. - HTTP request and response sizes have been increased to 32 MB. - We have removed the rate quotas for requests, datastore operations, memcache operations, and image API operations. Resource quotas still apply. - When creating new applications, developers will now see the High Replication Datastore as the default configuration option. Developers that still wish to use the Master/Slave configuration must explicitly choose this option at application creation time. - The Task Queue maximum configurable processing rate has been increased to 500/s. - All application Owners, as listed in the Admin Console, can download the app's code, unless code download is disabled for the application. - Added db.py support for making calls to the datastore asynchronously. Available functions are get_async(), put_async(), delete_async(), allocate_ids_async(). Call get_result on the return value of asynchronous datastore functions to block on the call. - Metadata queries can now get all namespaces, kinds, and properties in a given range. - The Testbed API now supports the Channel API. - Users can provide Django settings to be loaded in webapp's django_setup. - Modified Dashboard latency graphs to indicate they only include dynamic requests. - Fixed an issue where Federated User data didn't survive a get-put-delete operation cycle. - Fixed an issue where metadata queries did not support unicode characters. - Fixed an issue where HTTP headers could contain new line characters. - A warning message is shown when the Python version used to run the SDK is different than the Python version used in production. - Fixed an issue with Federated Users causing the Admin Console dataviewer to fail. http://code.google.com/p/googleappengine/issues/detail?id=384 - MacOS and Windows style newlines are now supported for logging in the SDK. http://code.google.com/p/googleappengine/issues/detail?id=560 - Fixed an issue where sending mail with smtp_host set did not work. http://code.google.com/p/googleappengine/issues/detail?id=626 - Fixed
[google-appengine] Re: automate user input in bulkloader's appcfg.py?
This should help: http://groups.google.com/group/google-appengine/browse_thread/thread/86457b3a95e30a5a --Matthew On Dec 14, 11:02 am, GK guruko...@gmail.com wrote: Hi, I want to write a python script which will automate the bulkloading process by writing a csv file, then running appcfg.py by using a command like os.system(appcfg.py ... ) The problem is I am having trouble automating user input when appcfg.py asks for authentication. I tried writing a text file called input.txt with the authentication details (it looked like this: myem...@gmail.com MyPassword and then running appcfg.py input.txt and this worked for the email, but not for the password. Would it be possible to modify appcfg.py to take the username and password as arguments, so that I could run the script like this: appcfg.py username=myem...@gmail.com pass=MyPassword ? Or could I simply hardcode the username/password in appcfg.py? What file would I have to modify in order to do this? Is there any easier way in python to automate user input? Any help would be appreciated. Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Prerelease SDK 1.4.0 is out!
SSL support for OpenID should be live now. There was an issue which prevented it from being released at the same time as the 1.3.8 release but that issue has since been fixed. --Matthew On Nov 18, 4:38 pm, Alexandre Vivien alx.viv...@gmail.com wrote: Hi Ikai, What about the OpenId SSL support? Is it part of this release ? Regards, Alexandre Vivien On 18 nov, 17:27, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey everyone, I just wanted to let everyone know that prerelease SDK 1.4.0 is out! Get it from the Google Code project: http://code.google.com/p/googleappengine/downloads/list We're still working on the docs and will have them ready for the final release, so if there are any questions about how to use the new features, feel free to ask on this thread and I'll do my best to clarify them. The release notes are below. This is an EXCITING release: Python - The Always On feature allows applications to pay and keep 3 instances of their application always running, which can significantly reduce application latency. - Developers can now enable Warmup Requests. By specifying a handler in an app's app.yaml, App Engine will attempt to to send a Warmup Request to initialize new instances before a user interacts with it. This can reduce the latency an end-user sees for initializing your application. - The Channel API is now available for all users. - Task Queue has been officially released, and is no longer an experimental feature. The API import paths that use 'labs' have been deprecated. Task queue storage will count towards an application's overall storage quota, and will thus be charged for. - The deadline for Task Queue and Cron requests has been raised to 10 minutes. Datastore and API deadlines within those requests remain unchanged. - For the Task Queue, developers can specify task retry_parameters in their queue.yaml. - Metadata Queries on the datastore for datastore kinds, namespaces, and entity properties are available. - URLFetch allowed response size has been increased, up to 32 MB. Request size is still limited to 1 MB. - The Admin Console Blacklist page lists the top blacklist rejected visitors. - The automatic image thumbnailing service supports arbitrary crop sizes up to 1600px. - Overall average instance latency in the Admin Console is now a weighted average over QPS per instance. - The developer who uploaded an app version can download that version's code using the appcfg.py download_app command. This feature can be disabled on a per application basis in the admin console, under the 'Permissions' tab. Once disabled, code download for the application CANNOT be re-enabled. - Fixed an issue where custom Admin Console pages did not work for Google Apps for your Domain users. - Allow Django initialization to be moved to appengine_config.py to avoid Django version conflicts when mixing webapp.template with pure Django. http://code.google.com/p/googleappengine/issues/detail?id=1758 - Fixed an issue in the dev_appserver where get_serving_url did not work for transparent, cropped PNGs: http://code.google.com/p/googleappengine/issues/detail?id=3887 - Fixed an issue with the DatastoreFileStub. http://code.google.com/p/googleappengine/issues/detail?id=3895 Java - - The Always On feature allows applications to pay and keep 3 instances of their application always running, which can significantly reduce application latency. - Developers can now enable Warmup Requests. By specifying a handler in an app's appengine-web.xml, App Engine will attempt to to send a Warmup Request to initialize new instances before a user interacts with it. This can reduce the latency an end-user sees for initializing your application. - The Channel API is now available for all users. - Task Queue has been officially released, and is no longer an experimental feature. The API import paths that use 'labs' have been deprecated. Task queue storage will count towards an application's overall storage quota, and will thus be charged for. - The deadline for Task Queue and Cron requests has been raised to 10 minutes. Datastore and API deadlines within those requests remain unchanged. - For the Task Queue, developers can specify task retry-parameters in their queue.xml. - Metadata Queries on the datastore for datastore kinds, namespaces, and entity properties are available. - URL Fetch allowed response size has been increased, up to 32 MB. Request size is still limited to 1 MB. - The Admin Console Blacklist page lists the top blacklist rejected visitors. - The automatic image thumbnailing service supports arbitrary crop sizes up to 1600px. - Overall average instance latency in the Admin Console is now a weighted average over QPS per
[appengine-java] Re: How to export logs details
You'll need to add the 'severity' flag, which will get all of the additional logs, but will suppress log lined without the additional application created logs. You may be interested in http://groups.google.com/group/google-appengine/browse_thread/thread/a8ec10b5f376920f which describes a (python implemented) parser for those logs. I imagine there are other tools which can handle them too. --Matthew On Nov 18, 3:00 am, Featheast Lee featheast@gmail.com wrote: Hi All, I would like to ask a question about how to export logs from App Engine server. Currently, inhttp://code.google.com/appengine/docs/java/tools/uploadinganapp.html there is a way to download the logs. However, after I followed the steps within, it seems the txt file will only record the request name but without more details. An example would be: 0.1.0.1 - - [18/Nov/2010:02:09:19 -0800] GET /cron/*** HTTP/1.1 200 0 - AppEngine-Google; (+http://code.google.com/appengine) 0.1.0.1 - - [18/Nov/2010:02:08:16 -0800] GET /cron/*** HTTP/1.1 200 0 - AppEngine-Google; (+http://code.google.com/appengine) In the server console logs, however, we are able to see all logs in more details including those added by developers. I wonder is there any way to also download those logs. Cheers! -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: Log Parser for downloaded request_logs
I'm glad you find it useful--once the logs are parsed you can filter them using sqlite3. At the moment, the request_logs tool only downloads logs by version and date--It look like you've filed http://code.google.com/p/googleappengine/issues/detail?id=2909 for this, if other people would find it helpful they may want to star it. --Matthew On Oct 12, 7:31 pm, vivpuri v...@vivekpuri.com wrote: Matthew Thank you for building this tool. While this tool helps, in my case, i am looking to download logs per request url, since downloading logs for complete app is not really required to fix specific issues. -V -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Log Parser for downloaded request_logs
Happy Monday! I recently posted a tool which lets you import the request logs downloaded from the App Engine Admin Console into a sqlite3 database. This is useful for ad-hoc analysis and aggregation. It also understands the logs which you as a developer wrote with logging.error or similar methods--I am not sure if any of the existing Apache Combined Log Format parsers understand that extension, it would be great if they did. You can also describe a custom column on those logs. You can view it at http://code.google.com/p/google-app-engine-samples/source/browse/trunk/logparser/logparser.py You can download using a subversion client, or directly at http://google-app-engine-samples.googlecode.com/svn/trunk/logparser/logparser.py Here are some examples from the docstring of the tool: Example: # Download request logs into requests.txt appcfg.py request_logs --severity 0 --include_all appdirectory requests.txt # Run the logparser to insert them into requests.db. # (You can specify multiple input files.) logparser.py --db requests.db requests.txt # Query them using the sqlite3 interactive command line interface. sqlite3 requests.db sqlite -- what are the most common 404s? sqlite select distinct request_line, count(*) from requests ... where status == 404 group by request_line order by request_line desc; sqlite -- what requests see 'Deadline Exceeded'? sqlite select distinct request_line from requests ... where applog like '%DeadlineExceeded%'; sqlite -- How many loading requests were seen? sqlite select count(*) from requests where loading_request=1; sqlite -- What was the average cpm across all pages? sqlite select sum(cpm_usd)/count(cpm_usd) from requests; The flag --custom_column widgets:^1:[0-9.]+ Found ([0-9]+) widgets will locate all Info logs (severity 1) which look like this: 1:1286325423.286856 Found 12 widgets and pull out the 12 part. Now you can run a query like these: sqlite -- How many widgets were seen? sqlite select select sum(widgets) from requests; sqlite -- What was the approximate the processing time per widget? sqlite select sum(cpu_ms)/cast(sum(widgets) as float) ... from requests where widgets ''; Let me know if you find this tool useful. --Matthew -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Allocating id's after import to another app
You should only need to call AllocateIds once for each kind. The bulkloader should do this when uploading data as of 1.3.8. Otherwise, I think error should eventually resolve on its own--every time you get the exception, it should advance the next id pointer pretty far, so you should only see it a few times. I haven't tested this myself. --Matthew On Oct 7, 9:36 am, Hugo Visser botte...@gmail.com wrote: Any suggestions? Would iterating the current entities and call the allocate function with those keys help? I'm getting errors on migrated data in production which is pretty bad. On Oct 6, 4:40 pm, Hugo Visser botte...@gmail.com wrote: I've imported data from one app id to another and now I'm getting spurious messages of duplicate id's, apparently because the id's are not automatically allocated. What would be the best strategy to allocate these id's again so that sequence generation will not attempt to use the existing id's? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[appengine-java] Re: Downloading application logs from app engine
You can download them using the --severity flag http://code.google.com/appengine/docs/java/tools/uploadinganapp.html#Command_Line_Arguments On Oct 2, 5:25 am, Vikas Hazrati vhazr...@gmail.com wrote: I guess copy paste is the only way out ;) On Sep 30, 5:45 pm, Vikas Hazrati vhazr...@gmail.com wrote: I am trying to download the application logs from the app engine but with the command that I am using appcfg.sh request_logs myapp/war 0051.txt I am able to get the app engine logs and not the ones that I get when i expand the logs. So in a nutshell instead of just this as a part of download 09-30 04:58AM 40.954 / 302 24240ms 22236cpu_ms 1080api_cpu_ms 0kb Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/534.3 (KHTML, like Gecko) Chrome/6.0.472.63 Safari/534.3,gzip(gfe) I would like to get the following logs which i see when i expand the above log in the admin console 09-30 04:58AM 40.954 / 302 24240ms 22236cpu_ms 1080api_cpu_ms 0kb Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/534.3 (KHTML, like Gecko) Chrome/6.0.472.63 Safari/534.3,gzip(gfe) [myappid/0-0-5-1.345167134118388057].stdout: 2010-09-30 11:58:45,996 INFO com.myapp.util.admin.LogLoadingRequest - GAE ALERT !! Loading request occuring. I 09-30 04:58AM 47.802 javax.servlet.ServletContext log: Initializing Spring root WebApplicationContext Regards | Vikas -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: [mapreduce] Can i run the tasks via code?
control.start_map is how you do this in python. i'm not sure of the java equivalent. On Oct 4, 10:49 am, Eli Jones eli.jo...@gmail.com wrote: Nevermind.. is see that you mean mapreduce jobs. I guess you could read the code they have for the page that lets you manually start the jobs.. then.. if you're lucky and clicking run really just fires off a call to a handler.. you can find out the parameters.. and configure a cron job to do the same thing. On Mon, Oct 4, 2010 at 1:40 PM, Eli Jones eli.jo...@gmail.com wrote: You could use cron jobs: http://code.google.com/appengine/docs/python/config/cron.html http://code.google.com/appengine/docs/python/config/cron.html On Mon, Oct 4, 2010 at 6:40 AM, BarrenTeam barren8...@gmail.com wrote: We actually run the jobs manually. Is there anyway to launch them automatically? For exemple through servlet? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Google Apps Full Accounts
That should work in either scenario. I just tried it with my account. Feel free to send the HTTP redirects privately to me, though I can't promise I'll have an answer. --Matthew On Aug 31, 1:58 am, Erik Karulf e...@penny-arcade.com wrote: Hi Matthew, The problem occurs if I try visiting either: http://appengine.google.com/a/penny-arcade.com/ orhttp://appengine.google.com/ I am prompted to login and I am redirected a few times until the system shows that error. It seems to be a conflict with the Google Multiple Sign In system. If I dedicate a Chrome incognito session to just my Google Apps account it still works. I can provide a trace of all the 301 responses if that helps, but I'm a bit wary about posting my authentication process on a public forum :) --Erik On Aug 30, 10:21 am, Matthew Blain matthew.bl...@google.com wrote: Hi Erik, Things should continue to work when you/your domain gets upgraded. Indeed the URL you have above is invalid, but I'm not sure what you did to get there--what did you go to to see this? Note that one of the advantages of the new system is that you no longer need to visit appengine.google.com/a/example.com, you can just log in at appengine.google.com. However, /a/example.comshould continue to work. --Matthew P.S. you should not need to do this, but you can try deleting all cookies (or use a browser in incognito mode to test.) On Aug 26, 6:13 pm, Erik Karulf e...@penny-arcade.com wrote: Hi All, Our domain was recently upgraded to the Google Apps Full Account system. However, when I try and login to Google App Engine, I get the following error: URL:https://appengine.google.com/_ah/login?continue=https://appengine.goo... Body: Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report your problem and mention this error message and the query that caused it. This persists for other users in my domain as well. Thanks! -Erik -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Google Apps Full Accounts
Hi Erik, Things should continue to work when you/your domain gets upgraded. Indeed the URL you have above is invalid, but I'm not sure what you did to get there--what did you go to to see this? Note that one of the advantages of the new system is that you no longer need to visit appengine.google.com/a/example.com, you can just log in at appengine.google.com. However, /a/example.com should continue to work. --Matthew P.S. you should not need to do this, but you can try deleting all cookies (or use a browser in incognito mode to test.) On Aug 26, 6:13 pm, Erik Karulf e...@penny-arcade.com wrote: Hi All, Our domain was recently upgraded to the Google Apps Full Account system. However, when I try and login to Google App Engine, I get the following error: URL:https://appengine.google.com/_ah/login?continue=https://appengine.goo... Body: Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report your problem and mention this error message and the query that caused it. This persists for other users in my domain as well. Thanks! -Erik -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: *.appspot.com certificate chain in Chrome, Safari and IE
This works for me on Windows 7. It's possible that the root certificates on your Windows machine are somehow missing the Equifax Secure Certificate Authority root certificate (also sometimes listed as GeoTrust)? Have you edited your list? I see a suggestion online to also check Windows Updates to see if there's a certificate update, though I believe this is not a recent CA. --Matthew On Aug 26, 10:45 am, Robert Kluin robert.kl...@gmail.com wrote: Interesting. You are right, I probably checked using a XP vm not a Win 7 vm. On Thu, Aug 26, 2010 at 10:44, Carlos Rodrigues cefrodrig...@gmail.com wrote: BTW, this is not a problem exclusive to GAE. The certificate for code.google.com also seems to have changed recently and I just got a warning from TortoiseSVN that the new certificate cannot be validated because the certificate chain is incomplete. Best regards, On Aug 26, 3:42 pm, Carlos Rodrigues cefrodrig...@gmail.com wrote: Since the problem only happens with browsers that rely on Windows' certificate infrastructure, the version of Windows matters. I've tested with IE 8 on Windows 7 and Windows Server 2008 and the problem occurs; I've also tested with IE 7 on Windows XP and Windows Server 2003 and the problem does not occur; I did not test with Windows Vista. It seems that older versions of Windows follow the certificate chain (by downloading it from somewhere), while the more recent versions only follow it if the webserver itself provides the intermediate CA's certificate (as I said, I've tested with other sites that use intermediate CAs and they show no errors - because the intermediate CA's certificate is being provided by Apache using the option I mentioned before). Best regards, On Aug 25, 10:19 pm, Robert Kluin robert.kl...@gmail.com wrote: I only get a certificate error if I go tohttps://test.xx.appspot.com. I do not get errors going tohttps://xx.appspot.com. I tested with IE and Chrome and Windows. Robert On Wed, Aug 25, 2010 at 05:27, Carlos Rodrigues cefrodrig...@gmail.com wrote: Hi again, Any ideas? This is a show-stopper as far as secure applications go... Best regards, On Aug 23, 12:39 pm, Carlos Rodrigues cefrodrig...@gmail.com wrote: Hi all, I'm developing a small application on GAE that requires HTTPs, however I'm having some trouble with the *.appspot.com certificate. O Chrome, Safari and IE on Windows I get a certificate validation error. This error appears to be related to the certificate validation path, because the topmost authority is Google Internet Authority and show as Not found. On Firefox there is no error, and the certificate chain correctly shows Equifax as the root CA and Google Internet Authority as an intermediate CA. On the Mac both Firefox and Safari work without showing any errors. Is there a way around this? I can't expect users to trust the application if they get a certificate error on Windows in every browser except Firefox. So a summary of tested browsers: * Internet Explorer 8 (Windows): error * Safari (Windows): error * Safari (OS X): OK * Chrome (Windows): error * Firefox (Windows): OK * Firefox (OS X): OK It appears that browsers which use the integrated certificate infrastructure on Windows are affected, and others are not. I know that Windows supports intermediate CAs because I've tested it. But it seems to require that the website itself provides the intermediate CAs certificate (for example, on Apache this would be the SSLCertificateChainFile /path/to/intermediate-ca.crt option). Google App Engine does not appear to do this. Best regards, Carlos Rodrigues -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[appengine-java] Re: Python bulk loader tool with local dev server of GAE Java
While the bulkloader may ask for a username and password, any username and password should be accepted by the dev_appserver. You can use the --email and --passin options to script this from the command line. On Aug 1, 10:33 pm, Jan jan.ja...@gmail.com wrote: Hi John, your remote-datastore tool looks great! Thank you very much for pointing me to it! I will have a look. It would still be a great improvement if Google's App Engine team could improve on the bulk loader or maybe even provide a Java version. That would complete an already excellent app hosting / development platform. Thanks a lot, Jan. On Aug 1, 11:06 pm, John Patterson jdpatter...@gmail.com wrote: You need to check out the source code (or even just copy and past the classes) into your own project - no downloads or jars (as stated on the project homepage) http://code.google.com/p/remote-datastore/source/checkout To insert data locally just call: RemoteDatastore.install(myAppId, war/); from a static initializer (or some other place guaranteed to only run once) and then you can use the datastore APIs from any Java code e.g. from a main(String[]) method. There is example code on the homepage using the low-level datastore API to insert data. I have used Twig to insert data too and JDO should work. If you need to read data from a CSV file you will need to parse the file and create Entities from it - there is an Apache CSV file reader you can use for that. On 2 Aug 2010, at 03:33, emmanuel harel wrote: John, could you give more information about how to use your library please ? I am not sure it is obvious for anyone. What are the dependencies of your project : the jar used. Thanks a lot 2010/8/1 John Patterson jdpatter...@gmail.com Hi Jan, I have used the Java RemoteDatastore to upload and download data in bulk. It allows you to use the low-level API, JDO, Twig, Objectify or whatever to store your data remotely or locally. http://code.google.com/p/remote-datastore/ On 1 Aug 2010, at 19:49, Jan wrote: Hi, I still did not find any solution to use the bulk uploader (now version 1.3.5) locally with GAE/Java. Communication with the production server works fine. As I cannot find any information about this issue, I assume that nobody else faces this problem. Can someone please post the steps necessary to make the Python bulk loader tool work locally with a Java app? Are there any alternatives available for the Python bulk uploader? Thank you, Jan. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com . To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com . For more options, visit this group athttp://groups.google.com/group/google-appengine-java?hl=en . -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com . To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com . For more options, visit this group athttp://groups.google.com/group/google-appengine-java?hl=en . -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com . To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com . For more options, visit this group athttp://groups.google.com/group/google-appengine-java?hl=en . -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: bulkloader -- download every Model except x ?
You could have your backup script get the list of kinds from the datastore stats. You can probably call the method in bulkloader.py which does this directly (though it's not guaranteed to always work the same way), or simply get inspiration from it. On Jul 31, 7:38 pm, Adam Sah adam@gmail.com wrote: Hi-- I'd like to backup every Model in my datastore *except* a given one(s). Yes, I can create a bulkloader file, and manually backup each Model using --kind... but this means that every new entity requires modifying the backup script, i.e. easy to forget and not be backed-up (scary). Any ideas? (and yes, I've considered the evil solution of scanning my source code for entity names...) thanks! adam -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[appengine-java] Re: How to upload primary key as an id instead of name
Sorry, this won't be available until 1.3.6. You should be able to do
something like this:
- property: __key__
external_name: CityId
export_transform: datastore.Key.id
import_transform: lambda value: datastore.Key.from_path('City',
int(value))
--Matthew
On Jul 10, 5:53 pm, Pasha pavel.selivers...@gmail.com wrote:
Could you please post an example. Thank you in advance.
On Jun 30, 1:18 pm, Matthew Blain matthew.bl...@google.com wrote:
The 1.3.5 bulkloader client will allow you to specify a numeric key;
you must use the Key constructor explicitly to do this, integers will
still be converted into strings.
On Jun 30, 12:12 am, MANISH DHIMAN manisd...@gmail.com wrote:
Hi All
When I upload data using CSV file on G A E. Primary key is stored
there as a name instead of id.
Example.
Format of .yaml is Given below
transformers:
- kind: City
connector: csv
connector_options:
encoding: utf-8
columns: from_header
property_map:
- property: __key__
external_name: CityId
export_transform: datastore.Key.id
- property: Name
external_name: Name
Primary key stored there is:
ID/Name Name
name=1 Delhi
name=2 London
Due to uploaded data with name=keyvalue, when I am try to get Key
from any Fetched Entities, then Key contains only name value but id
value is 0 and also name contains long value as a String instance.
Is it possible to store primary key(Using CSV while uploading data) in
a format given below :
ID/Name Name
id=1 Delhi
id=2 London
When data is stored with id=keyvalue, then Key contains id value is
keyvalue as long instance.
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: Trouble Setting App Engine ID
I just tried this and it worked for me. You can send me the details of the exact user name and error message you get privately and I'll try to take a look. On Jul 6, 11:24 pm, cwaldbieser cwaldbie...@gmail.com wrote: This does not appear to work for me. I have logged into the App Engine admin console using my gmail account. I try to create an app ID with the same name. The program refuses. Thanks, Carl On Jul 6, 3:17 pm, Matthew Blain matthew.bl...@google.com wrote: You should be able to create an application ID which matches an existing gmail account, but only when logged in to the current user. For example, if you have exam...@gmail.com and want to create example.appspot.com, you must log in to the App Engine admin console as 'exam...@gmail.com' and then create the 'example' application. You can then add additional developers to the application. --Matthew On Jul 5, 12:16 am, l.denardo lorenzo.dena...@gmail.com wrote: I think there's no way to do it. Gmail names seem to be locked for anyone, including the owner of the account. This happened to me too, and seems to be a frequent request from many of us. Regards Lorenzo On Jul 2, 9:03 pm, cwaldbieser cwaldbie...@gmail.com wrote: I read that if you have a GMail account, no one else can take that name for an App Engine ID. I created a GMail account with the name I wanted, but when I tried to create an app with that account, I was told by the page the name is taken! It was not taken prior to me creating the new GMail account. Am I blocking the name of the app ID I want? How do I correct this? Thanks, Carl -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Trouble Setting App Engine ID
You should be able to create an application ID which matches an existing gmail account, but only when logged in to the current user. For example, if you have exam...@gmail.com and want to create example.appspot.com, you must log in to the App Engine admin console as 'exam...@gmail.com' and then create the 'example' application. You can then add additional developers to the application. --Matthew On Jul 5, 12:16 am, l.denardo lorenzo.dena...@gmail.com wrote: I think there's no way to do it. Gmail names seem to be locked for anyone, including the owner of the account. This happened to me too, and seems to be a frequent request from many of us. Regards Lorenzo On Jul 2, 9:03 pm, cwaldbieser cwaldbie...@gmail.com wrote: I read that if you have a GMail account, no one else can take that name for an App Engine ID. I created a GMail account with the name I wanted, but when I tried to create an app with that account, I was told by the page the name is taken! It was not taken prior to me creating the new GMail account. Am I blocking the name of the app ID I want? How do I correct this? Thanks, Carl -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[appengine-java] Re: Any ETA for a backup/restore facility?
The bulk loader does indeed provide backup and restore functionality today. While the implementation is in Python it can talk to your Java server and the entities are shared between Java and Python. On Jun 28, 4:46 pm, mscwd01 mscw...@gmail.com wrote: Thanks for your replying guys, it would be great if we could get an official Google response to update us on this as well though! I'll definitely have a look at the Bulk Loader in the meantime... On Jun 28, 1:52 pm, Mike Dillon mikedillo...@gmail.com wrote: Mscwd01, I'm not a google employee, but I have had success backing up our datastore and then restoring our datastore with the bulkloader utility. Currently the bulkloader is in the python sdk, so all you need to do is download that and then youll be able to do backups and restore from those backups. Check out the literature on the app engine, and try a couple searches to get your bearings. Nick Johnson has commented or written every search result that comes back when I was researching this a couple of weeks back, and there is also an I/O video on the bulkloader. Make sure you read some of the fine print, i.e. one caveat is that you must have had your datastore populated for at least 12 hours which is the amount of time it takes for the statistics info to be built. That what the bulkloader works off of to do its datastore dump. - Mike On Jun 28, 7:16 am, mscwd01 mscw...@gmail.com wrote: Hey Google Employees, There has been a backup/restore facility on the roadmap for a while now. Can you let us know if and when we may get an in-built tool that will allow us to easily save the contents of the datastore to our local machines and restore it if needs be? In the meantime, what is the preferred solution to backup/restore our Java based apps? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: Bulkupload to local dev server -- key generation?
There is an issue in the Java dev_appserver which causes this to happen. I expect it will be fixed in the next release. The Python dev_appserver does not exhibit this if that is an option for you to test with. Note that I recommend upgrading to the 1.3.4 final release, but that should not have any effect on this issue. --Matthew On Jun 7, 7:24 pm, Craig Berry cdbe...@gmail.com wrote: I am attempting to populate a local dev db using bulk upload (the prerelease version, if that matters). This works fine when I do it to the production datastore at appspot, but when I connect to my local instance (http://localhost:/remote_api), I end up with exactly one record, with an ID of 0. My strong suspicion is that keys are not being generated for the records as they arrive, so they all end up rewriting that one record rather than getting stored as new ones. The __key__ definition fragment in my config file is - property: __key__ external_name: key export_transform: transform.key_id_or_name_as_string Again, this works exactly as expected for production datastore uploads. Any ideas how to make it work for local dev datastore uploads as well? -- Craig Berry -http://lapidum.org/home.html Magicians lie to the universe, and the universe believes them. -- Lenore Berry -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Auto Login on Bulk Down-loader
Take a look at the --passin flag.
On May 20, 3:39 am, Chris M pcdev...@gmail.com wrote:
Is there anyway to Auto-login on the bulk download tool.
I'm writing a batch file so I can schedule a download and delete every
night and Im stuck as the thing requires a login and there doesn't
seem to be any parameters to pass this in the request.
Any help greatly appreciated!
echo on
REM ## Tracker
@echo off
FOR /F TOKENS=1* DELIMS= %%A IN ('DATE/T') DO SET CDATE=%%B
FOR /F TOKENS=1,2 eol=/ DELIMS=/ %%A IN ('DATE/T') DO SET mm=%%B
FOR /F TOKENS=1,2 DELIMS=/ eol=/ %%A IN ('echo %CDATE%') DO SET dd=%
%B
FOR /F TOKENS=2,3 DELIMS=/ %%A IN ('echo %CDATE%') DO SET =%%B
SET date=%%%mm%%dd%
set deldate=%%-%mm%-%dd%
FOR /f tokens=1 %%u IN ('TIME /t') DO SET t=%%u
IF %t:~1,1%==: SET t=0%t%
@REM set timestr=%d:~6,4%%d:~3,2%%d:~0,2%%t:~0,2%%t:~3,2%
set time=%t:~0,2%%t:~3,2%
@echo on
c:\Program Files\Google\google_appengine\appcfg.py download_data
--config_file=E:\FEEDSYSTEMS\TRACKER\tracker-export.py --filename=%date
%data_archive.csv --batch_size=100
--kind=SearchRec ./TRACKER
curl --retry 20 --retry-delay 10
-Nhttp://tracker###.appspot.com/delete?date=%deldate%
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group
athttp://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: OpenID Attribute Exchange
To be more specific, the current version of OpenID does Attribute Exchange to request the user's email address. It does not offer any flexiblity to request different attributes. It is a feature request we are aware of. --Matthew On May 21, 12:46 pm, Ross M Karchner rosskarch...@gmail.com wrote: Which one? On Fri, May 21, 2010 at 2:48 PM, Brandon Bloom snprbo...@gmail.com wrote: Never mind -- I got an external implementation working for my needs. On May 20, 5:21 pm, Brandon Bloom snprbo...@gmail.com wrote: The docs say: Note: App Engine does not support OpenID Attribute Exchange. Why not? Due to the nature of my app, I need email addresses for all of my users. First and Last name would also be very nice. Will Attribute Exchange be supported eventually? Thanks, Brandon Bloom -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Prerelease 1.3.4 SDK ready for download
You will be able to switch an application from Google Accounts to Federated Login (for OpenID) and back again in the Admin Console on the Applications Settings page. The setting may be visible now, however it will not work completely until the release is complete. Please wait until we announce 1.3.4 before using this. --Matthew On May 13, 12:57 pm, Charles Abreu charlesab...@gmail.com wrote: Please, I have the same doubt. Charles Abreu On May 13, 3:13 pm, Ross M Karchner rosskarch...@gmail.com wrote: If we want to switch an existing app from Google accounts toOpenID, will we have to delete them and remake them? On Thu, May 13, 2010 at 1:46 PM, Ikai L (Google) ika...@google.com wrote: Hello, App Engine developers! Just wanted to let everyone know that prerelease 1.3.4 SDK is now available for download. As usual, we're looking for feedback. Please post it in this thread. The release notes are below: Java --- Version 1.3.4 = - Client side bulkloader available with the Python SDK that has a new configuration syntax and wizard for easier import/export with the datastore. Can be used by enabling remote_api in your Java application - Applications can now be configured to authenticate withOpenIDby selecting theOpenIDoption when creating your application in the admin console http://code.google.com/p/googleappengine/issues/detail?id=248 http://code.google.com/p/googleappengine/issues/detail?id=56 - New API to allow App Engine apps to act as OAuth service providers http://code.google.com/p/googleappengine/issues/detail?id=919 - The version update check in the Java SDK now uses https - Allow full access to javax.el.* http://code.google.com/p/googleappengine/issues/detail?id=3157 - Increased the timeout during deployment to 15 minutes - Fixed an issue with JPA where an illegal cast exception was thrown during the fetch of integer fields - MemcacheService.setNamespace() is deprecated in favor of MemcacheServiceFactory.getMemcacheManager(namespace) - Support in the SDK for Java 1.5 is being deprecated. These warnings now appear when starting the SDK Python - Version 1.3.4 = - New bulkloader configuration syntax and wizard for easier import/export with the datastore. - Applications can now be configured to authenticate withOpenIDby selecting theOpenIDoption when creating your application in the admin console. http://code.google.com/p/googleappengine/issues/detail?id=248 http://code.google.com/p/googleappengine/issues/detail?id=56 - New API to allow App Engine apps to act as OAuth service providers. http://code.google.com/p/googleappengine/issues/detail?id=919 - Auto task execution is now enabled in the dev_appserver. To turn this off use the flag --disable_task_running. - Fixed an issue using db.put() with constructor initialized id based keys. http://code.google.com/p/googleappengine/issues/detail?id=3209 -- Ikai Lan Developer Relations, Google App Engine Twitter: http://twitter.com/ikai Delicious: http://delicious.com/ikailan Google App Engine links: Blog: http://googleappengine.blogspot.com Twitter: http://twitter.com/app_engine Reddit: http://www.reddit.com/r/appengine -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Prerelease: New Appengine Bulkloader
Hi Ryan,
Thanks for the note. You can also do the same thing in your transform
with
transform.none_if_empty(transform.generate_foreign_key(...))
Perhaps this should be the default on a few more of the supplied
transforms.
--Matthew
On May 8, 3:42 pm, Ryan ryanleeschnei...@gmail.com wrote:
Not sure where you want bug reports, but I fixed a little something:
Basically, I couldn't have null/empty reference attributes, I would
get this exception:
Traceback (most recent call last):
File /Users/ryan/Downloads/google_appengine/google/appengine/tools/
adaptive_thread_pool.py, line 150, in WorkOnItems
status, instruction = item.PerformWork(self.__thread_pool)
File
/Users/ryan/Downloads/google_appengine/google/appengine/tools/bulkloader.py,
line 695, in PerformWork
transfer_time = self._TransferItem(thread_pool)
File
/Users/ryan/Downloads/google_appengine/google/appengine/tools/bulkloader.py,
line 850, in _TransferItem
self.content = self.request_manager.EncodeContent(self.rows)
File
/Users/ryan/Downloads/google_appengine/google/appengine/tools/bulkloader.py,
line 1271, in EncodeContent
entity = loader.create_entity(values, key_name=key, parent=parent)
File /Users/ryan/Downloads/google_appengine/google/appengine/ext/
bulkload/bulkloader_config.py, line 383, in create_entity
return self.dict_to_entity(input_dict, self.bulkload_state)
File /Users/ryan/Downloads/google_appengine/google/appengine/ext/
bulkload/bulkloader_config.py, line 129, in dict_to_entity
self.__run_import_transforms(input_dict, instance, bulkload_state)
File /Users/ryan/Downloads/google_appengine/google/appengine/ext/
bulkload/bulkloader_config.py, line 231, in __run_import_transforms
value = self.__dict_to_prop(transform, input_dict, bulkload_state)
File /Users/ryan/Downloads/google_appengine/google/appengine/ext/
bulkload/bulkloader_config.py, line 186, in __dict_to_prop
value = transform.import_transform(value)
File /Users/ryan/Downloads/google_appengine/google/appengine/ext/
bulkload/bulkloader_parser.py, line 90, in __call__
return self.method(*args, **kwargs)
File /Users/ryan/Downloads/google_appengine/google/appengine/ext/
bulkload/transform.py, line 141, in generate_foreign_key_lambda
return datastore.Key.from_path(kind, value)
File /Users/ryan/Downloads/google_appengine/google/appengine/api/
datastore_types.py, line 382, in from_path
ValidateString(id_or_name, 'name')
File /Users/ryan/Downloads/google_appengine/google/appengine/api/
datastore_types.py, line 107, in ValidateString
raise exception('%s must not be empty.' % name)
BadValueError: name must not be empty.
The fix is pretty simple (in ext/bulkload/transform.py):
def generate_foreign_key_lambda(value):
if key_is_id:
value = int(value)
if not value: # ADDED
return None # ADDED
return datastore.Key.from_path(kind, value)
return generate_foreign_key_lambda
Other than that, working great for me.
Thanks,
Ryan
On May 4, 3:42 pm, Craig Berry cdbe...@gmail.com wrote:
I did that check, and got prompted to log in. But the script dies
without ever having prompted me.
On Tue, May 4, 2010 at 14:34, Matthew Blain matthew.bl...@google.com
wrote:
You should get prompted for authentication. Make sure remote_api is
installed correctly on your server by visiting whatever you used for
the --url argument in your browser. It should require you to log in
then say This request did not contain a necessary header
--Matthew
On May 4, 10:51 am, Craig Berry cdbe...@gmail.com wrote:
Anybody there? I could really use a pointer on this. To clarify my
situation:
1. I'm using the Eclipse java plugin to build and deploy my app.
2. I'm trying to use the previewbulkloadertool to transform and
upload data from an existing db.
3. I set up the app-side java remote_api servlet as described.
4. I obtained the zip file, extracted it to a new dir on disk, and ran
the script as described in the doc.
5. When I do that, I get an authentication failure.
This is perhaps not surprising, as I never provided my credentials
anywhere. How and where is that supposed to happen?
On May 3, 7:53 pm, Craig Berry cdbe...@gmail.com wrote:
Perhaps this is documented somewhere, but I can't find it. I'm trying
to upload to a Java app, configured as recommended, if that matters.
How do I provide authentication information (username and password) to
bulkloader.py so that it can connect to my remote_api?
On Apr 9, 3:26 pm, Matthew Blain matthew.bl...@google.com wrote:
I’d like to announce a wider prerelease of the new App Engine
Bulkloaderconfiguration format. This new format extends the existing
bulkloaderwith a new format with several advantages:
* Semi-Automatic configuration generation: The SDK can generate a
bulkloaderconfiguration based on your
[google-appengine] Re: Prerelease: New Appengine Bulkloader
You should get prompted for authentication. Make sure remote_api is installed correctly on your server by visiting whatever you used for the --url argument in your browser. It should require you to log in then say This request did not contain a necessary header --Matthew On May 4, 10:51 am, Craig Berry cdbe...@gmail.com wrote: Anybody there? I could really use a pointer on this. To clarify my situation: 1. I'm using the Eclipse java plugin to build and deploy my app. 2. I'm trying to use the preview bulkloader tool to transform and upload data from an existing db. 3. I set up the app-side java remote_api servlet as described. 4. I obtained the zip file, extracted it to a new dir on disk, and ran the script as described in the doc. 5. When I do that, I get an authentication failure. This is perhaps not surprising, as I never provided my credentials anywhere. How and where is that supposed to happen? On May 3, 7:53 pm, Craig Berry cdbe...@gmail.com wrote: Perhaps this is documented somewhere, but I can't find it. I'm trying to upload to a Java app, configured as recommended, if that matters. How do I provide authentication information (username and password) to bulkloader.py so that it can connect to my remote_api? On Apr 9, 3:26 pm, Matthew Blain matthew.bl...@google.com wrote: I’d like to announce a wider prerelease of the new App Engine Bulkloader configuration format. This new format extends the existing bulkloader with a new format with several advantages: * Semi-Automatic configuration generation: The SDK can generate a bulkloader configuration based on your existing data. * Supports more data formats. CSV support has been extended to files with headers, basic XML support has been added, and it is simpler to use alternate text encodings in the files. Additional and custom data connectors are now easier to create. * Easier to use -- the new syntax is more declarative and descriptive than the old one. Developers who use languages other than Python no longer need to write code in the Python language, although the Python SDK is still required to run the tool. To try out the new bulkloader, please visithttp://bulkloadersample.appspot.com/ . Preliminary documentation is available on the README on that site along with a version of the 1.3.2 Python SDK containing the new bulkloader. You can send feedback to the group or directly to me. --Matthew Blain Google App Engine Team matthew.blain+bulkloa...@google.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Prerelease: New Appengine Bulkloader
If you don't mind sending me your appid privately and giving you permission to download the data from your app, I can try to investigate. --Matthew On May 3, 5:21 am, Yoav Aviram yoav.avi...@gmail.com wrote: I am getting the same AssertionError exception. On Apr 28, 10:44 pm, Josh jmskin...@gmail.com wrote: I get the following error and then the process has to be killed to exit. Any ideas? [ERROR ] [Thread-11] ExportProgressThread: Traceback (most recent call last): File /Users/s/Downloads/google_appengine/google/appengine/tools/ bulkloader.py, line 1442, in run self.PerformWork() File /Users/s/Downloads/google_appengine/google/appengine/tools/ bulkloader.py, line 2210, in PerformWork item.key_end) File /Users/s/Downloads/google_appengine/google/appengine/tools/ bulkloader.py, line 1993, in StoreKeys self.py_type)) AssertionError: agh3Zi1kYWlseXJFCxInX19TdGF0X1Byb3BlcnR5VHlwZV9Qcm9wZXJ0eU5hbWVfS2luZF9fIhh CbG9iX2NvbnRlbnRfRW50aXR5U2hhcmQM is a class 'google.appengine.api.datastore_types.Key', _ProgressDatabase expected type 'int' On Apr 23, 1:36 pm, Matthew Blain matthew.bl...@google.com wrote: I have just updatedhttp://bulkloadersample.appspot.com/withanew release. * Updated to the 1.3.3 Python SDK * The wizard is easier to run and generates TODO comments on all lines which require editing. (You may want to do additional edits too.) * 'xml' format has been renamed to 'simplexml'--leaving room a more effective xml connector in the future may have a different interface. (No, there's no current plans for one.) I plan to talk about this at Google I/O:http://code.google.com/events/io/2010/sessions/data-migration-appengi... Now is a great time to send feedback about the tool, or questions about the tool, to maximize the chance that your questions can be addressed in the session. --Matthew On Apr 22, 10:13 am, Sam Briesemeister sam.briesemeis...@gmail.com wrote: A couple of questions: - Is this feature easily ported into the 1.3.3 release of 4/21? - Is there a release timeline for this feature? Thanks! On Apr 9, 3:26 pm, Matthew Blain matthew.bl...@google.com wrote: I’d like to announce a wider prerelease of the new App Engine Bulkloaderconfiguration format. This new format extends the existing bulkloaderwith a new format with several advantages: * Semi-Automatic configuration generation: The SDK can generate a bulkloaderconfiguration based on your existing data. * Supports more data formats. CSV support has been extended to files with headers, basic XML support has been added, and it is simpler to use alternate text encodings in the files. Additional and custom data connectors are now easier to create. * Easier to use -- the new syntax is more declarative and descriptive than the old one. Developers who use languages other than Python no longer need to write code in the Python language, although the Python SDK is still required to run the tool. To try out the newbulkloader, please visithttp://bulkloadersample.appspot.com/ . Preliminary documentation is available on the README on that site along with a version of the 1.3.2 Python SDK containing the new bulkloader. You can send feedback to the group or directly to me. --Matthew Blain Google App Engine Team matthew.blain+bulkloa...@google.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group
[google-appengine] Re: bulkuploading to a version
Try visiting what you passed in to --url in the browser. It should say This request did not contain a necessary header if everything is working correctly. On Apr 29, 4:37 am, Nuno Maltez nuno.li...@gmail.com wrote: Hi, I wonder if this is possible. I have a GAE site that's static, i.e., does not use the datatstore at all. I'm in the process of converting it to a dynamic version (using django nonrel), and I was trying to deploy the new site to a different version under the same app_id, for testing. I have some data in my development datastore that I wanted to push to appspot using bulkuploader. My app is on a Google Apps domain, but of course my active version doesn't have /remote_api enabled, so I wanted to connect to the specific version: bulkloader.py --restore --debug --email=nuno@domain.com --auth_domain=domain.com --kind=Section --url=http://nonrel.latest.appid.appspot.com/remote_api/remote_api --filename=../db/Section . but this always fails with a [INFO ] Authentication Failed message. Is this because I'm using a appspot.com url with a google apps auth_domain ? Would it be possible to bulkupload to the active version - enabling remote_api - even though the code for my models isn't there - and would this problem also emerge if I tried to appcfg.py upload/download_data instead of the bulkuploader? Thanks in advance, Nuno -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: ReferenceProperty with bulkloader.Exporter
Have you tried the preview of the new bulkloader at http://bulkloadersample.appspot.com/ ? It has an example of this. However it will export just the key--you can then download both A and B and join them later. Are you trying to export a nested data structure into a hierarchical data format? If so, you need some way to download both kinds. If you exporter (using either system) dereferences the property using a model class, the remote_api connection will download it. Note that this will have a significant performance impact. I'm curious what your expected use case is, as nested data is an interesting and complex case. --Matthew On Apr 26, 3:30 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi Kartik, What do you mean by 'junk values'? The reference property should return either the key of the entity being referenced, or the entity itself. -Nick Johnson On Sat, Apr 24, 2010 at 9:10 AM, kartik rustagi kartikrust...@gmail.comwrote: Hello every one, I have defined two entities in my application, say A and B. Now one property of A is ReferenceProperty to B. Now I am trying to download the values stored in the datastore A in to my local system (using bulkloader.exporter). And as expected in the ReferenceProperty part of A, I am getting junk values. How do I define that this property of A has to use B's exporter? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Prerelease: New Appengine Bulkloader
I have just updated http://bulkloadersample.appspot.com/ with a new release. * Updated to the 1.3.3 Python SDK * The wizard is easier to run and generates TODO comments on all lines which require editing. (You may want to do additional edits too.) * 'xml' format has been renamed to 'simplexml'--leaving room a more effective xml connector in the future may have a different interface. (No, there's no current plans for one.) I plan to talk about this at Google I/O: http://code.google.com/events/io/2010/sessions/data-migration-appengine.html Now is a great time to send feedback about the tool, or questions about the tool, to maximize the chance that your questions can be addressed in the session. --Matthew On Apr 22, 10:13 am, Sam Briesemeister sam.briesemeis...@gmail.com wrote: A couple of questions: - Is this feature easily ported into the 1.3.3 release of 4/21? - Is there a release timeline for this feature? Thanks! On Apr 9, 3:26 pm, Matthew Blain matthew.bl...@google.com wrote: I’d like to announce a wider prerelease of the new App Engine Bulkloaderconfiguration format. This new format extends the existing bulkloaderwith a new format with several advantages: * Semi-Automatic configuration generation: The SDK can generate a bulkloaderconfiguration based on your existing data. * Supports more data formats. CSV support has been extended to files with headers, basic XML support has been added, and it is simpler to use alternate text encodings in the files. Additional and custom data connectors are now easier to create. * Easier to use -- the new syntax is more declarative and descriptive than the old one. Developers who use languages other than Python no longer need to write code in the Python language, although the Python SDK is still required to run the tool. To try out the newbulkloader, please visithttp://bulkloadersample.appspot.com/ . Preliminary documentation is available on the README on that site along with a version of the 1.3.2 Python SDK containing the new bulkloader. You can send feedback to the group or directly to me. --Matthew Blain Google App Engine Team matthew.blain+bulkloa...@google.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Error while downloading data
This may be http://code.google.com/p/googleappengine/issues/detail?id=3027 -- you can use an older version of the SDK or edit the line to remove the extra parentheses. On Apr 9, 6:37 am, vivpuri v...@vivekpuri.com wrote: Tried from windows box too(above out is from Mac), and even there i got the same error. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Prerelease: New Appengine Bulkloader
I’d like to announce a wider prerelease of the new App Engine Bulkloader configuration format. This new format extends the existing bulkloader with a new format with several advantages: * Semi-Automatic configuration generation: The SDK can generate a bulkloader configuration based on your existing data. * Supports more data formats. CSV support has been extended to files with headers, basic XML support has been added, and it is simpler to use alternate text encodings in the files. Additional and custom data connectors are now easier to create. * Easier to use -- the new syntax is more declarative and descriptive than the old one. Developers who use languages other than Python no longer need to write code in the Python language, although the Python SDK is still required to run the tool. To try out the new bulkloader, please visit http://bulkloadersample.appspot.com/ . Preliminary documentation is available on the README on that site along with a version of the 1.3.2 Python SDK containing the new bulkloader. You can send feedback to the group or directly to me. --Matthew Blain Google App Engine Team matthew.blain+bulkloa...@google.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: app engine is down?
We are investigating this issue. --Matthew On Feb 24, 8:07 am, kang areyouloo...@gmail.com wrote: Wish Google can tell us its maintain time:) On Wed, Feb 24, 2010 at 11:51 PM, kang areyouloo...@gmail.com wrote: Error: Server Error -- Stay hungry,Stay foolish. -- Stay hungry,Stay foolish. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Scheduled Maintenance?
Waleed-- Have you tried the suggestion posted above about using version.latest? Doing that should also fix up the 'too many versions' problem. --Matthew On Feb 17, 7:56 pm, Waleed wal...@ninua.com wrote: I tried to upload as a new version number (version 2), but I get an error: *** The application already has the maximum number of versions. *** My app is in Maintenance Mode and I can't upload an update to bring it back up. Any work-around? Waleed -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[appengine-java] Re: bulk download error 403
The Google Apps control panel does not affect who is a admin on a particular app engine application. That's controlled by the App Engine admin console, e.g. http://appengine.google.com/permissions?app_id=myprogram . For remote_api to work you also need the admin to match the authentication option of the application, e.g. whatever it says on http://appengine.google.com/domain?app_id=myprogram for Authentication Options. If it says anyone with a valid Google Account then you need to use a non-Google Apps account for the admin with remote API. This is often simplest to do with a Gmail account. If it says anyone with a valid *yourdomain* Google Apps domain, then only admins on the Permissions page with Google Apps account in that domain will work. Hopefully this clarifies things--it's confusing because there are so many different places to check. --Matthew On Dec 24 2009, 1:48 am, lembas keremo...@gmail.com wrote: First of all, sorry for writing remote instead of bulkload in my last 2 posts. There is no remote version. The only version is bulkload. I created it with Python like I said in my first post in this thread. I logged out my gmail.com account and mydomain.com account in my browser. Then I visithttp://bulkload.latest.myprogram.appspot.com/remote_api. There comes a login page of mydomain.com. When I login with my admin account on mydomain.com, it says Error: Forbidden Your client does not have permission to get URL /remote_api from this server. I do not use GAE UserService anywhere in my code. I do not have any security-constraint in my web.xml. I looked at the logs as you said. I have the following in my request- only-filtered log: 12-24 01:33AM 02.761 /remote_api 403 36ms 0cpu_ms 0kb Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/532.6 (KHTML, like Gecko) Chrome/4.0.266.0 Safari/532.6,gzip(gfe) See details 193.xxx.yyy.zzz - myid [24/Dec/2009:01:33:02 -0800] GET /remote_api HTTP/1.1 403 0 https://www.google.com/a/mydomain.com/ServiceLogin? service=ahpassive=truecontinue=http:// bulkload.latest.myprogram.appspot.com/_ah/login%3Fcontinue%3Dhttp:// bulkload.latest.myprogram.appspot.com/ remote_apiltmpl=gaahname=dummysig=a0d1d0bdb0ea9947083be67280bb1e39 Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/532.6 (KHTML, like Gecko) Chrome/4.0.266.0 Safari/532.6,gzip(gfe) How can I check if my admin account on mydomain.com is really an admin forhttp://bulkload.latest.myprogram.appspot.com/remote_api? I checked it by logging inhttps://www.google.com/a/cpanel/kavancha.com/Users and see that admin is an Administrator as stated in Status column next to Username column. Am I right? Thanks for your help. Now what should I do next? On Dec 24, 4:54 am, Matthew Blain matthew.bl...@google.com wrote: (Note that the log in page is only needed to test interactive login.) On Dec 23, 6:53 pm, Matthew Blain matthew.bl...@google.com wrote: You need to log in to the application, not just the Google control panel--do you have a login page you can visit onhttp://remote.latest.myprogram.appspot.com/remote_api? What do the logs look like in the admin console for your app? On Dec 19, 2:36 am, lembas keremo...@gmail.com wrote: First I visithttps://www.google.com/a/cpanel/mydomain.com then login as ad...@mydomain.com and then I visithttp://remote.latest.myprogram.appspot.com/remote_api, which has remoteapi definition in web.xml as stated inhttp://groups.google.com/group/google-appengine-java/browse_thread/th..., it says Error: Forbidden Your client does not have permission to get URL /remote_api from this server. but if i visithttp://myprogram.appspot.com/remote_api, which is the current version without any remoteapi definition in web.xml, it says Error: Not Found The requested URL /remote_api was not found on this server. what should I do now? On Dec 19, 2:24 am, Matthew Blain matthew.bl...@google.com wrote: A quick test is if you can visit yourapp/remote_api in the web browser--it should work if you log in as an admin, well it should say This request did not contain a necessary header but not any other errors. On Dec 16, 2:52 pm, lembas keremo...@gmail.com wrote: I get exactly the same error when I try to bulkupload with this command: appcfg.py upload_data --auth_domain=mydomain.com --db_filename=skip -- url=http://remote.latest.myprogram.appspot.com/remote_api--no_cookies --has_header --config_file=loader.py --filename=kind.csv --kind=Kind myprogram On Dec 17, 12:37 am, lembas keremo...@gmail.com wrote: Hi, I have a java app on myprogram.appspot.com. I use google eclipse plugin to deploy it.(Eclipse 3.5, App Engine SDK 1.3.0, GWT SDK 2.0.0) I set the version to bulkload and deployed it. Now I have bulkload.latest.myprogram.appspot.com as I can see
[appengine-java] Re: Bulk Upload with Authentication
I've responded in the other thread. On Feb 14, 1:01 pm, lembas keremo...@gmail.com wrote: I have a Java-app-with-authentication. I created it this way. I wish I had not. I need to upload bulk data. I am waiting for months but Java still cannot do it. I tried to do it with Python. I cannot do with it either because I have created my app with authentication and I cannot change my app back to a non-authentication-app. I can create another Java-app-without-authentication. But this time I need to bulk download my data but I cannot because my app is a Java- app-with-authentication. Any help? When will it be possible to bulk-upload to a Java app with authentication via Python or Java or any other way? Any workaround? Neither works for me as stated inhttp://groups.google.com/group/google-appengine-java/browse_thread/th... -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: export to csv
I recommend using the new bulkloader we're working on. I'll send you a link to it--it should make your life pretty simple. You do not need to deploy a Python app (see various threads from me-- we'll document this soon). bulkloader --dump writes out a sqlite3 file with encoded entities-- it's not particularly useful by itself, it's primarily useful for bulkloader --restore. Though it can be parsed. --Matthew On Jan 27, 5:19 am, Pablo Francavilla pfran...@gmail.com wrote: Hi Wesley, I think I didn't express well My Application it's written with GAE/J . Our customer ask us to give him a way to export to csv the entities of his application. So, I Googled a lot, and I found the only way to do that it's deploying a parallel python application. I follow these links http://appengine-cookbook.appspot.com/recipe/using-the-python-bulk-ex...http://code.google.com/appengine/docs/python/tools/uploadingdata.html...http://groups.google.com/group/google-appengine/browse_thread/thread/... My question is: It's possible to export to csv without writing a python class for each Java class ? Thanks On Tue, Jan 26, 2010 at 8:27 PM, Wesley C (Google) wesc+...@google.comwesc%2b...@google.com wrote: it looks like you have some issue with your app.yaml file. please make sure it's of a format similar to the following: application: sandbox-getsense-it version: 1 runtime: python api_version: 1 handlers: - url: /.* script: main.py also, here are two recent threads about creating CSV files: http://groups.google.com/group/google-appengine-python/browse_thread/... http://groups.google.com/group/google-appengine-python/browse_thread/... hope this helps! -- wesley - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Core Python Programming, Prentice Hall, (c)2007,2001 Python Fundamentals, Prentice Hall, (c)2009 http://corepython.com wesley.j.chun :: wesc+...@google.com wesc%2b...@google.com developer relations :: google app engine -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[appengine-java] Re: bulk download error 403
A quick test is if you can visit yourapp/remote_api in the web browser--it should work if you log in as an admin, well it should say This request did not contain a necessary header but not any other errors. On Dec 16, 2:52 pm, lembas keremo...@gmail.com wrote: I get exactly the same error when I try to bulkupload with this command: appcfg.py upload_data --auth_domain=mydomain.com --db_filename=skip -- url=http://remote.latest.myprogram.appspot.com/remote_api--no_cookies --has_header --config_file=loader.py --filename=kind.csv --kind=Kind myprogram On Dec 17, 12:37 am, lembas keremo...@gmail.com wrote: Hi, I have a java app on myprogram.appspot.com. I use google eclipse plugin to deploy it.(Eclipse 3.5, App Engine SDK 1.3.0, GWT SDK 2.0.0) I set the version to bulkload and deployed it. Now I have bulkload.latest.myprogram.appspot.com as I can see onhttps://appengine.google.com/deployment?app_id=myprogram I try to bulkdownload data to my app but cannot succeed. I use: bulkloader.py --dump --batch_size=5 --kind=Kind -- auth_domain=mydomain.com --url=http:// bulkload.latest.myprogram.appspot.com/remote_api --filename=dump.sql3 myprogram when I execute this command it asks my an email and a password. I enter ad...@mydomain.com and its password but the result is: [ERROR ] Exception during authentication Traceback (most recent call last): File C:\Program Files\Google\google_appengine\google\appengine\tools \bulkload er.py, line 2985, in Run request_manager.Authenticate() File C:\Program Files\Google\google_appengine\google\appengine\tools \bulkload er.py, line 1152, in Authenticate remote_api_stub.MaybeInvokeAuthentication() File C:\Program Files\Google\google_appengine\google\appengine\ext \remote_api \remote_api_stub.py, line 494, in MaybeInvokeAuthentication datastore_stub._server.Send(datastore_stub._path, payload=None) File C:\Program Files\Google\google_appengine\google\appengine\tools \appengin e_rpc.py, line 344, in Send f = self.opener.open(req) File C:\Python26\lib\urllib2.py, line 389, in open response = meth(req, response) File C:\Python26\lib\urllib2.py, line 502, in http_response 'http', request, response, code, msg, hdrs) File C:\Python26\lib\urllib2.py, line 427, in error return self._call_chain(*args) File C:\Python26\lib\urllib2.py, line 361, in _call_chain result = func(*args) File C:\Python26\lib\urllib2.py, line 510, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) HTTPError: HTTP Error 403: Forbidden [INFO ] Authentication Failed I got exactly the same error above when I tried downloading with this command: appcfg.py download_data --auth_domain=mydomain.com --url=http:// bulkload.latest.myprogram.appspot.com/remote_api -- config_file=exporter.py --filename=kind_data_archive.csv --kind=Kind myprogram If I enter my gmail.com account and password, which I use to deploy the app in google eclipse plugin, the error is: Invalid username or password. Please enter login credentials for bukload.latest.myprogram.appspot.com My app.yaml in myprogram folder is: application: myprogram version: bulkload runtime: python api_version: 1 handlers: - url: /remote_api script: $PYTHON_LIB/google/appengine/ext/remote_api/handler.py login: admin Any help? Or should I ask it on google-appengine-python group or google-appengine group? Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[google-appengine] Re: Introducing App Engine SDK 1.3.0
While the limit for passing data directly to the Images (or other) APIs has not changed, you can pass a Blob key to the Images API to do exactly what you want: convert a 50MB uploaded image to a smaller image. More information here: http://code.google.com/appengine/docs/python/images/overview.html#Transforming_Images_from_the_Blobstore http://code.google.com/appengine/docs/java/images/overview.html#Transforming_Images_from_the_Blobstore --Matthew On Dec 15, 10:14 am, trung tr...@phamcom.com wrote: This is awesome. But the image API limit is still capped at 1MB!!! I still rather be able to resize a 50MB uploaded image down to 1MB or less to cut down the time and bandwidth. I assume that increasing the Image API limit is the next logical step. :) On Dec 14, 8:00 pm, Jason (Google) apija...@google.com wrote: Hi Everyone. We just released version 1.3.0 of the App Engine SDK for both Python and Java. The most notable change is the new experimental Blobstore API which allows billed apps to store files up to 50 MB. The release also includes some performance tweaks to the Java runtime. Blog post:http://googleappengine.blogspot.com/2009/12/app-engine-sdk-130-releas... Release notes: Python:http://code.google.com/p/googleappengine/wiki/SdkReleaseNotes Java:http://code.google.com/p/googleappengine/wiki/SdkForJavaReleaseNotes Cheers! - Jason -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Bulkloader - moving data
Hi Mike, You can tune the rate at which the bulkloader uploads data with the -- http_limit --rps_limit and --bandwidth_limit flags as noted in http://code.google.com/appengine/docs/python/tools/uploadingdata.html . You shouldn't need it, but if you want to write a custom exporter you can now (as of 1.2.8) access they key property using the property name __key__. You can also sign up for the beta at http://groups.google.com/group/google-appengine/msg/6e878e78a70f8597 -- I hope to send something out about that tomorrow to people who have signed up. --Matthew On Dec 6, 12:05 pm, Mike mikejm...@gmail.com wrote: Hi, I have an app that has been running on appspot for the past month. The site was set up to use Google Account authentication but I now realise I want Google Apps authentication. So I dumped the data to my local machine but when I try restore to the new site (with Google Apps auth) I get time-outs on the big tables (the smaller tables restore fine). Is there any way of increasing the timeout limit or restoring parts of the dump file? I then tried the download to csv approach but I have a hierachy of tables with parents and children tables (like Book is parent of Chapter) but I'm not having much luck getting the parent and key properties out. There are some posts about changingbulkloader.py to get keys out in May but I am hoping these issues have been sorted out. Has anyone done download and upload successfully? Mike -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Google Apps account mess :(
Sorry for the confusion here. You may be able to solve this by deleting your cookies (or using another browser). You should also be able to 'move' the admin to the Google Apps account by temporarily inviting another account (say a gmail account), then deleting the account with the same name in both systems, then re- inviting it and following the Google Apps account link from the invitation email. --Matthew On Dec 7, 11:43 am, johnP j...@thinkwave.com wrote: I had the same problem. In my case, I deleted my email from Google Apps - which 'solved' the problem. johnP On Dec 7, 12:06 am, Daniel Lundqvist dan...@malarhojden.nu wrote: Hi, Recently did something stupid ... I think. I have this email address as a 'normal' google account already signed up to AppEngine (with one application). I was start trying to test out Google Apps for this domain and created that with this email as admin user. Believed it would be the same account but it seemed like it was two different. After this I cannot log on to administration console any more, it goes into some redirection loop after authentication. I have since then deleted Google Apps for my domain, but there is still a problem reaching it for my normal account. Is this something someone can assist me with? If this is the wrong forum kindly point me in the correct direction. BRs, Daniel -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Help! Locked out of account due to bug in 'invite developer'
If you have used a Google Apps account as the admin, you should be able to see it at http://appengine.google.com/a/example.com . If it's a normal account, you should see it logged in from the Google Account, but when there's an account in both systems with the same name, there's some issues. I'd recommend inviting another account (say a gmail account) as an admin, deleting the other admins, then re- inviting the other admins, being sure to accept the invitation from the /a/example.com link. --Matthew On Dec 8, 1:14 pm, SSP r...@supersizeprize.com wrote: I just ran into a really serious problem, with no obvious fix: When I try to invite someone as a developer for an app, the other users get locked out of the app. This problem ended up with me completely locked out of my own app. Here's what I was doing: 1) I have my domain (call it example.com) hosted in google apps for email. I have pointedwww.example.comto my google app. 2) The administrator for that app was r...@example.com. 3) I created the account dep...@example.com on both, Google Apps and Google Account, and then sent an invite to it to be an administrator for the app. I accepted the invitation. 4) Result: dep...@example.com is an admin for the account, but r...@example.com is no longer able to access it at all, and is not listed as an admin... 5) I thought I screwed something up, so I sent an invite to a third account (ad...@example.com), only to find dep...@example.com no longer an admin either and nor ad...@example.com either. Crap. What can I do to fix this? I really don't want to have to create a whole new app because what I have is set up, running, etc and it would be a significant amount of work to restore it all. Put it this way, I'm actually willing to pay for support to fix this. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Problems with Bulk Uploading.
Typically this problem can arise when the application is set up to use one authentication option (e.g. Google Accounts) and you are using a user with a different configuration (e.g. Google Apps account with the domain 'therailroadempire.com'). The simplest solution is to add another admin to your application which matches the authentication options of the application. --Matthew On Nov 23, 5:27 pm, Michael Robellard m...@robellard.com wrote: I added an --auth_domain=therailroadempire.com so my entire command is: appcfg.py upload_data --has_header --config_file=models/loaders.py -- filename=docs/cities.csv --kind=City -- auth_domain=therailroadempire.com . I am using the same username/password that I use to connect to the admin console. I am sure I am missing something simple, but I still can't figure it out. Anyone have any ideas? On Nov 21, 11:54 pm, Michael Robellard m...@robellard.com wrote: I am having a terrible time getting my bulk upload to work. It is working fine on my dev enviornment. When I try and upload to my app I get: [INFO 2009-11-21 23:49:48,233 bulkloader.py] Logging to bulkloader- log-20091121.234948 [INFO 2009-11-21 23:49:48,250 bulkloader.py] Throttling transfers: [INFO 2009-11-21 23:49:48,250 bulkloader.py] Bandwidth: 25 bytes/second [INFO 2009-11-21 23:49:48,250 bulkloader.py] HTTP connections: 8/ second [INFO 2009-11-21 23:49:48,250 bulkloader.py] Entities inserted/ fetched/modified: 20/second [INFO 2009-11-21 23:49:48,250 bulkloader.py] Opening database: bulkloader-progress-20091121.234948.sql3 [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-1] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-2] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-3] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-4] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-5] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-6] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-7] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-9] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-8] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 adaptive_thread_pool.py] [Thread-10] WorkerThread: started [DEBUG 2009-11-21 23:49:48,608 bulkloader.py] Configuring remote_api. url_path = /remote_api, servername = railroadempire.appspot.com [DEBUG 2009-11-21 23:49:48,608 bulkloader.py] Bulkloader using app_id: railroadempire [INFO 2009-11-21 23:49:48,608 bulkloader.py] Connecting to railroadempire.appspot.com/remote_api [INFO 2009-11-21 23:49:59,578 bulkloader.py] Authentication Failed Here is my app.yaml file: application: railroadempire version: 1 runtime: python api_version: 1 handlers: - url: /remote_api script: $PYTHON_LIB/google/appengine/ext/remote_api/handler.py login: admin - url: /.* script: environment.py I know I am just doing something stupid, but I have been trying to get this working for 2 hours now. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=.
[appengine-java] Re: Looking for Bulk Loader beta testers
Hi everyone, Thanks for the response so far--we'll be getting back to you over the next few days. I'd like to point out an existing feature which will be helpful to many of you: --dump and --restore. This will download or upload all of the entities for a particular Kind and save them in a local sqlite database. It's useful for general backup (e.g. a weekly backup), and also useful for moving data across applications, such as between your app running on the dev_appserver and on App Engine, or to load a staging instance with a known set of test data. You can find more information here: http://code.google.com/appengine/docs/python/tools/uploadingdata.html#Downloading_and_Uploading_All_Data Also, for Java developers, there is a remote API handler available; adding following to your web xml file should work (disclaimer: I have not yet personally tested this.) servlet servlet-nameremoteapi/servlet-name servlet-classcom.google.apphosting.utils.remoteapi.RemoteApiServlet/servlet-class /servlet servlet-mapping servlet-nameremoteapi/servlet-name url-pattern/remote_api/url-pattern /servlet-mapping security-constraint web-resource-collection web-resource-nameremoteapi/web-resource-name url-pattern/remote_api/url-pattern /web-resource-collection auth-constraint role-nameadmin/role-name /auth-constraint /security-constraint --Matthew On Tue, Nov 17, 2009 at 12:53 PM, Matthew Blain matthew.bl...@google.comwrote: Hi App Engine developers, We're working on some improvements and additions to the bulk loader to make it easier to move data between the App Engine Datastore and other data files you may have. If you're doing this right now, we're looking for some beta testers. Two specific issues we're addressing at this time are: * More language-neutral: Java developers, this will help you! * More format-neutral: If you use some format other than CSV, this will help you! If you're interested, fill out the form at https://spreadsheets.google.com/viewform?formkey=dC15V2hwczhpZ1VVWFhPZGhXR1dydUE6MQ to get started. --Matthew -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=.
[google-appengine] Re: Looking for Bulk Loader beta testers
Hi everyone, Thanks for the response so far--we'll be getting back to you over the next few days. I'd like to point out an existing feature which will be helpful to many of you: --dump and --restore. This will download or upload all of the entities for a particular Kind and save them in a local sqlite database. It's useful for general backup (e.g. a weekly backup), and also useful for moving data across applications, such as between your app running on the dev_appserver and on App Engine, or to load a staging instance with a known set of test data. You can find more information here: http://code.google.com/appengine/docs/python/tools/uploadingdata.html#Downloading_and_Uploading_All_Data Also, for Java developers, there is a remote API handler available; adding following to your web xml file should work (disclaimer: I have not yet personally tested this.) servlet servlet-nameremoteapi/servlet-name servlet-classcom.google.apphosting.utils.remoteapi.RemoteApiServlet/servlet-class /servlet servlet-mapping servlet-nameremoteapi/servlet-name url-pattern/remote_api/url-pattern /servlet-mapping security-constraint web-resource-collection web-resource-nameremoteapi/web-resource-name url-pattern/remote_api/url-pattern /web-resource-collection auth-constraint role-nameadmin/role-name /auth-constraint /security-constraint --Matthew On Tue, Nov 17, 2009 at 12:53 PM, Matthew Blain matthew.bl...@google.comwrote: Hi App Engine developers, We're working on some improvements and additions to the bulk loader to make it easier to move data between the App Engine Datastore and other data files you may have. If you're doing this right now, we're looking for some beta testers. Two specific issues we're addressing at this time are: * More language-neutral: Java developers, this will help you! * More format-neutral: If you use some format other than CSV, this will help you! If you're interested, fill out the form at https://spreadsheets.google.com/viewform?formkey=dC15V2hwczhpZ1VVWFhPZGhXR1dydUE6MQ to get started. --Matthew -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=.
[appengine-java] Looking for Bulk Loader beta testers
Hi App Engine developers, We're working on some improvements and additions to the bulk loader to make it easier to move data between the App Engine Datastore and other data files you may have. If you're doing this right now, we're looking for some beta testers. Two specific issues we're addressing at this time are: * More language-neutral: Java developers, this will help you! * More format-neutral: If you use some format other than CSV, this will help you! If you're interested, fill out the form at https://spreadsheets.google.com/viewform?formkey=dC15V2hwczhpZ1VVWFhPZGhXR1dydUE6MQ to get started. --Matthew -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=.
[google-appengine] Re: Why do I get https://www.google.com/accounts/DisplayUnlockCaptcha when using remote_api
Hi Tim, Can you tell me the appid so we can look into this further? Note that the transaction error is interesting--are you seeing lots of transaction failures and thus retrying the same call repeatedly? --Matthew On Nov 17, 5:54 am, Tim Hoffman zutes...@gmail.com wrote: Hi I am pushing about 20,000 entities from Plone to Appengine via the remote_api and every so often (200-300 entities (my guess is it is exactly 200) I start getting reponses from the remote_api that say Please go tohttps://www.google.com/accounts/DisplayUnlockCaptcha and verify you are a human. Then try again. 2009-11-17 13:47:26 INFO root Exception sending Rollback: Traceback (most recent call last): File /opt/ktstudio/zope/instances/prod/swantafe.buildout/ google_appengine/google/appengine/api/datastore.py, line 1989, in RunInTransactionCustomRetries tx.handle, resp) File /opt/ktstudio/zope/instances/prod/swantafe.buildout/ google_appengine/google/appengine/api/apiproxy_stub_map.py, line 72, in MakeSyncCall apiproxy.MakeSyncCall(service, call, request, response) File /opt/ktstudio/zope/instances/prod/swantafe.buildout/ google_appengine/google/appengine/api/apiproxy_stub_map.py, line 266, in MakeSyncCall rpc.CheckSuccess() File /opt/ktstudio/zope/instances/prod/swantafe.buildout/ google_appengine/google/appengine/api/apiproxy_rpc.py, line 111, in CheckSuccess raise self.exception NameError: global name 'txdata' is not defined Surley repeated use of the remote_api shouldn't make our google overlords think that I am some evil spamming robot. (What I am doing is robot like, but it is authenticated and it is my application and I am not spamming anyone ;-.) Is there some sort of limit to the number of calls that can be made before we have to reconnect or create a new remote_api connection ? As obviously something is triggering this reponse from google. Rgds Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=.
[google-appengine] Looking for Bulk Loader beta testers
Hi App Engine developers, We're working on some improvements and additions to the bulk loader to make it easier to move data between the App Engine Datastore and other data files you may have. If you're doing this right now, we're looking for some beta testers. Two specific issues we're addressing at this time are: * More language-neutral: Java developers, this will help you! * More format-neutral: If you use some format other than CSV, this will help you! If you're interested, fill out the form at https://spreadsheets.google.com/viewform?formkey=dC15V2hwczhpZ1VVWFhPZGhXR1dydUE6MQ to get started. --Matthew -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=.
[google-appengine] Re: Datastore timeouts
We are currently investigating an issue with high latency and error rate in the datastore. --Matthew On Oct 22, 7:04 am, dflorey daniel.flo...@gmail.com wrote: I'm experiencing a lot of 500ers when accessing App Engine apps or dashboard. Something weird in going on there... On 22 Okt., 15:46, Michael m...@mzlab.net wrote: I was seeing this problem again few minutes ago. It's certainly only on writes. (I switched app version to save logs. If you want, you can look at logs of beta19, app id: sovpad). It lasted around 5 minutes (6:32 - 6:37) On Oct 22, 1:47 am, Michael m...@mzlab.net wrote: Timeouts were on writes (as far as i could tell looking at logs), the problem lasted for several minutes and i had time to post :) On Oct 21, 11:37 pm, Jeff S (Google) j...@google.com wrote: Hi Michael, One possible cause could be that a Bigtable tablet which is used by your app was in the process of being split, which can cause a short burst of timeouts but ensure better performance going forward. Were these timeouts on just writes or also reads? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Remove Application Permissions
If the application is using the standard Google Accounts mechanism for this (sorry, I forget the exact term for it but AuthSub and OAuth are the name of the technical protocols used) you should have a link at https://www.google.com/accounts/ for managing this. Try https://www.google.com/accounts/IssuedAuthSubTokens --Matthew On Oct 2, 2:42 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi Todd, If you're referring to the admin console, you can remove administrators by clicking on 'Administrators' on the left. If you are talking about permissions in an application written on App Engine, you need to ask the author of the app. -Nick Johnson On Wed, Sep 30, 2009 at 3:13 PM, Todd tberman...@gmail.com wrote: This is a user question (not developer), so I hope I am posting in the correct place (I just could not find the answer anywhere). Anyway, I gave a 3rd part application access authority to access my contacts to use the app. After testing it for a few days, I determined it did not meet my needs. I am now looking for a way to turn off the access I granted. Can anyone explain to me how to do this (or show point my in the right direction to find this answer)? Thanks in advance! -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[appengine-java] Re: The API call datastore_v3.Put() is temporarily unavailable.
We are currently in planned maintenance. See http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/af970296d9a0b9c8 http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/78f2590cd347fdd0 and http://googleappengine.blogspot.com/2009/09/migration-to-better-datastore.html Apologies for the inconvenience, On Sep 22, 5:58 pm, Hani Naguib haninag...@gmail.com wrote: I am getting this aswell. Basically my apps are down because of this! On Sep 22, 5:45 pm, David davesmith@gmail.com wrote: Any idea what this means? com.google.apphosting.api.ApiProxy$CapabilityDisabledException: The API call datastore_v3.Put() is temporarily unavailable. Shows up in my production logs... Dave --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Upgrade from 1.2.4 to 1.2.5 fails on windows XP
Thanks for the report, we are investigating. As a workaround, you can download the SDK as a Zip file (the Linux/ Other Platforms link on the http://code.google.com/appengine/downloads.html page) and uncompress it yourself. The Windows installer contains the same files, plus the new (as of 1.2.5) Launcher. --Matthew On Sep 6, 9:06 am, Dmitriy dmitriy.antone...@gmail.com wrote: Hi! try this solution:http://www.add-in-express.com/creating-addins-blog/2007/11/12/windows... I had the same problem. Deleting that key helps to solve 2908 problem. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Anyone using fiddler?
Consider using -a 0.0.0.0 on the dev_appserver commandline. This will bind to ports other than localhost. You may be able to get fiddler to proxy 127.0.0.1 but it's probably easier to use your own machine name and the -a flag. On Sep 3, 2:08 pm, j...@q42.nl j...@q42.nl wrote: I wanted to use fiddler on my local app engine development server. But I get an error from fiddler: [Fiddler] Connection to localhost failed. Exception Text: No connection could be made because the target machine actively refused it ::1:8080 (I'm working on vista, thats why the ipv6 address is show i guess) I tried the usual fiddler workarounds (adding a dot, using machine name), but that didn't work, still actively refusing I need to somehow make the devserver listen to my machine name.. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Random HTTP 500 errors
One of the new features of today's release is that if you expand the logs for 500s in the admin console, you should see the reason. On Sep 3, 6:00 pm, GIMME ba...@gimme.org wrote: Hey , why not remove all try-except block and set debug=False in WSGIApplication, Then Google will log the error for you . On 8月31日, 下午11时42分, vp vivpu...@gmail.com wrote: Can anyone from Google give me an update on this issue. Right now my app is hovering at 1 Request/Second with an error rate of .5 Errors/ Second. As i have mentioned earlier, 99% of these errors clearly say ...500 10096ms 0cpu_ms 0kb..., which from what i can understand shows the request never gets to the actual request handler code. Thanks -V --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Upload local datastore content to App Engine
One of the new features of today's release is a --dump and --restore flag in the bulkloader, allowing configurationless download and restore of a dataset. It should work for exactly this scenario: you have data in one instance (say on dev_appserver) and want to upload it to another (say on appspot.com). You can find more information at http://code.google.com/appengine/docs/python/tools/uploadingdata.html#Downloading_and_Uploading_All_Data I'm not sure about the datastore_v3 error, but it may also be something we fixed. --Matthew On Sep 3, 11:35 am, FolkenDA folke...@gmail.com wrote: Hello everyone, I'm new to GAE and I am currently trying to move a website of mine to this platform. re-write the PHP code into python was really easy. However, I'm now trying to move data from an mySQL database into the GAE datastore. I was previously storing images in a directory in the server file system, so I successfully wrote a script that fetch them and store them in the local datastore. The script works in dev server because they have no timeout, but the GAE servers do. I tried to download the local datastore into CSV files that could be uploaded using the bulkloader method but got the following error: AssertionError: No api proxy found for service datastore_v3 I guess dev servers do not emulate this functionality. Is there some way I could use to upload local datastore to the production one ? Thank you, Folken --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: running a long process once
The typical answer is to split up your operation. You solve this particular problem in a few ways: * Split the data--if it only takes about 30 seconds to parse your entire file, then splitting it into two should easily get you under the 30 second limit on the server. Do note that the performance characteristics of the datastore are quite different on the server than in dev_appserver. * Use remote_api -- write your translation tool with remote_api in mind and run it locally but pointing at your production datastore. * Use the bulkloader -- effectively the same thing, wrapped in some code which handles backoff and such for you. However this may be difficult. * Run it locally, importing into dev_appserver, and use the new -- dump and --restore feature of the bulkloader to move the data to your app on App Engine. http://code.google.com/appengine/docs/python/tools/uploadingdata.html http://code.google.com/appengine/articles/remote_api.html --Matthew On Sep 3, 11:43 am, dogan kaya berktas dkberk...@gmail.com wrote: I am converting a legacy project to a new developed java project on GAE. I exported the old data into an XML file and want to parse it and add to GAE once. However it takes around 30 seconds to read and create new data structure on my local machine and this is why I can not run it on GAE even if, it should only called once. Any suggestions for long batch operations on GAE? Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: running a long process once
Another option is to use task_queue on the server. Upload your entire file (either as a string to your datastore, or as source code if it's a one time operation, or use urlfetch to retreive it into memcache or similar). Then process it line by line with the task queue API. On Sep 3, 7:26 pm, Matthew Blain matthew.bl...@google.com wrote: The typical answer is to split up your operation. You solve this particular problem in a few ways: * Split the data--if it only takes about 30 seconds to parse your entire file, then splitting it into two should easily get you under the 30 second limit on the server. Do note that the performance characteristics of the datastore are quite different on the server than in dev_appserver. * Use remote_api -- write your translation tool with remote_api in mind and run it locally but pointing at your production datastore. * Use the bulkloader -- effectively the same thing, wrapped in some code which handles backoff and such for you. However this may be difficult. * Run it locally, importing into dev_appserver, and use the new -- dump and --restore feature of the bulkloader to move the data to your app on App Engine. http://code.google.com/appengine/docs/python/tools/uploadingdata.htmlhttp://code.google.com/appengine/articles/remote_api.html --Matthew On Sep 3, 11:43 am, dogan kaya berktas dkberk...@gmail.com wrote: I am converting a legacy project to a new developed java project on GAE. I exported the old data into an XML file and want to parse it and add to GAE once. However it takes around 30 seconds to read and create new data structure on my local machine and this is why I can not run it on GAE even if, it should only called once. Any suggestions for long batch operations on GAE? Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Friend Connect vs App Engine Google Accounts Services
I believe that FriendConnect works at the JavaScript level (e.g. runs in the user's browser) while the App Engine backend is running on Google's servers. There's no direct connection between the two. If you want to use FriendConnect as your authentication mechanism, you may want to use it by itself entirely, without using the App Engine User API at all. --Matthew On Aug 20, 5:41 am, brandoneggar brandoneg...@gmail.com wrote: I'm just getting started on my first app and could use some clarification on the logon process. I've created a test page with a friend connect members gadget on the page. I assumed by signing in using this gadget I could then call users.get_current_user() and retrieve the currently logged in user. This returns 'unknown user'. If I put a link on the page to login using users.create_login_url() then I can retrieve the current user. I was kind of hoping to just use the friend connect gadget so I don't have to have 2 separate logins on the page. What's the correct way to do this? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Friend Connect vs App Engine Google Accounts Services
Ah, I think FriendConnect also sets a fcauth cookie which you can read. http://code.google.com/apis/friendconnect/opensocial_rest_rpc.html#site-cookie Check out the FriendConnectUser class in http://code.google.com/p/allforgood/source/browse/trunk/frontend/userinfo.py --Matthew On Aug 20, 6:31 pm, Matthew Blain matthew.bl...@google.com wrote: I believe that FriendConnect works at the JavaScript level (e.g. runs in the user's browser) while the App Engine backend is running on Google's servers. There's no direct connection between the two. If you want to use FriendConnect as your authentication mechanism, you may want to use it by itself entirely, without using the App Engine User API at all. --Matthew On Aug 20, 5:41 am, brandoneggar brandoneg...@gmail.com wrote: I'm just getting started on my first app and could use some clarification on the logon process. I've created a test page with a friend connect members gadget on the page. I assumed by signing in using this gadget I could then call users.get_current_user() and retrieve the currently logged in user. This returns 'unknown user'. If I put a link on the page to login using users.create_login_url() then I can retrieve the current user. I was kind of hoping to just use the friend connect gadget so I don't have to have 2 separate logins on the page. What's the correct way to do this? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Too Many Versions
Typically this means an internal error occurred at some point when you deployed your application, and the fix is usually to go to the 'Versions' section of the admin console and set the default version to something/something else, then upload again. --Matthew On Jul 13, 7:31 am, Ilya i...@labpixies.com wrote: Hi! I'm trying to update my app, but get Too Many Versions (403) error. My deployments quota is 125 (out of 250). I tried to change the version in app.yaml - same result My app id: labpixiesfacebook Please help. Thanks. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: 500 Server Error: no version is default
There is a quota for the amount of times you can deploy an application in one day which you seem to have encountered. I've reset your quota for the day, but consider using the dev_appserver from the SDK to test your app to limit the number of deployments you need. On Jul 9, 2:48 pm, khonggiannet khonggian...@gmail.com wrote: My application (app_id=raovat-sile-vn) throw 500 Server Error. It's strange that no version in 4 version I deployed for my website is set to be default! I try to make one default but still faced Server Error. I can't delete them also. Moreover, I can't deploy new version because the server throw error 503. What should I do now? Thank you in advance. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: iPhone cannot log in any more, system-wide issue, Google pls help
What is the URL of the page where you see the 500 error? On May 9, 6:27 am, Matt Trinneer matt.trinn...@gmail.com wrote: Hello, I can confirm that I am also encountering this issue. Best, Matt On May 9, 7:14 am, tijer troels...@gmail.com wrote: To reproduce the problem go to the google-developed app shell.appspot.com and try to login with an iphone. It not having an iphone then spoof the useragent to the iphone (like with Safari 4's debug menu) and try logging in then. It fails with a 500-error page. What to do? This has been going on for two days now. It really sux when you're developing an iPhone application :) --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: 500/503 Server Error on update
We recently noticed a number of application developers who were unable to deploy their applications. This is due to an issue recording the current minor version of the application. We have fixed all of the applications currently in this state and will soon roll out a fix to prevent this from happening in the future. Thanks, Matthew Blain Google Appengine Team On Apr 24, 4:58 pm, Matthew Blain matthew.bl...@google.com wrote: We're investigating this issue--can you send me the appid for your application (privately if you'd like) so I can verify it's the same issue we've seen elsewhere? As a workaround, either changing the major version version to an alternate version, or simply selecting the version you'd like to be default and clicking 'set default' should fix it. --Matthew On Apr 24, 3:07 pm, brightnesslevels brightnesslev...@gmail.com wrote: Well, I actually solved the 500 problem by changing the version number to 2 and the app deployed fine the first time. Now I'm getting Version is not ready to serve errors again (and again, and again). I checked my dashboard, and like before, none of the two versions was marked as default. I set version 2 to be the default one, but the not ready problem is still there. Now I've just tried setting my app version to 1 in app.yaml and deploy, and got error 500 again (: Eventually, by changing versions and redeploying, I got the latest version working, but I'm now not sure how exactly to deal with these problems in future. (: On Apr 24, 8:02 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi, There was a temporary problem with app deployment. It should be working fine again now. Regards, Nick Johnson On Apr 24, 4:53 pm, brightnesslevels brightnesslev...@gmail.com wrote: Just tried this on the most recent 1.2.1, and still getting the errors. On Apr 24, 7:41 pm, brightnesslevels brightnesslev...@gmail.com wrote: I've started using version 1.1.9 of Google App Engine about a week ago, and everything had been working okay (update-wise) until today. Now I'm getting either 500 or 503 error when I'm trying to update my app. Here's what's in the log: $ ../google_appengine/appcfg.py update --noisy . 2009-04-24 19:34:35,640 INFO appengine_rpc.py:373 Loaded authentication cookies from /home/sp/.appcfg_cookies 2009-04-24 19:34:35,640 INFO appengine_rpc.py:120 Server: appengine.google.com 2009-04-24 19:34:35,649 INFO appcfg.py:319 Checking for updates to the SDK. 2009-04-24 19:34:36,029 DEBUG appcfg.py:408 Skipping nag message 2009-04-24 19:34:36,030 INFO appcfg.py:1178 Reading app configuration. Scanning files on local disk. [ scans local files ] Initiating update. 2009-04-24 19:34:46,647 DEBUG appengine_rpc.py:308 Got http error, this is try #1 2009-04-24 19:34:57,584 DEBUG appengine_rpc.py:308 Got http error, this is try #2 2009-04-24 19:35:08,188 DEBUG appengine_rpc.py:308 Got http error, this is try #3 2009-04-24 19:35:18,783 DEBUG appengine_rpc.py:308 Got http error, this is try #4 2009-04-24 19:35:18,784 ERROR appcfg.py:1235 An unexpected error occurred. Aborting. Traceback (most recent call last): File /home/sp/c/python/google_appengine/google/appengine/tools/ appcfg.py, line 1213, in DoUpload missing_files = self.Begin() File /home/sp/c/python/google_appengine/google/appengine/tools/ appcfg.py, line 1009, in Begin version=self.version, payload=self.config.ToYAML()) File /home/sp/c/python/google_appengine/google/appengine/tools/ appengine_rpc.py, line 303, in Send f = self.opener.open(req) File /usr/lib/python2.5/urllib2.py, line 387, in open response = meth(req, response) File /usr/lib/python2.5/urllib2.py, line 498, in http_response 'http', request, response, code, msg, hdrs) File /usr/lib/python2.5/urllib2.py, line 425, in error return self._call_chain(*args) File /usr/lib/python2.5/urllib2.py, line 360, in _call_chain result = func(*args) File /usr/lib/python2.5/urllib2.py, line 506, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) HTTPError: HTTP Error 500: Internal Server Error Error 500: --- begin server output --- Server Error (500) A server error has occurred. --- end server output --- Earlier this day I had a number of issues with application not ready to serve yet errors. When I went to the dashboard, I found that version 1 (which is one and the only I've worked on so far) wasn't set as a default one. So, I set it as a default, and not ready to serve yet errors stopped happening. In a while though I started experiencing this500/503errors. --~--~-~--~~~---~--~~ You
[google-appengine] Re: GAEUnit problems w/ SDK 1.2.1?
Hi Ben,
We've added this restriction to make the dev_appserver work more like
the live App Engine datastore. I don't know exactly what GAEUnit is
doing, but it looks like there's a line like this in there:
datastore_file_stub.DatastoreFileStub('GAEUnitDataStore', None, None)
It should create the stub using the correct app id (e.g.
'butterpool'), which may be os.environ['APPLICATION_ID'] at that
point.
--Matthew
On Apr 23, 1:27 pm, Ben Nevile ben.nev...@gmail.com wrote:
since updating to SDK 1.2.1, GAEUnit is not able to access the
datastore. I was using GAEunit 1.2.2 before - just updated to 1.2.6,
but no love. Below is the error I get. Any tips?
Ben
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/ext/db/__init__.py, line 1346, in get
results = self.fetch(1)
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/ext/db/__init__.py, line 1390, in fetch
raw = self._get_query().Get(limit, offset)
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/api/datastore.py, line 942, in Get
return self._Run(limit, offset)._Next(limit)
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/api/datastore.py, line 883, in _Run
apiproxy_stub_map.MakeSyncCall('datastore_v3', 'RunQuery', pb,
result)
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/api/apiproxy_stub_map.py, line 68, in MakeSyncCall
apiproxy.MakeSyncCall(service, call, request, response)
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/api/apiproxy_stub_map.py, line 240, in MakeSyncCall
stub.MakeSyncCall(service, call, request, response)
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/api/datastore_file_stub.py, line 413, in
MakeSyncCall
response)
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/api/apiproxy_stub.py, line 80, in MakeSyncCall
method(request, response)
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/api/datastore_file_stub.py, line 518, in
_Dynamic_RunQuery
self.__ValidateAppId(app)
File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/
GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/
google/appengine/api/datastore_file_stub.py, line 237, in
__ValidateAppId
'app %s cannot access app %s\'s data' % (self.__app_id, app_id))
BadRequestError: app GAEUnitDataStore cannot access app butterpool's
data
ERROR
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: 500/503 Server Error on update
We're investigating this issue--can you send me the appid for your application (privately if you'd like) so I can verify it's the same issue we've seen elsewhere? As a workaround, either changing the major version version to an alternate version, or simply selecting the version you'd like to be default and clicking 'set default' should fix it. --Matthew On Apr 24, 3:07 pm, brightnesslevels brightnesslev...@gmail.com wrote: Well, I actually solved the 500 problem by changing the version number to 2 and the app deployed fine the first time. Now I'm getting Version is not ready to serve errors again (and again, and again). I checked my dashboard, and like before, none of the two versions was marked as default. I set version 2 to be the default one, but the not ready problem is still there. Now I've just tried setting my app version to 1 in app.yaml and deploy, and got error 500 again (: Eventually, by changing versions and redeploying, I got the latest version working, but I'm now not sure how exactly to deal with these problems in future. (: On Apr 24, 8:02 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi, There was a temporary problem with app deployment. It should be working fine again now. Regards, Nick Johnson On Apr 24, 4:53 pm, brightnesslevels brightnesslev...@gmail.com wrote: Just tried this on the most recent 1.2.1, and still getting the errors. On Apr 24, 7:41 pm, brightnesslevels brightnesslev...@gmail.com wrote: I've started using version 1.1.9 of Google App Engine about a week ago, and everything had been working okay (update-wise) until today. Now I'm getting either 500 or 503 error when I'm trying to update my app. Here's what's in the log: $ ../google_appengine/appcfg.py update --noisy . 2009-04-24 19:34:35,640 INFO appengine_rpc.py:373 Loaded authentication cookies from /home/sp/.appcfg_cookies 2009-04-24 19:34:35,640 INFO appengine_rpc.py:120 Server: appengine.google.com 2009-04-24 19:34:35,649 INFO appcfg.py:319 Checking for updates to the SDK. 2009-04-24 19:34:36,029 DEBUG appcfg.py:408 Skipping nag message 2009-04-24 19:34:36,030 INFO appcfg.py:1178 Reading app configuration. Scanning files on local disk. [ scans local files ] Initiating update. 2009-04-24 19:34:46,647 DEBUG appengine_rpc.py:308 Got http error, this is try #1 2009-04-24 19:34:57,584 DEBUG appengine_rpc.py:308 Got http error, this is try #2 2009-04-24 19:35:08,188 DEBUG appengine_rpc.py:308 Got http error, this is try #3 2009-04-24 19:35:18,783 DEBUG appengine_rpc.py:308 Got http error, this is try #4 2009-04-24 19:35:18,784 ERROR appcfg.py:1235 An unexpected error occurred. Aborting. Traceback (most recent call last): File /home/sp/c/python/google_appengine/google/appengine/tools/ appcfg.py, line 1213, in DoUpload missing_files = self.Begin() File /home/sp/c/python/google_appengine/google/appengine/tools/ appcfg.py, line 1009, in Begin version=self.version, payload=self.config.ToYAML()) File /home/sp/c/python/google_appengine/google/appengine/tools/ appengine_rpc.py, line 303, in Send f = self.opener.open(req) File /usr/lib/python2.5/urllib2.py, line 387, in open response = meth(req, response) File /usr/lib/python2.5/urllib2.py, line 498, in http_response 'http', request, response, code, msg, hdrs) File /usr/lib/python2.5/urllib2.py, line 425, in error return self._call_chain(*args) File /usr/lib/python2.5/urllib2.py, line 360, in _call_chain result = func(*args) File /usr/lib/python2.5/urllib2.py, line 506, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) HTTPError: HTTP Error 500: Internal Server Error Error 500: --- begin server output --- Server Error (500) A server error has occurred. --- end server output --- Earlier this day I had a number of issues with application not ready to serve yet errors. When I went to the dashboard, I found that version 1 (which is one and the only I've worked on so far) wasn't set as a default one. So, I set it as a default, and not ready to serve yet errors stopped happening. In a while though I started experiencing this 500/503 errors. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: URI Errors... logs?
Be sure to check the 'request' logs. If your app returned a non-200 response code but didn't log an error, it will not show up in the 'error' logs. On Apr 17, 9:43 am, Jesse Grosjean je...@hogbaysoftware.com wrote: I'm sorry if this has been covered elsewhere, but I can't seem to find it. In my apps Dashboard I see and errors box that looks like this: Errors URI Count % Errors /v1/documents 29 14% /v1/documents/3039-1/edits 1 100% I'm concerned about the first report with 29 errors. That's the main entry point into my application, and so I need to make it robust. The problem is I can't figure out what is going wrong. Though the errors are reported in the Dashboard I don't see any errors when I go look in the logs section. How can I find out more about what is causing those errors? Thanks, Jesse --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: urlfetch and another type of communication
Hi Ben, Thanks for raising these, sorry if this was frustrating, it would be a good feature to expose a more specific error here. As for the status site page, indeed it was not an issue directly in app engine or urlfetch. The site we were pointing the urlfetch test to had an issue, and the status site cannot itself distinguish between the remote server having issues and urlfetch having issues. The other test on the urlfetch status page reported almost 100% success at that time. You are correct that it would have been helpful if we'd noted that at the start of the investigation rather than the end. --Matthew On Apr 17, 9:06 am, Ben Nevile ben.nev...@gmail.com wrote: And hello again. So I woke up this morning to see that the issue had been marked resolved, and that you determined that the spike did not affect your customers. I was furious! But then I actually took the time to carefully debug my application, and I see that in fact the problem was mine. I was trying to fetch a URL with an unescaped space in it. I'm sorry that I'm such a tool. My cred is out the window at this point I know, but if you want to stem future frustration from and for idiots like me, a more helpful error message would be a good place to start. Here's the trace that pops out now: preTraceback (most recent call last): File quot;/base/python_lib/versions/1/google/appengine/ext/webapp/ __init__.pyquot;, line 501, in __call__ handler.get(*groups) File quot;controllers/migration.pyquot;, line 187, in get x = p.points100_in_between_dates(datetime(2009,4,14),datetime (2009,6,14)) File quot;models/player.pyquot;, line 49, in points100_in_between_dates stats = self.stats_in_between_dates(start_date,end_date) File quot;models/player.pyquot;, line 41, in stats_in_between_dates stats = json.read(urlfetch.fetch(url).content) File quot;/base/python_lib/versions/1/google/appengine/api/urlfetch.pyquot;, line 267, in fetch raise DownloadError(str(e)) DownloadError: ApplicationError: 2 How about BadUrlError or something like that? Ben On Apr 16, 10:21 pm, Ben Nevile ben.nev...@gmail.com wrote: So I'm aware that Google is aware that there areurlfetchissues tonight. At least, that's what I'm lead to believe at the GAE System Status page, where the problem has been marked as Anomaly for the last 5 hours or so. But I have no feedback other than that. Please Google, I'm sorry to whine at you, but I need a little feedback. Should I be making adjustments to my software to reduce dependency onurlfetch? Is there a team of people figuring out what's wrong, or just one lonely, frantic person? Was there a fire? You are a big animal and I am just a small gnat, trying to make a living by riding on your back. Perhaps that was an unwise choice. It cost me more money to host at my last place, but at least in a situation like this I could make a phone call. Ben --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Entire site down now..
We are investigating this deployment issue now. You can redeploy using an alternate major version in your app.yaml file, test the major version using majorversion.latest.yourapp.appspot.com, then switch major versions using the set default version feature of the Admin Console. --Matthew On Apr 15, 4:00 pm, Ben Nevile ben.nev...@gmail.com wrote: I went to the Versions pane of the Administration section and no version was highlighted as a default. So I chose one and made it the default. Now pages are serving again. scared to deploy... Ben On Apr 15, 3:39 pm, bvelasquez bvelasq...@gmail.com wrote: Ok, I'm not happy it happened to you, but now know it's not something I did. Bah! Help Google! Barry On Apr 15, 3:38 pm, Ben Nevile ben.nev...@gmail.com wrote: It's not just you. One of my apps is down too. I was getting errors deploying, and now it has completely shut off. The timing of this is TERRIBLE for me. Biggest few hours of the year for my particular application are about to happen between 4pm and 10pm PST tonight. PLEASE Google help! Ben On Apr 15, 3:32 pm, bvelasquez bvelasq...@gmail.com wrote: Error: Not Found The requested URL / was not found on this server. My entire site is gone now. http://www.tapingya.comorhttp://tapingya.appspot.com Is this just me or a GAE issue? Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Access to module file denied (PIL)
Is 'img_folder' a static file? If so, you can't access it directly
using 'open'.
For efficiency, App Engine stores and serves static files separately
from application files. Static files are not available in the
application's file system. If you have data files that need to be read
by the application code, the data files must be application files, and
must not be matched by a static file pattern.
http://code.google.com/appengine/docs/python/tools/configuration.html#Static_File_Handlers
If it's not a static file, then it should work, though I'm not sure
(not having personally used it) what the db.Blob conversion will do
there--probably nothing. An example of using the images api with
uploaded data can be found in the images-demo example:
http://code.google.com/p/google-app-engine-samples/source/browse/trunk/images-demo/images_demo.py#159
http://images-demo.appspot.com/
--Matthew
On Feb 23, 6:13 am, Mladen Stanojevic smla...@gmail.com wrote:
But, what if I want to use already uploaded image file, not images
from DB??
This code produces BadImageError:
img_path = os.path.join(os.path.abspath(os.path.dirname
(__file__)), 'img_folder', 'img_file_name')
img_blob = db.Blob(open(img_path).read())
img = images.Image(img_blob)
img.resize(width=80, height=100)
img.im_feeling_lucky()
thumbnail = img.execute_transforms()
Mladen
On Feb 11, 3:34 am, Ian Lewis ianmle...@gmail.com wrote:
Matthew,
I'm using the images api. Up until 1.1.9 my understanding was that importing
PIL wouldn't work in production (and with 1.1.9 it's enforcing it on the
dev_server?). Let me pull out the code here,
models.py
class UserProfileImage(db.Model):
user = db.ReferenceProperty(UserProperties, required=True)
image = db.BlobProperty(required=True)
mimetype = db.StringProperty(required=True)
views.py
...
def user_settings(request):
The user settings page.
if request.method == 'POST':
...
if not request.user.use_gravatar and 'profile_image' in request.FILES:
from google.appengine.api import images
old_profile_image = UserProfileImage.all().filter('user =',
request.user).get()
uploaded_file = request.FILES['profile_image']
# There should be only one chunk as we can only upload to memory
image = images.Image(uploaded_file.chunks().next())
new_width = image.width
new_height = image.height
if image.width 80 or image.height 80:
new_width = 80
new_height = 80
image.resize(new_width, new_height)
image_data = image.execute_transforms(output_encoding=images.PNG)
profile_image = UserProfileImage(user=request.user, \
image=image_data, \
mimetype='image/png')
profile_image.put()
if old_profile_image:
old_profile_image.delete()
...
Ian
On Wed, Feb 11, 2009 at 3:52 AM, Matthew Blain
matthew.bl...@google.comwrote:
Hello Ian,
How are you accessing PIL? Are you using the Images API* , or are you
importing from PIL directly?
--Matthew
*http://code.google.com/appengine/docs/python/images/
On Feb 10, 5:47 am, Ian Lewis ianmle...@gmail.com wrote:
I'm getting an error similar to the errors about not being able to
access
skipped files with appengine-django but this time I'm getting an error
about
not being able to access the PIL module file Image.py
I'm getting a different error pertaining to PIL now. This may or may not
be
related to appengine-django.
DEBUG2009-02-10 13:41:24,134 dev_appserver.py] Access to module file
denied: /usr/lib/python2.5/site-packages/PIL/Image.py
This causes the dev appserver to hang and use up lots of CPU. I'm using
appengine-django and updated to the latest version in svn.
Ian
--
===
株式会社ビープラウド イアン・ルイス
〒150-0012
東京都渋谷区広尾1-11-2アイオス広尾ビル604
email: ianmle...@beproud.jp
TEL：03-5795-2707
FAX：03-5795-2708http://www.beproud.jp/
===
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: upgrade to SDK 1.1.9 problems
Hi Tony, This suggests to me that there is something unusual with your installation. Does the sdk_dir parameter exist in CreateServer in C: \Program Files (x86)\Google\google_appengine\google\appengine \tools\dev_appserver.py ? One possible cause is that if files in the previous version are modified in any way then the new version won't overwrite the modified files. The easiest way to fix this issue is to uninstall and reinstall the SDK. --Matthew On Feb 13, 7:15 am, Tony Smith tonyy...@gmail.com wrote: Hi, Really nobody else has this problem? I can't start the dev server. Thanks, Tony --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: upgrade to SDK 1.1.9 problems
There should be no other folders affecting this. Can you compare the dev_appserver file you have on your machine at C: \Program Files (x86)\Google\google_appengine\google\appengine \tools\dev_appserver.py with the one at http://code.google.com/p/googleappengine/source/browse/trunk/google/appengine/tools/dev_appserver.py ? --Matthew On Feb 13, 10:36 am, Tony Smith tonyy...@gmail.com wrote: I did uninstall the SDK and reinstalled it. Twice. It did not help. Are there any other files (setup, etc) that I need to delete? From other folders than the Program Files appengine folder? Thanks, Tony On Feb 13, 12:40 pm, Matthew Blain matthew.bl...@google.com wrote: Hi Tony, This suggests to me that there is something unusual with your installation. Does the sdk_dir parameter exist in CreateServer in C: \Program Files (x86)\Google\google_appengine\google\appengine \tools\dev_appserver.py ? One possible cause is that if files in the previous version are modified in any way then the new version won't overwrite the modified files. The easiest way to fix this issue is to uninstall and reinstall the SDK. --Matthew On Feb 13, 7:15 am, Tony Smith tonyy...@gmail.com wrote: Hi, Really nobody else has this problem? I can't start the dev server. Thanks, Tony --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Access to module file denied (PIL)
Good to hear. Is the PIL issue still occurring? Does it happen for all
apps? Does the images-demo sample app in
http://code.google.com/p/google-app-engine-samples/
(it's there but there's no archive for it) work?
--Matthew
On Feb 10, 9:24 pm, Ian Lewis ianmle...@gmail.com wrote:
I found that this seems unrelated to the message about the PIL module and
was related to the local datastore I was using.
On Wed, Feb 11, 2009 at 12:36 PM, Ian Lewis ianmle...@gmail.com wrote:
Matthew,
I also wanted like to mention that this happens to me on every request
which is why I suspected appengine-django. I don't actually import the image
api unless I am saving a profile image.
On Wed, Feb 11, 2009 at 11:34 AM, Ian Lewis ianmle...@gmail.com wrote:
Matthew,
I'm using the images api. Up until 1.1.9 my understanding was that
importing PIL wouldn't work in production (and with 1.1.9 it's enforcing it
on the dev_server?). Let me pull out the code here,
models.py
class UserProfileImage(db.Model):
user = db.ReferenceProperty(UserProperties, required=True)
image = db.BlobProperty(required=True)
mimetype = db.StringProperty(required=True)
views.py
...
def user_settings(request):
The user settings page.
if request.method == 'POST':
...
if not request.user.use_gravatar and 'profile_image' in
request.FILES:
from google.appengine.api import images
old_profile_image = UserProfileImage.all().filter('user =',
request.user).get()
uploaded_file = request.FILES['profile_image']
# There should be only one chunk as we can only upload to memory
image = images.Image(uploaded_file.chunks().next())
new_width = image.width
new_height = image.height
if image.width 80 or image.height 80:
new_width = 80
new_height = 80
image.resize(new_width, new_height)
image_data = image.execute_transforms(output_encoding=images.PNG)
profile_image = UserProfileImage(user=request.user, \
image=image_data, \
mimetype='image/png')
profile_image.put()
if old_profile_image:
old_profile_image.delete()
...
Ian
On Wed, Feb 11, 2009 at 3:52 AM, Matthew Blain
matthew.bl...@google.comwrote:
Hello Ian,
How are you accessing PIL? Are you using the Images API* , or are you
importing from PIL directly?
--Matthew
*http://code.google.com/appengine/docs/python/images/
On Feb 10, 5:47 am, Ian Lewis ianmle...@gmail.com wrote:
I'm getting an error similar to the errors about not being able to
access
skipped files with appengine-django but this time I'm getting an error
about
not being able to access the PIL module file Image.py
I'm getting a different error pertaining to PIL now. This may or may
not be
related to appengine-django.
DEBUG2009-02-10 13:41:24,134 dev_appserver.py] Access to module
file
denied: /usr/lib/python2.5/site-packages/PIL/Image.py
This causes the dev appserver to hang and use up lots of CPU. I'm using
appengine-django and updated to the latest version in svn.
Ian
--
===
株式会社ビープラウド イアン・ルイス
〒150-0012
東京都渋谷区広尾1-11-2アイオス広尾ビル604
email: ianmle...@beproud.jp
TEL：03-5795-2707
FAX：03-5795-2708
http://www.beproud.jp/
===
--
===
株式会社ビープラウド イアン・ルイス
〒150-0012
東京都渋谷区広尾1-11-2アイオス広尾ビル604
email: ianmle...@beproud.jp
TEL：03-5795-2707
FAX：03-5795-2708
http://www.beproud.jp/
===
--
===
株式会社ビープラウド イアン・ルイス
〒150-0012
東京都渋谷区広尾1-11-2アイオス広尾ビル604
email: ianmle...@beproud.jp
TEL：03-5795-2707
FAX：03-5795-2708http://www.beproud.jp/
===
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: upgrade to 1.19 breaks appengine
Hi sagey, This message looks like it's coming as part of the update check, which has not significantly changed recently. It's possible there was a transient network issue somewhere, do you still see this happening? Can you access the admin console from your computer? --Matthew On Feb 10, 5:13 am, sagey sage...@gmail.com wrote: after installing 1.1.99 i get the following message on an app that previous worked. I've tried uninstalling 1.1.9 and reinstalling. i've tried uninstalling 1.1.9 and installing 1.1.7 and i still get the same message. I'm hoping someone can help please? C:\Program Files\Google\google_appengine\google\appengine\tools \appcfg.py:40: De precationWarning: the sha module is deprecated; use the hashlib module instead import sha INFO 2009-02-10 13:10:20,351 appengine_rpc.py] Server: appengine.google.com INFO 2009-02-10 13:10:20,351 appcfg.py] Checking for updates to the SDK. Traceback (most recent call last): File C:\Program Files\Google\google_appengine\dev_appserver.py, line 60, in module run_file(__file__, globals()) File C:\Program Files\Google\google_appengine\dev_appserver.py, line 57, in run_file execfile(script_path, globals_) File C:\Program Files\Google\google_appengine\google\appengine\tools \dev_apps erver_main.py, line 463, in module sys.exit(main(sys.argv)) File C:\Program Files\Google\google_appengine\google\appengine\tools \dev_apps erver_main.py, line 424, in main update_check.CheckForUpdates() File C:\Program Files\Google\google_appengine\google\appengine\tools \appcfg.p y, line 326, in CheckForUpdates api_versions=version[api_versions]) File C:\Program Files\Google\google_appengine\google\appengine\tools \appengin e_rpc.py, line 303, in Send f = self.opener.open(req) File C:\Python26\lib\urllib2.py, line 383, in open response = self._open(req, data) File C:\Python26\lib\urllib2.py, line 401, in _open '_open', req) File C:\Python26\lib\urllib2.py, line 361, in _call_chain result = func(*args) File C:\Python26\lib\urllib2.py, line 1130, in http_open return self.do_open(httplib.HTTPConnection, req) File C:\Python26\lib\urllib2.py, line 1103, in do_open r = h.getresponse() File C:\Python26\lib\httplib.py, line 950, in getresponse response.begin() File C:\Python26\lib\httplib.py, line 390, in begin version, status, reason = self._read_status() File C:\Python26\lib\httplib.py, line 354, in _read_status raise BadStatusLine(line) httplib.BadStatusLine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Access to module file denied (PIL)
Hello Ian, How are you accessing PIL? Are you using the Images API* , or are you importing from PIL directly? --Matthew * http://code.google.com/appengine/docs/python/images/ On Feb 10, 5:47 am, Ian Lewis ianmle...@gmail.com wrote: I'm getting an error similar to the errors about not being able to access skipped files with appengine-django but this time I'm getting an error about not being able to access the PIL module file Image.py I'm getting a different error pertaining to PIL now. This may or may not be related to appengine-django. DEBUG 2009-02-10 13:41:24,134 dev_appserver.py] Access to module file denied: /usr/lib/python2.5/site-packages/PIL/Image.py This causes the dev appserver to hang and use up lots of CPU. I'm using appengine-django and updated to the latest version in svn. Ian --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
