Re: [google-appengine] Re: Google App Engine remote_api returns 404 using remote_api_shell.py
Try uploading/deploying your code sometimes it just needs to be pushed to google. I’m not sure how I ended up solving this exactly. I have had lots of issues with the remote API. On Dec 16, 2013, at 6:41 AM, Ying Ding yd...@corp.lawyer.com wrote: I ran into this problem today too. Have you solved your problem? Hope you can see this and drop a line about your solution. Thank you! On Friday, September 6, 2013 1:12:02 AM UTC-4, Andrew Free wrote: I'm using googles built in tool for connecting to the remote api so I don't even have info in my client or app.yaml I could change. I have no idea why I suddenly cant connect. My friend who is also working on the project with me tried on his machine and got the same error. It was working fine for the past couple months. I'm also using the remote_api_shell so it can't be something in my code? My app.yaml has builtins: - remote_api: on [ rever ~/Documents/buybottmerge/buybott-gae ] remote_api_shell.py -s myappname.appspot.com Traceback (most recent call last): File /usr/local/bin/remote_api_shell.py, line 171, in module run_file(__file__, globals()) File /usr/local/bin/remote_api_shell.py, line 167, in run_file execfile(script_path, globals_) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/remote_api_shell.py, line 152, in module main(sys.argv) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/remote_api_shell.py, line 148, in main appengine_rpc.HttpRpcServer) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/remote_api_shell.py, line 76, in remote_api_shell rpc_server_factory=rpc_server_factory) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py, line 725, in ConfigureRemoteApi app_id = GetRemoteAppIdFromServer(server, path, rtok) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py, line 568, in GetRemoteAppIdFromServer response = server.Send(path, payload=None, **urlargs) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appengine_rpc.py, line 393, in Send f = self.opener.open(req) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 400, in open response = meth(req, response) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 513, in http_response 'http', request, response, code, msg, hdrs) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 438, in error return self._call_chain(*args) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 372, in _call_chain result = func(*args) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 521, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 404: Not Found I can see the errors on my logs in the dashboard as well. So something is working well enough for it to get that far before failing. 2013-09-05 18:13:35.735 /_ah/remote_api?rtok=569217424211 404 4ms 0kb Google-remote_api/1.0 Darwin/12.4.0 Python/2.7.2.final.0 gzip 50.53.136.79 - - [05/Sep/2013:18:13:35 -0700] GET /_ah/remote_api?rtok=569217424211 HTTP/1.1 404 130 - Google-remote_api/1.0 Darwin/12.4.0 Python/2.7.2.final.0 gzip myappname.appspot.com ms=4 cpu_ms=0 cpm_usd=0.15 app_engine_release=1.8.4 instance=00c61b117cbd87090d90186a5635840f196c4d14 -- You received this message because you are subscribed to a topic in the Google Groups Google App Engine group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/t7L4URlUr0A/unsubscribe. To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr
[google-appengine] Re: Google App Engine remote_api returns 404 using remote_api_shell.py
I use the deploy built into that app engine launcher that comes with the SDK on osx. I don't know if that is the same thing. I read about doing a normal appcfg update to fix this but it doesn't seem to be the problem for me. On Friday, October 18, 2013 8:03:13 AM UTC-7, gumptionthomas wrote: I know this is a little late, but are you using the git-push-to-deploy feature on your app? I've found that the builtins defined in app.yaml do not work after a push-to-deploy (they return 404s) but doing a normal appcfg update makes them work again. I experienced these 404 failures after push-deploys with both remote_api and deferred. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Google App Engine remote_api returns 404 using remote_api_shell.py
I'm on OS X but the path is correct. Again I'm getting logs on the server side so something is working to a degree. Tried updating/deploying it and still having the same issue. On Friday, September 6, 2013 12:49:06 AM UTC-7, Sercan Altundas wrote: Probably the SDK path is invalid. If so try this. Open the tool, Edit -- Preferences -- Appengine SDK:* C:\Program Files (x86)\Google\google_appengine* and update your application writing this line in *cmd*, *appcfg.py update your_apps_path* -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Google App Engine remote_api returns 404 using remote_api_shell.py
I'm using googles built in tool for connecting to the remote api so I don't even have info in my client or app.yaml I could change. I have no idea why I suddenly cant connect. My friend who is also working on the project with me tried on his machine and got the same error. It was working fine for the past couple months. I'm also using the remote_api_shell so it can't be something in my code? My app.yaml has builtins: - remote_api: on [ rever ~/Documents/buybottmerge/buybott-gae ] remote_api_shell.py -s myappname.appspot.comTraceback (most recent call last): File /usr/local/bin/remote_api_shell.py, line 171, in module run_file(__file__, globals()) File /usr/local/bin/remote_api_shell.py, line 167, in run_file execfile(script_path, globals_) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/remote_api_shell.py, line 152, in module main(sys.argv) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/remote_api_shell.py, line 148, in main appengine_rpc.HttpRpcServer) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/remote_api_shell.py, line 76, in remote_api_shell rpc_server_factory=rpc_server_factory) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py, line 725, in ConfigureRemoteApi app_id = GetRemoteAppIdFromServer(server, path, rtok) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py, line 568, in GetRemoteAppIdFromServer response = server.Send(path, payload=None, **urlargs) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/appengine_rpc.py, line 393, in Send f = self.opener.open(req) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 400, in open response = meth(req, response) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 513, in http_response 'http', request, response, code, msg, hdrs) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 438, in error return self._call_chain(*args) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 372, in _call_chain result = func(*args) File /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py, line 521, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 404: Not Found I can see the errors on my logs in the dashboard as well. So something is working well enough for it to get that far before failing. 2013-09-05 18:13:35.735 /_ah/remote_api?rtok=569217424211 404 4ms 0kb Google-remote_api/1.0 Darwin/12.4.0 Python/2.7.2.final.0 gzip 50.53.136.79 - - [05/Sep/2013:18:13:35 -0700] GET /_ah/remote_api?rtok=569217424211 HTTP/1.1 404 130 - Google-remote_api/1.0 Darwin/12.4.0 Python/2.7.2.final.0 gzip myappname.appspot.com ms=4 cpu_ms=0 cpm_usd=0.15 app_engine_release=1.8.4 instance=00c61b117cbd87090d90186a5635840f196c4d14 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Google App Engine trying to access dev data
I guess --default_partition was removed in the new SDK, doesn't help but at least explains why that would not work. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Google App Engine trying to access dev data
I opened /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/devappserver2/application_configuration.py and edited the line 84 to say self._application = 's~%s' % self._app_info_external.application instead of self._application = 'dev~%s' % self._app_info_external.application It fixed the problem but I should't have to do that... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Google App Engine trying to access dev data
I'm running my app on my local machine and using the remote API to access a datastore on my production side. Everything was working great until I tried adding a second app in google app engine launcher (I believe this is what caused the issue) because I had to merge what I was working on with some more up to date code and wanted to test as I went along. Suddenly I can't even access the remote datastore anymore. I get the error app s~buybottandrew cannot access app dev~buybottandrew's data I tried clearing the local datastore which allows me to access the remote datastore once, then the problem comes up again. I read suggestions on the default_partition flag and I've tried passing that as well, with a muitiplicity of different things including nothing and an empty string. --default_partition=s~buybottandrew It gives me the same error no matter the argument dev_appserver.py: error: unrecognized arguments: --default_partition=s~buybottandrew If I remove all my remote api code and deploy it when I test it on the production server everything works perfectly. I can't seem to narrow down what is going on for the life of me. Any input would be greatly appreciated. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Memory usage while parsing XML file into Google App Engine datastore
I'm trying to parse a big (5GB) XML file (product catalog) into a google datastore. The issue I am having is it taking up a lot of memory. I was able to get the memory down from the parsing part by reading it line by line and deleting elements as I go. However something is still sticking behind. My code is http://pastebin.com/ESARQikC I believe the issue is occuring in this specific function (process_element) def process_element(self,item): if item.tag == programname: self.Plist.append(item.text) elif item.tag == 'name': self.Plist.append(item.text) elif item.tag == 'description': self.Plist.append(item.text) elif item.tag == 'sku': self.Plist.append(item.text) elif item.tag == 'manufacturer': self.Plist.append(item.text) elif item.tag == 'price': self.Plist.append(item.text) elif item.tag == 'buyurl': self.Plist.append(item.text) elif item.tag == 'imageurl': self.Plist.append(item.text) elif item.tag == 'advertisercategory': self.Plist.append(item.text) elif item.tag==product: Product( programname=(%s % self.Plist[0]), name=(%s % self.Plist[1]), description=(%s % self.Plist[2][0:500]), sku=(%s % self.Plist[3]), manufacturer=(%s % self.Plist[4]), price=(%s % self.Plist[5]), buyurl=(%s % self.Plist[6]), imageurl=(%s % self.getBigImageUrl(self.Plist[7])), advertisercategory=(%s % self.Plist[8])).put() self.count+=1 print self.count if self.count%15000 == 0: time.sleep(1) for ob in self.Plist: del ob del self.Plist self.Plist=[] del item When I comment out the Product().put() line and run it, it can go through tons of lines without making much of a memory impact. The reason I added the sleep in the middle of it is I was thinking some subprocesses that GAE spawns were adding the data to the datastore and might need some time to operate. So I waited after adding 15000 items to see if any ram would be freed up (purged memory on the OS side as well) however it did not help. Is this something in my code or something I can't change related to adding data to a datastore. I'm stuck and confused after hours/days of playing around with it. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Memory usage while parsing XML file into Google App Engine datastore
My understanding is that the map reduce is run after the items are already in the datastore? Not while they are being added? On Tuesday, July 30, 2013 7:26:52 AM UTC-7, ruben...@infotechfl.com wrote: That large of a file/job seems like a job for MapReduce rather than AppEngine front or backend instances, IMO. My 2c. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
