[google-appengine] Re: Google AppEngine - Firewall Notification:Your access has been blocked by firewall policy 732
Hi again Deepak, Indeed, this got put on hold because, while we do refer people to Stack Overflow, Stack has its own set of rules for questions, and your question is on hold because it's not clear reading it that your issue is code related. Reading your question, it's unclear where your issue arises and what causes it. Honestly looking into it I'd just say ask your network admin to check your firewall, because with the info you gave, the issue seems to be there. This makes it off-topic for stack indeed. Including more information will get it reopened, provided that the added information follows Stack's how to ask a good question article http://stackoverflow.com/help/how-to-ask. But again, even if you add code, this is still a bit unclear, as it's still not indicated what fails to access what. Is it your dev_server that cannot access one URL, all URLs, or is it that once you deploy, your app cannot access some URLs, or other appspots, or even your devserver? I would suggest you edit your question extensively on Stack, including the code you've just given, and a clearer problem statement. At that point the question will be sent to the reopen queue, where members can vote to have it reopened for answers. Cheers! On Wednesday, July 29, 2015 at 10:50:39 AM UTC-4, Deepak Kumar wrote: Hi Patrice, Thanks for your quick response. I posted this on Stack Overflow as well ( http://stackoverflow.com/questions/31685166/google-appengine-firewall-notificationyour-access-has-been-blocked-by-firewal http://www.google.com/url?q=http%3A%2F%2Fstackoverflow.com%2Fquestions%2F31685166%2Fgoogle-appengine-firewall-notificationyour-access-has-been-blocked-by-firewalsa=Dsntz=1usg=AFQjCNG5feSR3dO0Xk6OqvpvogBY6GDkuA ) but they have marked this 'On Hold', and thats why i posted this here. further, just for clarification.. In my web app, I am trying to fetch a url (outside from google cloud network, lets say hosted on AWS or GoDaddy) and if i print that url response.. i get this warning message. And this is coming for every url access. URL url = new URL(urlString); HttpURLConnection conn = (HttpURLConnection) url.openConnection(); conn.setConnectTimeout(REQUEST_TIME_OUT); conn.setReadTimeout(REQUEST_TIME_OUT); conn.setDoOutput(true); int length = dataToBePost.length(); conn.setRequestProperty(Content-Length, (String.valueOf(length))); OutputStreamWriter wr = new OutputStreamWriter(conn.getOutputStream()); wr.write(dataToBePost); wr.flush(); InputStream inStream = conn.getInputStream(); //using inStream now On Wednesday, 29 July 2015 00:46:50 UTC+5:30, Deepak Kumar wrote: I am trying to fetch http url in my app, it works fine on my local server (dev env) but when i deploy this on Google AppEngine.. it shows below Firewall Notification Firewall Notification - Your access has been blocked by firewall policy 732. If you have any further concerns, please contact your network administrator for more information. I am not getting even a single clue... Can anyone help me out? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/111f4ac2-7e62-4d28-8861-6b149ecc6f24%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Google AppEngine - Firewall Notification:Your access has been blocked by firewall policy 732
Hi Patrice, Just for more clarification..Lets say i have a appspot app deployed at http://google.appspot.com, now this app internally fetches the http://google.com and performs some operation like build and returns json response out of http://google.com url fetch response. Now, when i access to http://google.appspot.com, it should return json response (because it gets the result from http://google.com and prepare the json ), so while fetching http://google.appspot.com from the browser i get this warning. And if i change http://google.com to some other url then also its not working.. 1. I access to http://google.appspot.com from my browser 2. http://google.appspot.com access to http://google.com (*here is the problem*) these urls are for example purpose only. I hope it will clear the question now :) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/a989352a-a063-4988-87cb-ffb9897c79e9%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Dev App server giving error Call to undefined function move_uploaded_file()
I believe this is a known issue of gcloud. Please use the App Engine SDK for now: https://cloud.google.com/appengine/downloads On Tue, Jul 28, 2015 at 2:03 AM, Paul Canning p...@drawandcode.com wrote: Google Cloud SDK 0.9.70 app 2015.07.16 app-engine-java 1.9.23 app-engine-python 1.9.23 app-engine-python-extras 1.9.21 bq 2.0.18 bq-win 2.0.18 core 2015.07.16 core-win 2015.06.02 gcloud 2015.07.16 gsutil 4.13 gsutil-win 4.12 preview 2015.07.16 windows-ssh-tools 2015.06.02 On Tue, Jul 28, 2015 at 12:31 AM, Mars Lan mars...@google.com wrote: What version of SDK are you using? On Mon, Jul 27, 2015 at 4:25 PM, Paul Canning p...@drawandcode.com wrote: I'll give it a go, but like I said, I've never used those flags before and it's worked fine. Why all of a sudden do I need to use them? On 28 Jul 2015 00:16, Mars Lan mars...@google.com wrote: The documentation is a bit behind, but the corresponding flags are --php_executable_path --php_gae_extension_path. They are automatically specified when running from the launcher, and you can see the exact command from the log window. On Mon, Jul 27, 2015 at 4:11 PM, Paul Canning p...@drawandcode.com wrote: Can you link to any documentation? I've never had to do that before. I've always just ran dev_appserver.py app.yaml and it worked. On 28 Jul 2015 00:07, Mars Lan mars...@google.com wrote: In the command line you'll need to point to the bundled PHP interpreter and GAE extension in order for things to work correctly. On Mon, Jul 27, 2015 at 2:34 PM, Paul Canning p...@drawandcode.com wrote: Sorry my reply was to the message above yours. I'll do a full break down tomorrow. Despite posting in the wrong place, has anyone got any insight on this issue? On 27 Jul 2015 22:21, Nick (Cloud Platform Support) pay...@google.com wrote: Hey Paul, It's great to provide that info. As I mentioned in my reply, I think this should move to stackoverflow, where you'll find a lot more people who can help. Be sure to include the full error message and code context when you do so. Best wishes, Nick On Monday, July 27, 2015 at 5:19:20 PM UTC-4, Paul Canning wrote: Windows 7, 64bit. Via terminal. This worked in the same dev environment just a week or so ago. And as mentioned, works flawlessly on my deployment module. Same code, same PHP version. On 27 Jul 2015 22:03, Mars Lan mars...@google.com wrote: What OS are you running dev_appserver on? Are you using terminal or launcher? On Monday, July 27, 2015 at 3:27:21 AM UTC-7, Paul Canning wrote: The dev app server has started giving me the error: Call to undefined function move_uploaded_file() I am using this same function on a live module and it has worked perfectly in the past on the dev server. I am using PHP 5.5, defined in the config yaml file. -- - Paul Canning [ software artist ] - [drawcode] digital creative studio +44 (0)151 329 0900 Website http://www.drawandcode.com/ / Twitter https://twitter.com/DrawAndCode / Facebook https://www.facebook.com/drawandcode / Vimeo https://vimeo.com/drawandcode - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CAHU-9Behak6cqxgTPGUYMfWYHauphjJB3RU7%3D%3D%2B9rq1apV0_TA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Dev App server giving error Call to undefined function move_uploaded_file()
I got it to work using the PHP executable path flag, but yea, would be nice for it to work as it did previously! On 29 Jul 2015 22:31, Mars Lan mars...@google.com wrote: I believe this is a known issue of gcloud. Please use the App Engine SDK for now: https://cloud.google.com/appengine/downloads On Tue, Jul 28, 2015 at 2:03 AM, Paul Canning p...@drawandcode.com wrote: Google Cloud SDK 0.9.70 app 2015.07.16 app-engine-java 1.9.23 app-engine-python 1.9.23 app-engine-python-extras 1.9.21 bq 2.0.18 bq-win 2.0.18 core 2015.07.16 core-win 2015.06.02 gcloud 2015.07.16 gsutil 4.13 gsutil-win 4.12 preview 2015.07.16 windows-ssh-tools 2015.06.02 On Tue, Jul 28, 2015 at 12:31 AM, Mars Lan mars...@google.com wrote: What version of SDK are you using? On Mon, Jul 27, 2015 at 4:25 PM, Paul Canning p...@drawandcode.com wrote: I'll give it a go, but like I said, I've never used those flags before and it's worked fine. Why all of a sudden do I need to use them? On 28 Jul 2015 00:16, Mars Lan mars...@google.com wrote: The documentation is a bit behind, but the corresponding flags are --php_executable_path --php_gae_extension_path. They are automatically specified when running from the launcher, and you can see the exact command from the log window. On Mon, Jul 27, 2015 at 4:11 PM, Paul Canning p...@drawandcode.com wrote: Can you link to any documentation? I've never had to do that before. I've always just ran dev_appserver.py app.yaml and it worked. On 28 Jul 2015 00:07, Mars Lan mars...@google.com wrote: In the command line you'll need to point to the bundled PHP interpreter and GAE extension in order for things to work correctly. On Mon, Jul 27, 2015 at 2:34 PM, Paul Canning p...@drawandcode.com wrote: Sorry my reply was to the message above yours. I'll do a full break down tomorrow. Despite posting in the wrong place, has anyone got any insight on this issue? On 27 Jul 2015 22:21, Nick (Cloud Platform Support) pay...@google.com wrote: Hey Paul, It's great to provide that info. As I mentioned in my reply, I think this should move to stackoverflow, where you'll find a lot more people who can help. Be sure to include the full error message and code context when you do so. Best wishes, Nick On Monday, July 27, 2015 at 5:19:20 PM UTC-4, Paul Canning wrote: Windows 7, 64bit. Via terminal. This worked in the same dev environment just a week or so ago. And as mentioned, works flawlessly on my deployment module. Same code, same PHP version. On 27 Jul 2015 22:03, Mars Lan mars...@google.com wrote: What OS are you running dev_appserver on? Are you using terminal or launcher? On Monday, July 27, 2015 at 3:27:21 AM UTC-7, Paul Canning wrote: The dev app server has started giving me the error: Call to undefined function move_uploaded_file() I am using this same function on a live module and it has worked perfectly in the past on the dev server. I am using PHP 5.5, defined in the config yaml file. -- - Paul Canning [ software artist ] - [drawcode] digital creative studio +44 (0)151 329 0900 Website http://www.drawandcode.com/ / Twitter https://twitter.com/DrawAndCode / Facebook https://www.facebook.com/drawandcode / Vimeo https://vimeo.com/drawandcode - -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CAH%2B40aOFzzOu0RPm9%3DuC2-%3DbwPOqdG2wnnzVL%3DXyLXa9jaR%2B%2Bg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] cloudstorage library and URLFetch quotas - workaround?
We use Cloud Storage to store large elasticsearch results (from aggregations - so scan+scroll isn't going to work here). To handle these large aggregations in parallel, we store them as multiline JSON dumps that is sourced from a managed vm. As a result, to perform *parallel processing*, many *app engine *instances will open this file at once, and as a result, *hit the URLFetch rate limit* because of this documented limitation: and the calls count against your URL fetch quota, as the library uses the URL Fetch service to interact with Cloud Storage. - https://cloud.google.com/appengine/docs/python/googlecloudstorageclient/ *Here's the resulting exception:* https://lh3.googleusercontent.com/-WbU1UiwCB2s/VbkWhCRDMjI/AH0/Ta3WBGEC0n0/s1600/Screenshot%2B2015-07-28%2B17.07.40.png *Here's the code that opens the file:* import cloudstorage as gcs def open_file(path, mode, **kwargs): f = gcs.open(path, mode=mode, **kwargs) if not f: raise Exception(File could not be opened: %s % path) return f -- We need a method of communicating with Cloud Storage that bypasses the URLFetch quotas and rate limits, or it becomes impossible for us to effectively execute parallel processing. *Is there a method of reading GCS files from App Engine that does not route through URLFetch*, much like the datastore API does not incur url fetch rate limits? I've detailed this question on Stackoverflow as well: http://stackoverflow.com/questions/31707961/urlfetch-rate-limits-with-google-cloud-storage -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/ffbec1ff-ed10-490d-b908-797bc6364398%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Looking for advice on best way to use memcache/datastore w front-end/back-end
So I have a rest service that is powered by the datastore. We have a angular front-end and java backend, and use REST to access the datastore data. To keep the front-end up-to-date, I want to access the datastore data once per day, and store once per day. I assume I should access it once at the beginning of the day and store it in the memcache. Then, I should access the memcache every time a user loads the page. Assuming this is correct, should I access the memcache from the java end and make a rest call every time the user loads the page, or should I access the memcache directly from the front-end? Thanks, -Keith -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/bce1adfc-a9cb-4dd8-81e6-8162a8a44ae1%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Question regarding deleting entities from datastore
Try flushing memcache and see if the issue persists. ( You're probably getting the entity by key via ndb / objectify /etc that will query memcache / in-context cache first whether an entity exists only then query the datastore. Since you removed the entity directly from the datastore and not the way you put it there - memcache had no way of knowing that and thus keeps returning things until it expires / gets flushed. See more details here https://cloud.google.com/appengine/docs/python/ndb/cache, so yeah, it's probably working as expected. ) Thanks, Mihail. On Wednesday, July 29, 2015 at 12:52:29 AM UTC+3, Kenchu wrote: I've noticed that if I delete entities through the dashboard interface, you can still access them if you have a key. They won't show up in queries but the keys still returns entities. Is this by design? It seems kinda strange to me. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/eb5157fb-30fb-4d7a-8013-06aeee2348ae%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Not very friendly - New Datastore Query Screen
I have created the issue. https://code.google.com/p/googleappengine/issues/detail?id=12187 -Aswath On Tue, Jun 30, 2015 at 6:54 PM, Ryan (Cloud Platform Support) rbruy...@google.com wrote: Salutations All, You should create a PIT with specific requests (ie not losing Query after drilling down) that you would like to see. Once you create it, link it here and I will process it for you. On Monday, June 29, 2015 at 5:32:44 AM UTC-4, aswath wrote: Hi, The new Datastore Query Screen is not very friendly to query and to do the analysis. Several issues. - The screen itself takes long time to appear - After doing the query using the namespace, as you scroll down the results, there is no indication, to say it is the end of the results - Drill down (click on one of the row), then do browser back button, then the query filter is lost. It takes a very long time here, when you press the back button - The results view is shown from the beginning. The view is not positioned at the same place, where the row was clicked, when I did the drill down in the previous step. -Aswath www.AccountingGuru.net (Mobile + Online inventory/order/accounting service) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/CAKFF5G7UwvGRA4AG%2BYksqzBp4mxSj2k%3DiKw59ft6PYSFtcciCQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Google App Engine Laucher extra flags listen to --host 127.0.0.1
Ok but i thought that 127.0.0.1 is a valid ip address, and can used. I.e if you know Xampp Server when i go to Xampp Computer and change the httpd.conf file to listen to the ip address 127.0.0.1, is not a problem to connect to this Xampp Server from a remote device i.e (Mobile device). When i ask at Xampp forum about the remote connection and the change of the httpd.conf to listen to 127.0.0.1, they told me that 127.0.0.1 is only a so called loop back IP and if you want to access that Server from external, any valid external IP (you assign more than one IP to the Server) can be taken. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/2dba3321-6085-4631-a255-0cf5674a5f7f%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] api to find company of logged in user when the user is part of google apps domain
I am trying to create an app for some of my customers who are using google apps domain. I wanted to use google services to distinguish the users based on their company name. I was trying to figure out which API is useful for this scenario. I have requested information for the same in stackoverflow. http://stackoverflow.com/questions/31669333/api-to-find-company-of-logged-in-user-when-the-user-is-part-of-google-apps-domai Please help me!! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/68afbcc4-a96f-4029-846d-11bf565fe9f7%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Google AppEngine - Firewall Notification:Your access has been blocked by firewall policy 732
Hi Patrice, Thanks for your quick response. I posted this on Stack Overflow as well ( http://stackoverflow.com/questions/31685166/google-appengine-firewall-notificationyour-access-has-been-blocked-by-firewal ) but they have marked this 'On Hold', and thats why i posted this here. further, just for clarification.. In my web app, I am trying to fetch a url (outside from google cloud network, lets say hosted on AWS or GoDaddy) and if i print that url response.. i get this warning message. And this is coming for every url access. URL url = new URL(urlString); HttpURLConnection conn = (HttpURLConnection) url.openConnection(); conn.setConnectTimeout(REQUEST_TIME_OUT); conn.setReadTimeout(REQUEST_TIME_OUT); conn.setDoOutput(true); int length = dataToBePost.length(); conn.setRequestProperty(Content-Length, (String.valueOf(length))); OutputStreamWriter wr = new OutputStreamWriter(conn.getOutputStream()); wr.write(dataToBePost); wr.flush(); InputStream inStream = conn.getInputStream(); //using inStream now On Wednesday, 29 July 2015 00:46:50 UTC+5:30, Deepak Kumar wrote: I am trying to fetch http url in my app, it works fine on my local server (dev env) but when i deploy this on Google AppEngine.. it shows below Firewall Notification Firewall Notification - Your access has been blocked by firewall policy 732. If you have any further concerns, please contact your network administrator for more information. I am not getting even a single clue... Can anyone help me out? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/a9c94c52-a34a-43d7-a8ef-00604dc9557d%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: api to find company of logged in user when the user is part of google apps domain
Hi, There is no API that gives you directly. Using the Users API, you can get the full email, from which you can get the domain. But if your customer has multiple domains setup on his Apps account, this might give false results. This is the only way I can think of where you can get such that, as far as I know. Cheers! On Wednesday, July 29, 2015 at 8:46:44 AM UTC-4, Nagendra Babu wrote: I am trying to create an app for some of my customers who are using google apps domain. I wanted to use google services to distinguish the users based on their company name. I was trying to figure out which API is useful for this scenario. I have requested information for the same in stackoverflow. http://www.google.com/url?q=http%3A%2F%2Fstackoverflow.com%2Fquestions%2F31669333%2Fapi-to-find-company-of-logged-in-user-when-the-user-is-part-of-google-apps-domaisa=Dsntz=1usg=AFQjCNESPvm6-o1b0Zob3tRWoXhILWCOQQ Please help me!! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/134e41ef-3bda-4fa9-9ad8-64f6b9372f62%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
