[google-appengine] Re: App Engine (Java) application - Browse and search Google Spreadsheets content
Thanks, for your answer. is there anyone who can help me? I can pay for it - I need solution quickly. Dne úterý, 19. března 2013 21:20:03 UTC+1 Vinny P napsal(a): Hi David, Welcome to GAE. A Java application to process a Google Doc spreadsheet is fairly simple to write, there's documentation and Java sample code here at: https://developers.google.com/google-apps/spreadsheets/ With that said, there are other, better ways to access and search spreadsheet-style data. Try Google Fusion Tables ( http://support.google.com/fusiontables/answer/2571232?hl=en ); the data is presented in a spreadsheet style format, but can be queried using SQL syntax ( https://developers.google.com/fusiontables/docs/v1/sql-reference ). Documentation and example code is here: https://developers.google.com/fusiontables/ -Vinny P On Tuesday, March 19, 2013 4:38:25 AM UTC-5, in...@fajneveci.cz wrote: Hi, I'm beginner on GAE. I need make an Java application, that will search the Google spreadsheet and return corresponding row. Can you direct me, Is there a tutorial? Or other useful links. Thanks, David. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Get exact coordinates from IP
AppEngine adds some cool Geo IP headers to all requests from all clients. Here is an example: http://mylocationtest.appspot.com/ Cheers, -Andrin On Sun, Mar 31, 2013 at 9:34 AM, Daniel Gandsjö gand...@gmail.com wrote: I need to find out how I can get the exact coordinates of an IP address.. I've looked at many forum and sites but that pages have only given me the server address, I need to get the correct location. I'm running a code on my localhost that I've copied to study a little, the page I copied from are no longer running but it works on my localhost and the thing is when I run the page easy called locateme.html then the browser simply say localhost:29XXX wants to use your computers location I click allow and get my coputers exact location on the map. I just can't figure out how I can use this to get the location of any other IP-address -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Get exact coordinates from IP
On Sun, Mar 31, 2013 at 2:34 AM, Daniel Gandsjö gand...@gmail.com wrote: I need to find out how I can get the exact coordinates of an IP address.. I've looked at many forum and sites but that pages have only given me the server address, I need to get the correct location. I'm running a code on my localhost that I've copied to study a little, the page I copied from are no longer running but it works on my localhost and the thing is when I run the page easy called locateme.html then the browser simply say localhost:29XXX wants to use your computers location I click allow and get my computers exact location on the map. I just can't figure out how I can use this to get the location of any other IP-address If you had location-finding code that worked on your localhost, you are most likely referring to the HTML5 GeoLocation API: Example: http://www.w3schools.com/html/html5_geolocation.asp#gsc.tab=0 Documentation: http://dev.w3.org/geo/api/spec-source.html This works on all recent browsers, although depending on permission settings, the user may have to explicitly grant the webpage permission to use the GeoLocation service (for instance, I'm typing this on my iPad and it requires my permission before webpages get my location info). It should be noted that the HTML5 API works completely client-side; just javascript, no server side code whatsoever. On Tue, Apr 2, 2013 at 10:35 AM, Andrin von Rechenberg and...@miumeet.com wrote: AppEngine adds some cool Geo IP headers to all requests from all clients. Here is an example: If you don't want to use HTML5 Geolocation for whatever reason, AppEngine's GeoIP service is a good alternative. It should be noted that it's a separate and distinct from the HTML5 service though. See documentation here: https://developers.google.com/appengine/docs/python/runtime#Request_Headers - -Vinny P Technology Media Advisor Chicago, IL @GOV on AppDotNet: https://alpha.app.net/gov -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] New Twilio Service?
I was just reading HN, and apparently you guys are launching a new Twilio integration? Discussion: https://news.ycombinator.com/item?id=5479498 Documentation: https://developers.google.com/appengine/articles/twilio This is some very nice stuff. I have a spare domain and some free time, I am definitely going to play around with this. Quick question:Where it says Google App *Engine customers receive complimentary credit for 2,000 SMS messages or inbound minutes** when you upgrade*, what does upgrading refer to? An upgrade to App Engine or Twilio? Thanks much, - -Vinny P Technology Media Advisor Chicago, IL @GOV on AppDotNet: https://alpha.app.net/gov -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] TaskQueue Issues
My tasks are increasing in retry count but I have no logs showing they ever executed. My backends are shutting down pre-maturely (that process these tasks) and again, no errors or anything in the logs explaining why. Not sure if this is a backend or taskqueue issue. Here is the latency graph for task queues: https://lh6.googleusercontent.com/-WUcDcWegm70/UVsHDGm6YcI/ABQ/C09Ysu8CarE/s1600/chart.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: TaskQueue Issues
Hello Prateek, Are you running on Master/Slave or HRD? I recall similar occurrences happening for me on M/S before I migrated. If you're running on HRD, a few other questions: 1. Can you provide a screenshot of your logs? I realize that you said your tasks are showing no logs, but there could be a diamond in the rough that you're missing. 2. What logging level have you specified in log4j? 3. Have you changed your application code recently? If so, can we see source code? My first thought is that your backend is the problem here. The fact that the retry count is increasing means that AppEngine is (probably!) executing tasks just fine, but your backend is failing and responding with error codes. What is your backend doing? Does it depend on any non-GAE APIs? - -Vinny P Technology Media Advisor Chicago, IL @GOV on AppDotNet: https://alpha.app.net/gov On Tuesday, April 2, 2013 11:29:53 AM UTC-5, Prateek Malhotra wrote: My tasks are increasing in retry count but I have no logs showing they ever executed. My backends are shutting down pre-maturely (that process these tasks) and again, no errors or anything in the logs explaining why. Not sure if this is a backend or taskqueue issue. Here is the latency graph for task queues: https://lh6.googleusercontent.com/-WUcDcWegm70/UVsHDGm6YcI/ABQ/C09Ysu8CarE/s1600/chart.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: TaskQueue Issues
I am using HRD. No changes to code, we've been doing the same thing for months. I remember this happening in the past, tasks just failing randomly with no logs. They eventually go through, but the instances usually restart before the tasks finish. CPU/Memory usage look fine the entire life of the process I run. I use python so there's no log4j but I use the default settings, so all logging messages, including debug, make it into my log. The problem seems to have gone away, tasks are executing fine again and my backends aren't shutting down. It may have been a small issue with the task queue service. My tasks are assigned to specific back end instances so the fact that they kept failing and the backend instances shutdown and come back shows that the task was having an error connecting to the backend which caused it to just shutdown due to inactivity, and finally when the task queue started connecting again, the instances came back up. Prateek Malhotra Project Manager/Lead Web Applications Developer ReferABuyer.com - Developer of the Automatic$eller Software! 1973 Washington Valley Road Martinsville, NJ 08836 Phone: 732-868-4421 Fax: 732-356-5875 http://www.referabuyer.com prat...@referabuyer.com On Tue, Apr 2, 2013 at 1:42 PM, Vinny P vinny...@gmail.com wrote: Hello Prateek, Are you running on Master/Slave or HRD? I recall similar occurrences happening for me on M/S before I migrated. If you're running on HRD, a few other questions: 1. Can you provide a screenshot of your logs? I realize that you said your tasks are showing no logs, but there could be a diamond in the rough that you're missing. 2. What logging level have you specified in log4j? 3. Have you changed your application code recently? If so, can we see source code? My first thought is that your backend is the problem here. The fact that the retry count is increasing means that AppEngine is (probably!) executing tasks just fine, but your backend is failing and responding with error codes. What is your backend doing? Does it depend on any non-GAE APIs? - -Vinny P Technology Media Advisor Chicago, IL @GOV on AppDotNet: https://alpha.app.net/gov On Tuesday, April 2, 2013 11:29:53 AM UTC-5, Prateek Malhotra wrote: My tasks are increasing in retry count but I have no logs showing they ever executed. My backends are shutting down pre-maturely (that process these tasks) and again, no errors or anything in the logs explaining why. Not sure if this is a backend or taskqueue issue. Here is the latency graph for task queues: https://lh6.googleusercontent.com/-WUcDcWegm70/UVsHDGm6YcI/ABQ/C09Ysu8CarE/s1600/chart.png -- You received this message because you are subscribed to a topic in the Google Groups Google App Engine group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/4CYIHFua1Kw/unsubscribe?hl=en . To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: TaskQueue Issues
(Reposting without signature) I am using HRD. No changes to code, we've been doing the same thing for months. I remember this happening in the past, tasks just failing randomly with no logs. They eventually go through, but the instances usually restart before the tasks finish. CPU/Memory usage look fine the entire life of the process I run. I use python so there's no log4j but I use the default settings, so all logging messages, including debug, make it into my log. The problem seems to have gone away, tasks are executing fine again and my backends aren't shutting down. It may have been a small issue with the task queue service. My tasks are assigned to specific back end instances so the fact that they kept failing and the backend instances shutdown and come back shows that the task was having an error connecting to the backend which caused it to just shutdown due to inactivity, and finally when the task queue started connecting again, the instances came back up. Thank you, Prateek On Tuesday, April 2, 2013 1:42:21 PM UTC-4, Vinny P wrote: Hello Prateek, Are you running on Master/Slave or HRD? I recall similar occurrences happening for me on M/S before I migrated. If you're running on HRD, a few other questions: 1. Can you provide a screenshot of your logs? I realize that you said your tasks are showing no logs, but there could be a diamond in the rough that you're missing. 2. What logging level have you specified in log4j? 3. Have you changed your application code recently? If so, can we see source code? My first thought is that your backend is the problem here. The fact that the retry count is increasing means that AppEngine is (probably!) executing tasks just fine, but your backend is failing and responding with error codes. What is your backend doing? Does it depend on any non-GAE APIs? - -Vinny P Technology Media Advisor Chicago, IL @GOV on AppDotNet: https://alpha.app.net/gov On Tuesday, April 2, 2013 11:29:53 AM UTC-5, Prateek Malhotra wrote: My tasks are increasing in retry count but I have no logs showing they ever executed. My backends are shutting down pre-maturely (that process these tasks) and again, no errors or anything in the logs explaining why. Not sure if this is a backend or taskqueue issue. Here is the latency graph for task queues: https://lh6.googleusercontent.com/-WUcDcWegm70/UVsHDGm6YcI/ABQ/C09Ysu8CarE/s1600/chart.png -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Does deleting a backup also delete the files in Cloud Storage?
IIRC it does not. Works fine on blobstore though. On Monday, April 1, 2013 4:46:47 PM UTC-7, Jason Collins wrote: We use the Datastore Admin backup tool (fired by a cron) to backup our data into Cloud Storage nightly. Our storage costs have crept up and I'd like to delete the old backups. Aside: if you think, like I do, that you should be able to automate backup deletion, please star https://code.google.com/p/googleappengine/issues/detail?id=7412 or possible even https://code.google.com/p/googleappengine/issues/detail?id=7428 Datastore Admin has a feature that allows me to delete old backups. However, I don't think that it actually deletes the Cloud Storage files themselves. Here is the code I'm looking at from google.appengine.ext.datastore_admin.backup_handler: def delete_backup_files(filesystem, backup_files): if backup_files: if filesystem == files.BLOBSTORE_FILESYSTEM: blob_keys = [] for fname in backup_files: blob_key = files.blobstore.get_blob_key(fname) if blob_key: blob_keys.append(blob_key) if len(blob_keys) == MAX_BLOBS_PER_DELETE: blobstore_api.delete(blob_keys) blob_keys = [] if blob_keys: blobstore_api.delete(blob_keys) I'm guessing that blank line that has been redacted says TODO: implement Google Storage file deletion. Can anyone confirm or deny? How do people manage their backups today? Is my only option to write some kind of custom tool to dump old files on Cloud Storage? Thanks, j -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] New Twilio Service?
On Tuesday, April 2, 2013 1:43:57 PM UTC-5, alex wrote: see attached screenshot. Much appreciated! Can't visit the Twilio site myself to see, the web filter at my work is apparently unhappy with Twilio. - -Vinny P Technology Media Advisor Chicago, IL @GOV on AppDotNet: https://alpha.app.net/gov -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] New Twilio Service?
I create a new account on twilio via the special page and upgrade it but I can't found the amount of free sms. Where I can see the balance with the offer of 2000 sms? I see only my 20$ -- Gianni On Tue, Apr 2, 2013 at 9:56 PM, Vinny P vinny...@gmail.com wrote: On Tuesday, April 2, 2013 1:43:57 PM UTC-5, alex wrote: see attached screenshot. Much appreciated! Can't visit the Twilio site myself to see, the web filter at my work is apparently unhappy with Twilio. - -Vinny P Technology Media Advisor Chicago, IL @GOV on AppDotNet: https://alpha.app.net/gov -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] unusual traffic from your computer network
I see posts about this issue going back years, so sorry if I'm kicking a dead horse, but I haven't been able to find any resolution. (I’ve posted this message twice on a new account, once 5 days ago and once 3 days ago, and neither message has actually made it into the forum. So I’m trying my old account. Sorry if this post ends up getting duplicated.) We have a paid app on app engine we've been using to serve a commercial web app for 3 years. The app is mapped to a custom domain via Google Apps. I think that’s the crux here. We have one application that serves different content for different clients. Each of our clients has reverse proxy set up on their web server to fetch the content from our custom domain on app engine. We use reverse proxy simply to mask our domain to the clients' domains. There is no caching, and the reverse proxy is Apache2 with out of the box configuration. On March 26, after 2 years of happily serving content to a particular client's server, Google for some reason decided that this server was violating its Terms of Service and started denying content to that client's reverse proxy, redirecting users to the www.google.com/sorry/misc page with the message that: Our systems have detected unusual traffic from your computer network. This of course caused our application to be totally unusable. We sent requests to Google for more information and heard nothing. The next day App Engine decided that particular server was ok again and resumed serving our content to the problem server. Then again on March 30 Google decided to ban this particular server. Our app is very low volume, averaging about .05 requests/second. There were no traffic spikes that day. There were no configuration changes to the reverse proxy or any of our infrastructure. The only information I can find on the issue is here: http://support.google.com/websearch/bin/answer.py?hl=enanswer=86640rd=1. That page suggests that the client's server was doing one of these things: •Sending automated queries •Using software that sends queries to Google to determine how a website or webpage ranks on Google for various queries •'Meta searching' Google •Performing 'offline' searches on Google I could find no evidence of any requests being sent to Google search. There were open requests to one of Google's nameservers, presumably to look up our app's ip from its Google Apps custom domain. Surely that isn't a violation of Terms of Service. We found no malware on the machine. So at this point we have no idea why Google stopped serving the content to that particular server, or why it resumed service. Additionally all our other clients' reverse proxies continued to work fine. There was even another reverse proxy successfully fetching the same content that Google was denying to the other proxy. Switching to the yyy.appspot.com domain from our custom domain seems to fix the problem, so I really suspect the problem is with the domain mapping. I sent a support request to Google Apps, and of course they said they couldn’t look into it, stating: “You are correct that the custom domain mapping is created in the Google Apps Control Panel and is handled there however any issues with the mapping of Google App Engine apps needs to be investigated and supported by the App Engine team.” So I’m left wondering why Google has denied requests from this particular server after 2 years when nothing has changed. And yet Google continues to happily serve our other clients who are using the exact same proxy settings on other machines. Searching through previous posts, the best information I can gather is that maybe our proxies headers are malformed and Google doesn't like them. Why would Google randomly complain after 2 years of happily serving content to this same proxy with the same headers? Previous posts described this problem as a landmine, where stepping in the wrong place can trigger it. Seems more like a surprise missile attack to me because we were simply walking the same path we'd walked every day for 2 years when everything blew up. Obviously this is totally unacceptable. We can't very well offer a commercial service to clients with the caveat that it might blow up at any time, and we have no idea when or why. I also don't understand the connection between Google Search's Terms of Service and my paid App Engine app. Why does Google deny service to my paid application when it thinks some machine is violating its search policies??? Even if that machine were violating its search policies, if I want to serve content to the violating machine from my totally un-Google-search-related web app, I should be able to. Granted a DOS situation could be a valid reason for denying service to my app engine app, but violating Google's search policies is totally unrelated to my app engine app, and I should be able to serve content from my paid application to whomever I want. Can Google
[google-appengine] Re: TaskQueue Elevated again today
I doubt this is a recent issue and/or related to performance graphs. TaskQueue with very short countdown were always very flaky so say the least. I routinely saw tasks with countdown=0 lagging by a 1 min or so. This is since years ago. Especially tasks which are scheduled from other tasks, not frontend requests. I filed some tickets but never gotten anything resolved. You can find and star my feature request to provide TQ with accurate timing. Though do not get your hopes high. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] IRC Hours tomorrow 4/2 at 8am PST
Hi everyone, AppScale is an open osurce implementation of Google App Engine. We are having office hours at 8am PST tomorrow at #appscale on Freenode. Hope to see you there! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] instances screen - View Logs not working - unnecessary instance
Hello, In the attached instances screen from the Admin console, I click on the 'View Logs' link, and there are no logs displayed. As per the documention, https://developers.google.com/appengine/docs/adminconsole/instances, the third column 'Request' is the number of Requests in the last minute. My application has not recieved any requests for the last 1/2 hr. I can see this by clicking on the 'Logs' link on the left side. The 2nd instance is running, even though there is no traffic. It is charged unnecessarily. My costs are increasing because of this idle instances. To control the costs, I am manually shutting down the instances, when ever I get a chance. -Aswath -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. attachment: instances.png
