[google-appengine] IOException while updating cells using batch process using 2 legged OAuth using google spreadsheet api

Hi I am new at using the OAuth process. I am using the 2 legged process to get the OAuth done. I am getting the following exception. This error has really wasted my two weeks. Please help me out. I am using the 2legged OAuth process to authenticate the DocsService and SpreadsheetService. My code

[google-appengine] Re: Min idle instances setting not working at all?

Where did you find the min idle instances setting? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/jfcSBnHMr5QJ. To post to this group, send email

[google-appengine] Does RPC object block response until async operations finish?

Hi Google guys, I just did a test of async db and memcache operations. I put or deleted 100 entities and immediately returned. The async operation call took only 0.01s, the sync one took 0.2s, but both of their total response time in the backend log was over 200ms, and I could also feel the latenc

[google-appengine] Re: google app engine for extremely demanding multiplayer browser game

Thank you. I already made several apps and games using GWT and a java backend as prototypes and I am very satisfied with the result. I have also watched the relevant Google IO talks on scaling, proper app design for scalability, and so on, and I believe I have enough information to invest time

[google-appengine] Re: google app engine for extremely demanding multiplayer browser game

Hi Karel, Another advantage of GAE for a multiplayer game like yours is the channel API. It is a Comet-like push system that avoids you polling the server (and the DataStore) to retrieve the actions of the other players. Have also a look at www.ovh.com. They propose (virtual) dedicated servers and

[google-appengine] Re: App Engine SDK 1.5.4 released!

I've been expecting the new datastore query improvement... I have a question related to that feature: i have deployed a new version with Java SDK 1.5.4 to test queries that previously failed, but it seams they still fail immediately, also requesting an index that is already built. Also, these queri

[google-appengine] Re: using app engine for extremely demanding multiplayer browser game

Hey Jay, I actually registered yesterday on your game to get an idea of a game hosted on GAE. I'm enjoying it! But the new pricing greatly disturbs me. I'm not sure if running this game on GAE is actually viable at all in terms of costs. I did some research on the new pricing (for example htt

[google-appengine] Re: Communication between AppEngine and PhoneGap/JQM

I found by myself beggining of answer. For people who would like to make communicate a browser-based application and a GAE app, Reslet seems to be a good framework because it provides a GAE specific implementation for the server-side, and a JavaScript implementation for the client side (which will

[google-appengine] App Engine Weekly Community Update #8

Dear App Engine Community, Each week we bring you some news and metrics about the App Engine community. *Highlights* App Engine 1.5.4 SDK Release http://googleappengine.blogspot.com/2011/09/app-engine-154-sdk-release.html A few adjustments to App Engine’s upcoming pricing changes h

[google-appengine] Cross Namespace Queries?

I'm looking into using the namespace API in my application. I usually like leveraging platform support for things like this to remove a category of defects from my application. But after doing some searching, it appears that the namespace support is currently rather limited. There is only pri

[google-appengine] Something to pass along to the google search team

In http://highscalability.com/blog/2011/9/7/what-google-app-engine-price-changes-say-about-the-future-of.html he wrote: > With each crawl costing money, the whole idea of crawling the Internet will > have to change. which led me to a thought: Since google bot is crawling zillions of web sites,

[google-appengine] Cron job every 30 minutes only on work days

Hi, is there a way to define something like this ? /cron/odgodjeni Jada jada every 30 minutes *every mon,tue,wed,thu,fri *from 06:00 to 15:00 Europe/Zagreb I don't want my cron job to starts on Saturdays and Sundays especially with new 15 minutes idle instance

[google-appengine] how longs are application logs kept

I noticed that while logs with error severity can be accessed several hours, even days after the event, but logs with info severity start disappearing within just a couple of hours. Is this documented? I saw a spike in traffic at 12:28:57 UTC in my app, and I'm trying to investigate this. I can

[google-appengine] High Replication -- Writes Way Higher Than Reads

I frequently have way more writes (billing history) than reads on the datastore and this seems very strange to me. Typically, .3 million writes (300,000) and .06 million reads (60,000). And I don't think I am writing to the datastore nearly the amount I am reading from it -- I would think they wo

[google-appengine] Re: Something to pass along to the google search team

Google webmaster tools https://www.google.com/webmasters/tools/home lets you (amongst other things) submit sitemaps and see the crawl rate for your site (for the previous 90 days). There's also a form to report problems with how googlebot is accessing your site https://www.google.com/web

Re: [google-appengine] Something to pass along to the google search team

Sure, but if they just went breadth-first (putting pages to crawl into the tail of a work queue that spans hundreds of sites), then there wouldn't be a spike at all. On Sep 13, 2011, at 10:55 AM, Tim wrote: > > Google webmaster tools > > https://www.google.com/webmasters/tools/home > > le

[google-appengine] Re: how longs are application logs kept

Found this: http://code.google.com/appengine/docs/python/tools/uploadinganapp.html#Downloading_Logs Which explains why my info logs are more shortlived than my error logs. However, when I used the request_logs command, I only see the logs "header", but no associated data that I passed on to the l

[google-appengine] Re: High Replication -- Writes Way Higher Than Reads

Have you read this thread - https://groups.google.com/d/msg/google-appengine/mjnSqQWOfqU/cgPVeHbrR8oJ? It explains what happens at the datastore when an entity is put, and how this converts into datastore writes. -- You received this message because you are subscribed to the Google Groups "Go

[google-appengine] Re: High Replication -- Writes Way Higher Than Reads

Hi James, The new GAE 1.5.4 SDK shows in the local dev DatastoreViewer how many write ops were needed to create each entity (check screenshot attached). You will probably be suprised. François -- You received this message because you are subscribed to the Google Groups "Google App Engine" gr

Re: [google-appengine] Multiple Instances of the Same App

Hi, Quote (Eric Kolotyluk wrote) : We have an app we want to develop for our customers, but we essentially want > each customer to have their own instance of the app for quotas and billing > purposes. Basically, if our customers want the service, they would pay > Google directly, rather than us

[google-appengine] Re: High Replication -- Writes Way Higher Than Reads

That's very useful ... and, yes, surprising to me for sure! Thanks for pointing that out, Francois. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/

Re: [google-appengine] Re: Min idle instances setting not working at all?

You are conflating min-idle-instances and max-idle-instances, which are different concepts. My statement was only with respect to min-idle-instances, and is still correct. min-idle-instances was removed on 2011/08/31-19:49:59 (by you disabling Always-On) and then set to 3 on 2011/09/11-09:47:38 (by

[google-appengine] why Datastore Key Fetch Ops is so many?

now, my quota: Datastore Entity Fetch Ops 0% 0% 17,400 of Unlimited Okay Datastore Entity Put Ops 0% 0% 136 of UnlimitedOkay Datastore Entity Delete Ops 0% 0% 0 of Unlimited Okay Datastore Index Write Ops 0% 0% 240 of Unlimited

[google-appengine] Request queue for dynamic backends - how does it function specifically?

We are moving much of our taskqueue work to dynamic backends. One obvious question we're faced with is "how many (max) instances do we need for our background work?" If we are feeding all of our work to our dynamic backends via taskqueue, will we see the queues get backed up if the backend instan

[google-appengine] Re: Long running tasks impact on scheduler ?

Thanks for the explanation Jon (sorry I has used John before). Hopefully you all can continue to explore how TQ tasks can be managed separately by The Scheduler** for better instance optimization. cheers, stevep **Caps pun intended: http://www.imdb.com/title/tt0113762/ On Sep 12, 10:32 am, Jon

[google-appengine] Datastore async ops, query vs get, and batches

I'm trying to get rid of queries as much as I can (anticipating the move to HR datastore), and using pre-computed keys and lists of keys much more so I can simply db.get() items I need without needing to worry about eventual consistency of queries (or put my entire datastore into one huge entit

Re: [google-appengine] Something to pass along to the google search team

On Tuesday, 13 September 2011 16:04:41 UTC+1, Joshua Smith wrote: > > Sure, but if they just went breadth-first (putting pages to crawl into the > tail of a work queue that spans hundreds of sites), then there wouldn't be a > spike at all. > > I expect there's something about wanting to pull ba

[google-appengine] Re: Min idle instances setting not working at all?

I typed too fast, I meant *max* idle instances in the Dashboard. Sorry about the confusion. That said, the description of the slider is not very clear: it's called "max" which is correct from a billing perspective, but from a functionality perspective, it really looks like you're setting the "defa

Re: [google-appengine] why Datastore Key Fetch Ops is so many?

Doing a count uses key fetch ops, is it possible you have a few counts in your code? Greg On Tue, Sep 13, 2011 at 10:14 AM, saintthor wrote: > now, my quota: > > Datastore Entity Fetch Ops > 0% >0%

Re: [google-appengine] Re: backend vs frontend instances

Now frontend have 2.4GHz CPU - I can use 2CPU second per clock second in cpu-usage task. Will frontend slower than now after new billing enable? 2011/9/13 Timofey Koolin > Now frontend have 2.4GHz CPU - I can use 2CPU second per clock second in > cpu-usage task. > > Will frontend slower than no

Re: [google-appengine] Re: backend vs frontend instances

All frontends already only have 600MHz allocated and there is no plan to change this. So, no, frontends won't be slower after the new billing is enabled. Greg On Tue, Sep 13, 2011 at 11:12 AM, Timofey Koolin wrote: > Now frontend have 2.4GHz CPU - I can use 2CPU second per clock second in > cpu

Re: [google-appengine] Re: backend vs frontend instances

Will the memory be decreased? Because my app is using JRuby, which is very memory intensive and I sit around 200MB memory utilisation per app. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https:

[google-appengine] Re: why Datastore Key Fetch Ops is so many?

Yes I found counts absolutely kill your small datastore ops. Of course it has never been recommended to .count()... but if you are you will not be able to stay in free quota... On Sep 13, 12:51 pm, "Gregory D'alesandre" wrote: > Doing a > count

Re: [google-appengine] Re: backend vs frontend instances

The memory allocation will be set to 128M, but our analysis is that should impact very few apps. What is your appid? I'll see if it is on the list that we were going to use to contact apps that would be affected. Greg On Tue, Sep 13, 2011 at 11:25 AM, Michael Quartly < pleasedontdisablemyacco..

[google-appengine] Happy Programmer Day

So slashdot is telling me today is Programmer Day. Yay for us! After heavily optimizing my app engine app, I was lucky enough to not need to update it for about a year. Now, with pricing changes coming down the l

[google-appengine] Unexpected Entity Group transaction contention

Re-reading the documentation, this kinda makes sense, but it bit me recently so I want to tell the story and see what others think. I make an entity Parent(). Some time later I make an entity Child(parent=some_parent) and I do this in a transaction. I do this a bunch, concurrently from task-que

Re: [google-appengine] Unexpected Entity Group transaction contention

Testing is happening presently for multi-entity-group transactions I believe. I saw a thread on it about a week ago. Steve On 11-09-13 03:23 PM, Brian Olson wrote: Re-reading the documentation, this kinda makes sense, but it bit me recently so I want to tell the story and see what others thi

RE: [google-appengine] Re: Something to pass along to the google search team

That's all good info, but it doesn't apply if you are on GAE. If you are on GAE you can't specify your crawl rate. It is assigned a special Crawl rate. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Tim Sent: Tuesday, September 13, 2011 7:55 AM

Re: [google-appengine] Request queue for dynamic backends - how does it function specifically?

Check this out: http://code.google.com/appengine/docs/python/taskqueue/overview-push.html#Push_Queues_and_Backends This suggests that tasks pushed onto taskqueues must get executed within 10 minutes, in the case of front-end instances. But backends are exempt from this limit. This implies that w

[google-appengine] DeadlineExceededError: The API call mail.Send() took too long to respond and was cancelled

I received at least 10 instances of these errors in one day yesterday, out of around ~50 emails that were sent through the day. In the last few months that my app has been executing, I have never seen this. Searching on Google revealed that the best cure is to send emails in the context of a task

[google-appengine] Re: Unexpected Entity Group transaction contention

Any time you write/update an entity in a group (share a common ancestor) you lock the entire entity group all the way to the top most parent. All branches under that parent... the entire tree. Multi eg transactions will allow you to write to multiple groups but it will not reduce contention in th

Re: [google-appengine] DeadlineExceededError: The API call mail.Send() took too long to respond and was cancelled

Coincidence. I've noticed a surge in mail timeouts over the past few days. As I said on a different thread, this is really stupid - google should be able to send mail without EVER having a timeout. For now, you need to always send mail from a task, because of these ridiculous exceptions. On S

Re: [google-appengine] DeadlineExceededError: The API call mail.Send() took too long to respond and was cancelled

Cool. Thanks. Then I can safely set my max_idle_instances back to 1. I also noticed high email latencies on the receive side. I have a user facing email address on a personal domain hosted on Google, whose sole purpose is to automatically forward emails to my app at appspotmail.com (using a Gma

[google-appengine] Re: Happy Programmer Day

Same to you :) Even though the additional work-load is not quite appreciated at the moment, I think if someone can deal with it... ;) -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups

[google-appengine] Re: Cron job every 30 minutes only on work days

The GAE notes are confusing to me for your scenario. Have you tried: 1. Setting up 19 cron jobs of the form every mon,tue,wed,thu,fri HH:MM where HH:MM is: 09:00, 09:30, 10:00, ..., 15:00 1. Setting up 1 cron job of the form every mon,tue,wed,thu,fri 09:00 and using this cro

[google-appengine] Re: Request queue for dynamic backends - how does it function specifically?

That's not what I was asking, though thanks for the information. It appears that my task queues that feed the backends are backing up (because there are not enough instances, by configuration), so I'm guessing that's my answer. j On Sep 13, 1:38 pm, Rishi Arora wrote: > Check this > out:http:/

Re: [google-appengine] Re: backend vs frontend instances

my main apps id is xanthus-ms and my test app is xq-remake -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/WEmz9Ifo-EoJ. To post to this group, sen

[google-appengine] Error "javax.net.ssl.SSLSocketFactory not supported by Google App Engine's Java runtime environment

Hi all, i am a newbie to developing applications for "Google App Engine". What i try to achieve is to transfer one of our apps so that it could run on the "Google App Engine". My existing code needs to transfer data via SSL from an other application. For this i am using classes from "javax.net.ss

[google-appengine] SSL communication with external app not working.

Hi, at first let me say that i am a newbie in developing apps for the "Google App Engine". What i try to achieve is to port our existing application (Java) to run on the "Google App Engine". However the application will need to transfer data via SSL with an external site. Now i am using classe

Re: [google-appengine] Sqlite3 for backends

The idea would be to use sqlite in memory ( sqlite.connect(":memory:") ) so it would be ultra fast. That's why I was talking about using it in backends... :) -Andrin On Mon, Sep 12, 2011 at 4:18 PM, Bart Thate wrote: > Oi ! > > Agree completely, in fact really forgot about it ;] > I thought it

[google-appengine] Min Pending Latency -- does it really do anything?

I have a simple webcam app used by a maximum of maybe 3 people at any time, which also handles requests from a batch process initiated from my house which uploads a new image to my app every 15 seconds via HTTP call to my app's frontend. My goal is to get the app running on just a single fronte

[google-appengine] Re: Happy Programmer Day

Happy Programmer Day! Let's see... my app is pretty much done so the only issue i'm tackling is: * Getting adsense approved, this is my worst fear of all since i don't have any 'original content'. :( -- You received this message because you are subscribed to the Google Groups "Google Ap

Re: [google-appengine] Min Pending Latency -- does it really do anything?

It really doesn't matter it a second instance kicks in to process your user-facing requests. If your max_idle_instances is set to 1, then you're only paying for one idle instance at any given time. Remember that "max_idle_instances=1" doesn't mean "max_instances=1". I do agree your concerns, and

[google-appengine] Re: Min Pending Latency -- does it really do anything?

Have you looked into using the Blobstore? You can serve the images without using instances (or cpu). On Sep 13, 5:30 pm, dloomer wrote: > I have a simple webcam app used by a maximum of maybe 3 people at any time, > which also handles requests from a batch process initiated from my house > which

Re: [google-appengine] Min Pending Latency -- does it really do anything?

Interesting. I didn't know about the 28 instance hours, since under the "Estimated Charges Under New Pricing" section of my billing history it still shows 24 free instance hours. Thanks for that info. -- You received this message because you are subscribed to the Google Groups "Google App En

[google-appengine] Re: Min Pending Latency -- does it really do anything?

Serving the images by itself isn't much of an issue. But every request to my page is still going to need a call to a regular webapp handler to serve up the HTML surrounding the images. And if I use blobstore for the uploads, that still will require HTTP requests. So I think I'd end up using t

[google-appengine] New Pricing + Long running requests optimization

Hello guys, I would like to get an advice how to deal with long running request when the new pricing will apply. My app is searching for the cheapest book prices on the internet. So when user searches for the book and the price is not in database, I have to check 20+ sellers for the current price

[google-appengine] Re: Does read/write an entity with arraylist cost more than an entity w/o arraylist

My case is unindexed. I also want to know if it matters with the size of the list. Anyone please help Thanks, Bendanpa -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/m

[google-appengine] Re: New Pricing + Long running requests optimization

sounds like you could use async urlfetch instead of 20 separate tasks? On Sep 13, 6:43 pm, "ESPR!T" wrote: > Hello guys, > > I would like to get an advice how to deal with long running request > when the new pricing will apply. > > My app is searching for the cheapest book prices on the internet.

Re: [google-appengine] Re: New Pricing + Long running requests optimization

+1 to this. There's currently a limit of 10 async requests pending at once, but the worst case will still be the latency of two calls. Jeff On Tue, Sep 13, 2011 at 5:09 PM, JH wrote: > sounds like you could use async urlfetch instead of 20 separate tasks? > > On Sep 13, 6:43 pm, "ESPR!T" wrote

[google-appengine] Re: New Pricing + Long running requests optimization

Sorry could you be more specific? I have to display a page to user while I am fetching the prices on background (sometimes I have prices for 10 suppliers already in db and I need to fetch just 10 more). I though that async url fetch is more like like that you can call a fetch from url on backgroun

[google-appengine] Can i use game engines like jMonkey or Panda3d?

Can i use games engines like jMonkey (java) or Panda3D (python) or any similar game engine? I know that most of them have networking libraries using sockets, which is not supported by gae, but what if i don't use these libraries. I am going to

[google-appengine] Re: New Pricing + Long running requests optimization

Hi You could submit the request via ajax back to your appengine app and it can then do an async requuest on all the urls, . In your case you have some of the info already and have to fetch some of it. So it might be two ajax calls, one to get the list of books, the result is book prices for st

Re: [google-appengine] Min Pending Latency -- does it really do anything?

It was announced just 4 days ago, in response to developer concerns for small size apps. http://googleappengine.blogspot.com/2011/09/few-adjustments-to-app-engines-upcoming.html On Tue, Sep 13, 2011 at 5:52 PM, dloomer wrote: > Interesting. I didn't know about the 28 instance hours, since under

[google-appengine] Re: why Datastore Key Fetch Ops is so many?

yes i use count. what can instead it? On 9月14日, 上午2时28分, JH wrote: > Yes I found counts absolutely kill your small datastore ops. Of > course it has never been recommended to .count()... but if you are you > will not be able to stay in free quota... > > On Sep 13, 12:51 pm, "Gregory D'alesandre

Re: [google-appengine] Re: New Pricing + Long running requests optimization

My app is nearly identical to yours - several concurrent URL fetches are performed to "gather" content. And when users access my site, that content is nicely formatted for them for display. My solution - part of if has already been suggested by Jeff - use async URL fetch. Spinning an instance fo

[google-appengine] Re: New Pricing + Long running requests optimization

You can try having your Max Idle Instances at 1, but leave your Min Pending Latency to a small number. This allows additional instances to spin up to handle other requests, but will not increase your Total Instance Hour significantly, as you will now only be charged for Active Instance (the ora

[google-appengine] Re: why Datastore Key Fetch Ops is so many?

Use an entity to store a running count, and increment it within a transaction. If your application can write entities at > 5/s, you will need to use shard counters to get around the limit for an entity being modified. -- You received this message because you are subscribed to the Google Groups

Re: [google-appengine] Re: backend vs frontend instances

When is the memory expected to be lowered? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/1rgi9mJrnfkJ. To post to this group, send email to googl

[google-appengine] Re: New Pricing + Long running requests optimization

With the backends I can't display data to use when he ask for them - he can't wait next hour for getting the prices of books as he wants them now. So I need to run the backend all the item and process price requests as soon as possible (and as there is 5+ million books I can't do a pre-fetch of som

Re: [google-appengine] Re: New Pricing + Long running requests optimization

Just out of curiosity - do book prices really change more than once every hour? Surely, you could have some kind of a hybrid approach where you pre-fetch the prices of 5-10% of the most common books, so you don't have to fetch them when a user wants to see the prices. This will alleviate some of

[google-appengine] Re: New Pricing + Long running requests optimization

1) I am fetching the price for book only once a day when someone ask for it (after that is being served from database) 2) there is nothing like most common books - user comes in and ask for anything - I can't show him blank prices and tell him come again in an hour 3) 5-10% of books is more than 50

[google-appengine] Missing about 7 hours in Dashboard Charts

Hi GAE Team, I met this issue several months ago. I also tried to change timezone, but not got fixed. Thank you for looking into it. -- keakon My blog(Chinese): www.keakon.net Blog source code: https://bitbucket.org/keakon/doodle/ -- You received this message because you are subscribe

[google-appengine] Re: Missing about 7 hours in Dashboard Charts

I also have this issue. Cheers, Steve -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/T0kDhL4XpysJ. To post to this group, send email to google-ap