[google-appengine] API Search OverQuotaError

2013-01-25 Thread Moises Belchin
Hi all,

We've getting this error:

OverQuotaError: The API call search.IndexDocument() required more
quota than is available.


However our Search API Quota is about 3%

SearchSearch API Calls
[image: 3%]
3%149,105 of 4,320,000OkaySearch Stored Data
[image: 0%]
0%0.04 of 100.00 GBytesOkay
What does it mean?

Thanks and regards.
Moisés Belchín.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] API call search

2013-01-25 Thread Moises Belchin
We're having many errors like this.

*The API call search.Search() took too long to respond and was cancelled.*


Does anyone have the same problem?

Thanks and regards.
Moisés Belchín.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] API Search OverQuotaError

2013-01-25 Thread Andreas Schmid
it means you reached the daily limit and have to wait until the quota resets or 
request a higher quota.

On Jan 25, 2013, at 4:11 AM, Moises Belchin moisesbelc...@gmail.com wrote:

 Hi all,
 
 We've getting this error:
 
 OverQuotaError: The API call search.IndexDocument() required more quota than 
 is available.
 
 However our Search API Quota is about 3%
 
 Search
 Search API Calls  3%   149,105 of 4,320,000   Okay
 Search Stored Data 0%  0.04 of 100.00 GBytes   Okay
 What does it mean?
 
 Thanks and regards.
 Moisés Belchín.
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine?hl=en.
 For more options, visit https://groups.google.com/groups/opt_out.
  
  

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] Terms of service diff

2013-01-25 Thread Joshua Smith
http://web.archive.org/web/2012073615/https://developers.google.com/appengine/terms

That's the previous version from Nov 2011. I did a quick diff and almost every 
clause has some changes.

You are spitting in the wind asking Google's technical and business people to 
explain what Google's lawyers write. It is never going to happen. And even if 
it did, you would be foolish to rely on such things as they are not legally 
binding.

Keeping up with Google's TOS changes is a cost of doing business on the 
platform.

-Joshua

On Jan 25, 2013, at 1:50 AM, anatoly techtonik techto...@gmail.com wrote:

 Hi Takashi,
 
 Thanks for response. I can't pay lawyers every time the Google changes ToS, 
 and I am bad at reading behind the lines. Why there is no diff? Is there 
 something to hide? What are the major changes affecting users?
 
 
 On Fri, Jan 25, 2013 at 12:03 AM, Takashi Matsuo tmat...@google.com wrote:
 
 Hi anatoly,
 
 Sorry for the inconvenience, but I'd recommend taking your time and read it 
 through once, and keep the copy for another change?
 
 By the way, your app will very unlikely be broken just because you accept the 
 ToS.
 
 On Thu, Jan 24, 2013 at 2:49 AM, anatoly techtonik techto...@gmail.com 
 wrote:
 GAE says Our Terms of Service have recently changed., but I don't have time 
 to reread them. Why there is no diff? I am afraid that my app will be broken 
 once I agree.
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/Nwf2jdPWLfwJ.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.
 
 
 
 -- 
 Takashi Matsuo | Developers Advocate | tmat...@google.com
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.
 
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an 
 email to google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine?hl=en.
 For more options, visit https://groups.google.com/groups/opt_out.
  
  

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] Terms of service diff

2013-01-25 Thread Joshua Smith
(of course, I meant Nov 2012; still haven't adjusted to this year being 2013 :)

On Jan 25, 2013, at 8:51 AM, Joshua Smith joshuaesm...@charter.net wrote:

 http://web.archive.org/web/2012073615/https://developers.google.com/appengine/terms
 
 That's the previous version from Nov 2011. I did a quick diff and almost 
 every clause has some changes.
 
 You are spitting in the wind asking Google's technical and business people to 
 explain what Google's lawyers write. It is never going to happen. And even if 
 it did, you would be foolish to rely on such things as they are not legally 
 binding.
 
 Keeping up with Google's TOS changes is a cost of doing business on the 
 platform.
 
 -Joshua
 
 On Jan 25, 2013, at 1:50 AM, anatoly techtonik techto...@gmail.com wrote:
 
 Hi Takashi,
 
 Thanks for response. I can't pay lawyers every time the Google changes ToS, 
 and I am bad at reading behind the lines. Why there is no diff? Is there 
 something to hide? What are the major changes affecting users?
 
 
 On Fri, Jan 25, 2013 at 12:03 AM, Takashi Matsuo tmat...@google.com wrote:
 
 Hi anatoly,
 
 Sorry for the inconvenience, but I'd recommend taking your time and read it 
 through once, and keep the copy for another change?
 
 By the way, your app will very unlikely be broken just because you accept 
 the ToS.
 
 On Thu, Jan 24, 2013 at 2:49 AM, anatoly techtonik techto...@gmail.com 
 wrote:
 GAE says Our Terms of Service have recently changed., but I don't have 
 time to reread them. Why there is no diff? I am afraid that my app will be 
 broken once I agree.
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To view this discussion on the web visit 
 https://groups.google.com/d/msg/google-appengine/-/Nwf2jdPWLfwJ.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.
 
 
 
 -- 
 Takashi Matsuo | Developers Advocate | tmat...@google.com
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at 
 http://groups.google.com/group/google-appengine?hl=en.
 
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an 
 email to google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine?hl=en.
 For more options, visit https://groups.google.com/groups/opt_out.
  
  
 
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine?hl=en.
 For more options, visit https://groups.google.com/groups/opt_out.
  
  

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] API Search OverQuotaError

2013-01-25 Thread Aza Tek
On Fri, Jan 25, 2013 at 3:29 PM, Andreas Schmid a.schmi...@gmail.comwrote:

 it means you reached the daily limit and have to wait until the quota
 resets or request a higher quota.


 And the 3% is a percentage of?

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] API Search OverQuotaError

2013-01-25 Thread Andreas Schmid
did you index multiple documents simultaneously? 
i know there is a limit also on how many documents get indexed per second or 
some other time limit. 
this is not documented.

On Jan 25, 2013, at 9:19 AM, Aza Tek azat...@gmail.com wrote:

 On Fri, Jan 25, 2013 at 3:29 PM, Andreas Schmid a.schmi...@gmail.com wrote:
 it means you reached the daily limit and have to wait until the quota resets 
 or request a higher quota.
 
  And the 3% is a percentage of?
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to 
 google-appengine+unsubscr...@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine?hl=en.
 For more options, visit https://groups.google.com/groups/opt_out.
  
  

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Re: Strange Memcache put error

2013-01-25 Thread Deepak Singh
Still getting the same issue. Could not find why it throws this error while
writing to memcache.


On Mon, Jan 21, 2013 at 10:03 PM, Deepak Singh deepaksingh...@gmail.comwrote:

 Hi All,

 I am getting a strange error as follows

 com.pdstechi.hotel.server.HotelRpcServiceImpl getRoomsXmlHotelSearchResult: 
 Memcache put: Error setting single item (?xml version=1.0 encoding=UTF-8 
 standalone=yes?AvailabilitySearchAuthorityOrgyfr/OrgUserXML/UserPasswordxml12345/PasswordCurrencyINR/CurrencyTimeout40/Timeout/AuthorityRegionId18725/RegionIdHotelStayDetailsArrivalDate2013-01-30/ArrivalDateNights1/NightsRoomGuestsAdult/Adult/Guests/Room/HotelStayDetailsDetailLevelcustom/DetailLevel/AvailabilitySearch)


 The error comes when putting a data into cache.



 Deepak Singh




-- 
Deepak Singh

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Cost of updating list property

2013-01-25 Thread Jiansen He
Hi,

Say an entity has a list property which has 1 million integers.  Now we 
need to update the list property by adding 1 more integer.  Does updating 
via put cost 2 million write operations? If so, is there a cheap 
alternative?

With Thanks
Jiansen

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Re: Cost of updating list property

2013-01-25 Thread Ryan Chazen
Depends if those integers are indexed or not. Each index is a write op.
However, an entity can only be 1mb big.. I think 1 million integers would 
be more than 1mb as appengine stores natively as strings...

What you could try is to store the integers in multiple entities (say 
1-1000 integers per entity). That would make adding new integers easy as 
you would not need to modify old entities. You could join all the integers 
back together if needed with a query.

On Friday, January 25, 2013 8:32:48 PM UTC+2, Jiansen He wrote:

 Hi,

 Say an entity has a list property which has 1 million integers.  Now we 
 need to update the list property by adding 1 more integer.  Does updating 
 via put cost 2 million write operations? If so, is there a cheap 
 alternative?

 With Thanks
 Jiansen


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Re: Cost of updating list property

2013-01-25 Thread Michael Hermus
I believe that each value in an indexed multi-valued property gets its own 
index entry. Therefore, I think that adding 1 value should incur the cost of 
adding one index entry, which is 2 writes (one for asc, one for desc) and 1 
write for each custom index that includes the property.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] Re: Cost of updating list property

2013-01-25 Thread Guido van Rossum
The only way to get this to perform is to serialize the values into a
string. Repeated properties are way too slow when you get to this number of
repetitions. (They're good for tags, which need to be indexed, and of which
youd expect there to be z few, or dozens, or occasionally hundreds.)

--Guido

On Fri, Jan 25, 2013 at 11:37 AM, Ryan Chazen rya...@gmail.com wrote:

 Depends if those integers are indexed or not. Each index is a write op.
 However, an entity can only be 1mb big.. I think 1 million integers would
 be more than 1mb as appengine stores natively as strings...

 What you could try is to store the integers in multiple entities (say
 1-1000 integers per entity). That would make adding new integers easy as
 you would not need to modify old entities. You could join all the integers
 back together if needed with a query.


 On Friday, January 25, 2013 8:32:48 PM UTC+2, Jiansen He wrote:

 Hi,

 Say an entity has a list property which has 1 million integers.  Now we
 need to update the list property by adding 1 more integer.  Does updating
 via put cost 2 million write operations? If so, is there a cheap
 alternative?

 With Thanks
 Jiansen

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appengine@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine?hl=en.
 For more options, visit https://groups.google.com/groups/opt_out.






-- 
--Guido van Rossum (python.org/~guido)

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] the email associated with our app engine account was inadvertently reassigned as a nickname

2013-01-25 Thread Piper Davies
we've reassigned the email as its own entity, but are now unable to access 
our app engine. HELP! thanks so much :)

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Strange issues on production

2013-01-25 Thread Prateek Malhotra
We have a process that splits a job between backend instances and 
synchronizes via memcache (not the best method, I know, but it has been 
working for us). Earlier in the day, we started seeing weird behavior. Its 
one or more of the following:

1. Backends are acting funky 
2. Memcache latency/issues
3. URL Fetch latency/issues
4. Google Cloud Storage latency/issues
5. Task Queues are scheduling weirdly

From what I can see, tasks are being executed fine. The expected completion 
time of the tasks, however, are taking a lot longer than anticipated (5-10x 
longer). I also see weird behavior of the countdown mechanism that 
synchronizes parts of the job (based on memcache). Sporadic updates and 
random resets down to '0' and back up to a more believable number. I wonder 
if atomic incr/decr calls to memcache are not finding previous values 
properly? If I had to guess, I think the issue is with either 1, 2, or 4 
listed above. Other parts of my app hit the same URL endpoints this process 
hits, and they are running fine. As aforementioned, memcache values seem to 
be acting the weirdest, so I think the issue might reside there.

Has anyone else noticed weird behavior with memcache in recent hours?

Thank you,
Prateek




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Latency Issues across Production APIs

2013-01-25 Thread Prateek Malhotra
The status dashboard keeps switching between Elevated and Normal and 
these graphs show an obvious spike in latency:
Memcache Set:

https://lh4.googleusercontent.com/-1MEvD3r645s/UQLsMBFp-CI/AAw/G0mcAtUj-xI/s1600/memcache_put.png

HR Datastore Queries:

https://lh6.googleusercontent.com/-qvPkxzW-ZvM/UQLsS5qY1MI/AA4/Xboj3RcZ9rE/s1600/Queries.png


My application is experiencing issues that's effecting my business. Is this 
being investigated? (Status dashboard does not indicate so)

My app that's effected uses backends, task queues, memcache, HRD, google 
storage, and url fetch (I think task queues/memcache are what's really 
effected)


Thank you,

Prateek



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Re: Latency Issues across Production APIs

2013-01-25 Thread Prateek Malhotra
Sorry, forgot to mention:

Memcache and Task Queues seem to be the most effected. Tasks that usually 
take 10-20 seconds on my backends are taking almost 2 minutes. Some tasks 
seem to not even fully complete. Also, I use memcache as a synchronizing 
mechanism and use incr/decr to keep track of how many tasks are left (uses 
channel API to display # to the user), and it sporadically jumps down to 0 
when it really shouldn't be. My backend jobs (the full generation of the 
report) take anywhere between 2-80 minutes, with 95% taking below 4-5 
minutes. We are getting about a 20% success rate on the reports and that's 
taking 15 minutes or more.

Any help would be greatly appreciated!

-Prateek

On Friday, January 25, 2013 3:36:26 PM UTC-5, Prateek Malhotra wrote:

 The status dashboard keeps switching between Elevated and Normal and 
 these graphs show an obvious spike in latency:
 Memcache Set:


 https://lh4.googleusercontent.com/-1MEvD3r645s/UQLsMBFp-CI/AAw/G0mcAtUj-xI/s1600/memcache_put.png

 HR Datastore Queries:


 https://lh6.googleusercontent.com/-qvPkxzW-ZvM/UQLsS5qY1MI/AA4/Xboj3RcZ9rE/s1600/Queries.png


 My application is experiencing issues that's effecting my business. Is 
 this being investigated? (Status dashboard does not indicate so)

 My app that's effected uses backends, task queues, memcache, HRD, google 
 storage, and url fetch (I think task queues/memcache are what's really 
 effected)


 Thank you,

 Prateek





-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Appstats for Go versions on appengine production

2013-01-25 Thread Carl Schroeder
I wants. I can has appstats yet?
Don't make me find a cat pic for this. ;)

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.