Hi Chad,
I'll check the logs for TweetGrid and see what's going on. I'll
send you an email once I have some information and we can work it out.
Thanks;
— Matt Sanford
On Dec 6, 2008, at 03:23 PM, Chad Etzel wrote:
Hi Matt,
I am noticing I am getting rate-limited by the Search API more and
more frequently. I just got limited with a "Retry-After" value of
800 (or about 13 minutes). I'm not sure how much more my calm can
be enhanced in a 13 minute period, but this does not bode well for
my search apps such as TweetGrid.com.
Can you say what exactly qualifies as exceeding the rate limit for
search? There are no hard numbers in the docs. Is it possible to
whitelist an app by referrer? TweetGrid works by querying the
search servers from the clients' browsers, so whitelisting my server
IP would be of no use.
Request/Response headers are below:
Thanks,
-Chad
Headers for reference:
Request Headers
Host search.twitter.com
User-Agent Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:
1.8.1.1) Gecko/20061204 Firefox/2.0.0.1
Accept */*
Accept-Language en-us,en;q=0.5
Accept-Encoding gzip,deflate
Accept-Charset ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive 300
Connection keep-alive
Referer
http://tweetgrid.com/grid?l=1&q1=jazzychad&q2=tweetgrid+OR+%22tweet+grid%22
Cookie rpp=100;
__utmz=110314503.1227378583.81.2.utmcsr=twitter.com|
utmccn=(referral)|utmcmd=referral|utmcct
=/home;
__utma
=110314503.2390361217092253000.1216939739.1227380887.1228599709.83;
__utma=43838368.64616265
.1208222991.1228589665.1228593169.206; __utmv=43838368.lang%3A
%20en_US; __utmxx=43838368.00002859631981918557
:1228059149:2592000; __utmx=43838368.00002859631981918557:1:3;
__utmz=43838368.1228108435.204.12.utmcsr
=tweetgrid.com|utmccn=(referral)|utmcmd=referral|utmcct=/grid;
__qca=1204080243-25856624-1326010; __utmc
=43838368;
_twitter_sess
=
BAh7CjoMY3NyZl9pZCIlMWFhZWZjZDY0ZjMxZjMyMWVhZjYxMjVhNjY4ZmY1
%250AOGY6CXVzZXIwOg5yZXR1cm5fdG8iIWh0dHA6Ly90d2l0dGVyLmNvbS90d2Vl
%250AdGdyaWQiCmZsYXNoSUM6J0FjdGlvbkNvbnRyb2xsZXI6OkZsYXNoOjpGbGFz
%250AaEhhc2h7AAY6CkB1c2VkewA6B2lkIiU5NGYzMTlkYmU5ZmI1M2U2MDg2OGNl
%250ANjU5OTkzNjhmYQ%253D
%253D--10fb9d01aceab6d2682b213515f18ae15dff5fe6;
_search_twitter_sess
=BAh7BzoMY3NyZl9pZCIlNjVkMjZlOGRjMjdiMWI0NWEwODZmMDg0ZjZmZGI3
%0AMTAiCmZsYXNoSUM6J0FjdGlvbkNvbnRyb2xsZXI6OkZsYXNoOjpGbGFzaEhh
%0Ac2h7AAY6CkB1c2VkewA%3D--fc15a28d4723f2c07c2c77ef5dddb01e84a14843
; __utmc=110314503
Response Headers
Date Sat, 06 Dec 2008 23:10:43 GMT
Server hi
Status 503 Service Unavailable
Retry-After 414
X-Runtime 0.04179
Cache-Control no-cache, max-age=300
Content-Type text/html; charset=utf-8
X-Served-By searchweb006.twitter.com
Expires Sat, 06 Dec 2008 23:15:43 GMT
Vary Accept-Encoding
Content-Encoding gzip
Content-Length 66
Connection close
