Hi Matt, I am noticing I am getting rate-limited by the Search API more and more frequently. I just got limited with a "Retry-After" value of 800 (or about 13 minutes). I'm not sure how much more my calm can be enhanced in a 13 minute period, but this does not bode well for my search apps such as TweetGrid.com.
Can you say what exactly qualifies as exceeding the rate limit for search? There are no hard numbers in the docs. Is it possible to whitelist an app by referrer? TweetGrid works by querying the search servers from the clients' browsers, so whitelisting my server IP would be of no use. Request/Response headers are below: Thanks, -Chad Headers for reference: Request Headers Host search.twitter.com User-Agent Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1 Accept */* Accept-Language en-us,en;q=0.5 Accept-Encoding gzip,deflate Accept-Charset ISO-8859-1,utf-8;q=0.7,*;q=0.7 Keep-Alive 300 Connection keep-alive Referer http://tweetgrid.com/grid?l=1&q1=jazzychad&q2=tweetgrid+OR+%22tweet+grid%22 Cookie rpp=100; __utmz=110314503.1227378583.81.2.utmcsr=twitter.com |utmccn=(referral)|utmcmd=referral|utmcct =/home; __utma=110314503.2390361217092253000.1216939739.1227380887.1228599709.83; __utma=43838368.64616265 .1208222991.1228589665.1228593169.206; __utmv=43838368.lang%3A%20en_US; __utmxx=43838368.00002859631981918557 :1228059149:2592000; __utmx=43838368.00002859631981918557:1:3; __utmz=43838368.1228108435.204.12.utmcsr =tweetgrid.com|utmccn=(referral)|utmcmd=referral|utmcct=/grid; __qca=1204080243-25856624-1326010; __utmc =43838368; _twitter_sess=BAh7CjoMY3NyZl9pZCIlMWFhZWZjZDY0ZjMxZjMyMWVhZjYxMjVhNjY4ZmY1%250AOGY6CXVzZXIwOg5yZXR1cm5fdG8iIWh0dHA6Ly90d2l0dGVyLmNvbS90d2Vl %250AdGdyaWQiCmZsYXNoSUM6J0FjdGlvbkNvbnRyb2xsZXI6OkZsYXNoOjpGbGFz%250AaEhhc2h7AAY6CkB1c2VkewA6B2lkIiU5NGYzMTlkYmU5ZmI1M2U2MDg2OGNl %250ANjU5OTkzNjhmYQ%253D%253D--10fb9d01aceab6d2682b213515f18ae15dff5fe6; _search_twitter_sess=BAh7BzoMY3NyZl9pZCIlNjVkMjZlOGRjMjdiMWI0NWEwODZmMDg0ZjZmZGI3 %0AMTAiCmZsYXNoSUM6J0FjdGlvbkNvbnRyb2xsZXI6OkZsYXNoOjpGbGFzaEhh%0Ac2h7AAY6CkB1c2VkewA%3D--fc15a28d4723f2c07c2c77ef5dddb01e84a14843 ; __utmc=110314503 Response Headers Date Sat, 06 Dec 2008 23:10:43 GMT Server hi Status 503 Service Unavailable Retry-After 414 X-Runtime 0.04179 Cache-Control no-cache, max-age=300 Content-Type text/html; charset=utf-8 X-Served-By searchweb006.twitter.com Expires Sat, 06 Dec 2008 23:15:43 GMT Vary Accept-Encoding Content-Encoding gzip Content-Length 66 Connection close