[twitter-dev] Couldn't find Status with ID=xx errors

[Anirudh S]

I've been using the search API for a while now. Recently some of the queries
return 404 status with the error message like this "Couldn't find Status
with ID=3355800333". The API docs (
http://apiwiki.twitter.com/Twitter-Search-API-Method%3A-search)  mention
that "This method will return an HTTP 404 error if since_id is used and is
too old to be in the search index" . We are not using the optional since_id
in our query. Has there been any change to the API?

An example query is :
http://search.twitter.com/search.atom?q=%22Vegit%22+%22Convenience+Foods%22+-filter%3Alinks&lang=en&rpp=12

Thanks,
Anirudh S


-- 
Anirudh Surendranath
SmartCrowds Software Pvt Ltd
email  : anir...@smartcrowds.com
 : anirudh[DOT]mail[AT]gmail[DOT]com
http://gingerjoos.com

[twitter-dev] oAuth doubt : do we need get access permission from user every time

[DesignFellow]

Hi,

I am learning Twitter oAuth. I have a doubt of using oAuth.

do we need to get access permission everytime from the user to get an
access token?

I understand that we can store the access token in DB.
but how do i know the logged in user's screen name after session
timeout?

is there any method to get the logged in users id with asking
permission of the user?

Thanks in advance :)
DesignFellow

[twitter-dev] Re: efficient application that follows keywords

[Joel Strellner]

Look into the "track" streaming API method.  That should be the least
resource intensive way to track keywords.

If you can't use the streaming API, make sure you use the since_id
parameter.

-Joel

On Sun, Aug 23, 2009 at 4:29 AM, Qcho  wrote:

>
> Hello
>
> I am a new twitter developer and I am developing an application that
> follows several keywords. Each keyword will have its URL .com/
> keyw1  and the page will show the tweets
> containing that keyword.
>
> I am planning to use the Search API.
>
> Because the API returns only the matches for the latest x days (30?),
> I will have to do a cache of the posts in my local database to include
> tweets older than x days in my results.
> And with this method I can use the since_id parameter and not overflow
> twitter's servers.
>
> The number of keywords can grow very big, so I will update more
> frequently the popular keywords than the less popular ones. Is there
> any other API restriction/limit I should be aware of, or any other
> thing I can do to make the queries efficient and dont waste mine or
> twitter's resources?
>
> Thank you
>
> Victor
>

[twitter-dev] Re: Unexpected behaviour in search API

[JDG]

Showed up in the link you just provided -- perhaps it takes a while to index
the tweets.

On Sun, Aug 23, 2009 at 15:51, raffjones wrote:

>
> I've developed an app to follow comedian Eddie Izzard on his 1000-mile
> run across the UK - http://eddieizrunning.com/.
>
> Its using my own (in development, to be released shortly as open
> source) ActionScript 3.0 API for Twitter, FlashTwitter, to retrieve
> the data from Twitter, sort it, grab images from Twitpic, expand URLs
> to get map references/sighting etc. and plot all the tweets on a
> custom Google Map.
>
> I am trying to retrieve user sightings using the search API. I've
> asked people to post a Twitpic link to @eddieizrunning using the
> hashtag #eddiepic. Here's an example of what one users did earlier
> today:
>
> @eddieizrunning http://www.twitpic.com/f1980 #eddiepic
>
> But this does NOT show up for the following query to the search API:
>
> http://search.twitter.com/search.atom?q=%23eddiepic
>
> Anyone have any ideas why? Another tweet later that did not have a
> Twitpic link did appear in the search result.
>
> Any thanks gratefully received...
>
> raff
>
>
>


-- 
Internets. Serious business.

[twitter-dev] Re: Finding the most popular trending topics

[Chad Etzel]

Hi,

There is currently no way to get the number of retweets/tweets of
trending topics through the API.

Thanks,
-Chad

On Sun, Aug 23, 2009 at 5:34 PM, TrixJo wrote:
>
> Trying to find the most popular trending topics.
>
> Currently using:
>
> http://search.twitter.com/trends/current.json?exclude=hashtags
>
>
> Is there a way that I can find the most popular trending topics as
> well as the number of retweets for each topic?
>
> That way I can save the trending topics in my database as well as the
> number of retweets currently retweeted for each topic and I can rank
> each trending topic myself based on the number or retweets
>
> tahnks
>

[twitter-dev] Re: heavy throttling by search.twitter.com API from GAE application

[Chad Etzel]

Hopefully to add some clarity:

I have not used AWS or EC2, but as I understand it, Elastic IP's are
IP's that you 'own' under your account that you can assign at will to
your instances. In this way, it acts as a Static IP since you use it
exclusively.

-Chad

On Sun, Aug 23, 2009 at 11:06 AM, boaz wrote:
>
> Just to clarify: I am testing with unauthenticated calls
>
> On Aug 23, 5:17 pm, boaz  wrote:
>> Hello everyone,
>>
>> I checked the behavior on an AWS instance _without_ static IP (which
>> is called by Amazon elastic IP) and I do not see any problem with the
>> limits. The "limit status" shows that I have exactly 150 calls left
>> minus the ones I have explicitly used. I do not obeserve any behvior
>> where my limits are affected by other users with which I share the
>> resource.
>> Am I missing something? Could it be just a matter of luck/random
>> behavior?
>>
>> Thank you,
>> Boaz
>>
>> On Aug 22, 12:03 am, "Darren Bounds (Cliqset)" 
>> wrote:
>>
>> > Hello Chad,
>>
>> > Can you confirm that this is not the case for AWS elastic IPs which
>> > had been previously whitelisted by Twitter?
>>
>> > Thanks,
>> > Darren
>>
>> > On Aug 21, 4:35 pm, Chad Etzel  wrote:
>>
>> > > Hello,
>>
>> > > I have replied to Jud off-list, but for everyone's benefit we'd like
>> > > to reiterate that AWS and GAE are shared resources and therefore share
>> > > the rate limit across applications. A dedicated IP and unique UA will
>> > > guarantee the maximum API limits. There are several cheap and reliable
>> > > VPS hosting services available which can provide a dedicated IP
>> > > address and full control over the server.
>>
>> > > Thanks,
>> > > -Chad
>>
>> > > On Fri, Aug 21, 2009 at 12:48 PM, Jud wrote:
>>
>> > > > I've got a python app running on Google App Engine (appspot hosted)
>> > > > that querieshttp://search.twitter.com/search.atom?q=forsimple
>> > > > queries (e.g. "foo OR bar"), and it's being severely throttled (e.g.
>> > > > can't get a successful request through (response 200 w/ data) more
>> > > > than a couple of times per _hour_).
>>
>> > > > - I'm setting the UA string to something unique/identifiable (e.g. my
>> > > > company name)
>> > > > - I'm respecting the retry-after header coming back when I see a 503
>> > > > (average retry-after duration is ~750)
>> > > > - GAE turns the IP address behind the app over ~ every 6 hours
>> > > > - app hits tries to hit search.twitter.com every 5 minutes.
>>
>> > > > I've successfully polled the endpoint at much higher rates (in
>> > > > completely different IP address ranges) in the past, without issue.
>> > > > Unclear what's going on. Any suggestions would be greatly appreciated.
>

[twitter-dev] Re: Bug: negation search

[Chad Etzel]

Hi Scott,

#php -follow

...works fine for me over the API

#php -lance -phpge3k -stackalert -RT -imoracle -#freelance -phplinks
-web2feed -freelance -webtechman -tuvinh -freelancer -job -jobs
-wefollow

...is 142 characters (even before URL encoding) so it's going over the limit.

-Chad

On Sun, Aug 23, 2009 at 10:52 PM, Scott Haneda wrote:
>
> Building my ever growing exclusion list for Twitter to get more signal and
> less noise...
>
> #php -lance -phpge3k -stackalert -RT -imoracle -#freelance -phplinks
> -web2feed -freelance -webtechman -tuvinh -freelancer -job -jobs
>
> That works.
>
> #php -lance -phpge3k -stackalert -RT -imoracle -#freelance -phplinks
> -web2feed -freelance -webtechman -tuvinh -freelancer -job -jobs -wefollow
>
> That does not work.
> Any combination of "follow" cussed an error.
>
> I'm only testing on a mobile, in tweetie, but on mobile safari, in the
> search box, results are the same. search.twitter.com seems immune.
>
> It is not length bound. Just "-follow", will also not work.
>
> This appears API limited for the most part.
> --
> Scott
> Iphone says hello.
>

[twitter-dev] Re: using Twitter API with PHP

[Scott Haneda]

If you don't want a public community API, and want to write it in your  
own, then you are sort stuck.


The docs show you sample curl commands or you can http request in a  
browser to test simulate.


You have sample curl examples, if you are objectionable to libraries,  
then warp your php around those curl commands.


If that is not what you want, it sounds like you should look for an  
introduction to php tutorial, or a general introduction to web based  
scripting languages.


--
Scott
Iphone says hello.

On Aug 23, 2009, at 1:45 PM, Termanater13  wrote:


Ive been looking to use the Twitter API with my php Site and I cant
find much just a bunch of URLs used wuth the Twitter API and the curl
commands used with the API. Can someone point me in the direction of
where to start, and please nothing done by the comunity unless its a
tutorial on how to write my own if at al possible.

[twitter-dev] Re: using Twitter API with PHP

[Abraham Williams]

You might check out his book by @kmakice:
http://www.amazon.com/Twitter-API-Running-Learn-Applications/dp/0596154615/ref=sr_1_1?ie=UTF8&s=books&qid=1251084745&sr=8-1

On Sun, Aug 23, 2009 at 15:45, Termanater13  wrote:

>
> Ive been looking to use the Twitter API with my php Site and I cant
> find much just a bunch of URLs used wuth the Twitter API and the curl
> commands used with the API. Can someone point me in the direction of
> where to start, and please nothing done by the comunity unless its a
> tutorial on how to write my own if at al possible.
>



-- 
Abraham Williams | Community Evangelist | http://web608.org
Hacker | http://abrah.am | http://twitter.com/abraham
Project | http://fireeagle.labs.poseurtech.com
This email is: [ ] blogable [x] ask first [ ] private.
Sent from Madison, WI, United States

[twitter-dev] using Twitter API with PHP

[Termanater13]

Ive been looking to use the Twitter API with my php Site and I cant
find much just a bunch of URLs used wuth the Twitter API and the curl
commands used with the API. Can someone point me in the direction of
where to start, and please nothing done by the comunity unless its a
tutorial on how to write my own if at al possible.

[twitter-dev] Finding the most popular trending topics

[TrixJo]

Trying to find the most popular trending topics.

Currently using:

http://search.twitter.com/trends/current.json?exclude=hashtags


Is there a way that I can find the most popular trending topics as
well as the number of retweets for each topic?

That way I can save the trending topics in my database as well as the
number of retweets currently retweeted for each topic and I can rank
each trending topic myself based on the number or retweets

tahnks

[twitter-dev] Unexpected behaviour in search API

[raffjones]

I've developed an app to follow comedian Eddie Izzard on his 1000-mile
run across the UK - http://eddieizrunning.com/.

Its using my own (in development, to be released shortly as open
source) ActionScript 3.0 API for Twitter, FlashTwitter, to retrieve
the data from Twitter, sort it, grab images from Twitpic, expand URLs
to get map references/sighting etc. and plot all the tweets on a
custom Google Map.

I am trying to retrieve user sightings using the search API. I've
asked people to post a Twitpic link to @eddieizrunning using the
hashtag #eddiepic. Here's an example of what one users did earlier
today:

@eddieizrunning http://www.twitpic.com/f1980 #eddiepic

But this does NOT show up for the following query to the search API:

http://search.twitter.com/search.atom?q=%23eddiepic

Anyone have any ideas why? Another tweet later that did not have a
Twitpic link did appear in the search result.

Any thanks gratefully received...

raff

[twitter-dev] Is it possible to create account with Twitter API

[RebolTutorial]

All in the question :)

[twitter-dev] Re: Is it possible to create account with Twitter API

[Cameron Kaiser]

> All in the question :)

No.

-- 
 personal: http://www.cameronkaiser.com/ --
  Cameron Kaiser * Floodgap Systems * www.floodgap.com * ckai...@floodgap.com
-- Honk if you're illiterate! -

[twitter-dev] Re: heavy throttling by search.twitter.com API from GAE application

[boaz]

Just to clarify: I am testing with unauthenticated calls

On Aug 23, 5:17 pm, boaz  wrote:
> Hello everyone,
>
> I checked the behavior on an AWS instance _without_ static IP (which
> is called by Amazon elastic IP) and I do not see any problem with the
> limits. The "limit status" shows that I have exactly 150 calls left
> minus the ones I have explicitly used. I do not obeserve any behvior
> where my limits are affected by other users with which I share the
> resource.
> Am I missing something? Could it be just a matter of luck/random
> behavior?
>
> Thank you,
> Boaz
>
> On Aug 22, 12:03 am, "Darren Bounds (Cliqset)" 
> wrote:
>
> > Hello Chad,
>
> > Can you confirm that this is not the case for AWS elastic IPs which
> > had been previously whitelisted by Twitter?
>
> > Thanks,
> > Darren
>
> > On Aug 21, 4:35 pm, Chad Etzel  wrote:
>
> > > Hello,
>
> > > I have replied to Jud off-list, but for everyone's benefit we'd like
> > > to reiterate that AWS and GAE are shared resources and therefore share
> > > the rate limit across applications. A dedicated IP and unique UA will
> > > guarantee the maximum API limits. There are several cheap and reliable
> > > VPS hosting services available which can provide a dedicated IP
> > > address and full control over the server.
>
> > > Thanks,
> > > -Chad
>
> > > On Fri, Aug 21, 2009 at 12:48 PM, Jud wrote:
>
> > > > I've got a python app running on Google App Engine (appspot hosted)
> > > > that querieshttp://search.twitter.com/search.atom?q=forsimple
> > > > queries (e.g. "foo OR bar"), and it's being severely throttled (e.g.
> > > > can't get a successful request through (response 200 w/ data) more
> > > > than a couple of times per _hour_).
>
> > > > - I'm setting the UA string to something unique/identifiable (e.g. my
> > > > company name)
> > > > - I'm respecting the retry-after header coming back when I see a 503
> > > > (average retry-after duration is ~750)
> > > > - GAE turns the IP address behind the app over ~ every 6 hours
> > > > - app hits tries to hit search.twitter.com every 5 minutes.
>
> > > > I've successfully polled the endpoint at much higher rates (in
> > > > completely different IP address ranges) in the past, without issue.
> > > > Unclear what's going on. Any suggestions would be greatly appreciated.

[twitter-dev] Bug: negation search

[Scott Haneda]

Building my ever growing exclusion list for Twitter to get more signal  
and less noise...


#php -lance -phpge3k -stackalert -RT -imoracle -#freelance -phplinks - 
web2feed -freelance -webtechman -tuvinh -freelancer -job -jobs


That works.

#php -lance -phpge3k -stackalert -RT -imoracle -#freelance -phplinks - 
web2feed -freelance -webtechman -tuvinh -freelancer -job -jobs -wefollow


That does not work.
Any combination of "follow" cussed an error.

I'm only testing on a mobile, in tweetie, but on mobile safari, in the  
search box, results are the same. search.twitter.com seems immune.


It is not length bound. Just "-follow", will also not work.

This appears API limited for the most part.
--
Scott
Iphone says hello.

[twitter-dev] Re: Trying to display JSON object

[Dewald Pretorius]

With PHP, use json_decode($jsonencoded, true).

That returns a standard array, which is far easier to process than the
JSON object.

Dewald

[twitter-dev] Re: heavy throttling by search.twitter.com API from GAE application

[Martin Omander]

Another data point: I also run a Python app on Google App Engine. It
hits the Twitter search API 3 times per minute, with different search
parameters. About 20% of my app's search requests get a 503L error
code, and the other 80% return search results as expected. There is no
clear pattern or grouping of these errors. Other calls to the Twitter
API that are not search-related, like users/show, fail only about 0.1%
of the time.

Anecdotal evidence: I seem to remember the success rate of my app's
search requests was higher before the DDOS attacks two weeks ago. As I
haven't saved the logs, I can't be sure.

It would be better if the failure rate for searches were lower. But
20% failure is not a big deal for me as the searches run as cron jobs,
which can always retry later.

/Martin


On Aug 23, 7:51 am, Andrew Badera  wrote:
> 150 is a per-user rate, not a per-IP rate, to begin with, isn't it?
> The issue here is whitelisted IPs sharing 20k total, right?
>
> ∞ Andy Badera
> ∞ This email is: [ ] bloggable [x] ask first [ ] private
> ∞ Google me:http://www.google.com/search?q=(andrew+badera)+OR+(andy+badera)
>
>
>
> On Sun, Aug 23, 2009 at 10:17 AM, boaz wrote:
>
> > Hello everyone,
>
> > I checked the behavior on an AWS instance _without_ static IP (which
> > is called by Amazon elastic IP) and I do not see any problem with the
> > limits. The "limit status" shows that I have exactly 150 calls left
> > minus the ones I have explicitly used. I do not obeserve any behvior
> > where my limits are affected by other users with which I share the
> > resource.
> > Am I missing something? Could it be just a matter of luck/random
> > behavior?
>
> > Thank you,
> > Boaz
>
> > On Aug 22, 12:03 am, "Darren Bounds (Cliqset)" 
> > wrote:
> >> Hello Chad,
>
> >> Can you confirm that this is not the case for AWS elastic IPs which
> >> had been previously whitelisted by Twitter?
>
> >> Thanks,
> >> Darren
>
> >> On Aug 21, 4:35 pm, Chad Etzel  wrote:
>
> >> > Hello,
>
> >> > I have replied to Jud off-list, but for everyone's benefit we'd like
> >> > to reiterate that AWS and GAE are shared resources and therefore share
> >> > the rate limit across applications. A dedicated IP and unique UA will
> >> > guarantee the maximum API limits. There are several cheap and reliable
> >> > VPS hosting services available which can provide a dedicated IP
> >> > address and full control over the server.
>
> >> > Thanks,
> >> > -Chad
>
> >> > On Fri, Aug 21, 2009 at 12:48 PM, Jud wrote:
>
> >> > > I've got a python app running on Google App Engine (appspot hosted)
> >> > > that querieshttp://search.twitter.com/search.atom?q=forsimple
> >> > > queries (e.g. "foo OR bar"), and it's being severely throttled (e.g.
> >> > > can't get a successful request through (response 200 w/ data) more
> >> > > than a couple of times per _hour_).
>
> >> > > - I'm setting the UA string to something unique/identifiable (e.g. my
> >> > > company name)
> >> > > - I'm respecting the retry-after header coming back when I see a 503
> >> > > (average retry-after duration is ~750)
> >> > > - GAE turns the IP address behind the app over ~ every 6 hours
> >> > > - app hits tries to hit search.twitter.com every 5 minutes.
>
> >> > > I've successfully polled the endpoint at much higher rates (in
> >> > > completely different IP address ranges) in the past, without issue.
> >> > > Unclear what's going on. Any suggestions would be greatly appreciated.

[twitter-dev] Re: Can someone suggest a VB.NET Twitter API Interface that works?

[Joe Mayo]

Hi Catcalls,

Not sure if you tried my library, LINQ to Twitter (http://
linqtotwitter.codeplex.com/).  I recently found a bug that was keeping
it from working for VB because of the way that the compiler was
generating code, so it's possible that I'm the lazy coder you're
trashing and being rude to.   My primary language is C#, so I
would like to get more VB programmers to use the library and give me
feedback.  I can't guarantee that I'll fix everything immediately, but
over time I can help make the library more useful.  Also, if you're
using OAuth, Andrew Arnott has integrated his DotNetOpenAuth (http://
dotnetopenauth.net:8000/), which is an excellent library itself.

Joe

On Aug 13, 3:48 pm, catcalls  wrote:
> Hi,
>
> I've been using a free Twitter API Interface that was coded in C# and
> I imported the DLL and it was working fine until I discovered I cannot
> post spaces to twitter updates! I mean, WHAT!?
>
> So, I have basically coded this application with full interaction with
> this DLL and wasted the past three days of my time because the
> original coder was too lazy to get it to work for his clients.
>
> So, can someone recommend a library that they used and was really
> pleased with - I don't mind paying a small fee for something that
> actually works you see.
>
> I have a complete app coded that just needs the API Interface to work.
> I tried rewriting some OAuth code but kept getting nonce errors so I
> gave up. I might go back to that again though if this request fails as
> a last resort.
>
> I now understand the API authentication procedure a lot more now - and
> remember the mistakes I was making previously. I might be able to
> actually code a working class in VB.nET now with my expanded knowledge
> of the OAuth authentication procedure.
>
> But, in the meantime, any one know of a good API for VB.NET to use in
> the form of a DLL that is Open Source too? This is because I'd really
> like to take a look at working OAuth/Twitter API code in visual
> basic .net 2005.
>
> Thank you in advance.
>
> catcalls

[twitter-dev] Re: Trying to display JSON object

[shiplu]

foreach($json->results as $result){
$result->item;
}
will do.
-- 
A K M Mokaddim
http://talk.cmyweb.net
http://twitter.com/shiplu
Stop Top Posting !!
বাংলিশ লেখার চাইতে বাংলা লেখা অনেক ভাল

[twitter-dev] Interesting Use-Case for the source attribute

[Jesse Stay]

I have an app I'm sending Twitter updates via both my website, and a
Facebook app.  It's the same user database and same brand all around though.
 What would be very useful is if there was a way to, when users post from
the Facebook app, mention a specific source for the Facebook app version of
my site, and a different source for the non-Facebook app so their friends
can differentiate between the two.  I'd rather not have to make the users
log in all over again when they get to the Facebook app because I have to
use 2 OAuth instances.  Is there a good way to provide 2 source attributes
for the same app?  Can I add this as a suggestion for future features?
Thanks,

Jesse

[twitter-dev] Re: heavy throttling by search.twitter.com API from GAE application

[Andrew Badera]

150 is a per-user rate, not a per-IP rate, to begin with, isn't it?
The issue here is whitelisted IPs sharing 20k total, right?

∞ Andy Badera
∞ This email is: [ ] bloggable [x] ask first [ ] private
∞ Google me: http://www.google.com/search?q=(andrew+badera)+OR+(andy+badera)



On Sun, Aug 23, 2009 at 10:17 AM, boaz wrote:
>
> Hello everyone,
>
> I checked the behavior on an AWS instance _without_ static IP (which
> is called by Amazon elastic IP) and I do not see any problem with the
> limits. The "limit status" shows that I have exactly 150 calls left
> minus the ones I have explicitly used. I do not obeserve any behvior
> where my limits are affected by other users with which I share the
> resource.
> Am I missing something? Could it be just a matter of luck/random
> behavior?
>
> Thank you,
> Boaz
>
> On Aug 22, 12:03 am, "Darren Bounds (Cliqset)" 
> wrote:
>> Hello Chad,
>>
>> Can you confirm that this is not the case for AWS elastic IPs which
>> had been previously whitelisted by Twitter?
>>
>> Thanks,
>> Darren
>>
>> On Aug 21, 4:35 pm, Chad Etzel  wrote:
>>
>> > Hello,
>>
>> > I have replied to Jud off-list, but for everyone's benefit we'd like
>> > to reiterate that AWS and GAE are shared resources and therefore share
>> > the rate limit across applications. A dedicated IP and unique UA will
>> > guarantee the maximum API limits. There are several cheap and reliable
>> > VPS hosting services available which can provide a dedicated IP
>> > address and full control over the server.
>>
>> > Thanks,
>> > -Chad
>>
>> > On Fri, Aug 21, 2009 at 12:48 PM, Jud wrote:
>>
>> > > I've got a python app running on Google App Engine (appspot hosted)
>> > > that querieshttp://search.twitter.com/search.atom?q=forsimple
>> > > queries (e.g. "foo OR bar"), and it's being severely throttled (e.g.
>> > > can't get a successful request through (response 200 w/ data) more
>> > > than a couple of times per _hour_).
>>
>> > > - I'm setting the UA string to something unique/identifiable (e.g. my
>> > > company name)
>> > > - I'm respecting the retry-after header coming back when I see a 503
>> > > (average retry-after duration is ~750)
>> > > - GAE turns the IP address behind the app over ~ every 6 hours
>> > > - app hits tries to hit search.twitter.com every 5 minutes.
>>
>> > > I've successfully polled the endpoint at much higher rates (in
>> > > completely different IP address ranges) in the past, without issue.
>> > > Unclear what's going on. Any suggestions would be greatly appreciated.
>

[twitter-dev] efficient application that follows keywords

[Qcho]

Hello

I am a new twitter developer and I am developing an application that
follows several keywords. Each keyword will have its URL .com/
keyw1 and the page will show the tweets containing that keyword.

I am planning to use the Search API.

Because the API returns only the matches for the latest x days (30?),
I will have to do a cache of the posts in my local database to include
tweets older than x days in my results.
And with this method I can use the since_id parameter and not overflow
twitter's servers.

The number of keywords can grow very big, so I will update more
frequently the popular keywords than the less popular ones. Is there
any other API restriction/limit I should be aware of, or any other
thing I can do to make the queries efficient and dont waste mine or
twitter's resources?

Thank you

Victor

[twitter-dev] Re: heavy throttling by search.twitter.com API from GAE application

[boaz]

Hello everyone,

I checked the behavior on an AWS instance _without_ static IP (which
is called by Amazon elastic IP) and I do not see any problem with the
limits. The "limit status" shows that I have exactly 150 calls left
minus the ones I have explicitly used. I do not obeserve any behvior
where my limits are affected by other users with which I share the
resource.
Am I missing something? Could it be just a matter of luck/random
behavior?

Thank you,
Boaz

On Aug 22, 12:03 am, "Darren Bounds (Cliqset)" 
wrote:
> Hello Chad,
>
> Can you confirm that this is not the case for AWS elastic IPs which
> had been previously whitelisted by Twitter?
>
> Thanks,
> Darren
>
> On Aug 21, 4:35 pm, Chad Etzel  wrote:
>
> > Hello,
>
> > I have replied to Jud off-list, but for everyone's benefit we'd like
> > to reiterate that AWS and GAE are shared resources and therefore share
> > the rate limit across applications. A dedicated IP and unique UA will
> > guarantee the maximum API limits. There are several cheap and reliable
> > VPS hosting services available which can provide a dedicated IP
> > address and full control over the server.
>
> > Thanks,
> > -Chad
>
> > On Fri, Aug 21, 2009 at 12:48 PM, Jud wrote:
>
> > > I've got a python app running on Google App Engine (appspot hosted)
> > > that querieshttp://search.twitter.com/search.atom?q=forsimple
> > > queries (e.g. "foo OR bar"), and it's being severely throttled (e.g.
> > > can't get a successful request through (response 200 w/ data) more
> > > than a couple of times per _hour_).
>
> > > - I'm setting the UA string to something unique/identifiable (e.g. my
> > > company name)
> > > - I'm respecting the retry-after header coming back when I see a 503
> > > (average retry-after duration is ~750)
> > > - GAE turns the IP address behind the app over ~ every 6 hours
> > > - app hits tries to hit search.twitter.com every 5 minutes.
>
> > > I've successfully polled the endpoint at much higher rates (in
> > > completely different IP address ranges) in the past, without issue.
> > > Unclear what's going on. Any suggestions would be greatly appreciated.