I may be too much of a database guy :), but my instinct is always to grab what I can, normalize it into a set of database tables, and then do the analysis myself. I always learn more that way. If you want the top tags for all tweets, you can access the sample method of the streaming API, get the tags from the entities object in each tweet, and put them into a table.
http://dev.twitter.com/pages/streaming_api_methods#statuses-sample This will give then you want you asked for: SELECT count(*) AS cnt, tag FROM tags GROUP BY tag ORDER BY cnt DESC LIMIT 1000 I haven't worked with the sample method, but if it truly is a random sample, the tags will be representative of the entire flow. Then you can go back and use the search API for the most recent tweets for each tag, although the rate limits will keep you from getting too many. A solution there is to search for multiple tags at once, and then split them out by tag yourself. Although you still can only get 1,500 tweets for each search. On Sun, Nov 14, 2010 at 11:10 PM, b3zra1y <agregwil...@gmail.com> wrote: > Thanks, I looked at that. > But I need more than 10. > Ideally, i can identify the top ~1000 or more hashtags. > Any way to achieve that? > > On Nov 14, 8:47 pm, Jonathan Reichhold <jonathan.reichh...@gmail.com> > wrote: >> Have you considered the trends api? Popular hashtags for many locations are >> included in the trends. You can then use the search api to find examples of >> those trends. >> >> http://dev.twitter.com/doc/get/trendshttp://dev.twitter.com/doc/get/search >> >> Jonathan >> >> >> >> On Sun, Nov 14, 2010 at 5:12 PM, b3zra1y <agregwil...@gmail.com> wrote: >> > Thanks for the response. >> > I'll check out your code. >> >> > I should have clarified a bit more. >> > I'm looking for the most popular hashtags within the Twitter DB. >> > I would then like to be able to obtain a reference to the tweets that >> > use these popular hashtags. >> > Ideally, I would be able to obtain the text of each of those tweets, >> > but I'm suspecting that this would far outweigh the Twitter API limit >> > will. >> >> > On Nov 14, 4:21 pm, Adam Green <140...@gmail.com> wrote: >> > > Are you looking for the most popular hashtags out of all tweets or >> > > within a set of tweets about a specific subject? If it is the later, >> > > what I do is use the streaming API to collect all tweets for certain >> > > keywords, parse out the hashtags within them, and store them in a >> > > MySQL database. Then I can use straight-forward SQL commands to find >> > > the most frequent tags over any period of time. As you'd expect, it is >> > > a steep power curve with a very long tail. The top 100 to 200 hashtags >> > > in any subset get about 80% of the use. >> >> > > I have a set of simple source code in PHP that creates this type of >> > > database. You can use this as a starting point.http://bit.ly/a1CsZE >> >> > > On Sun, Nov 14, 2010 at 8:37 AM, b3zra1y <agregwil...@gmail.com> wrote: >> > > > Hi all - >> > > > I'm looking for an API method that will return a list of popular >> > > > hashtags. >> >> > > > I'm new to the API, but at first glance I don't see such a method. >> > > > Can you point the way ? >> > > > THANKS >> >> > > -- >> > > Adam Green >> > > Twitter API Consultant and Trainer http://140dev.com >> > > @140dev >> >> > -- >> > Twitter developer documentation and resources:http://dev.twitter.com/doc >> > API updates via Twitter:http://twitter.com/twitterapi >> > Issues/Enhancements Tracker: >> >http://code.google.com/p/twitter-api/issues/list >> > Change your membership to this group: >> >http://groups.google.com/group/twitter-development-talk > > -- > Twitter developer documentation and resources: http://dev.twitter.com/doc > API updates via Twitter: http://twitter.com/twitterapi > Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list > Change your membership to this group: > http://groups.google.com/group/twitter-development-talk > -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
