[twitter-dev] +filter:links for Twitter API
Looking for functionality like +filter:links available in the search API but for the regular Twitter API. There is some (close) functionality in the Streaming API with statuses/ filter track - but since that filter is phrase based, I can't just ask for everything that contains 'http://' unfortunately. Any ideas? Trying to remove a lot of chatter and wasted processing from a content / reading solution. Thanks, - B. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Re: Is tweet retweeted or not.
Can you use the function statuses/retweeted_by_me (using the credentials the user has given you) and compare with the user's timeline to see if a tweet has already been retweeted? On Jun 5, 11:33 am, Julio Biason julio.bia...@gmail.com wrote: On Sat, Jun 5, 2010 at 1:22 PM, Furkan Kuru furkank...@gmail.com wrote: Retweets are not given in the timeline. You have to get retweets and merge them. They are. Either you can call home_timeline instead of public_timeline or call public_timeline with the include_rts parameter. -- Julio Biason julio.bia...@gmail.com Twitter:http://twitter.com/juliobiason
[twitter-dev] Re: Can't get followers ids from users with lots of followers
Provide a cursor to get back the results in 5000 user chunks. Read http://apiwiki.twitter.com/Twitter-REST-API-Method%3A-friends%C2%A0ids for more details. On Apr 22, 11:18 pm, RTuosto ryantuo...@gmail.com wrote: I get a twitter over capacity when I do something like this: http://api.twitter.com/1/followers/ids.xml?screen_name=britneyspears But if I do it with my own account which only has a few followers it works as normal. How do I avoid this error? -- Subscription settings:http://groups.google.com/group/twitter-development-talk/subscribe?hl=en
[twitter-dev] 502 errors on user timelines
I've noticed that when trying to get the entire status timeline for some users (user ID 49777412 was one such user), requesting a page (say the first page) of 200 tweets results in a 502 error. Retrying the request a several seconds (5 seconds, in my case) later succeeds. When requesting the second page of statuses, it again fails, but a few seconds later it succeeds. It seems as though there's some caching issue happening in which the initial request will take too long to return so Twitter returns a 502 error, and by the time the second request happens the data has been retrieved and is ready to serve the request. How should I go about avoiding or reducing the occurrence of these errors? Thanks, Brendan
[twitter-dev] Re: Docs wrong for retweets method? Count seems to be ignored if 20
I've reported this through several means (tweets to TwitterApi, post on this forum, etc.). Seems to be a bug that I too would like to see fixed! On Dec 30, 8:51 pm, Tim Haines tmhai...@gmail.com wrote: Hey guys, I'm trying: curl -u timhaines:123#notreallyhttp://twitter.com/statuses/retweets/5635825799.json?count=100 and only the first 20 RTs are being returned. Same with the xml method. The docs (http://apiwiki.twitter.com/Twitter-REST-API-Method:-statuses-retweets) say you should be able to fetch up to the first 100. Am I doing it wrong? Or Doc/API bug? Tim.
[twitter-dev] Re: Loose ends for List and Retweet APIs
While we're on the matter of suggestions, could someone fix the count parameter to statuses/retweets? Currently it won't return more than 20, regardless of what count is. On Dec 18, 2:09 pm, Marcel Molina mar...@twitter.com wrote: There are some loose ends that need to be tied up in both the List and Retweet APIs to round out the feature set and fix some bugs. I want to crank these all out. So here is a little list I've been building. Please add what I've left out and you think is missing. Retweet: * add retweet_count to every status representation * support paging through the resource that returns all retweets for a given tweet * don't require authentication for *most* read only resources List: * on a user representation, show list count, list memberships count and list subscriptions count * don't require authentication on read only resources * expose a list of ids for a list's members and subscribers (this change will go hand in hand with a new bulk user lookup resource where you provide a list of ids and get back a list of user representations) * count parameter for status timelines of a list appears to do nothing Many other things I'm sure... -- Marcel Molina Twitter Platform Teamhttp://twitter.com/noradio
[twitter-dev] Re: Loose ends for List and Retweet APIs
It would be good to be able to get retweets in a user's timeline. If that is not possible for backwards compatibility reasons, is it possible to have a function such as retweets_by_user which has similar semantics to retweets_by_me, except we can specify the user whose retweets are being retrieved (requiring appropriate authentication for protected users, of course)? Thanks! On Dec 18, 2:09 pm, Marcel Molina mar...@twitter.com wrote: There are some loose ends that need to be tied up in both the List and Retweet APIs to round out the feature set and fix some bugs. I want to crank these all out. So here is a little list I've been building. Please add what I've left out and you think is missing. Retweet: * add retweet_count to every status representation * support paging through the resource that returns all retweets for a given tweet * don't require authentication for *most* read only resources List: * on a user representation, show list count, list memberships count and list subscriptions count * don't require authentication on read only resources * expose a list of ids for a list's members and subscribers (this change will go hand in hand with a new bulk user lookup resource where you provide a list of ids and get back a list of user representations) * count parameter for status timelines of a list appears to do nothing Many other things I'm sure... -- Marcel Molina Twitter Platform Teamhttp://twitter.com/noradio
[twitter-dev] Bug in statuses/retweets
The count option for statuses/retweets does not work as specified. Consider a Tweet that has been sufficiently (more than 100 times) retweeted, such as http://twitter.com/twitter/status/6227052301 Getting retweets of this status through the following call http://api.twitter.com/1/statuses/retweets/6227052301.xml results in 20 retweets being returned. We can correctly limit the number of retweets returned by doing http://api.twitter.com/1/statuses/retweets/6227052301.xml?count=2. However, we cannot return up to the last 100 retweets as specified in the API by making count larger than 20. For example, http://api.twitter.com/1/statuses/retweets/6227052301.xml?count=50 only returns the 20 most recent retweets. Thanks, Brendan
[twitter-dev] Getting retweets in user timelines
According to the API documentation retweets do not appear in a user's timeline when requested via the statuses/user_timeline method. It seems as though through the API it's not possible to see what a particular individual is retweeting. Is this assertion correct, and if so, is there a plan to make such functionality available? Also, it would be awesome if we could get through the API that a status has been retweeted when making requests to a user's timeline. This would avoid the overhead of going through each tweet and making a statuses/retweets call. Thank you, Brendan
[twitter-dev] Re: Streaming API: Spritzer-stream coverage
On Tue, May 26, 2009 at 10:07 PM, elversatile elversat...@gmail.com wrote: Makes sense. I was assuming the same. Thanks people! John from Twitter said that spritzer is 1/3 of the gardenhose, which makes it 15%. So I guess statistical insignificance of spritzer is due to its low percentage. I'm also curious what statistical insignificance means in this context, since in the Streaming API docs they're pretty assiduous saying which are significant vs. insignificant. Sample sizes far lower than 4% are of course fine for certain purposes as long as they're drawn uniformly. And even if not all that uniform, they might still be good enough :) There are so many different things to do with *hose/spritzer I'm not sure what statistical significance means in the abstract. I'm seeing hundreds of thousands of messages per day on /spritzer. If you're interested in computing a statistic that holds across all tweets -- say, average tweet length -- that's *plenty*. (Now, if you wanted to compute the statistic per 1 minute time window and cared about minute-per-minute differences, the story might be different...) I'm curious to know what the docs author meant by statistically (in)significant here. Brendan [ http://anyall.org ]
[twitter-dev] Re: Search Twitter (Java, C#) - Language Preferences?
On Tue, May 26, 2009 at 5:32 AM, Merrows sa...@merrows.co.uk wrote: I have a system already written in C# and .NET which I started in 2003. I have been happy with using c# and .NET as it has a good class structure, and also Winforms works well for writing client-server applications. Recently, I have seen much less interest in C# from developers. I want to integrate search results from twitter into the current system and I am thinking of what languages to use. I have googled what language to use, and the limits of JSON and ATOM have placed some restrictions on what I can do. Especially, some developers have complained about performance issues using C# and .NET related to serialization of the data. C or C++ will be faster, but those are pretty much the only mainstream programming languages faster than C# and Java. Unless your C# JSON or XML/ATOM libraries are a bottleneck, which I doubt... -- Brendan O'Connor - http://anyall.org
[twitter-dev] Re: Quick hack: using Twitter with Yahoo Placemaker to geolocate tweets
On Wed, May 27, 2009 at 8:08 PM, Nancy M nmira...@gmail.com wrote: I do like the maps, but 50% error -- you would not possibly get on an airplane with that kind of error rate, would you? And I don't think I'd want to make decisions about my demographics on something with that error rate either. Why not take the IPS and bounce them against whois or something? This app isn't about that; it's about what places a person is talking about. You can't use their IP's, the point is to identify locations in the text of their tweets. (I asked whether the app was looking at the author's location to help disambiguate because i thought it could be used to improve accuracy; but this is hypothetical.) In defense of error rates, if the task is just to get a sense about what regions of the world someone tends to talk about, then something like a 10% or 20% error rate might be ok; and it was lower than that for Chris's and some of the other example twitter users the app was suggesting. But here's one case where errors are very bad. One thing I thought was great about the map UI was that you can see a flag all by itself out in mexico or something, and be curious what the person is saying about mexico, and click on it to see the message. If errors tend to be geographic outliers then they really hurt this use case since geographic outliers are easy to see and are interesting simply because they are unusual (oh, brendan's always boring and talks about california, but look, one time he talked about switzerland! oops, not really.) I think the issue with some of the errors the yahoo placemaker thing was making with my tweets is, is that it's not integrating very well prior information about how commonly those locations are talked about. I think scala is only rarely used to mean the switzerland canton, but is quite often used to mean the programming language; but placemaker is happy to use a rare, unlikely sense of scala here. -- Brendan O'Connor - http://anyall.org
[twitter-dev] how are people collecting spritzer/gardenhose?
spritzer is great! well done folks. I'm wondering how other people are collecting the data. I'm saving the json-per-line raw output to a flatfile, just using a restarting curl, then processing later. Something as simple as this seems to work for me: while true; do date; echo starting curl curl -s -u user:pass http://stream.twitter.com/spritzer.json tweets.$(date --iso) sleep 1 done | tee curl.log ... and also, to force file rotation once in a while: while true; do date; echo forcing curl restart killall curl sleep $((60*60*5)) done | tee kill.log anyone else? -Brendan
[twitter-dev] Re: WWDC Twitter developer meetup at Twitter HQ: RSVP!
On Sun, May 24, 2009 at 9:18 PM, Brendan O'Connor breno...@gmail.comwrote: hm, i'd love to come to a twitter devs meetup, but i'm interested in data mining applications and less so around issues that WWDC devs would also be interested in. unless i'm guessing wrong about people's interests... ? Brendan
[twitter-dev] Re: WWDC Twitter developer meetup at Twitter HQ: RSVP!
hm, i'd love to come to a twitter devs meetup, but i'm interested in data mining applications and less so around issues that WWDC devs would also be interested in. On Thu, May 21, 2009 at 2:18 PM, Alex Payne a...@twitter.com wrote: Hi all, There's great crossover between Twitter API developers and Mac/iPhone developers. Andrew Stone, developer of Twittelator Pro, suggested that we all get together during WWDC and coordinate around the Apple Push Notification Service and other issues of mutual interest. Twitter's offices are just a few blocks from Moscone, so it should be easy for any interested coders to make it over here. Please RSVP with a reply to this thread and let us know what dates and times work for you. Andrew was thinking early one morning, but not being much of a morning person, I'd prefer something later in the day. We'll let group consensus decide. Thanks, and hope to see you in early June. -- Alex Payne - API Lead, Twitter, Inc. http://twitter.com/al3x
[twitter-dev] announcement - tweetmotif - topical summarization system
Hi, I feel a little bad that I always use twitter-dev to whine about bugs in the search API. But it's really great and you can build interesting things on top of it! We just put up an experimental search/text analytics app that clusters tweets based on key phrases and terms relative to a specific search query. It can sometimes be helpful for knowing *why* a term is trending, or for finding different types of sentiments people have toward something. There's also a more research-y direction for discovering related concepts for a query. The first draft, experimental version is up; please play around with it if you're in to this sort of thing. http://tweetmotif.com http://anyall.org/blog/2009/05/announcing-tweetmotif-for-summarizing-twitter-topics-with-a-dash-of-nlp/ -Brendan
[twitter-dev] Re: Bad Celebrity Search Results
i just found out some high-volume users aren't indexed at all. for example: http://search.twitter.com/search?q=+from%3Athe_real_shaq and it's not just the from: operators that's broken. if I search for some text from one of his most recent tweets, nothing from him shows up. for this tweet: http://twitter.com/THE_REAL_SHAQ/status/1785949479 this search doesn't get it: http://search.twitter.com/search?q=Listen+in+tonite+7p+to+9p+Shaq -Brendan On Wed, May 13, 2009 at 2:04 PM, Hayes Davis ha...@appozite.com wrote: I'm also curious about this phenomenon. It does seem that certain high-profile users are indexed poorly in search. It doesn't seem to correlate exactly with follower numbers but I've not done much in the way of empirical analysis on that. It's causing me some trouble on tweetreach.com as I often get requests to run reach reports about things tweeted by high profile users only to find that tweets from those users aren't returned by search. Should I file an issue for this? Hayes On Tue, May 12, 2009 at 1:54 PM, rob robsew...@gmail.com wrote: Hi, I'm doing a project that deals specifically with P Diddy (twitter.com/ iamdiddy). When I do a search, no tweets newer than May 6th show up. However, looking at his timeline, more recent tweets exist. This isn't a problem with my tweets (twitter.com/robseward). Also, it appears search is not returning accurate results for other celebrities online. Does anyone know what's going on here? Is the problem isolated to users with a high number of followers or is it something non celebrity- related. Some examples below: P Diddy: http://search.twitter.com/search?q=from%3Aiamdiddy http://twitter.com/iamdiddy Ashton Kutcher: http://search.twitter.com/search?q=from%3Aaplusk http://twitter.com/aplusk Shaq: http://search.twitter.com/search?q=from=THE_REAL_SHAQ twitter.com/THE_REAL_SHAQ Me (not a celebrity. Accurate search results). http://search.twitter.com/search?q=+from%3Arobseward twitter.com/robseward Rob
[twitter-dev] Re: Bad Celebrity Search Results
i wanted to get all of shaq's tweets with the search api and i couldn't :) going through random ones on twitterholic .. from:aplusk barely works from:scobleizer works from:adventuregirl works from:timoreilly works haven't tried the standard API for these. bleah Brendan On Wed, May 13, 2009 at 6:57 PM, explicious avail4...@gmail.com wrote: Hi Brendan, found out how? references? or merely observed per the link? It's curious because it might be throwing off my calculated 'coolness vector' - I noticed the coolness vector of a tweet containing a celebs name seemed lower than anticipiated - however it wasn't the point of the experiment, mind you - I just found the downplay sorta odd and mad- ening. :-) Thanks Waitman On May 13, 6:44 pm, Brendan O'Connor breno...@gmail.com wrote: i just found out some high-volume users aren't indexed at all. for example:
[twitter-dev] regex for smiley indexing?
Hey Twitter folks I *love* that you guys index messages by smiley vs. frowny emoticons! It looks like you normalize a wide range of happy and sad emoticons together. I'm doing some searches in [[ :) ]] and trying to then identify what the original smiley in the message was and it's a little tricky. For example, for happy, I've seen all of these: :-) :D ^_^ =) :) : ) ;) I have some regexes to extract them them -- attached if anyone's curious -- but I'm sure i'm missing plenty, and I sometimes identify some that don't belong. Are you guys using a regex or something at index time? Does it change much? Would you mind sharing? cheers, :) ... or should i say ^_^ Brendan [ anyall.org ] emoticons.py Description: Binary data
[twitter-dev] Re: regex for smiley indexing?
On Mar 4, 1:52 pm, Nicole Simon nee...@gmail.com wrote: I would assume that they do use a simple OR. Sure, but an OR of what?
Re: twitter search + Google + Site search
Google does have a public API, its AJAX API (which is just a JSON-over-HTTP API) http://code.google.com/apis/ajaxsearch/ and if you're in to python http://anyall.org/blog/2008/11/python-bindings-to-googles-ajax-search-api/ Brendan On Sat, Dec 6, 2008 at 12:10 PM, Aaron Brazell [EMAIL PROTECTED]wrote: You could use Lijit. ;) Yes, that was shameless self promotion for the company I work with. But seriously, you'd have some problems with Google because I don't think Google has a publicly available search API. -- Aaron Brazell web:: www.technosailor.com phone:: 410-608-6620 skype:: technosailor twitter:: @technosailor On Sat, Dec 6, 2008 at 2:11 PM, desinformado [EMAIL PROTECTED] wrote: Hello people, I am setting a tech gadget search related website and I would like to know how to pass the search parameters from my site search to Google and Twitter Search. If a visitor search for something in my site the result come from twitter + my site search + google search. Any help?
