[twitter-dev] Re: User_Timeline - include_rts not working
Ok, I think I may be closer to understanding what is not working or works in a strange way. The returned data, when retweets are included is of this structure. Each tweet that is a retweet, has the original tweet information underneath it. Tweet Tweet Retweet Tweet That's fine and all, except it appears that the original tweet is being included in the count of tweets requested per page. In the above example, this is considered 4 tweets being returned, not 3. If I request 25 tweets and there is one retweet, then I'm really only getting 24 tweets returned (plus the sub-tweet that is the original tweet that had been retweeted). So for now, I'm keeping a count of the number of retweets included in each page and showing a link to go to the next page if #tweets + #retweets > count parameter. At least this let's users keep paging through the stream, but it still stinks that I can't get a full 25 tweets per page. What if a page was all retweets? Then the page would show NO records. On Oct 4, 1:28 pm, timrnicholson wrote: > Further note that in testing, if I set the count parameter to 1 to > return a single record and page through the friends_timeline, I > actually get certain pages that return no data. i.e. I can page > through a single tweet at a time and still get some responses that are > empty. So the API is clearly first retrieving a record (or group of > records) and then applying some other filter to it. Its that other > filter that I need to figure out so that I can craft the request to > ensure that I always get back the requested number of records (except > when there are no more records). > > I don't see any way to retrieve the TOTAL number of records for a > particular query either. If I could know for sure that a shortage of > returned records on a particular page was due to some filter and that > there truly are more records on subsequent pages, then I could at > least use this as a workaround. > > On Oct 4, 11:48 am, timrnicholson wrote: > > > > > Well, I thought i had this problem solved. I am using a library called > > twitteroauth and it was stripping off the "&include_rts=true". I > > finally figured out that include_rts needed to be placed into an > > arguments array instead of being in the request URL. > > > So once I got the include_rts parm passed to Twitter everything > > wasworkingfine. Or at least it was in most cases. HOWEVER, I am seeing > > now that certain requests areNOTreturning the fullcountparameter > > worth of records. There must be SOME filtering that the Twitter API is > > doing AFTER it retrieves thecountnumber worth of records. I have > > this problem regardless of whether I use the home_timeline which is > > supposed to always include everything or whether I use the > > friends_timeline with the include_rtsparameter. > > > Note that I am trying to requestcount= 25 records,notthe defaultcount= 20 > > records. I can see that retweets are being included and I'm > > still getting ust 24 records back in certain cases. > > > On Sep 9, 10:06 am, Matt Harris wrote: > > > > Hey Tim, > > > > When I run: > > > curl > > > "http://api.twitter.com/1/statuses/user_timeline/RWW.xml?count=20&page..."; > > > > I get the expected result of 20 statuses one retweet (from > > > @ConanOBrien). When you make the request are you running it like I am > > > or are you using a library? > > > > To answer your query about thecountparameter. The behavior is this: > > > we will try and return up to 'count' statuses in one request, > > > wherecountis equal to all statuses in the timeline before any filtering of > > > retweets. So, if you request 20 statuses without retweets, and 1 of > > > the statuses is a retweet, you will get 19 statuses back. > > > > Hope that helps explain what is going on, > > > Matt > > > > On Thu, Sep 9, 2010 at 7:30 AM, timrnicholson > > > wrote: > > > > I'm properly calling api.twitter.com/1/statuses/user_timeline with > > > > include_rts as true and retweets arenotbeing included. The only > > > > stream that I can get to return retweets (because it doesn't even > > > > require the include_rtsparameter) is the home_timeline. > > > > > For example, the following doesn't work: > > > >http://api.twitter.com/1/statuses/user_timeline/RWW.xml?count=20&page... > > > > > The worst part about this isnotjust that the include_rtsparameter > > > > doesn't work for including retweets, the returned timeline doesn't > > > > even have
[twitter-dev] Re: User_Timeline - include_rts not working
Further note that in testing, if I set the count parameter to 1 to return a single record and page through the friends_timeline, I actually get certain pages that return no data. i.e. I can page through a single tweet at a time and still get some responses that are empty. So the API is clearly first retrieving a record (or group of records) and then applying some other filter to it. Its that other filter that I need to figure out so that I can craft the request to ensure that I always get back the requested number of records (except when there are no more records). I don't see any way to retrieve the TOTAL number of records for a particular query either. If I could know for sure that a shortage of returned records on a particular page was due to some filter and that there truly are more records on subsequent pages, then I could at least use this as a workaround. On Oct 4, 11:48 am, timrnicholson wrote: > Well, I thought i had this problem solved. I am using a library called > twitteroauth and it was stripping off the "&include_rts=true". I > finally figured out that include_rts needed to be placed into an > arguments array instead of being in the request URL. > > So once I got the include_rts parm passed to Twitter everything > wasworkingfine. Or at least it was in most cases. HOWEVER, I am seeing > now that certain requests areNOTreturning the fullcountparameter > worth of records. There must be SOME filtering that the Twitter API is > doing AFTER it retrieves thecountnumber worth of records. I have > this problem regardless of whether I use the home_timeline which is > supposed to always include everything or whether I use the > friends_timeline with the include_rtsparameter. > > Note that I am trying to requestcount= 25 records,notthe defaultcount= 20 > records. I can see that retweets are being included and I'm > still getting ust 24 records back in certain cases. > > On Sep 9, 10:06 am, Matt Harris wrote: > > > > > Hey Tim, > > > When I run: > > curl > > "http://api.twitter.com/1/statuses/user_timeline/RWW.xml?count=20&page..."; > > > I get the expected result of 20 statuses one retweet (from > > @ConanOBrien). When you make the request are you running it like I am > > or are you using a library? > > > To answer your query about thecountparameter. The behavior is this: > > we will try and return up to 'count' statuses in one request, wherecountis > > equal to all statuses in the timeline before any filtering of > > retweets. So, if you request 20 statuses without retweets, and 1 of > > the statuses is a retweet, you will get 19 statuses back. > > > Hope that helps explain what is going on, > > Matt > > > On Thu, Sep 9, 2010 at 7:30 AM, timrnicholson > > wrote: > > > I'm properly calling api.twitter.com/1/statuses/user_timeline with > > > include_rts as true and retweets arenotbeing included. The only > > > stream that I can get to return retweets (because it doesn't even > > > require the include_rtsparameter) is the home_timeline. > > > > For example, the following doesn't work: > > >http://api.twitter.com/1/statuses/user_timeline/RWW.xml?count=20&page... > > > > The worst part about this isnotjust that the include_rtsparameter > > > doesn't work for including retweets, the returned timeline doesn't > > > even have 20 records in it when there are retweets. In other words, > > > the API isnotonly ignoring the include_rtsparameterbut itsnot > > > even returning the right number of requested records when it thinks > > > include_rts is false. > > > > This totally screws up my pagination methods because I'm getting less > > > than the expected number of records back, so my app thinks there's no > > > more timeline to be retrieved. I certainly don't want to just always > > > include a "next page" link when there really aren't any more records > > > left. > > > > Also, thecountparameteris being ignored in all of this as well, but > > > I've latched on to another thread about that. > > > > On Aug 30, 12:50 pm, Taylor Singletary > > > wrote: > > >> Hi Timmerk, > > > >> Make sure you're using api.twitter.com as the host for all of your API > > >> requests. The proper API isnotat twitter.com -- it's at api.twitter.com. > > >> Include_rts willnotwork against twitter.com (and one day you'll find all > > >> of your requests rejected.) > > > >> Also, please note that proper API routes include a version component. The >
[twitter-dev] Re: User_Timeline - include_rts not working
Well, I thought i had this problem solved. I am using a library called twitteroauth and it was stripping off the "&include_rts=true". I finally figured out that include_rts needed to be placed into an arguments array instead of being in the request URL. So once I got the include_rts parm passed to Twitter everything was working fine. Or at least it was in most cases. HOWEVER, I am seeing now that certain requests are NOT returning the full count parameter worth of records. There must be SOME filtering that the Twitter API is doing AFTER it retrieves the count number worth of records. I have this problem regardless of whether I use the home_timeline which is supposed to always include everything or whether I use the friends_timeline with the include_rts parameter. Note that I am trying to request count = 25 records, not the default count = 20 records. I can see that retweets are being included and I'm still getting ust 24 records back in certain cases. On Sep 9, 10:06 am, Matt Harris wrote: > Hey Tim, > > When I run: > curl > "http://api.twitter.com/1/statuses/user_timeline/RWW.xml?count=20&page..."; > > I get the expected result of 20 statuses one retweet (from > @ConanOBrien). When you make the request are you running it like I am > or are you using a library? > > To answer your query about thecountparameter. The behavior is this: > we will try and return up to 'count' statuses in one request, wherecountis > equal to all statuses in the timeline before any filtering of > retweets. So, if you request 20 statuses without retweets, and 1 of > the statuses is a retweet, you will get 19 statuses back. > > Hope that helps explain what is going on, > Matt > > > > > > On Thu, Sep 9, 2010 at 7:30 AM, timrnicholson wrote: > > I'm properly calling api.twitter.com/1/statuses/user_timeline with > > include_rts as true and retweets arenotbeing included. The only > > stream that I can get to return retweets (because it doesn't even > > require the include_rtsparameter) is the home_timeline. > > > For example, the following doesn't work: > >http://api.twitter.com/1/statuses/user_timeline/RWW.xml?count=20&page... > > > The worst part about this isnotjust that the include_rtsparameter > > doesn't work for including retweets, the returned timeline doesn't > > even have 20 records in it when there are retweets. In other words, > > the API isnotonly ignoring the include_rtsparameterbut itsnot > > even returning the right number of requested records when it thinks > > include_rts is false. > > > This totally screws up my pagination methods because I'm getting less > > than the expected number of records back, so my app thinks there's no > > more timeline to be retrieved. I certainly don't want to just always > > include a "next page" link when there really aren't any more records > > left. > > > Also, thecountparameteris being ignored in all of this as well, but > > I've latched on to another thread about that. > > > On Aug 30, 12:50 pm, Taylor Singletary > > wrote: > >> Hi Timmerk, > > >> Make sure you're using api.twitter.com as the host for all of your API > >> requests. The proper API isnotat twitter.com -- it's at api.twitter.com. > >> Include_rts willnotwork against twitter.com (and one day you'll find all > >> of your requests rejected.) > > >> Also, please note that proper API routes include a version component. The > >> call you're making should > >> be:http://api.twitter.com/1/statuses/user_timeline.json?screen_name=NuWa... > > >> Taylor > > >> On Mon, Aug 30, 2010 at 10:43 AM, timmerk wrote: > >> > I'm having the same issue - you can see an example here: > > >> >http://twitter.com/statuses/user_timeline.json?screen_name=NuWaveGOV&;... > > >> > As you can see, there are no retweets included in the JSON. > > >> > Thanks! > > >> > On Aug 25, 2:30 pm, Matt Harris wrote: > >> > > Hey Hen, > > >> > > Are you still finding retweets arenotshowing up for you? > > >> > > Matt > > >> > > On Sat, Aug 21, 2010 at 7:19 AM, henasraf wrote: > >> > > > Matt, > >> > > > Any user I show in my app wouldnotshow retweets, even if they surely > >> > > > exist. You can see for yourself athttp://wosaic.net/twitguin(still > >> > > > early stages, don't mind it being a bit lame), see any user such as > >> > > > myself athttp://wosaic.net/twitgui
[twitter-dev] Re: User_Timeline - include_rts not working
I'm properly calling api.twitter.com/1/statuses/user_timeline with include_rts as true and retweets are not being included. The only stream that I can get to return retweets (because it doesn't even require the include_rts parameter) is the home_timeline. For example, the following doesn't work: http://api.twitter.com/1/statuses/user_timeline/RWW.xml?count=20&page=1&include_rts=true The worst part about this is not just that the include_rts parameter doesn't work for including retweets, the returned timeline doesn't even have 20 records in it when there are retweets. In other words, the API is not only ignoring the include_rts parameter but its not even returning the right number of requested records when it thinks include_rts is false. This totally screws up my pagination methods because I'm getting less than the expected number of records back, so my app thinks there's no more timeline to be retrieved. I certainly don't want to just always include a "next page" link when there really aren't any more records left. Also, the count parameter is being ignored in all of this as well, but I've latched on to another thread about that. On Aug 30, 12:50 pm, Taylor Singletary wrote: > Hi Timmerk, > > Make sure you're using api.twitter.com as the host for all of your API > requests. The proper API is not at twitter.com -- it's at api.twitter.com. > Include_rts will not work against twitter.com (and one day you'll find all > of your requests rejected.) > > Also, please note that proper API routes include a version component. The > call you're making should > be:http://api.twitter.com/1/statuses/user_timeline.json?screen_name=NuWa... > > Taylor > > > > On Mon, Aug 30, 2010 at 10:43 AM, timmerk wrote: > > I'm having the same issue - you can see an example here: > > >http://twitter.com/statuses/user_timeline.json?screen_name=NuWaveGOV&;... > > > As you can see, there are no retweets included in the JSON. > > > Thanks! > > > On Aug 25, 2:30 pm, Matt Harris wrote: > > > Hey Hen, > > > > Are you still finding retweets are not showing up for you? > > > > Matt > > > > On Sat, Aug 21, 2010 at 7:19 AM, henasraf wrote: > > > > Matt, > > > > Any user I show in my app would not show retweets, even if they surely > > > > exist. You can see for yourself athttp://wosaic.net/twitguin(still > > > > early stages, don't mind it being a bit lame), see any user such as > > > > myself athttp://wosaic.net/twitguin/user/henasraf;you may go > > > > through pages and see that no retweets ever show; they should be color > > > > coded in orange. You can compare tohttp://twitter.com/henasraftosee > > > > retweets that should show. > > > > > Thanks, > > > > Hen > > > > > On Aug 19, 11:34 pm, Matt Harris wrote: > > > >> Hey, > > > > >> Retweets should be included if they exist in the users timeline when > > you > > > >> request them. For example if you request 20 Tweets of the timeline and > > one > > > >> of those last 20 was a retweet - it will be included. If one of the > > last 20 > > > >> Tweets wasn't a retweet it won't be included, even if include_rts is > > true. > > > > >> Does this explain what is happening in your app? > > > >> If not could you give an example of a username which shows this > > problem. > > > > >> Best, > > > >> Matt > > > > >> On Thu, Aug 19, 2010 at 1:24 PM, henasraf wrote: > > > >> > Hey all, I'm using user_timeline to fetch the timeline of a user in > > my > > > >> > app. Problem is, it doesn't include native Retweets, even though > > I've > > > >> > set include_rts to true. The docs clearly say it should work, but it > > > >> > doesn't. What could be the problem? Thanks in advance :) > > > > >> -- > > > > >> Matt Harris > > > >> Developer Advocate, Twitterhttp://twitter.com/themattharris > > > > -- > > > > Matt Harris > > > Developer Advocate, Twitterhttp://twitter.com/themattharris-Hide quoted > > text - > > > > - Show quoted text - > > > -- > > Twitter developer documentation and resources:http://dev.twitter.com/doc > > API updates via Twitter:http://twitter.com/twitterapi > > Issues/Enhancements Tracker: > >http://code.google.com/p/twitter-api/issues/list > > Change your membership to this group: > >http://groups.google.com/group/twitter-development-talk?hl=en- Hide quoted > >text - > > - Show quoted text - -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk?hl=en
