Re: [twitter-dev] Streaming API limits...

2011-02-27 Thread John Kalucki
This is documented in painful detail here: http://dev.twitter.com/pages/streaming_api_concepts#updating-filter-predicates . If you connect a second time, you should get a TCP Close or Reset on the first connection. It sounds like your client library isn't detecting the connection close.

Re: [twitter-dev] Streaming API access level limit

2011-02-27 Thread John Kalucki
Are you specifying the IDs in the URL or in a POST parameter? There's a limit to the URL length that we'll parse, but we'll take huge POST parameters. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Feb 22, 2011 at 11:22 PM, aquajach wrote: > Hi, > > J

Re: [twitter-dev] Twitter stream shuts off every 60 seconds

2011-02-27 Thread John Kalucki
It sounds like you have multiple connections on the same account. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Fri, Feb 25, 2011 at 2:20 PM, jon wrote: > Hi, > > If I try: > curl -d @tracking http://stream.twitter.com/1/statuses/filter.json - > uUsername:Passwor

[twitter-dev] Re: Site Streams Beta - Endpoint change to sitestream.twitter.com

2011-02-22 Thread John Kalucki
Note that Site Streams is still in a beta test. We're just moving endpoints around for other projects. Sorry for any confusion. -John On Tue, Feb 22, 2011 at 2:15 PM, John Kalucki wrote: > Please change your Site Streams beta clients to point to > sitestream.twitter.com

[twitter-dev] Site Streams Beta - Endpoint change to sitestream.twitter.com

2011-02-22 Thread John Kalucki
Please change your Site Streams beta clients to point to sitestream.twitter.com and not to betastream.twitter.com. We'll continue to support betastream.twitter.com for several weeks. This is more of a clean-up step. Thanks, -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Tw

Re: [twitter-dev] User Streams and delimited=length

2011-02-18 Thread John Kalucki
Delimited=length works with User Streams. Perhaps you have a typo. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Feb 16, 2011 at 6:00 PM, WushuJames wrote: > Hi, > > I'm playing around with User Streams. I was able to connect to > https://userstream.twitte

Re: [twitter-dev] Re: Streaming API vs. Search API: no API returns >95% of intented tweets

2011-02-18 Thread John Kalucki
http://dev.twitter.com/pages/streaming_api_concepts#result-quality Search filters for relevance and is not intended as a source of all tweets. Streaming provides the complete record to all you to perform whatever post-processing you'd like. -John Kalucki http://twitter.com/jkalucki Twitter

Re: [twitter-dev] Opening sitestream with authorization only for some users issue

2011-02-15 Thread John Kalucki
by the absence of the friends list. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Feb 15, 2011 at 11:52 AM, A.A.Novikov wrote: > Hi, a couple of days ago I've noticed that the implementation of a > undocumented edge case changed: > > Let's say there are u

Re: [twitter-dev] Re: Streaming API vs. Search API: no API returns >95% of intented tweets

2011-02-15 Thread John Kalucki
requested, or sends a limit message to let you know what has been dropped. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Tue, Feb 15, 2011 at 12:50 PM, Karussell wrote: > Hi Colin, hi John, > > > To increase recall, search sometimes includes keywords in followed links

Re: [twitter-dev] Streaming API vs. Search API: no API returns >95% of intented tweets

2011-02-15 Thread John Kalucki
If you examine set C, do they contain matches on fields other than the Tweet text? To increase recall, search sometimes includes keywords in followed links and other techniques. Also, are you getting rate limit messages on the Streaming API? -John Kalucki http://twitter.com/jkalucki Twitter, Inc

[twitter-dev] Site Streams - Testing a new cluster

2011-02-15 Thread John Kalucki
es or success, please either DM @sitestreams, mention @sitestreams, or simply reply to this thread. Please keep all of your production streams on the DNS name sitestream.twitter.com. Thanks, -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources:

[twitter-dev] Re: Streaming API maintenance: brief delivery pause and an increased likelihood for duplicate tweets

2011-02-10 Thread John Kalucki
onds up to about two minutes. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Feb 9, 2011 at 1:15 PM, John Kalucki wrote: > We are performing a maintenance activity shortly that will increase the > likelihood of duplicate tweets and other messages on all Streaming APIs: >

[twitter-dev] Streaming API maintenance: brief delivery pause and an increased likelihood for duplicate tweets

2011-02-09 Thread John Kalucki
/streaming_api_concepts#quality-of-service. -John Kalucki Twitter, Inc. http://twitter.com/jkalucki -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list

[twitter-dev] Site Streams Beta Users

2011-02-05 Thread John Kalucki
. We don't expect any service interruptions, but we'd like to keep everyone's distractions to a minimum. Thank you, John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twit

Re: [twitter-dev] stream_socket_client with STREAM_CLIENT_ASYNC_CONNECT yields 401

2011-01-18 Thread John Kalucki
The Phirehose library for PHP and the Twitter Streaming API is well tested and widely used. I'd start by looking at their code. -John On Sun, Jan 16, 2011 at 12:18 PM, webjay wrote: > I should probably ask in a Php group, but I'll try here first, in case it's > Twitter related. > > When I conn

Re: [twitter-dev] Streaming Site API hogs at some stage

2011-01-06 Thread John Kalucki
The approach that Tim mentions is a good backstop, but this covers for an operational situation at Twitter that almost never happens. If you are seeing this condition happen often, there's probably something else wrong somewhere. If it is on our end, I'd like to fix it, but chances are its on your

Re: [twitter-dev] Stream problems on 2010-12-17?

2010-12-18 Thread John Kalucki
Are you tracking reconnections and HTTP error codes? Sounds like you may have been churning your connection and getting banned. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Sat, Dec 18, 2010 at 7:32 AM, Frank Sorro wrote: > Hi Twitter admins and developers, > I am develo

Re: [twitter-dev] user stream best practices

2010-12-18 Thread John Kalucki
to balance this cost externalization very carefully and with all due concern for everyone's time. Our resources are limited, and our reasoning may not always be immediately obvious, but we're trying to get you as much data as possible, as efficiently as possible for everyone. -John Ka

Re: [twitter-dev] Usage of site streams in production projects.

2010-12-18 Thread John Kalucki
eta clients can be pretty nimble on changing your end. Also, keep your REST API fallback code well tested for the time being... -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Dec 16, 2010 at 1:32 PM, ||M|| wrote: > Hi, > > Maybe this question is asked before but I

Re: [twitter-dev] Sporadic 401s?

2010-12-18 Thread John Kalucki
Site Streams connectivity through the holidays, and we'll get this out in the New Year. There are a number of minor goodies queued behind this deploy. We'll get there. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Fri, Dec 17, 2010 at 10:54 AM, David wrote: > I have been

Re: [twitter-dev] Site stream unfollow event

2010-12-18 Thread John Kalucki
of an account's followers. There are awful scaling issues involved here, vectors for spammy behavior, and generally not much value for end-users in providing this data. Twitter is mostly about who you follow and what you are interested in. Who is following you is becoming less and less relevant.

Re: [twitter-dev] user stream best practices

2010-12-13 Thread John Kalucki
Roughly: If the tweet is from a following, place it in the home timeline. If the tweet refers to the user (to or from), or contains the @screenname place it in mentions If it's a message -> messages. What remains is probably a track term. -John Kalucki http://twitter.com/jkalucki Twit

Re: [twitter-dev] not getting unfollow and retweet event from User Stream

2010-12-08 Thread John Kalucki
. Can you reproduce this case? -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Dec 8, 2010 at 12:24 AM, Yusuke Yamamoto wrote: > Hi all, > > I'm not getting "unfollow" (from me) and "retweet" (from me) events from > User Stream now. >

[twitter-dev] XML disabled on Streaming API

2010-12-06 Thread John Kalucki
As previously announced, XML has been disabled on the Streaming API. The few remaining consumers should move to JSON, and bid the year 2003 adieu. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via

Re: [twitter-dev] Streaming API firehose visibility

2010-12-03 Thread John Kalucki
Yes, where firehose is the stream of all public statuses, with some low-quality accounts removed. On Wed, Dec 1, 2010 at 3:52 PM, dburkes wrote: > If I am using the statuses/filter streaming API, with a "track=" query > that is not overly broad, and my client never receives any "limit" > respon

Re: [twitter-dev] Re: Best scalable method to process mentions

2010-11-30 Thread John Kalucki
You should use Site Streams to gather mentions for a large number of users, or User Streams to gather for a single user. Otherwise you will run into API rate limits and other issues. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Nov 30, 2010 at 4:09 AM, Serdar wrote: >

Re: [twitter-dev] filter.json per user connection limit

2010-11-23 Thread John Kalucki
trained not to enter their credentials into other websites, and once basic auth is turned off on the Streaming API, this option will be precluded. -John Kalucki http://twitter.com/jkalucki Twitter Inc On Sat, Nov 20, 2010 at 9:57 AM, Jason Newell wrote: > The docs recommended I contact Twit

Re: [twitter-dev] User Streams count parameter

2010-11-23 Thread John Kalucki
the mean time, hit the REST API after a connection is established to do the backfill. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Mon, Nov 22, 2010 at 8:01 PM, Jonathon Hill wrote: > Per http://dev.twitter.com/pages/user_streams_suggestions: > > "If disconnected

Re: [twitter-dev] Site Stream latency

2010-11-20 Thread John Kalucki
e kinds of symptoms. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sun, Nov 14, 2010 at 12:13 PM, N wrote: > When my program makes hundreds of connections with Site Stream to > observe tens of thousands of users, the latency for every status > messages seems to start off lik

Re: [twitter-dev] Re: Twitter + Gnip Partnership

2010-11-17 Thread John Kalucki
Every search engine, social network, blogging platform, content aggregator, and to a certain extent, every used book store and used record store... -John On Wed, Nov 17, 2010 at 1:04 PM, Dewald Pretorius wrote: > As a business model, is there another company that takes content, > which its use

Re: [twitter-dev] Receiving streaming API tweets without id_str

2010-11-08 Thread John Kalucki
This should be fixed. Again. Please let us know if this recurs. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sat, Nov 6, 2010 at 10:08 AM, Adam Green <140...@gmail.com> wrote: > My error logs started showing tweets without an id_str value a few > days ago. I invest

Re: [twitter-dev] Re: Exception while using count parameter of streaming api

2010-11-08 Thread John Kalucki
Shadow allows you to follow more users, but also allows you to continue to use track. There are no cases where we support count and track together. -John Kalucki http://twitter.com/jkalucki Twitter, Inc On Fri, Nov 5, 2010 at 9:41 AM, revati choudhari wrote: > Thanks for your re

Re: [twitter-dev] Receiving streaming API tweets without id_str

2010-11-08 Thread John Kalucki
We're looking into this issue. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sat, Nov 6, 2010 at 10:08 AM, Adam Green <140...@gmail.com> wrote: > My error logs started showing tweets without an id_str value a few > days ago. I investigated today and found that

[twitter-dev] Removing new_id from Streaming on or after Monday November 15, 2010

2010-11-05 Thread John Kalucki
soon as is practical. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your

Re: [twitter-dev] Duplicate tweets showing in the stream

2010-11-04 Thread John Kalucki
I'm assuming that this is on Site Streams. It's very odd that the tweet ids and created_at timestamps are so very close together. Can you post the raw, unparsed JSON that you are receiving? Just one example would be sufficient to get started. -John Kalucki http://twitter.com/jkalucki Tw

Re: [twitter-dev] Basic question re Snowflake/K-sorted

2010-11-04 Thread John Kalucki
This is good enough, as it's very unlikely that a tweet will be delivered with an id less than your saved maximum id. If you want to be paranoid, you can subtract a few seconds from the millisecond part of the id, but this is, in practice, unlikely to ever happen. -John Kalucki http://twitte

[twitter-dev] 10 minute warning: Snowflake status id jump in 10 minutes: 2:00pm PDT, 14:00 UTC

2010-11-04 Thread John Kalucki
-- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-developm

[twitter-dev] Site Streams Beta now allows applications to stream all of their users.

2010-11-03 Thread John Kalucki
The 100k user / 1k connection limit is no longer necessary and has been dropped. You may now connect for all of your tokens. Please limit your implementation to no more than 25 new connections per second. Follow @sitestreams for more information about this beta test. -John Kalucki http

Re: [twitter-dev] De-duplicating Site Streams

2010-10-31 Thread John Kalucki
Create two in-memory hash sets of seen ids. Write ids to both. If the id is found on write, discard. Alternatively expire them every few tens of minutes to bound growth, but provide continuous coverage. -John On Tue, Oct 26, 2010 at 8:55 PM, Marc Mims wrote: > De-duplicating statuses in the

Re: [twitter-dev] Rate limit for streaming api (tracking keyword)

2010-10-31 Thread John Kalucki
http://dev.twitter.com/pages/streaming_api_concepts#filter-limiting http://dev.twitter.com/pages/streaming_api_concepts#parsing-responses On Thu, Oct 28, 2010 at 9:55 PM, Thiago Esteves wrote: > Hi, > > I am developing an application that needs to track a keyword on > twitter, that keyword is a

[twitter-dev] Additional capacity added to stream.twitter.com and betastream.twitter.com clusters

2010-10-27 Thread John Kalucki
d from rotation. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membershi

Re: [twitter-dev] friends list in Site Stream

2010-10-20 Thread John Kalucki
This amount of data is trivial compared to the total amount of data sent over Site Streams. The friends list per user is roughly the size of a tweet or two. We have to weigh the cost of maintaining the feature vs. the bandwidth and CPU savings. Unless the savings is significant, generally the optim

Re: [twitter-dev] what does "K-sorted" mean?

2010-10-20 Thread John Kalucki
K-sorted means roughly sorted, where no item is no more than K positions from it's totally ordered position. A sequence is k-sorted IFF, for all i,r, 1<= i <= r <= n, i<= r-k implies that a(i) <= a(r). The generation scheme has to allow sufficient IDs to be generated in a non-coordinated way to co

Re: [twitter-dev] Re: No of statuses extracted by statuses/filter

2010-10-15 Thread John Kalucki
http://dev.twitter.com/pages/streaming_api_concepts#parsing-responses -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Oct 14, 2010 at 12:29 PM, AA wrote: > Thanks a lot! > This is very helpful. > > John: > > You said: > "If you don't receive a limit message,

Re: [twitter-dev] Stream API responds with 401 when multiple keywords are used

2010-10-15 Thread John Kalucki
There's at least one OAuth library out there that doesn't encode the comma correctly. Search back in this group for details. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Thu, Oct 14, 2010 at 6:40 PM, Corey Wallis wrote: > Hi All, > > I have working code that us

Re: [twitter-dev] Re: No of statuses extracted by statuses/filter

2010-10-12 Thread John Kalucki
Sorry. Gmail fail / Groups fail. On Tue, Oct 12, 2010 at 3:17 PM, John Kalucki wrote: > If you don't receive a limit message, you know that you've received all > possible tweets for the predicate. If you do receive a limit message, you > know the precise proportion of

Re: [twitter-dev] Re: No of statuses extracted by statuses/filter

2010-10-12 Thread John Kalucki
If you don't receive a limit message, you know that you've received all possible tweets for the predicate. If you do receive a limit message, you know the precise proportion of tweets received and dropped. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Tue, Oct 12, 2010

Re: [twitter-dev] Site Streams: Work Locally / 401 Unauthorized From EC2 (/cc @jkalucki)

2010-10-12 Thread John Kalucki
I can see what you describe in the logs. The most likely problem is that the EC2-based client isn't signing the OAuth correctly somehow. There should be nothing on our end that allows you in on one IP, but 401s you on another. -John On Tue, Oct 12, 2010 at 1:28 PM, tsmango wrote: > I've been

[twitter-dev] Streaming API sampling and filter limiting algorithms switched to new status id

2010-10-12 Thread John Kalucki
n the future. Overall, the results for Sample and Filter should be very similar to the previous sequentially generated status id system. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter:

Re: [twitter-dev] Re: Is authentication required to use Streaming API?

2010-10-07 Thread John Kalucki
Every account has default-level access. On Thu, Oct 7, 2010 at 10:26 AM, D. Smith wrote: > Can I use any Twitter account username/password or does the account > have to be registered with Twitter API? > > On Oct 7, 1:18 pm, John Kalucki wrote: >> stream.twitter.com/1/st

Re: [twitter-dev] Re: Is authentication required to use Streaming API?

2010-10-07 Thread John Kalucki
stream.twitter.com/1/statuses/filter.json track=keyword1,keyword2 etc. -John On Thu, Oct 7, 2010 at 10:13 AM, D. Smith wrote: > I'm confused now. Which API should I use Streaming or Search? > What I want is to monitor Twitter and every time someone uses certain > words (maybe a total of about

Re: [twitter-dev] Re: [SiteStreams] can't follow more than one user

2010-10-06 Thread John Kalucki
It might be an OAuth encoding error with the ','. Which OAuth library are you using? -John On Wed, Oct 6, 2010 at 9:34 AM, Ruben Fonseca wrote: > Hi Thomas > > On Oct 6, 5:20 pm, Thomas Mango wrote: >> Hey, Ruben. That's the correct URL format. Are you sure your account was >> approved for Sit

Re: [twitter-dev] Re: Streaming API test: Adding new_id field to statuses at 17:00 UTC Sept 29

2010-10-04 Thread John Kalucki
I dug back to Mark's email for context, but I still can't puzzle out what Mark was referring to and what you are asking for. The answer might be buried somewhere in that 74 message thread. Could you restate your question? Does the count parameter do what you need? -John Ka

Re: [twitter-dev] about Rate-limit

2010-10-03 Thread John Kalucki
If you have 100k members to poll continuously, perhaps you should look into the Site Streams beta? -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sun, Oct 3, 2010 at 4:47 PM, Emre GÜLCAN wrote: > Thanks Scott > > Emre GULCAN > Application Developer > > > >

Re: [twitter-dev] Re: Site Streams - Unfollow Events?

2010-10-01 Thread John Kalucki
able to test this outside my app, although I doubt that > it's my code (it simply outputs all incoming data to debug). Tried with > cURL but got an error about Basic Auth. > > Can anyone verify that there are no list events in the streams, or am I > simply going blind? > >

Re: [twitter-dev] Re: Site Streams - Unfollow Events?

2010-10-01 Thread John Kalucki
List modifications are streamed as social events. The lists themselves are not streamed. -John On Fri, Oct 1, 2010 at 11:01 AM, Tom van der Woerdt wrote: > Correct. > > I'd like to add an additional question to this thread: what about list > events? The docs say that they get sent, but they don

Re: [twitter-dev] Re: Looking for Java class/package for Firehose

2010-09-30 Thread John Kalucki
ally for Firehose. I must use > threads to pass the jobs to and i must have some mechanism to forking > and staying alive like a daemon or something like that, and ideally it > would automatically handle reconnecting in case of error. > > > > On Sep 30, 11:33 am, John Kalucki wr

Re: [twitter-dev] Re: Looking for Java class/package for Firehose

2010-09-30 Thread John Kalucki
Twitter4J seems to be popular, but I don't have first-hand experience with it. -John On Thu, Sep 30, 2010 at 8:32 AM, D. Smith wrote: > Oh, man, I am new to Java, don't even know what Scala is... I've heard > about it that it's like based on Java and it's supposed to be easier > to code than in

Re: [twitter-dev] twitter streams API question

2010-09-30 Thread John Kalucki
ither, especially for higher velocity predicates. See http://dev.twitter.com/pages/streaming_api_concepts#filter-limiting for more details` -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Sep 30, 2010 at 5:37 AM, Tom van der Woerdt wrote: > Filter = all, just like search. > > To

Re: [twitter-dev] Re: Site Streams - Unfollow Events?

2010-09-30 Thread John Kalucki
the currently cached relationship details for each user being > followed by that stream and set them up again). > > I hope this clarifies the different situations where I'd find unfollow > events useful. Thanks! > > On Sep 29, 11:42 pm, John Kalucki wrote: >>

Re: [twitter-dev] Re: Site Streams - Unfollow Events?

2010-09-29 Thread John Kalucki
Please describe your use case for unfollows on Site Streams... -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Sep 29, 2010 at 5:09 PM, tsmango wrote: > Ah I wasn't able to find that. It's a shame if true. Thanks for the > information. > > On Sep 29, 6:05

[twitter-dev] Streaming API new_id test

2010-09-29 Thread John Kalucki
ng up tomorrow at about the same time. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/i

Re: [twitter-dev] Steaming API — is track lagging considerably behind real–time right now?

2010-09-29 Thread John Kalucki
The status blog will be updated shortly. -John On Wed, Sep 29, 2010 at 7:22 AM, Taylor Singletary wrote: > Hi Ben, > > The Streaming API is working through a backlog now after some earlier > issues. It should become more current soon. > > Taylor > > On Wed, Sep 29, 2010 at 6:03 AM, Ben Hodgson

Re: [twitter-dev] Re: User Streams goes Production, Site Streams adds Home Timelines

2010-09-28 Thread John Kalucki
Followings is additive to the Users. You can observe the behavior of these settings on userstream.twitter.com. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Sep 28, 2010 at 9:10 PM, Michael Ledford wrote: > > On Sep 28, 3:04 pm, John Kalucki wrote: > >> Site S

[twitter-dev] Streaming API test: Adding new_id field to statuses at 17:00 UTC Sept 29

2010-09-28 Thread John Kalucki
://groups.google.com/group/twitter-api-announce/browse_thread/thread/daf6298d0fdcbc87 http://groups.google.com/group/twitter-api-announce/browse_thread/thread/7982e3b037eeef95 -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http

[twitter-dev] Re: User Streams goes Production, Site Streams adds Home Timelines

2010-09-28 Thread John Kalucki
Correction: The endpoint is https://userstream.twitter.com/2/user.json. User Streams is HTTPS only. On Tue, Sep 28, 2010 at 12:04 PM, John Kalucki wrote: > User Streams > = > > After an uneventful beta test period, the User Streams feature of the > Twitter Streaming API is

[twitter-dev] User Streams goes Production, Site Streams adds Home Timelines

2010-09-28 Thread John Kalucki
defaults to "followings". These differing default values may be confusing, but were chosen to retain backwards compatibility. We recommend that you explicitly set this parameter to avoid confusion and future compatibility problems as we refine this API. John Kalucki http://twitter.com

Re: [twitter-dev] not authorized over and over again

2010-09-27 Thread John Kalucki
It sounds that, perhaps, you aren't recalculating the hash with the current timestamp. You can't re-use hashes. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Mon, Sep 27, 2010 at 3:39 PM, eMailaya wrote: > Im developing a desktop application. firstly, the user needs

Re: [twitter-dev] xAuth problem with using filter streams

2010-09-27 Thread John Kalucki
The reason text was enclosed. It says 403 - Administratively Forbidden. You've been blacklisted, almost certainly for violating the API policy. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Mon, Sep 27, 2010 at 6:06 AM, Tom van der Woerdt wrote: > Hi, > > The 403

Re: [twitter-dev] Streaming API skips users

2010-09-24 Thread John Kalucki
with curl, and study the output, do you see the data that you expect? -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Sep 23, 2010 at 8:59 PM, Ginny Hendry wrote: > We are new to the Twitter API. In early stages of testing an app, we > reading from the streaming API

Re: [twitter-dev] Check if I have gardenhose or spritzer access

2010-09-22 Thread John Kalucki
Until Snowflake comes out, and IDs become non-sequential, look at the status id and figure your rough sample percentage. Once Snowflake comes out, this will be somewhat more difficult. -John On Wed, Sep 22, 2010 at 4:10 PM, Lucas Vickers wrote: > Hello, > > How can I check if my login has spri

Re: [twitter-dev] Re: Stream api statuses/filter no catching my hashtag

2010-09-21 Thread John Kalucki
Why are you writing your own PHP Streaming API client? It's somewhat complicated to get all the details right. The Phirehose library seems to be well received, and it's incorporated lots of fixes for corner cases. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Sep 2

Re: [twitter-dev] Filtered Streaming API, Count, and Confusing Wording in the Wiki

2010-09-20 Thread John Kalucki
Count is enabled for higher access levels with the follow parameter on the filter endpoint. Shadow, and Birddog, for example, allow the count parameter. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Mon, Sep 20, 2010 at 7:51 PM, Justin wrote: > I found my answer elsewhere,

Re: [twitter-dev] Stream api statuses/filter no catching my hashtag

2010-09-20 Thread John Kalucki
You say you are backing off on HTTP connections. Are you connecting constantly, or just once, and staying connected for very long periods? Are you tracking the number of limit messages you are receiving? Perhaps your track search was rate limited? -John Kalucki http://twitter.com/jkalucki Twitter

Re: [twitter-dev] newbie question on rate limits

2010-09-20 Thread John Kalucki
Large companies, and anyone who wants sustained access to high-volume Twitter data, use the Streaming API. The REST API is primarily for client applications and very-small-scale integrations. Note that REST whitelisting is unlikely for use-cases that are covered by the Streaming API. -John

Re: [twitter-dev] Re: Twitter client to get updates

2010-09-18 Thread John Kalucki
y wont run out of resources by > giving unlimited service. > > > > > > On Sep 17, 9:30 pm, John Kalucki wrote: > > Look into the User Streams endpoint on the Streaming API if you are > building > > a desktop notification service. If you are building a centralized

Re: [twitter-dev] Policy clarification on Streaming API, User Stream and Site Stream products

2010-09-17 Thread John Kalucki
rd (Ed) Borasky > http://borasky-research.net http://twitter.com/znmeb > > "A mathematician is a device for turning coffee into theorems." - Paul > Erdos > > > > Quoting John Kalucki : > > Posted here: http://dev.twitter.com/pages/streaming_api >> >> There

[twitter-dev] Policy clarification on Streaming API, User Stream and Site Stream products

2010-09-17 Thread John Kalucki
ter client. - *Site Streams:* Allows multiplexing of multiple User Streams over a Site Stream connection. Once more than a handful of User Streams connections are opened from the same host or service, Site Streams *must be* used. The primary use case is website and other service integration

Re: [twitter-dev] Twitter client to get updates

2010-09-17 Thread John Kalucki
Look into the User Streams endpoint on the Streaming API if you are building a desktop notification service. If you are building a centralized service, you'll want Site Streams. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Fri, Sep 17, 2010 at 7:41 AM, ram wrote: > I

Re: [twitter-dev] 401s from http://stream.twitter.com/statuses/filter

2010-09-16 Thread John Kalucki
Streaming still supports basic auth, but User Streams and Site Streams endpoints only support OAuth. If you are getting 401s, chances are you are violating a connection policy. -John On Thu, Sep 16, 2010 at 6:27 PM, Aaron Rankin wrote: > I'm seeing plenty of 401s returned from the > http://str

Re: [twitter-dev] Question about User Vs Site Streams, and Moving away from REST calls.

2010-09-16 Thread John Kalucki
Streams connection not far lower than having a connection to Site > Streams? That's what Justin asked, just one connection. > > Tom > > > On 9/16/10 6:22 AM, John Kalucki wrote: > > Our intention is that User Streams and Site Streams will, shortly, offer > >

Re: [twitter-dev] Question about User Vs Site Streams, and Moving away from REST calls.

2010-09-15 Thread John Kalucki
er Streams and Site Streams via revocation of access. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Sep 15, 2010 at 12:24 PM, Justin wrote: > I've successfully migrated one of my sites away from making search and > mention rest calls, switched over to the streami

Re: [twitter-dev] Re: Twitter Search/Stream API

2010-09-15 Thread John Kalucki
Also, all automated repetitive searching should be on the Streaming API. Search is intended largely for ad-hoc queries. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Wed, Sep 15, 2010 at 12:25 PM, Justin wrote: > Also, from what I understand, search may not include everyth

Re: [twitter-dev] Re: Is gardenhose being ramped up?

2010-09-13 Thread John Kalucki
Any scoop would be helpful for planning purposes. > Thanks! > > Sanjay > > On Sep 13, 12:05 pm, John Kalucki wrote: > > We increased the Gardenhose on August 30, as announced here: > http://groups.google.com/group/twitter-api-announce/browse_thread/thr... > > . > >

Re: [twitter-dev] Is gardenhose being ramped up?

2010-09-13 Thread John Kalucki
four times as large as daily peak traffic. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Mon, Sep 13, 2010 at 8:43 AM, Sanjay wrote: > I just took a look at my bandwidth usage from last night to see the > effect of the VMAs (dramatic BTW), and thought I'd check it out

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-11 Thread John Kalucki
the non-working solution. In this case, do you have access to the firehose? Can you use an existing client library? There are dozens of clients for the Streaming API out there. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sat, Sep 11, 2010 at 12:36 AM, omri wrote: > I requ

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread John Kalucki
> > > > > File "C:\Python26\lib\urllib2.py", line 516, in > > > http_error_default > > >raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) > > > HTTPError: HTTP Error 401: Unauthorized > > > > > i think i dont know whic

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread John Kalucki
sg, hdrs, fp) > HTTPError: HTTP Error 401: Unauthorized > > i think i dont know which username and password to type in the header > - 'Authorization' 'basic (username:password) > the twitter's username? > the twitter api oauth? > > thanks > > >

Re: [twitter-dev] how to apply Birddog role

2010-09-09 Thread John Kalucki
Without more details about your product, it's hard to direct you to the right Twitter product. Please detail your organization and use case to an email to a...@twitter.com. Note that we aren't granting many whitelist requests at this point, so you may have to wait for a response. -Jo

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread John Kalucki
What text message does it return with the 401 error? You can still use basic auth with streaming. Does that work for you? You should use your screenname and password for basic auth. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Sep 9, 2010 at 2:48 AM, omri wrote: >

Re: [twitter-dev] User Streams Update

2010-09-08 Thread John Kalucki
As soon as an issue is clear, we tend to announce what we've learned. If I had the list of changes ready to go, I would have posted them. The current general Twitter API TOS applies to User Streams. Follow the TOS and the User Streams Implementation Suggestions... -John Kalucki

[twitter-dev] User Streams Update

2010-09-08 Thread John Kalucki
the cracks, and I want to ensure that everyone has appropriate access to this API. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracke

Re: [twitter-dev] Re: Retweet a listed tweet

2010-09-08 Thread John Kalucki
That is weird. It has been fixed though, but I don't know when the fix will deploy. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Wed, Sep 8, 2010 at 6:56 AM, Ken wrote: > No... just to clarify, I'm talking about the Twitter.com website. I've > wondered a

Re: [twitter-dev] Retweet a listed tweet

2010-09-08 Thread John Kalucki
Is the tweet in question from a protected user? -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Sep 8, 2010 at 3:15 AM, Ken wrote: > As I work today on some features related to lists, I wonder again why, > on Twitter.com, I am unable to retweet a tweet that appears on

Re: [twitter-dev] User Streams or Site Streams?

2010-09-07 Thread John Kalucki
and open it for > any users interested in it, I'm just a stand alone developer and don't > have a company, is my Site Streams request acceptable? Thanks. > > On Tue, Sep 7, 2010 at 9:40 PM, John Kalucki wrote: > > This app cannot use User Streams and must only use S

Re: [twitter-dev] help with accessing the streaming api

2010-09-07 Thread John Kalucki
s you haven't provided parameters to track. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Sep 7, 2010 at 4:38 AM, omri wrote: > def run (self): >status_url = "http://stream.twitter.com/1/statuses/filter.json"; >request = urllib2.Request(s

Re: [twitter-dev] Streaming API

2010-09-07 Thread John Kalucki
ll of their statuses, but not their timelines. This feature has been in production for over a year. If you have OAuth tokens for the users, you can use the Site Streams beta to get protected user's statuses, but currently you will also get a lot of other information for them as well. -John Ka

Re: [twitter-dev] User Streams or Site Streams?

2010-09-07 Thread John Kalucki
User Streams onto a single connection. To use User Streams would consume an awful lot of resources on both ends. Site Steams does and will support Home Timelines -- but we're not ready to beta this feature just yet due to a performance issue that we're working through. -John Ka

Re: [twitter-dev] Re: Hi there

2010-09-05 Thread John Kalucki
y a random sample of approximately 10% of the Firehose. You can apply for the Gardenhose by emailing a...@twitter.com. Detail your organization and use case. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Sun, Sep 5, 2010 at 10:53 AM, Tom van der Woerdt wrote: > Yeah, well, the idea o

Re: [twitter-dev] Hi there

2010-09-05 Thread John Kalucki
These questions are all answered in the documentation: http://dev.twitter.com/pages/streaming_api On Sun, Sep 5, 2010 at 9:57 AM, omri wrote: > I have a few questions regarding the streaming API : > How many maximum results I have in one response? > Is there a limit of requests? > Is it possibl

  1   2   3   4   5   6   7   8   >