Hi Polymatheus,
1) How can the above script be amended to show both follow and track?
> Is this possible?
>
John's suggestion is the only way, you must use the new paths.
2) If I opened a stream to follow 10 users and then a further 5 users
> joined my site, would I have to close the first stream then open a new
> stream for the 15 follows? Or just a second stream with the additional
> 5 users? The second approach reduce the chance of tweets being lost
> between closing and opening a new stream.
>
You must restart the stream, unfortunately, there is no way around this at
this point.
3) I can't seem to close a stream that I opened using the sample code
>
Abraham gives a potential solution to this, and I believe its along the
right path. I normally only see this if we are lagging behind for whatever
reason.
Let me know if you have any further questions, since I am the person that
wrote the code you're using.
-Joel
On Mon, Aug 31, 2009 at 12:32 PM, Polymatheus <world.mo...@gmail.com> wrote:
>
> I've used the code above to start streaming and then dumping the
> output to a text file every hour to process later. There are a few
> things I want to clarify,
>
> 1) How can the above script be amended to show both follow and track?
> Is this possible?
> 2) If I opened a stream to follow 10 users and then a further 5 users
> joined my site, would I have to close the first stream then open a new
> stream for the 15 follows? Or just a second stream with the additional
> 5 users? The second approach reduce the chance of tweets being lost
> between closing and opening a new stream.
> 3) I can't seem to close a stream that I opened using the sample code
> above, I have tried changing the file to simply say:
>
>
> $fp = fsockopen("stream.twitter.com", 80, $errno, $errstr, 10);
> fclose($fp);
>
> But it doesn't appear to work :/
>
> Thanks in advance
>
> On 10 Aug, 08:09, Joel Strellner <j...@twitturly.com> wrote:
> > Tom,
> >
> > Yes, that code works perfectly for me exactly as is. You might want to
> > change the connect timeout from 10 to 30 seconds.
> >
> > How long are you waiting before calling it quits? It does take a few
> > seconds for /track to start sending your results.
> >
> > -Joel
> >
> >
> >
> > On Sun, Aug 9, 2009 at 8:17 PM, Tom Fitzgerald <ccexpe...@gmail.com>
> wrote:
> >
> > > I'm sorry Joel I keep getting a PHP timeout on the code you sent. I'll
> > > troubleshoot more and see if I can give you any more details (increase
> > > the maximum time, etc). Who knows, maybe its Twitter. Any other
> > > thoughts? I'll get back to you more with some detailed info. Are you
> > > able to get that exact code working on your server?
> >
> > > On Aug 3, 2:12 pm, Joel Strellner <j...@twitturly.com> wrote:
> > > > Hi Tom,
> >
> > > > I am not sure about XML, since I use JSON - it has a much lower
> > > > over-the-wire data size, and its easier to parse.
> >
> > > > Let me know if the code works for you.
> >
> > > > -Joel
> >
> > > > On Mon, Aug 3, 2009 at 10:55 AM, Tom Fitzgerald <ccexpe...@gmail.com
> >
> > > wrote:
> >
> > > > > I appreciate the reply Joel. I'll give it a try. I also tried just
> > > > > downloading from the stream api with the curl command line. However
> I
> > > > > kept getting 'malformed xml' errors. It was weird, each tweet would
> > > > > have the <?xml ... tag before it. That ring any bells with you?
> Same
> > > > > thing with JSON format but it was a different error, still
> malformed.
> > > > > All I'm doing is
> >
> > > > > curlhttp://stream.twitter.com/spritzer.xml-uuser:pass
> >
> > > > > <?xml version="1.0" encoding="UTF-8"?> is the exact line I get
> before
> > > > > every status. If I manually clean up the XML (or JSON) it works
> great.
> >
> > > > > On Aug 2, 7:10 pm, Joel Strellner <j...@twitturly.com> wrote:
> > > > > > Other than my username and password, this is an example that I
> know
> > > is
> > > > > > working:
> >
> > > > > > <?php
> > > > > > $count = 1;
> > > > > > $startparsing = false;
> >
> > > > > > $keyword_needles[] = 'twitter';
> > > > > > $keyword_needles[] = 'keyword2';
> > > > > > $keyword_needles[] = 'keyword3';
> > > > > > $keyword_needles[] = 'keyword4';
> >
> > > > > > // if your keywords have spaces, they must be urlencoded (twitter
> > > does
> > > > > > not support phrases, only the first keyword will be used, the
> space
> > > > > > character and after will be ignored)
> > > > > > foreach ($keyword_needles AS $i=>$needle) {
> > > > > > $keyword_needles[$i] = urlencode($needle);
> >
> > > > > > }
> >
> > > > > > $poststr = 'track=' . implode(',', $keyword_needles);
> > > > > > $fp = fsockopen("stream.twitter.com", 80, $errno, $errstr, 10);
> > > > > > if (!$fp) {
> > > > > > echo "$errstr ($errno)\n";
> >
> > > > > > } else {
> >
> > > > > > $out = "POST /track.json HTTP/1.1\r\n";
> > > > > > $out .= "Host: stream.twitter.com\r\n";
> > > > > > $out .= "User-Agent: YourUserAgent\r\n";
> > > > > > $out .= "Referer:http://yourdomain.com\r\n";;
> > > > > > $out .= "Content-Type:
> application/x-www-form-urlencoded\r\n";
> > > > > > $out .= "Authorization: Basic " . base64_encode
> > > > > > ("username:password")."\r\n";
> > > > > > $out .= "Content-length: " . strlen($poststr) . "\r\n";
> > > > > > $out .= "Connection: Close\r\n\r\n";
> > > > > > $out .= $poststr . "\r\n\r\n";
> >
> > > > > > fwrite($fp, $out);
> > > > > > while (!feof($fp)) {
> > > > > > $line = fgets($fp, 4096);
> > > > > > if ($startparsing) {
> > > > > > if (trim($line) != '') {
> > > > > > echo trim($line) . "\n";
> > > > > > $tweet_obj = json_decode(trim($line));
> > > > > > // do your stuff here
> > > > > > }
> > > > > > }
> > > > > > else {
> > > > > > // view the header lines: uncomment the below line
> > > > > > echo trim($line) . "\n";
> >
> > > > > > $header_arr[] = $line;
> > > > > > $headercount = count($header_arr)-1;
> >
> > > > > > if (trim($header_arr[$headercount]) == '') {
> > > > > > $startparsing = true;
> > > > > > $count = 1;
> > > > > > unset($header_arr, $headercount);
> > > > > > }
> > > > > > }
> > > > > > if (trim($line) != '') $count++;
> > > > > > }
> > > > > > fclose($fp);}
> >
> > > > > > ?>
> >
> > > > > > The only changes I made was to echo things out and I added a
> keyword
> > > > > > that I was sure would have volume - twitter. It did take a
> little
> > > bit
> > > > > > of time to connect. I am assuming that that is because of their
> > > > > > current load though, and not the script.
> >
> > > > > > On Aug 2, 2:25 am, Tom Fitzgerald <ccexpe...@gmail.com> wrote:
> >
> > > > > > >Joel,
> >
> > > > > > > For some reason when I try your code I get a timeout error. Any
> > > > > > > suggestions? What you have is exactly what I'm looking for. It
> > > could
> > > > > > > really help me out a jam, thanks!
> >
> > > > > > > On Jul 27, 4:02 pm,JoelStrellner <j...@twitturly.com> wrote:
> >
> > > > > > > > Here is a working example of how to do /track:
> >
> > > > > > > > $count = 1;
> > > > > > > > $startparsing = false;
> >
> > > > > > > > $keyword_needles[] = 'keyword1';
> > > > > > > > $keyword_needles[] = 'keyword2';
> > > > > > > > $keyword_needles[] = 'keyword3';
> > > > > > > > $keyword_needles[] = 'keyword4';
> >
> > > > > > > > // if your keywords have spaces, they must be urlencoded
> (twitter
> > > > > does not
> > > > > > > > support phrases, only the first keyword will be used, the
> space
> > > > > character
> > > > > > > > and after will be ignored)
> > > > > > > > foreach ($keyword_needles AS $i=>$needle) {
> > > > > > > > $keyword_needles[$i] = urlencode($needle);
> >
> > > > > > > > }
> >
> > > > > > > > $poststr = 'track=' . implode(',', $keyword_needles);
> > > > > > > > $fp = fsockopen("stream.twitter.com", 80, $errno, $errstr,
> 30);
> > > > > > > > if (!$fp) {
> > > > > > > > echo "$errstr ($errno)\n";} else {
> >
> > > > > > > > $out = "POST /track.json HTTP/1.1\r\n";
> > > > > > > > $out .= "Host: stream.twitter.com\r\n";
> > > > > > > > $out .= "User-Agent: YourUserAgent\r\n";
> > > > > > > > $out .= "Referer:http://yourdomain.com\r\n";;
> > > > > > > > $out .= "Content-Type:
> > > application/x-www-form-urlencoded\r\n";
> > > > > > > > $out .= "Authorization: Basic " .
> > > > > > > > base64_encode("username:password")."\r\n";
> > > > > > > > $out .= "Content-length: " . strlen($poststr) . "\r\n";
> > > > > > > > $out .= "Connection: Close\r\n\r\n";
> > > > > > > > $out .= $poststr . "\r\n\r\n";
> >
> > > > > > > > fwrite($fp, $out);
> > > > > > > > while (!feof($fp)) {
> > > > > > > > $line = fgets($fp, 4096);
> > > > > > > > if ($startparsing) {
> > > > > > > > if (trim($line) != '') {
> > > > > > > > //echo trim($line) . "\n";
> > > > > > > > $tweet_obj = json_decode(trim($line));
> > > > > > > > // do your stuff here
> > > > > > > > }
> > > > > > > > }
> > > > > > > > else {
> > > > > > > > // view the header lines: uncomment the below
> line
> > > > > > > > //echo trim($line) . "\n";
> >
> > > > > > > > $header_arr[] = $line;
> > > > > > > > $headercount = count($header_arr)-1;
> >
> > > > > > > > if (trim($header_arr[$headercount]) == '') {
> > > > > > > > $startparsing = true;
> > > > > > > > $count = 1;
> > > > > > > > unset($header_arr, $headercount);
> > > > > > > > }
> > > > > > > > }
> > > > > > > > if (trim($line) != '') $count++;
> > > > > > > > }
> > > > > > > > fclose($fp);
> >
> > > > > > > > }
> > > > > > > > On Mon, Jul 27, 2009 at 11:18 AM, Joseph <
> northwest...@gmail.com
> >
> > > > > wrote:
> >
> > > > > > > > > I am trying to use the track streaming API, but I'm having
> > > trouble
> > > > > > > > > with the syntax. The example shows how to use a tracking
> list
> > > > > stored
> > > > > > > > > in a file in the format: track = word1, word2, etc..
> >
> > > > > > > > > I tried the following (following a successful fsockopen
> call to
> > > > > > > > > stream.twitter.api:
> >
> > > > > > > > > POST /track.json track = Palin, #fubar HTTP/1.1 Host:
> > > > > > > > > stream.twitter.com User-Agent: UserAgent Authorization:
> Basic
> > > > > > > > > cGXybmFzc3TzZGV2OlBhcm5hMzT1Mzl4MDMz Connection: Close
> >
> > > > > > > > > and I am getting the following error code: HTTP/1.1 400 Bad
> > > Request
> >
> > > > > > > > > The actual relevant test PHP code is:
> >
> > > > > > > > > $fp = fsockopen($url, 80, $errno, $errstr, 30);
> > > > > > > > > if (!$fp) {
> > > > > > > > > echo "$errstr ($errno)\n";
> > > > > > > > > } else {
> > > > > > > > > echo "file handle: ".$fp."<br/>";
> > > > > > > > > $header = "POST /track.json track = $trackTerms
> > > HTTP/1.1\r\n";
> > > > > > > > > $header .= "Host: stream.twitter.com\r\n";
> > > > > > > > > $header .= "User-Agent: UserAgent\r\n";
> > > > > > > > > $header .= "Authorization: Basic " .
> > > base64_encode($twitUsername
> > > > > .
> > > > > > > > > ':' . $twitPwd)."\r\n";
> > > > > > > > > $header .= "Connection: Close\r\n\r\n";
> > > > > > > > > echo $header."<br/>";
> > > > > > > > > fwrite($fp, $header);
> > > > > > > > > $line = fgets($fp, 4096);
> > > > > > > > > echo $line;
> > > > > > > > > fclose($fp);
> > > > > > > > > }
>
