[twitter-dev] Re: how are people collecting spritzer/gardenhose?

[M. Edward (Ed) Borasky]

Right now, I'm collecting spritzer data with a simple shell script
"curl <magic incantations> | bzip2 -c > <yyyymmddhhmmss>.bz2". A cron
job checks every minute and restarts the script if it crashes. The
rest is simple ETL. :)