[twitter-dev] Re: Twitter User List

2009-06-29 Thread Cameron Kaiser
I am looking to find the entire twitter user list ids. Social graph method provides the way to fetch the friends and followers id, thorough which we can access the profile of the person using user method - show. But this requires a code to be written to recursively crawl the list from any

[twitter-dev] Re: Twitter User List

2009-06-29 Thread Arunachalam
Any idea how to implement the same using php / any other language. Im confused abt the implementation. Cheers, Arunachalam On Mon, Jun 29, 2009 at 5:57 PM, Cameron Kaiser spec...@floodgap.comwrote: I am looking to find the entire twitter user list ids. Social graph method provides the

[twitter-dev] Re: Twitter User List

2009-06-29 Thread Abraham Williams
There has been over 5200 profiles created. You could just start at 1 and count up. Might take you a while though. Abraham On Mon, Jun 29, 2009 at 07:55, Arunachalamarunachala...@gmail.com wrote: Any idea how to implement the same using php / any other language. Im confused abt the

[twitter-dev] Re: Twitter User List

2009-06-29 Thread Doug Williams
Can you be more specific about your end goal? What is it that you are trying to do? Let's figure out if there is a better way to get you there. Thanks, Doug On Mon, Jun 29, 2009 at 9:06 AM, Arunachalam arunachala...@gmail.comwrote: Even if i have my account whitelisted, which have 20,000

[twitter-dev] Re: Twitter User List

2009-06-29 Thread Scott Haneda
I dint think this is a function of a workaround. This is a function of Twitter having a good policy in place to prevent abuse. You can do what you want by incrementally querrying the API. The API limits will make it take too long. Even with multiple accounts it will be months before you

[twitter-dev] Re: Twitter User List

2009-06-29 Thread Doug Williams
Please do not scrape our site. We have processes in place that will automatically block your spiders. If you feel that you have a compelling need for vast amounts of data please email the API team [1] with a detailed description of your needs and the value you hope to create and let's have a

[twitter-dev] Re: Twitter User List

2009-06-29 Thread Dossy Shiobara
On 6/29/09 1:30 PM, Scott Haneda wrote: Consider if each username is an average 10 bytes. You have 520,000,000 bytes to download of just username data. Let's double that for http overhead and other misc data that will come over the wire. 1 billion bytes. That's a strongly conservative

[twitter-dev] Re: Twitter User List

2009-06-29 Thread David Fisher
Thanks for the replies Doug. btw, as far as I can tell the ~ 52M integer values for user ids aren't fully sequential, with some amount missing in between, which I'm assuming is intentionally done to make it slightly more difficult to know the exact user growth trends/patterns (seems valid to me)

[twitter-dev] Re: Twitter User List

2009-06-29 Thread Arunachalam
no...i dont have any idea of crawling twitter. Cheers, Arunachalam On Mon, Jun 29, 2009 at 11:34 PM, Doug Williams d...@twitter.com wrote: Please do not scrape our site. We have processes in place that will automatically block your spiders. If you feel that you have a compelling need for