I have been trying to run a Hadoop Streaming job for pulling tweets from the API, but I cannot even ping twitter.com from the machine I am using. This just started today.
I read that making concurrent HTTP requests is fine, but if the IP was indeed blacklisted, then I must be exceeding some limit. Who should I contact about this? Does anybody know what the limit is (aside from the 20,000 per hour for whitelisted users)? I am using a suggested min of 8 mappers/reducers, 1 for each core.
