Re: any code to load large data from web into Cassandra

2014-12-27 Thread Jack Krupansky
Sorry, but you are still not being clear. In particular, website data has no common, defined meaning. You'll need to use some standard, defined terminology or specific examples so that we can have some idea what you are referring to. The blog post you cited is referring to the Twitter API,

Re: any code to load large data from web into Cassandra

2014-12-27 Thread Keith Sterling
Check out this datastax article http://www.datastax.com/documentation/cassandra/2.0/cassandra/tools/toolsBulkloader_t.html And code examples can be found here https://github.com/PatrickCallaghan/datastax-bulkloader-writer-example You can write a writer in scala or Java which will

Re: any code to load large data from web into Cassandra

2014-12-27 Thread Eric Stevens
I think Joanne is taking not about bulk loading, but about just general access as in any standard client driver. Joanne, this is a pretty broad topic. You would need to have some part of a website built in some language such as Python or Java or some other language. Then you would use an

any code to load large data from web into Cassandra

2014-12-26 Thread Joanne Contact
Thank you. I did not express clearly on my question. I wonder if there is sample code to load any website data to Cassandra? Say, this webpage http://datatomix.com/?p=84 seems to use Python, tweepy, to use twitter API to get data in json format and then load data into Cassandra. So it seems