cassandra data to hadoop

2011-12-23 Thread ravikumar visweswara
Hello All, I have a situation to dump cassandra data to hadoop cluster for further analytics. Lot of other relevant data which is not present in cassandra is already available in hdfs for analysis. Both are independent clusters right now. Is there a suggested way to get the data periodically or co

Re: cassandra data to hadoop

2011-12-23 Thread ravikumar visweswara
avi: > > Hadoop newbie here, so pardon me if I am pointing out the obvious - have > you taken a look at this link - > http://wiki.apache.org/cassandra/HadoopSupport > > Looks like Cassandra 0.6 onwards supports output to mapreduce. > > Regards > Sanjeev > > On Fri,

how to compress log files with snappy compression

2011-12-31 Thread ravikumar visweswara
Hello All, Is there a way to compress my text log files in snappy format on Mac OSX and Linux before or while pushing to hdfs? I dont want to run another map job to do the compression. -R