Re: is there a SSTAbleInput for Map/Reduce instead of ColumnFamily?

2013-09-06 Thread Jim Ancona
> > On Aug 30, 2013, at 9:21 AM, "Hiller, Dean" wrote: > > > is there a SSTableInput for Map/Reduce instead of ColumnFamily (which > uses thrift)? > > > > We are not worried about repeated reads since we are idempotent but > would rather have the direct

Re: is there a SSTAbleInput for Map/Reduce instead of ColumnFamily?

2013-08-30 Thread Jeremiah D Jordan
FYI: http://techblog.netflix.com/2012/02/aegisthus-bulk-data-pipeline-out-of.html -Jeremiah On Aug 30, 2013, at 9:21 AM, "Hiller, Dean" wrote: > is there a SSTableInput for Map/Reduce instead of ColumnFamily (which uses > thrift)? > > We are not worried about repea

is there a SSTAbleInput for Map/Reduce instead of ColumnFamily?

2013-08-30 Thread Hiller, Dean
is there a SSTableInput for Map/Reduce instead of ColumnFamily (which uses thrift)? We are not worried about repeated reads since we are idempotent but would rather have the direct speed (even if we had to read from a snapshot, it would be fine). (We would most likely run our M/R on 4 nodes