Re: TableScan vs PrunedScan

2015-07-07 Thread Ram Sriharsha
Hi Gil You would need to prune the resulting Row as well based on the requested columns. Ram Sent from my iPhone > On Jul 7, 2015, at 3:12 AM, Gil Vernik wrote: > > Hi All, > > I wanted to experiment a little bit with TableScan and PrunedScan. > My first test was to print columns from var

TableScan vs PrunedScan

2015-07-07 Thread Gil Vernik
Hi All, I wanted to experiment a little bit with TableScan and PrunedScan. My first test was to print columns from various SQL queries. To make this test easier, i just took spark-csv and i replaced TableScan with PrunedScan. I then changed buildScan method of CsvRelation from def BuildScan =