TableScan vs PrunedScan

2015-07-07 Thread Gil Vernik
Hi All, I wanted to experiment a little bit with TableScan and PrunedScan. My first test was to print columns from various SQL queries. To make this test easier, i just took spark-csv and i replaced TableScan with PrunedScan. I then changed buildScan method of CsvRelation from def BuildScan

Re: TableScan vs PrunedScan

2015-07-07 Thread Ram Sriharsha
Hi Gil You would need to prune the resulting Row as well based on the requested columns. Ram Sent from my iPhone On Jul 7, 2015, at 3:12 AM, Gil Vernik g...@il.ibm.com wrote: Hi All, I wanted to experiment a little bit with TableScan and PrunedScan. My first test was to print