Re: Datasource with ColumnBatchScan support.

2020-06-17 Thread Wenchen Fan
If you already have your own `FileFormat` implementation: just override the `supportBatch` method. On Tue, Jun 16, 2020 at 5:39 AM Nasrulla Khan Haris wrote: > HI Spark developers, > > > > FileSourceScanExec >

Datasource with ColumnBatchScan support.

2020-06-15 Thread Nasrulla Khan Haris
HI Spark developers, FileSourceScanExec extends ColumnarBatchScan which internal converts columnarbatch to InternalRows, If I