Re: [EXTERNAL] Re: ColumnnarBatch to InternalRow Cast exception with codegen enabled.

2020-06-12 Thread Kris Mo
> > > > *From:* Kris Mo > *Sent:* Friday, June 12, 2020 2:20 AM > *To:* Nasrulla Khan Haris > *Cc:* dev@spark.apache.org > *Subject:* [EXTERNAL] Re: ColumnnarBatch to InternalRow Cast exception > with codegen enabled. > > > > Hi Nasrulla, > > > >

RE: [EXTERNAL] Re: ColumnnarBatch to InternalRow Cast exception with codegen enabled.

2020-06-12 Thread Nasrulla Khan Haris
. From: Kris Mo Sent: Friday, June 12, 2020 2:20 AM To: Nasrulla Khan Haris Cc: dev@spark.apache.org Subject: [EXTERNAL] Re: ColumnnarBatch to InternalRow Cast exception with codegen enabled. Hi Nasrulla, Not sure what your new code is doing, but the symptom looks like you're creating a new data

RE: [EXTERNAL] Re: ColumnnarBatch to InternalRow Cast exception with codegen enabled.

2020-06-12 Thread Nasrulla Khan Haris
: [EXTERNAL] Re: ColumnnarBatch to InternalRow Cast exception with codegen enabled. Hi Nasrulla, Not sure what your new code is doing, but the symptom looks like you're creating a new data source that wraps around the builtin Parquet data source? The problem here is, whole-stage codegen generated