liujp opened a new issue, #5638:
URL: https://github.com/apache/incubator-gluten/issues/5638

   ### Backend
   
   VL (Velox)
   
   ### Bug description
   
   when the schema in Orc file is different from the table schema(especially 
the field name), the gluten read error. as follows:
   schema in ORC file:
   <img width="2080" alt="image" 
src="https://github.com/apache/incubator-gluten/assets/11934146/2222f056-130a-42cd-b7e0-8ee150e6ce95";>
    the user table is:
   CREATE TABLE parquet_test
   (
       treatment TINYINT,
       numerator DOUBLE,
       denominator TINYINT,
       numerator_pre BIGINT,
       denominator_pre TINYINT,
       Y DOUBLE,
       X1 INT,
       X2 INT,
       X3 INT,
       X3_string STRING,
       X7_needcut BIGINT,
       X8_needcut BIGINT,
       weight DOUBLE,
       distance DOUBLE
   )
   
   then execute the query: 
   val df = spark.sql( "SELECT count(Y) from udf_table")
   a null value returns,
   
   
![](https://file.tapd.woa.com/compress/compress_img/700/tapd_70077997_base64_1715042626_348.png?src=/tfl/captures/2024-05/tapd_70077997_base64_1715042626_348.png)
   
   but use query: val df = spark.sql( "SELECT count(_col5) from udf_table")
   return ok;
   <img width="561" alt="image" 
src="https://github.com/apache/incubator-gluten/assets/11934146/114172ed-31f5-4abf-aec3-b9abb573b030";>
   
   
   ### Spark version
   
   None
   
   ### Spark configurations
   
   _No response_
   
   ### System information
   
   _No response_
   
   ### Relevant logs
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to