Re: [I] [native_datafusion] No support for default values for Parquet columns [datafusion-comet]

2025-05-23 Thread via GitHub 


andygrove closed issue #1750: [native_datafusion] No support for default values 
for Parquet columns
URL: https://github.com/apache/datafusion-comet/issues/1750


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Re: [I] [native_datafusion] No support for default values for Parquet columns [datafusion-comet]

2025-05-19 Thread via GitHub 


mbutrovich commented on issue #1750:
URL: 
https://github.com/apache/datafusion-comet/issues/1750#issuecomment-2892026436

   Taking a look at this today.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

[I] [native_datafusion] No support for default values for Parquet columns [datafusion-comet]

2025-05-19 Thread via GitHub 


andygrove opened a new issue, #1750:
URL: https://github.com/apache/datafusion-comet/issues/1750

   ### Describe the bug
   
   `native_datafusion` produces incorrect results when reading Parquet for 
columns that contain null and have a default value assigned.
   
   ### Steps to reproduce
   
   Add this test to `CometExpressionSuite`:
   
   ```scala
 test("parquet default values") {
   withTable("t1") {
 sql(s"create table t1(col1 boolean) using parquet")
 sql(s"insert into t1 values(true)")
 sql(s"alter table t1 add column col2 string default 'hello'")
 checkSparkAnswerAndOperator("select * from t1")
   }
 }
   ```
   
   Results:
   
   ```
   !== Correct Answer - 1 ==   == Spark Answer - 1 ==
struct   struct
   ![true,hello]   [true,null]
   ```
   
   ### Expected behavior
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]