Re: [I] [native_datafusion] No support for default values for Parquet columns [datafusion-comet]

[via GitHub]

andygrove closed issue #1750: [native_datafusion] No support for default values 
for Parquet columns
URL: https://github.com/apache/datafusion-comet/issues/1750


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Re: [I] [native_datafusion] No support for default values for Parquet columns [datafusion-comet]

[via GitHub]

mbutrovich commented on issue #1750:
URL: 
https://github.com/apache/datafusion-comet/issues/1750#issuecomment-2892026436

   Taking a look at this today.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

[I] [native_datafusion] No support for default values for Parquet columns [datafusion-comet]

[via GitHub]

andygrove opened a new issue, #1750:
URL: https://github.com/apache/datafusion-comet/issues/1750

   ### Describe the bug
   
   `native_datafusion` produces incorrect results when reading Parquet for 
columns that contain null and have a default value assigned.
   
   ### Steps to reproduce
   
   Add this test to `CometExpressionSuite`:
   
   ```scala
 test("parquet default values") {
   withTable("t1") {
 sql(s"create table t1(col1 boolean) using parquet")
 sql(s"insert into t1 values(true)")
 sql(s"alter table t1 add column col2 string default 'hello'")
 checkSparkAnswerAndOperator("select * from t1")
   }
 }
   ```
   
   Results:
   
   ```
   !== Correct Answer - 1 ==   == Spark Answer - 1 ==
struct   struct
   ![true,hello]   [true,null]
   ```
   
   ### Expected behavior
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org