parthchandra commented on issue #1551:
URL:
https://github.com/apache/datafusion-comet/issues/1551#issuecomment-2744739770
fyi, currently some tests in Spark SQL (e.g. `"add a nested column at the
end of the leaf struct column"`) fail because of structs like
```
struct
+- array
+- struct
```
The tests fail with
```
Caused by: org.apache.comet.CometNativeException: no entry found for key
[info] at comet::errors::init::{{closure}}(__internal__:0)
[info] at std::panicking::rust_panic_with_hook(__internal__:0)
[info] at
std::panicking::begin_panic_handler::{{closure}}(__internal__:0)
[info] at
std::sys::backtrace::__rust_end_short_backtrace(__internal__:0)
[info] at rust_begin_unwind(__internal__:0)
[info] at core::panicking::panic_fmt(__internal__:0)
[info] at core::option::expect_failed(__internal__:0)
[info] at
comet::parquet::parquet_support::cast_struct_to_struct(__internal__:0)
[info] at comet::parquet::parquet_support::cast_array(__internal__:0)
[info] at
comet::parquet::parquet_support::cast_struct_to_struct(__internal__:0)
[info] at comet::parquet::parquet_support::cast_array(__internal__:0)
[info] at
comet::parquet::parquet_support::spark_parquet_convert(__internal__:0)
[info] at <core::iter::adapters::GenericShunt<I,R> as
core::iter::traits::iterator::Iterator>::next(__internal__:0)
[info] at <comet::parquet::schema_adapter::SchemaMapping as
datafusion::datasource::schema_adapter::SchemaMapper>::map_batch(__internal__:0)
[info] at <futures_util::stream::stream::map::Map<St,F> as
futures_core::stream::Stream>::poll_next(__internal__:0)
[info] at <datafusion_datasource::file_stream::FileStream as
futures_core::stream::Stream>::poll_next(__internal__:0)
[info] at
Java_org_apache_comet_parquet_Native_readNextRecordBatch(__internal__:0)
[info] at <unknown>(__internal__:0)
[info] at org.apache.comet.parquet.Native.readNextRecordBatch(Native
Method)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
