akshaytayal opened a new issue, #13175:
URL: https://github.com/apache/gluten/issues/13175
Part of the Spark 4.2 unit-test enablement (GLUTEN-12569, PR
apache/gluten#13163). This issue tracks **re-enabling** one root-cause group of
UTs that are currently **disabled** to keep the `gluten-ut/spark42` CI green.
### Root cause
Spark 4.2 DSv2 row-level writes (DELETE/MERGE/UPDATE/INSERT) on Gluten path
### How it's disabled
`.exclude(...)` in
`gluten-ut/spark42/src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala`
(under the DSv2 Delete/Merge/Update/Insert suites).
Standard `.exclude("<test>")` entries.
### Files updated
-
`gluten-ut/spark42/src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala`
### Disabled tests (39)
- `GlutenGroupBasedDeleteFromTableSuite` :: delete from empty tables
- `GlutenGroupBasedDeleteFromTableSuite` :: delete from table with table
constraints
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with EXISTS subquery
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with NOT EXISTS subquery
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with NOT IN predicates
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with NOT IN subqueries
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with NULL condition on
non-null column
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with NULL equality on
VOID column
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with aliases
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with conditions on nested
columns
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with literal false
condition
- `GlutenGroupBasedDeleteFromTableSuite` :: delete with unsupported
predicates cannot be converted into delete with filters
- `GlutenDeleteFromTableSuite` :: delete from empty tables
- `GlutenDeleteFromTableSuite` :: delete from table with table constraints
- `GlutenDeleteFromTableSuite` :: delete with EXISTS subquery
- `GlutenDeleteFromTableSuite` :: delete with NOT EXISTS subquery
- `GlutenDeleteFromTableSuite` :: delete with NOT IN predicates
- `GlutenDeleteFromTableSuite` :: delete with NOT IN subqueries
- `GlutenDeleteFromTableSuite` :: delete with NULL condition on non-null
column
- `GlutenDeleteFromTableSuite` :: delete with NULL equality on VOID column
- `GlutenDeleteFromTableSuite` :: delete with aliases
- `GlutenDeleteFromTableSuite` :: delete with conditions on nested columns
- `GlutenDeleteFromTableSuite` :: delete with literal false condition
- `GlutenDeleteFromTableSuite` :: delete with unsupported predicates cannot
be converted into delete with filters
- `GlutenDeltaBasedMergeIntoTableUpdateAsDeleteAndInsertSuite` :: merge with
literal false ON condition
- `GlutenDeltaBasedMergeIntoTableUpdateAsDeleteAndInsertSuite` :: merge with
statically empty source and only MATCHED clauses
- `GlutenGroupBasedMergeIntoTableSuite` :: merge with literal false ON
condition
- `GlutenGroupBasedMergeIntoTableSuite` :: merge with statically empty
source and only MATCHED clauses
- `GlutenDeltaBasedMergeIntoTableSuite` :: merge with literal false ON
condition
- `GlutenDeltaBasedMergeIntoTableSuite` :: merge with statically empty
source and only MATCHED clauses
- `GlutenGroupBasedUpdateTableSuite` :: update with constraint violation and
transactional checks
- `GlutenDeltaBasedUpdateTableSuite` :: update with constraint violation and
transactional checks
- `GlutenDeltaBasedUpdateAsDeleteAndInsertTableSuite` :: update with
constraint violation and transactional checks
- `GlutenInsertSuite` :: SPARK-55716: V1 INSERT NOT NULL enforcement
respects storeAssignmentPolicy
- `GlutenInsertSuite` :: SPARK-55716: V1 INSERT rejects null array element
for NOT NULL element type
- `GlutenInsertSuite` :: SPARK-55716: V1 INSERT rejects null into NOT NULL
column for file sources
- `GlutenInsertSuite` :: SPARK-55716: V1 INSERT rejects null map value for
NOT NULL value type
- `GlutenInsertSuite` :: SPARK-55716: V1 INSERT rejects null struct field
for NOT NULL field
- `GlutenInsertSuite` :: SPARK-55716: V1 INSERT rejects null with V2 file
source path
### How to re-enable
Implement the underlying Gluten/Velox support, then remove the corresponding
`.exclude(...)` / allowlist / `@Ignore` / `ignore(...)` entries and confirm the
tests pass in the spark42 UT CI.
Related: PR apache/gluten#13163, GLUTEN-12569.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
