[
https://issues.apache.org/jira/browse/HUDI-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009457#comment-18009457
]
Davis Zhang commented on HUDI-9586:
-----------------------------------
added test coverage for select where in and where equals.
spark always do automatic type casting and in case type cast failed it simply
ignore that value.
so on hudi side we don't need to handle anything specific but have test
coverage.
[https://github.com/apache/hudi/pull/13594] covers the testing
> Validate lookup set types during index lookup [spark query engine]
> ------------------------------------------------------------------
>
> Key: HUDI-9586
> URL: https://issues.apache.org/jira/browse/HUDI-9586
> Project: Apache Hudi
> Issue Type: Bug
> Components: index
> Reporter: Davis Zhang
> Priority: Blocker
> Fix For: 1.1.0
>
>
> context https://issues.apache.org/jira/browse/HUDI-9566
> *Description:*
> On the read path, ensure that the data type of lookup set literals is
> compatible with the SI column’s declared type. Specifically:
> * Allow index lookup only when types matches
> * If incompatible:
> *
> ** *Preferred behavior:* Fallback to full table scan (no index)
> *
> ** *Alternative behavior:* Throw query error
> *Label:* {{{}blocker{}}}, {{{}si{}}}, {{lookup-validation}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
