[
https://issues.apache.org/jira/browse/SPARK-47625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mihailo Milosevic updated SPARK-47625:
--
Description:
{{INDETERMINATE_COLLATION}} should only be thrown on comparison operations and
memory storing of data, and we should be able to combine different implicit
collations for certain operations like concat and possible others in the future.
This is why we have to add another predefined collation id named
{{INDETERMINATE_COLLATION_ID}} which means that the result is a combination of
conflicting non-default implicit collations. Right now it would an id of -1 so
it fail if it ever goes to the {{{}CollatorFactory{}}}.
> Addition of Indeterminate Collation Support
> ---
>
> Key: SPARK-47625
> URL: https://issues.apache.org/jira/browse/SPARK-47625
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Mihailo Milosevic
>Priority: Major
>
> {{INDETERMINATE_COLLATION}} should only be thrown on comparison operations
> and memory storing of data, and we should be able to combine different
> implicit collations for certain operations like concat and possible others in
> the future.
> This is why we have to add another predefined collation id named
> {{INDETERMINATE_COLLATION_ID}} which means that the result is a combination
> of conflicting non-default implicit collations. Right now it would an id of
> -1 so it fail if it ever goes to the {{{}CollatorFactory{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
