[ https://issues.apache.org/jira/browse/SPARK-38769 ]


    gabrywu deleted comment on SPARK-38769:
    ---------------------------------

was (Author: gabry.wu):
[~maxgekk] 

> [SQL] behavior of schema_of_json not same with 2.4.0
> ----------------------------------------------------
>
>                 Key: SPARK-38769
>                 URL: https://issues.apache.org/jira/browse/SPARK-38769
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 3.1.1
>            Reporter: gabrywu
>            Priority: Minor
>
> When I switch to spark 3.1.1 from spark 2.4.0, I found a built-in function 
> throw errors:
> |== Physical Plan == org.apache.spark.sql.AnalysisException: cannot resolve 
> 'schema_of_json(get_json_object(`adtnl_info_txt`, '$.all_model_scores'))' due 
> to data type mismatch: The input json should be a foldable string expression 
> and not null; however, got get_json_object(`adtnl_info_txt`, 
> '$.all_model_scores').; line 3 pos 2; |
> But schema_of_json worked well in 2.4.0, So, is it a bug, or a new feature, 
> which doesn't support non-Literal expressions?



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to