Burak Yavuz created SPARK-30324: ----------------------------------- Summary: Simplify API for JSON access in DataFrames/SQL Key: SPARK-30324 URL: https://issues.apache.org/jira/browse/SPARK-30324 Project: Spark Issue Type: New Feature Components: SQL Affects Versions: 2.4.4 Reporter: Burak Yavuz
get_json_object() is a UDF to parse JSON fields. It is verbose and hard to use, e.g. I wasn't expecting the path to a field to have to start with "$.". We can simplify all of this when a column is of StringType, and a nested field is requested. This API sugar will in the query planner be rewritten asĀ get_json_object. This nested access can then be extended in the future to other semi-structured formats. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org