Dongjoon Hyun created SPARK-25722: ------------------------------------- Summary: Support a backtick character in column names Key: SPARK-25722 URL: https://issues.apache.org/jira/browse/SPARK-25722 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.4.0 Reporter: Dongjoon Hyun
Among built-in data sources, `avro` and `orc` doesn't allow `backtick` in column names. We had better be consistent if possible. *TEXT*, *CSV*, *JSON*, *PARQUET* {code:java} Seq("text", "csv", "json", "parquet").foreach { format => Seq("1").toDF("`").write.mode("overwrite").format(format).save("/tmp/t") }{code} *AVRO* {code:java} scala> Seq("1").toDF("`").write.mode("overwrite").format("avro").save("/tmp/t") org.apache.avro.SchemaParseException: Illegal initial character: `{code} *ORC* {code:java} scala> Seq("1").toDF("`").write.mode("overwrite").format("orc").save("/tmp/t") java.lang.IllegalArgumentException: Unmatched quote at 'struct<^```:string>'{code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org