[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mikel San Vicente updated SPARK-22442: -------------------------------------- Description: Product encoder encodes special characters wrongly when field name contains certain nonstandard characters. For example for: {{ case class MyType(`field.1`: String, `field 2`: String) }} we will get the following schema {{ root |-- field$u002E1: string (nullable = true) |-- field$u00202: string (nullable = true) }} was: Product encoder encodes special characters wrongly when field name contains certain nonstandard characters. For example for: {{case class MyType(`field.1`: String, `field 2`: String) }} we will get the following schema {{root |-- field$u002E1: string (nullable = true) |-- field$u00202: string (nullable = true)}} > Schema generated by Product Encoder doesn't match case class field name when > using non-standard characters > ---------------------------------------------------------------------------------------------------------- > > Key: SPARK-22442 > URL: https://issues.apache.org/jira/browse/SPARK-22442 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.0.2, 2.1.2, 2.2.0 > Reporter: Mikel San Vicente > Priority: Normal > > Product encoder encodes special characters wrongly when field name contains > certain nonstandard characters. > For example for: > {{ > case class MyType(`field.1`: String, `field 2`: String) > }} > we will get the following schema > {{ > root > |-- field$u002E1: string (nullable = true) > |-- field$u00202: string (nullable = true) > }} -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org