Jorge Machado created SPARK-44108:
-------------------------------------
Summary: Cannot parse Type from german "umlaut"
Key: SPARK-44108
URL: https://issues.apache.org/jira/browse/SPARK-44108
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.3.0
Reporter: Jorge Machado
Hello all,
I have a client that has a column named : bfzgtäeil
Spark cannot handle this. My test:
{code:java}
import org.apache.spark.sql.catalyst.parser.CatalystSqlParser
import org.scalatest.funsuite.AnyFunSuite
class HiveTest extends AnyFunSuite {
test("test that Spark does not cut columns with ä") {
val data =
"bfzugtäeil:string"
CatalystSqlParser.parseDataType(data)
}
} {code}
I debugged it and I'm deep on the org.antlr.v4.runtime.Lexer class.
Any ideas ?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
