[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641471#comment-14641471 ]
David Sabater commented on SPARK-6898: -------------------------------------- [~cloud_fan] I literally copy&pasted the snipped of code from your reply and used Spark 1.4.1 from brew on my Mac and I am getting the error I just included in my earlier reply. For reference I am in UK, in case the locale is doing something weird with backticks... {noformat} log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. 2015-07-25 10:09:05.510 java[6618:141238] Unable to load realm info from SCDynamicStore Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties 15/07/25 10:09:06 INFO SecurityManager: Changing view acls to: davidsabater 15/07/25 10:09:06 INFO SecurityManager: Changing modify acls to: davidsabater 15/07/25 10:09:06 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(davidsabater); users with modify permissions: Set(davidsabater) 15/07/25 10:09:06 INFO HttpServer: Starting HTTP Server 15/07/25 10:09:06 INFO Utils: Successfully started service 'HTTP class server' on port 60987. Welcome to ____ __ / __/__ ___ _____/ /__ _\ \/ _ \/ _ `/ __/ '_/ /___/ .__/\_,_/_/ /_/\_\ version 1.4.1 /_/ Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_45) Type in expressions to have them evaluated. Type :help for more information. 15/07/25 10:09:09 INFO SparkContext: Running Spark version 1.4.1 15/07/25 10:09:09 INFO SecurityManager: Changing view acls to: davidsabater 15/07/25 10:09:09 INFO SecurityManager: Changing modify acls to: davidsabater 15/07/25 10:09:09 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(davidsabater); users with modify permissions: Set(davidsabater) {noformat} > Special chars in column names is broken > --------------------------------------- > > Key: SPARK-6898 > URL: https://issues.apache.org/jira/browse/SPARK-6898 > Project: Spark > Issue Type: Bug > Components: SQL > Reporter: Wenchen Fan > Assignee: Wenchen Fan > Fix For: 1.4.0 > > > This function is added a long time ago, but it's not complete, it will fail > if we have "." inside column name. > {code} > test("SPARK-3483 Special chars in column names") { > val data = sparkContext.parallelize( > Seq("""{"key?number1": "value1", "key.number2": "value2"}""")) > jsonRDD(data).registerTempTable("records") > sql("SELECT `key?number1`, `key.number2` FROM records") > } > {code} > this test will fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org