[ https://issues.apache.org/jira/browse/SPARK-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615234#comment-14615234 ]
Shivaram Venkataraman commented on SPARK-8840: ---------------------------------------------- Does this work in Scala / Python ? This might be a SparkSQL rather than a SparkR issue cc [~yhuai] [~davies] > Float type coercion with hiveContext > ------------------------------------ > > Key: SPARK-8840 > URL: https://issues.apache.org/jira/browse/SPARK-8840 > Project: Spark > Issue Type: Bug > Components: SparkR > Affects Versions: 1.4.0 > Reporter: Evgeny SInelnikov > > Problem with +float+ type coercion on SparkR with hiveContext. > {code} > > result <- sql(hiveContext, "SELECT offset, percentage from data limit 100") > > show(result) > DataFrame[offset:float, percentage:float] > > head(result) > Error in as.data.frame.default(x[[i]], optional = TRUE) : > cannot coerce class ""jobj"" to a data.frame > {code} > This trouble looks like already exists (SPARK-2863 - Emulate Hive type > coercion in native reimplementations of Hive functions) with same > reason - not completed "native reimplementations of Hive..." not > "...functions" only. > I used spark 1.4.0 binaries from official site: > http://spark.apache.org/downloads.html > And running it on: > * Hortonworks HDP 2.2.0.0-2041 > * with Hive 0.14 > * with disabled hooks for Application Timeline Servers (ATSHook) in > hive-site.xml, commented: > ** hive.exec.failure.hooks, > ** hive.exec.post.hooks, > ** hive.exec.pre.hooks. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org