[
https://issues.apache.org/jira/browse/SPARK-11046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042513#comment-15042513
]
Nakul Jindal commented on SPARK-11046:
--------------------------------------
Hi, I am trying to look into this.
When you say that SparkR passes a DataFrame schema from R to JVM backend using
regular expression, do you mean this format:
map<string,boolean>
or
array<logical>
Also, is "structField.character" the only function where this "regular
expression" format is passed from R to JVM (using
org.apache.spark.sql.api.r.SQLUtils", "createDF)?
> Pass schema from R to JVM using JSON format
> -------------------------------------------
>
> Key: SPARK-11046
> URL: https://issues.apache.org/jira/browse/SPARK-11046
> Project: Spark
> Issue Type: Improvement
> Components: SparkR
> Affects Versions: 1.5.1
> Reporter: Sun Rui
> Priority: Minor
>
> Currently, SparkR passes a DataFrame schema from R to JVM backend using
> regular expression. However, Spark now supports schmea using JSON format.
> So enhance SparkR to use schema in JSON format.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
