[
https://issues.apache.org/jira/browse/SPARK-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059537#comment-15059537
]
Felix Cheung commented on SPARK-10312:
--------------------------------------
I think method implementation could easily handle this.
ie.
read.parquet(sqlContext, c("path1", "path2"))
read.parquet <- function (x, paths) {
// call JVM with as.list(paths)
}
which is what we are doing right now.
> Enhance SerDe to handle atomic vector
> -------------------------------------
>
> Key: SPARK-10312
> URL: https://issues.apache.org/jira/browse/SPARK-10312
> Project: Spark
> Issue Type: Improvement
> Components: SparkR
> Affects Versions: 1.4.1
> Reporter: Sun Rui
>
> Currently, writeObject() does not handle atomic vector well. For an atomic
> vector, it treats it like a scalar object. For example, if you pass c(1:10)
> into writeObject, it will write a single integer as 1. You have to explicitly
> cast an atomic vector, for example, as.list(1:10), to a list, if you want to
> write the whole vector.
> Could we enhance the SerDe that when the object is an atomic vector whose
> length >1, convert it to a list and then write?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
