Hossein Falaki created SPARK-17811: -------------------------------------- Summary: SparkR cannot parallelize data.frame with NA or NULL in Date columns Key: SPARK-17811 URL: https://issues.apache.org/jira/browse/SPARK-17811 Project: Spark Issue Type: Bug Components: SparkR Affects Versions: 2.0.1 Reporter: Hossein Falaki
To reproduce: {code} df <- data.frame(Date = as.Date(c(rep("2016-01-10", 10), "NA", "NA")), id = 1:12) dim(createDataFrame(df)) {code} We don't seem to have this problem with POSIXlt {code} df <- data.frame(Date = as.POSIXlt(as.Date(c(rep("2016-01-10", 10), "NA", "NA"))), id = 1:12) dim(createDataFrame(df)) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org