I found the spark Jira ticket, https://issues.apache.org/jira/browse/SPARK-911, and noticed that no one had done it. It seemed like a useful and interesting feature. I implemented a pull request here ( https://github.com/apache/spark/pull/1381) and was looking for some input on it( go easy on me first time contributor).
-- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Pull-request-for-PLAT-911-tp7432.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.