Matei Zaharia created SPARK-2032: ------------------------------------ Summary: Add an RDD.samplePartitions method for partition-level sampling Key: SPARK-2032 URL: https://issues.apache.org/jira/browse/SPARK-2032 Project: Spark Issue Type: Improvement Components: Spark Core Reporter: Matei Zaharia
This would allow us to sample a percent of the partitions and not have to materialize all of them. It's less uniform but much faster and may be useful for quickly exploring data. -- This message was sent by Atlassian JIRA (v6.2#6252)