spark git commit: [SPARK-22707][ML] Optimize CrossValidator memory occupation by models in fitting

2017-12-24 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 0bf1a74a7 -> fba03133d [SPARK-22707][ML] Optimize CrossValidator memory occupation by models in fitting ## What changes were proposed in this pull request? Via some test I found CrossValidator still exists memory issue, it will still

svn commit: r23897 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_24_12_01-0bf1a74-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-24 Thread pwendell
Author: pwendell Date: Sun Dec 24 20:14:52 2017 New Revision: 23897 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_24_12_01-0bf1a74 docs [This commit notification would consist of 1418 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22465][CORE] Add a safety-check to RDD defaultPartitioner

2017-12-24 Thread mridulm80
Repository: spark Updated Branches: refs/heads/master 1219d7a43 -> 0bf1a74a7 [SPARK-22465][CORE] Add a safety-check to RDD defaultPartitioner ## What changes were proposed in this pull request? In choosing a Partitioner to use for a cogroup-like operation between a number of RDDs, the