zhengruifeng created SPARK-31182: ------------------------------------ Summary: PairRDD support aggregateByKeyWithinPartitions Key: SPARK-31182 URL: https://issues.apache.org/jira/browse/SPARK-31182 Project: Spark Issue Type: Improvement Components: ML, Spark Core Affects Versions: 3.1.0 Reporter: zhengruifeng
When implementing `RobustScaler`, I was looking for a way to guarantee that the {{QuantileSummaries in {{}}{{aggregateByKey}}{{}}}} are compressed before network communication. Then I only found a tricky method to work around (however not applied), and there was no method for this. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org