[ https://issues.apache.org/jira/browse/SPARK-31182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhengruifeng resolved SPARK-31182. ---------------------------------- Resolution: Not A Problem > PairRDD support aggregateByKeyWithinPartitions > ---------------------------------------------- > > Key: SPARK-31182 > URL: https://issues.apache.org/jira/browse/SPARK-31182 > Project: Spark > Issue Type: Improvement > Components: ML, Spark Core > Affects Versions: 3.1.0 > Reporter: zhengruifeng > Priority: Minor > > When implementing `RobustScaler`, I was looking for a way to guarantee that > the {{QuantileSummaries in {{}}{{aggregateByKey}}{{}}}} are compressed before > network communication. > Then I only found a tricky method to work around (however not applied), and > there was no method for this. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org