Hyukjin Kwon created SPARK-46180: ------------------------------------ Summary: Reduce the number of shuffle partitions in pandas-on-Spark test cases Key: SPARK-46180 URL: https://issues.apache.org/jira/browse/SPARK-46180 Project: Spark Issue Type: Test Components: PySpark, Tests Affects Versions: 4.0.0 Reporter: Hyukjin Kwon
The current pandas API on Spark test cases take too much time, especially, about ops_on_diff_frames. The testing time can decrease by reducing the number of partitions. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org