Bjørn Jørgensen created SPARK-41553: ---------------------------------------
Summary: Change num_files to repartition Key: SPARK-41553 URL: https://issues.apache.org/jira/browse/SPARK-41553 Project: Spark Issue Type: Improvement Components: Pandas API on Spark Affects Versions: 3.4.0 Reporter: Bjørn Jørgensen Functions have this signature. def to_json( (..) num_files: Optional[int] = None, .. note:: pandas-on-Spark writes JSON files into the directory, `path`, and writes multiple `part-...` files in the directory when `path` is specified. This behavior was inherited from Apache Spark. The number of files can be controlled by `num_files`. if num_files is not None: warnings.warn( "`num_files` has been deprecated and might be removed in a future version. " "Use `DataFrame.spark.repartition` instead.", FutureWarning, ) I will change num_files to repartition -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org