[ https://issues.apache.org/jira/browse/SPARK-41553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17648795#comment-17648795 ]
Apache Spark commented on SPARK-41553: -------------------------------------- User 'bjornjorgensen' has created a pull request for this issue: https://github.com/apache/spark/pull/39098 > Change num_files to repartition > ------------------------------- > > Key: SPARK-41553 > URL: https://issues.apache.org/jira/browse/SPARK-41553 > Project: Spark > Issue Type: Improvement > Components: Pandas API on Spark > Affects Versions: 3.4.0 > Reporter: Bjørn Jørgensen > Priority: Major > > Functions have this signature. > > def to_json( > (..) > num_files: Optional[int] = None, > > > .. note:: pandas-on-Spark writes JSON files into the directory, `path`, and > writes > multiple `part-...` files in the directory when `path` is specified. > This behavior was inherited from Apache Spark. The number of files can > be controlled by `num_files`. > > > > if num_files is not None: > warnings.warn( > "`num_files` has been deprecated and might be removed in a future version. " > "Use `DataFrame.spark.repartition` instead.", > FutureWarning, > ) > > > I will change num_files to repartition -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org