[ https://issues.apache.org/jira/browse/SPARK-24330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan resolved SPARK-24330. --------------------------------- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21381 [https://github.com/apache/spark/pull/21381] > Refactor ExecuteWriteTask in FileFormatWriter with DataWriter(V2) > ----------------------------------------------------------------- > > Key: SPARK-24330 > URL: https://issues.apache.org/jira/browse/SPARK-24330 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.3.1 > Reporter: Gengliang Wang > Assignee: Gengliang Wang > Priority: Major > Fix For: 2.4.0 > > > Refactor ExecuteWriteTask in FileFormatWriter to reduce common logic and > improve readability. > After the change, callers only need to call {{commit()}} or {{abort}} at the > end of task. > Also there is less code in {{SingleDirectoryWriteTask}} and > {{DynamicPartitionWriteTask}}. > Definitions of related classes are moved to a new file, and > {{ExecuteWriteTask}} is renamed to {{FileFormatDataWriter}}. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org