David Szakallas created SPARK-37269:
---------------------------------------

             Summary: The partitionOverwriteMode option is not respected when 
using insertInto
                 Key: SPARK-37269
                 URL: https://issues.apache.org/jira/browse/SPARK-37269
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.2.0
            Reporter: David Szakallas


>From the documentation of the {{spark.sql.sources.partitionOverwriteMode}} 
>configuration option:
{quote}This can also be set as an output option for a data source using key 
partitionOverwriteMode (which takes precedence over this setting), e.g. 
dataframe.write.option("partitionOverwriteMode", "dynamic").save(path).
{quote}
This is true when using .save(), however .insertInto() does not respect the 
output option.

 

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to