Hyukjin Kwon created SPARK-61617:
------------------------------------

             Summary: Match PySpark's registerTempTable, the bool and 
properties arguments of the catalog and writers, and createExternalTable's 
signature, in the Python client
                 Key: SPARK-61617
                 URL: https://issues.apache.org/jira/browse/SPARK-61617
             Project: Spark
          Issue Type: Bug
          Components: Connect
    Affects Versions: connect-rust-4.3.0
            Reporter: Hyukjin Kwon


The Python client of spark-connect-rust differed from PySpark 4.3.0's Connect 
client in these catalog and writer methods:
- DataFrame.registerTempTable created the view, raising 
TEMP_TABLE_OR_VIEW_ALREADY_EXISTS for an existing one, without PySpark's 
FutureWarning "Deprecated in 2.0, use createOrReplaceTempView instead.". 
PySpark's warns and calls createOrReplaceTempView.
- The bool arguments of dropTable, dropView, createDatabase, dropDatabase, 
getCreateTableString, analyzeTable, DataFrameWriter.insertInto and 
DataFrame.unpersist took only a bool, where PySpark takes what its proto bool 
fields take (an int, a NumPy bool) or tests the truth of the value.
- createDatabase(properties=[]) raised a TypeError, where PySpark takes a false 
value as no properties.
- createExternalTable took a fifth positional description, which PySpark's 
(tableName, path=None, source=None, schema=None, **options) does not.




--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to