Andrew Grigorev created SPARK-35919:
---------------------------------------

             Summary: Support pathlib.PurePath-like objects in DataFrameReader 
/ DataFrameWriter
                 Key: SPARK-35919
                 URL: https://issues.apache.org/jira/browse/SPARK-35919
             Project: Spark
          Issue Type: Improvement
          Components: PySpark
    Affects Versions: 3.1.2, 2.4.8
            Reporter: Andrew Grigorev


It would be nice to support Path objects in 
`spark.\{read,write}.\{parquet,orc,csv,...etc}` methods.

Without pyspark source code changes it currently seems possible only by the 
ugly monkeypatching hacks - https://stackoverflow.com/q/68170685/2649222.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to