Haejoon Lee created SPARK-47274:
-----------------------------------

             Summary: Provide more useful context for PySpark DataFrame API 
errors
                 Key: SPARK-47274
                 URL: https://issues.apache.org/jira/browse/SPARK-47274
             Project: Spark
          Issue Type: Bug
          Components: Connect, PySpark
    Affects Versions: 4.0.0
            Reporter: Haejoon Lee


Errors originating from PySpark operations can be difficult to debug with 
limited context in the error messages. While improvements on the JVM side have 
been made to offer detailed error contexts, PySpark errors often lack this 
level of detail. Adding detailed context about the location within the user's 
PySpark code where the error occurred will help debuggability for PySpark users.

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to