Samuel Moseley created SPARK-36161:
--------------------------------------
Summary: dropDuplicates does not type check argument
Key: SPARK-36161
URL: https://issues.apache.org/jira/browse/SPARK-36161
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 3.1.2
Reporter: Samuel Moseley
When giving a single string to {{dropDuplicates}} method in pyspark a cryptic
error is returned. Rather than returning a cryptic error, handle gracefully or
return an exception.
Proposal: Model after {{dropna}} behavior. If single string then use it to
create a list, otherwise if argument is not list/tuple return an exception
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
