Lucas Nelson created SPARK-50404:
------------------------------------
Summary: PySpark Pipe Method
Key: SPARK-50404
URL: https://issues.apache.org/jira/browse/SPARK-50404
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 3.5.3
Reporter: Lucas Nelson
Implement pipe method for classic PySpark DataFrame. Similar to the transform
method, this method can be called directly on a DataFrame to perform custom
transformations functions. However, unlike the current transform method which
requires one call per custom transformation, pipe can accept an ambiguous
number of transformations and chain them together on the user's behalf.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
