[ https://issues.apache.org/jira/browse/SPARK-44005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Allison Wang updated SPARK-44005: --------------------------------- Description: Currently, if you have a UDTF like this: {code:java} class TestUDTF: def eval(self, a: int): yield a {code} and run the UDTF, it will fail with a confusing error message like {code:java} Unexpected tuple 1 with StructType {code} Note this works when arrow is enabled. We should support this use case for regular UDTFs. was: Currently, if you have a UDTF like this: {code:java} class TestUDTF: def eval(self, a: int): yield a {code} and run the UDTF, it will fail with a confusing error message like {code:java} Unexpected tuple 1 with StructType {code} We should support this use case. > Support returning non-tuple values for regular Python UDTFs > ----------------------------------------------------------- > > Key: SPARK-44005 > URL: https://issues.apache.org/jira/browse/SPARK-44005 > Project: Spark > Issue Type: Sub-task > Components: PySpark > Affects Versions: 3.5.0 > Reporter: Allison Wang > Priority: Major > > Currently, if you have a UDTF like this: > {code:java} > class TestUDTF: > def eval(self, a: int): > yield a {code} > and run the UDTF, it will fail with a confusing error message like > {code:java} > Unexpected tuple 1 with StructType {code} > Note this works when arrow is enabled. We should support this use case for > regular UDTFs. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org