[ https://issues.apache.org/jira/browse/SPARK-41870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694791#comment-17694791 ]
Apache Spark commented on SPARK-41870: -------------------------------------- User 'ueshin' has created a pull request for this issue: https://github.com/apache/spark/pull/40227 > Handle duplicate columns in `createDataFrame` > --------------------------------------------- > > Key: SPARK-41870 > URL: https://issues.apache.org/jira/browse/SPARK-41870 > Project: Spark > Issue Type: Sub-task > Components: Connect > Affects Versions: 3.4.0 > Reporter: Sandeep Singh > Priority: Major > > {code:java} > df = self.spark.createDataFrame([(1, 2)], ["c", "c"]){code} > Error: > {code:java} > Traceback (most recent call last): > File > "/Users/s.singh/personal/spark-oss/python/pyspark/sql/tests/test_dataframe.py", > line 65, in test_duplicated_column_names > df = self.spark.createDataFrame([(1, 2)], ["c", "c"]) > File > "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/session.py", > line 277, in createDataFrame > raise ValueError( > ValueError: Length mismatch: Expected axis has 1 elements, new values have 2 > elements{code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org