[ https://issues.apache.org/jira/browse/SPARK-41850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sandeep Singh updated SPARK-41850: ---------------------------------- Description: {code:java} File "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/functions.py", line 288, in pyspark.sql.connect.functions.isnan Failed example: df.select("a", "b", isnan("a").alias("r1"), isnan(df.b).alias("r2")).show() Expected: +---+---+-----+-----+ | a| b| r1| r2| +---+---+-----+-----+ |1.0|NaN|false| true| |NaN|2.0| true|false| +---+---+-----+-----+ Got: +----+----+-----+-----+ | a| b| r1| r2| +----+----+-----+-----+ | 1.0|null|false|false| |null| 2.0|false|false| +----+----+-----+-----+ <BLANKLINE>{code} was: {code:java} File "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/functions.py", line 276, in pyspark.sql.connect.functions.input_file_name Failed example: df = spark.read.text(path) Exception raised: Traceback (most recent call last): File "/usr/local/Cellar/python@3.10/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/doctest.py", line 1350, in __run exec(compile(example.source, filename, "single", File "<doctest pyspark.sql.connect.functions.input_file_name[2]>", line 1, in <module> df = spark.read.text(path) AttributeError: 'DataFrameReader' object has no attribute 'text'{code} > Fix `isnan` function > -------------------- > > Key: SPARK-41850 > URL: https://issues.apache.org/jira/browse/SPARK-41850 > Project: Spark > Issue Type: Sub-task > Components: Connect > Affects Versions: 3.4.0 > Reporter: Sandeep Singh > Priority: Major > > {code:java} > File > "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/functions.py", > line 288, in pyspark.sql.connect.functions.isnan > Failed example: > df.select("a", "b", isnan("a").alias("r1"), > isnan(df.b).alias("r2")).show() > Expected: > +---+---+-----+-----+ > | a| b| r1| r2| > +---+---+-----+-----+ > |1.0|NaN|false| true| > |NaN|2.0| true|false| > +---+---+-----+-----+ > Got: > +----+----+-----+-----+ > | a| b| r1| r2| > +----+----+-----+-----+ > | 1.0|null|false|false| > |null| 2.0|false|false| > +----+----+-----+-----+ > <BLANKLINE>{code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org