[
https://issues.apache.org/jira/browse/SPARK-32764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32764:
----------------------------------
Description:
{code:scala}
val spark: SparkSession = SparkSession
.builder()
.master("local")
.appName("SparkByExamples.com")
.getOrCreate()
spark.sparkContext.setLogLevel("ERROR")
import spark.sqlContext.implicits._
val df = Seq((-0.0, 0.0)).toDF("neg", "pos")
.withColumn("comp", col("neg") < col("pos"))
df.show(false)
======
+----+---+----+
|neg |pos|comp|
+----+---+----+
|-0.0|0.0|true|
+----+---+----+{code}
I think that result should be false.
**Apache Spark 2.4.6 RESULT**
{code}
scala> spark.version
res0: String = 2.4.6
scala> Seq((-0.0, 0.0)).toDF("neg", "pos").withColumn("comp", col("neg") <
col("pos")).show
+----+---+-----+
| neg|pos| comp|
+----+---+-----+
|-0.0|0.0|false|
+----+---+-----+
{code}
was:
{code:scala}
val spark: SparkSession = SparkSession
.builder()
.master("local")
.appName("SparkByExamples.com")
.getOrCreate()
spark.sparkContext.setLogLevel("ERROR")
import spark.sqlContext.implicits._
val df = Seq((-0.0, 0.0)).toDF("neg", "pos")
.withColumn("comp", col("neg") < col("pos"))
df.show(false)
======
+----+---+----+
|neg |pos|comp|
+----+---+----+
|-0.0|0.0|true|
+----+---+----+{code}
I think that result should be false.
> compare of -0.0 < 0.0 return true
> ---------------------------------
>
> Key: SPARK-32764
> URL: https://issues.apache.org/jira/browse/SPARK-32764
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.0.0, 3.0.1
> Reporter: Izek Greenfield
> Priority: Major
> Labels: correctness
>
> {code:scala}
> val spark: SparkSession = SparkSession
> .builder()
> .master("local")
> .appName("SparkByExamples.com")
> .getOrCreate()
> spark.sparkContext.setLogLevel("ERROR")
> import spark.sqlContext.implicits._
> val df = Seq((-0.0, 0.0)).toDF("neg", "pos")
> .withColumn("comp", col("neg") < col("pos"))
> df.show(false)
> ======
> +----+---+----+
> |neg |pos|comp|
> +----+---+----+
> |-0.0|0.0|true|
> +----+---+----+{code}
> I think that result should be false.
> **Apache Spark 2.4.6 RESULT**
> {code}
> scala> spark.version
> res0: String = 2.4.6
> scala> Seq((-0.0, 0.0)).toDF("neg", "pos").withColumn("comp", col("neg") <
> col("pos")).show
> +----+---+-----+
> | neg|pos| comp|
> +----+---+-----+
> |-0.0|0.0|false|
> +----+---+-----+
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
