[ https://issues.apache.org/jira/browse/SPARK-34857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308257#comment-17308257 ]
Takeshi Yamamuro commented on SPARK-34857: ------------------------------------------ Please feel free to make a PR for this issue. > AtLeastNNonNulls does not show up correctly in explain > ------------------------------------------------------ > > Key: SPARK-34857 > URL: https://issues.apache.org/jira/browse/SPARK-34857 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.1.1 > Reporter: Tim Armstrong > Priority: Minor > > I see this in an explain plan > {noformat} > (12) Filter > Input [3]: [c1#2410L, c2#2419, c3#2422] > Condition : AtLeastNNulls(n, c1#2410L) > I expect it to be AtLeastNNonNulls and n to have the actual value. > {noformat} > Proposed fix is to change > https://github.com/databricks/runtime/blob/09ad623c458c40cbaa0dbb4b9f600d96531d35f5/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/nullExpressions.scala#L384 > to > {noformat} > override def toString: String = s"AtLeastNNonNulls(${n}, > ${children.mkString(",")})" > {noformat} > Or maybe it's OK to remove and use a default implementation? -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org