Re: SparkR was removed from CRAN on 2018-05-01
unsubscribe Le ven. 25 mai 2018 à 23:11, Felix Cheung a écrit : > This is the fix > > https://github.com/apache/spark/commit/f27a035daf705766d3445e5c6a99867c11c552b0#diff-e1e1d3d40573127e9ee0480caf1283d6 > > I don’t have the email though. > > -- > *From:* Hossein > *Sent:* Friday, May 25, 2018 10:58:42 AM > *To:* dev@spark.apache.org > *Subject:* SparkR was removed from CRAN on 2018-05-01 > > Would you please forward the email from CRAN? Is there a JIRA? > > Thanks, > --Hossein >
[SQL] Two ScalarSubquery expressions?! Could we have ScalarSubqueryExec instead?
Hi, Just been bitten by finding out that there are two ScalarSubquery expressions, one is a SubqueryExpression [1] and another is a ExecSubqueryExpression [2]. Could we have the ExecSubqueryExpression subclass called ScalarSubqueryExec to follow the naming convention in logical and physical plans? That'd help a lot (and I doubt I'm the only one confused). Thanks. [1] https://github.com/apache/spark/blob/branch-2.3/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/subquery.scala?utf8=%E2%9C%93#L246 [2] https://github.com/apache/spark/blob/branch-2.3/sql/core/src/main/scala/org/apache/spark/sql/execution/subquery.scala?utf8=%E2%9C%93#L46 Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski Mastering Spark SQL https://bit.ly/mastering-spark-sql Spark Structured Streaming https://bit.ly/spark-structured-streaming Mastering Kafka Streams https://bit.ly/mastering-kafka-streams Follow me at https://twitter.com/jaceklaskowski
[SQL] Understanding RewriteCorrelatedScalarSubquery optimization (and TreeNode.transform)
Hi, I'm trying to understand RewriteCorrelatedScalarSubquery optimization and how extractCorrelatedScalarSubqueries [1] works. I don't understand how "The expression is rewritten and returned." is done. How is the expression rewritten? Since it's private it's not even possible to write tests and that got me thinking how you go about code like this? How do you know whether it works fine or not? Any help? I'd appreciate. [1] https://github.com/apache/spark/blob/branch-2.3/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/subquery.scala?utf8=%E2%9C%93#L290-L299 Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski Mastering Spark SQL https://bit.ly/mastering-spark-sql Spark Structured Streaming https://bit.ly/spark-structured-streaming Mastering Kafka Streams https://bit.ly/mastering-kafka-streams Follow me at https://twitter.com/jaceklaskowski
