Our entire team prefers 'x to $"x" or col("x"). We find this way of addressing
top-level columns to be more readable, especially when Column expressions get
complicated. It is unfortunate that the default Spark implementation requires
importing SparkSession.implicits to use this. That’s not a
i don't care much about the symbol class but i find 'a much easier on the
eye than $"a" or "a" and we use it extensively as such in many DSLs
including spark.
so its the syntax i would like to preserve not the class, which seems to be
the opposite of what they are suggesting.
On Sun, Mar 31,
I wish to unsubscribe from dev@spark.apache.org
> On Mar 31, 2019, at 10:07 AM, Rubén Berenguel wrote:
>
> I favour using either $”foo” or columnar expressions, but know of several
> developers who prefer single quote syntax and consider it a better practice.
>
> R
>
> On 31 March 2019 at
I favour using either $”foo” or columnar expressions, but know of several
developers who prefer single quote syntax and consider it a better practice.
R
On 31 March 2019 at 15:15:00, Sean Owen (sro...@apache.org) wrote:
> FWIW I use "foo" in Pyspark or col("foo") where necessary, and $"foo" in
FWIW I use "foo" in Pyspark or col("foo") where necessary, and $"foo" in
Scala
On Sun, Mar 31, 2019 at 1:58 AM Reynold Xin wrote:
> As part of evolving the Scala language, the Scala team is considering
> removing single-quote syntax for representing symbols. Single-quote syntax
> is one of the
This vote passes!
+1:
Wenchen Fan (binding)
Sean Owen (binding)
Mihaly Toth
DB Tsai (binding)
Jonatan Jäderberg
Xiao Li (binding)
Denny Lee
Felix Cheung (binding)
+0: None
-1: None
It's the largest RC ever; I will follow up with an official release
announcement soon.
Thank you all for your
As part of evolving the Scala language, the Scala team is considering removing
single-quote syntax for representing symbols. Single-quote syntax is one of the
ways to represent a column in Spark's DataFrame API. While I personally don't
use them (I prefer just using strings for column names, or
