Ryan Blue created TOREE-376: ------------------------------- Summary: Scala interpreter should make Spark SQL implicits available Key: TOREE-376 URL: https://issues.apache.org/jira/browse/TOREE-376 Project: TOREE Issue Type: Improvement Reporter: Ryan Blue
The scala interpreter doesn't define Spark SQL functions or implicits that are commonly used and available by default in Spark's shell. Relevant test cases: {code} scala> val c = $"test" c: org.apache.spark.sql.ColumnName = test scala> val df = Seq((1, "a"), (2, "b")).toDF("id", "data") df: org.apache.spark.sql.DataFrame = [id: int, data: string] scala> df.withColumn("m", map(lit("id"), $"id")).printSchema root |-- id: integer (nullable = false) |-- data: string (nullable = true) |-- m: map (nullable = false) | |-- key: string | |-- value: integer (valueContainsNull = false) {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)