Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r188401185
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTypeSuite.scala
---
@@ -186,6 +186,37 @@ class ComplexTypeSuite
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186611074
--- Diff: python/pyspark/sql/functions.py ---
@@ -1798,6 +1798,22 @@ def create_map(*cols):
return Column(jc)
+@ignore_unicode_prefix
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186493539
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186489614
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186474451
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186464404
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186433318
--- Diff: python/pyspark/sql/functions.py ---
@@ -1798,6 +1798,22 @@ def create_map(*cols):
return Column(jc)
+@ignore_unicode_prefix
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186418197
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186408884
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala
---
@@ -405,6 +405,7 @@ object FunctionRegistry {
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186410527
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186408382
--- Diff: python/pyspark/sql/functions.py ---
@@ -1798,6 +1798,22 @@ def create_map(*cols):
return Column(jc)
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186410991
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -1033,6 +1033,17 @@ object functions {
@scala.annotation.varargs
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186409077
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186408332
--- Diff: python/pyspark/sql/functions.py ---
@@ -1798,6 +1798,22 @@ def create_map(*cols):
return Column(jc)
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186410288
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186410897
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTypeSuite.scala
---
@@ -186,6 +186,37 @@ class ComplexTypeSuite
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186410190
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21258#discussion_r186409860
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -235,6 +235,69 @@ case class
GitHub user kiszk opened a pull request:
https://github.com/apache/spark/pull/21258
[SPARK-23933][SQL] Add map_fromarray function
## What changes were proposed in this pull request?
The PR adds the SQL function `map_fromarray`. The behavior of the function
is based on
19 matches
Mail list logo
