[jira] [Created] (SPARK-26471) Use ConfigEntry for hardcoded configs for speculation category.

Takuya Ueshin created SPARK-26471: - Summary: Use ConfigEntry for hardcoded configs for speculation category. Key: SPARK-26471 URL: https://issues.apache.org/jira/browse/SPARK-26471 Project: Spark

[jira] [Created] (SPARK-26474) Use ConfigEntry for hardcoded configs for worker category.

Takuya Ueshin created SPARK-26474: - Summary: Use ConfigEntry for hardcoded configs for worker category. Key: SPARK-26474 URL: https://issues.apache.org/jira/browse/SPARK-26474 Project: Spark

[jira] [Created] (SPARK-26472) Use ConfigEntry for hardcoded configs for serializer category.

Takuya Ueshin created SPARK-26472: - Summary: Use ConfigEntry for hardcoded configs for serializer category. Key: SPARK-26472 URL: https://issues.apache.org/jira/browse/SPARK-26472 Project: Spark

[jira] [Created] (SPARK-26467) Use ConfigEntry for hardcoded configs for rpc category.

Takuya Ueshin created SPARK-26467: - Summary: Use ConfigEntry for hardcoded configs for rpc category. Key: SPARK-26467 URL: https://issues.apache.org/jira/browse/SPARK-26467 Project: Spark

[jira] [Created] (SPARK-26462) Use ConfigEntry for hardcoded configs for memory category.

Takuya Ueshin created SPARK-26462: - Summary: Use ConfigEntry for hardcoded configs for memory category. Key: SPARK-26462 URL: https://issues.apache.org/jira/browse/SPARK-26462 Project: Spark

[jira] [Created] (SPARK-26466) Use ConfigEntry for hardcoded configs for submit category.

Takuya Ueshin created SPARK-26466: - Summary: Use ConfigEntry for hardcoded configs for submit category. Key: SPARK-26466 URL: https://issues.apache.org/jira/browse/SPARK-26466 Project: Spark

[jira] [Created] (SPARK-26465) Use ConfigEntry for hardcoded configs for jars category.

Takuya Ueshin created SPARK-26465: - Summary: Use ConfigEntry for hardcoded configs for jars category. Key: SPARK-26465 URL: https://issues.apache.org/jira/browse/SPARK-26465 Project: Spark

[jira] [Created] (SPARK-26464) Use ConfigEntry for hardcoded configs for storage category.

Takuya Ueshin created SPARK-26464: - Summary: Use ConfigEntry for hardcoded configs for storage category. Key: SPARK-26464 URL: https://issues.apache.org/jira/browse/SPARK-26464 Project: Spark

[jira] [Created] (SPARK-26460) Use ConfigEntry for hardcoded kryo/kryoserializer configs.

Takuya Ueshin created SPARK-26460: - Summary: Use ConfigEntry for hardcoded kryo/kryoserializer configs. Key: SPARK-26460 URL: https://issues.apache.org/jira/browse/SPARK-26460 Project: Spark

[jira] [Updated] (SPARK-26460) Use ConfigEntry for hardcoded configs for kryo/kryoserializer categories.

[ https://issues.apache.org/jira/browse/SPARK-26460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-26460: -- Summary: Use ConfigEntry for hardcoded configs for kryo/kryoserializer categories. (was: Use

[jira] [Created] (SPARK-26445) Use ConfigEntry for hardcoded configs for driver/executor categories.

Takuya Ueshin created SPARK-26445: - Summary: Use ConfigEntry for hardcoded configs for driver/executor categories. Key: SPARK-26445 URL: https://issues.apache.org/jira/browse/SPARK-26445 Project:

[jira] [Commented] (SPARK-26445) Use ConfigEntry for hardcoded configs for driver/executor categories.

[ https://issues.apache.org/jira/browse/SPARK-26445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728974#comment-16728974 ] Takuya Ueshin commented on SPARK-26445: --- I'm working on this. > Use ConfigEntry for hardcoded

[jira] [Created] (SPARK-26443) Use ConfigEntry for hardcoded configs for history category.

Takuya Ueshin created SPARK-26443: - Summary: Use ConfigEntry for hardcoded configs for history category. Key: SPARK-26443 URL: https://issues.apache.org/jira/browse/SPARK-26443 Project: Spark

[jira] [Created] (SPARK-26442) Use ConfigEntry for hardcoded configs.

Takuya Ueshin created SPARK-26442: - Summary: Use ConfigEntry for hardcoded configs. Key: SPARK-26442 URL: https://issues.apache.org/jira/browse/SPARK-26442 Project: Spark Issue Type:

[jira] [Created] (SPARK-26370) Fix resolution of higher-order function for the same identifier.

Takuya Ueshin created SPARK-26370: - Summary: Fix resolution of higher-order function for the same identifier. Key: SPARK-26370 URL: https://issues.apache.org/jira/browse/SPARK-26370 Project: Spark

[jira] [Created] (SPARK-26355) Add a workaround for PyArrow 0.11.

Takuya Ueshin created SPARK-26355: - Summary: Add a workaround for PyArrow 0.11. Key: SPARK-26355 URL: https://issues.apache.org/jira/browse/SPARK-26355 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-26211) Fix InSet for binary, and struct and array with null.

Takuya Ueshin created SPARK-26211: - Summary: Fix InSet for binary, and struct and array with null. Key: SPARK-26211 URL: https://issues.apache.org/jira/browse/SPARK-26211 Project: Spark

[jira] [Created] (SPARK-26112) Update since versions of new built-in functions.

Takuya Ueshin created SPARK-26112: - Summary: Update since versions of new built-in functions. Key: SPARK-26112 URL: https://issues.apache.org/jira/browse/SPARK-26112 Project: Spark Issue

[jira] [Created] (SPARK-26060) Track SparkConf entries and make SET command reject such entries.

Takuya Ueshin created SPARK-26060: - Summary: Track SparkConf entries and make SET command reject such entries. Key: SPARK-26060 URL: https://issues.apache.org/jira/browse/SPARK-26060 Project: Spark

[jira] [Created] (SPARK-25926) Move config entries in core module to internal.config.

Takuya Ueshin created SPARK-25926: - Summary: Move config entries in core module to internal.config. Key: SPARK-25926 URL: https://issues.apache.org/jira/browse/SPARK-25926 Project: Spark

[jira] [Created] (SPARK-25884) Add TBLPROPERTIES and COMMENT, and use LOCATION when SHOW CREATE TABLE.

Takuya Ueshin created SPARK-25884: - Summary: Add TBLPROPERTIES and COMMENT, and use LOCATION when SHOW CREATE TABLE. Key: SPARK-25884 URL: https://issues.apache.org/jira/browse/SPARK-25884 Project:

[jira] [Resolved] (SPARK-25822) Fix a race condition when releasing a Python worker

[ https://issues.apache.org/jira/browse/SPARK-25822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-25822. --- Resolution: Fixed Fix Version/s: 2.4.0 2.3.3 Issue resolved by

[jira] [Created] (SPARK-25763) Use more `@contextmanager` to ensure clean-up each test.

Takuya Ueshin created SPARK-25763: - Summary: Use more `@contextmanager` to ensure clean-up each test. Key: SPARK-25763 URL: https://issues.apache.org/jira/browse/SPARK-25763 Project: Spark

[jira] [Resolved] (SPARK-17952) SparkSession createDataFrame method throws exception for nested JavaBeans

[ https://issues.apache.org/jira/browse/SPARK-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-17952. --- Issue resolved by pull request 22527 https://github.com/apache/spark/pull/22527 > SparkSession

[jira] [Created] (SPARK-25540) Make HiveContext in PySpark behave as the same as Scala.

Takuya Ueshin created SPARK-25540: - Summary: Make HiveContext in PySpark behave as the same as Scala. Key: SPARK-25540 URL: https://issues.apache.org/jira/browse/SPARK-25540 Project: Spark

[jira] [Created] (SPARK-25525) Do not update conf for existing SparkContext in SparkSession.getOrCreate.

Takuya Ueshin created SPARK-25525: - Summary: Do not update conf for existing SparkContext in SparkSession.getOrCreate. Key: SPARK-25525 URL: https://issues.apache.org/jira/browse/SPARK-25525 Project:

[jira] [Resolved] (SPARK-25444) Refactor GenArrayData.genCodeToCreateArrayData() method

[ https://issues.apache.org/jira/browse/SPARK-25444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-25444. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.5.0 Issue

[jira] [Commented] (SPARK-25431) Fix function examples and unify the format of the example results.

[ https://issues.apache.org/jira/browse/SPARK-25431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617169#comment-16617169 ] Takuya Ueshin commented on SPARK-25431: --- Seems like the automatic link didn't work again. The new

[jira] [Commented] (SPARK-21914) Running examples as tests in SQL builtin function documentation

[ https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617123#comment-16617123 ] Takuya Ueshin commented on SPARK-21914: --- Actually I was just thinking of the tests like that. I

[jira] [Updated] (SPARK-25431) Fix function examples and unify the format of the example results.

[ https://issues.apache.org/jira/browse/SPARK-25431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-25431: -- Summary: Fix function examples and unify the format of the example results. (was: Fix

[jira] [Created] (SPARK-25431) Fix function examples and unify the format of the functions results.

Takuya Ueshin created SPARK-25431: - Summary: Fix function examples and unify the format of the functions results. Key: SPARK-25431 URL: https://issues.apache.org/jira/browse/SPARK-25431 Project:

[jira] [Created] (SPARK-25418) The metadata of DataSource table should not include Hive-generated storage properties.

Takuya Ueshin created SPARK-25418: - Summary: The metadata of DataSource table should not include Hive-generated storage properties. Key: SPARK-25418 URL: https://issues.apache.org/jira/browse/SPARK-25418

[jira] [Resolved] (SPARK-25310) ArraysOverlap may throw a CompileException

[ https://issues.apache.org/jira/browse/SPARK-25310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-25310. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 Issue

[jira] [Resolved] (SPARK-25307) ArraySort function may return a error in the code generation phase.

[ https://issues.apache.org/jira/browse/SPARK-25307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-25307. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.4.0 Issue

[jira] [Resolved] (SPARK-25308) ArrayContains function may return a error in the code generation phase.

[ https://issues.apache.org/jira/browse/SPARK-25308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-25308. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.4.0 Issue

[jira] [Resolved] (SPARK-23466) Remove redundant null checks in generated Java code by GenerateUnsafeProjection

[ https://issues.apache.org/jira/browse/SPARK-23466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23466. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 Issue

[jira] [Resolved] (SPARK-25223) Use a map to store values for NamedLambdaVariable.

[ https://issues.apache.org/jira/browse/SPARK-25223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-25223. --- Resolution: Won't Do > Use a map to store values for NamedLambdaVariable. >

[jira] [Created] (SPARK-25223) Use a map to store values for NamedLambdaVariable.

Takuya Ueshin created SPARK-25223: - Summary: Use a map to store values for NamedLambdaVariable. Key: SPARK-25223 URL: https://issues.apache.org/jira/browse/SPARK-25223 Project: Spark Issue

[jira] [Resolved] (SPARK-25178) Directly ship the StructType objects of the keySchema / valueSchema for xxxHashMapGenerator

[ https://issues.apache.org/jira/browse/SPARK-25178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-25178. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 Issue

[jira] [Created] (SPARK-25208) Loosen Cast.forceNullable for DecimalType.

Takuya Ueshin created SPARK-25208: - Summary: Loosen Cast.forceNullable for DecimalType. Key: SPARK-25208 URL: https://issues.apache.org/jira/browse/SPARK-25208 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-25141) Modify tests for higher-order functions to check bind method.

[ https://issues.apache.org/jira/browse/SPARK-25141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-25141. --- Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.4.0 Issue

[jira] [Created] (SPARK-25142) Add error messages when Python worker could not open socket in `_load_from_socket`.

Takuya Ueshin created SPARK-25142: - Summary: Add error messages when Python worker could not open socket in `_load_from_socket`. Key: SPARK-25142 URL: https://issues.apache.org/jira/browse/SPARK-25142

[jira] [Created] (SPARK-25141) Modify tests for higher-order functions to check bind method.

Takuya Ueshin created SPARK-25141: - Summary: Modify tests for higher-order functions to check bind method. Key: SPARK-25141 URL: https://issues.apache.org/jira/browse/SPARK-25141 Project: Spark

[jira] [Resolved] (SPARK-23940) High-order function: transform_values(map, function) → map

[ https://issues.apache.org/jira/browse/SPARK-23940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23940. --- Resolution: Fixed Assignee: Neha Patil Fix Version/s: 2.4.0 Issue resolved

[jira] [Resolved] (SPARK-23932) High-order function: zip_with(array, array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23932. --- Resolution: Fixed Assignee: Sandeep Singh Fix Version/s: 2.4.0 Issue

[jira] [Resolved] (SPARK-23939) High-order function: transform_keys(map, function) → map

[ https://issues.apache.org/jira/browse/SPARK-23939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23939. --- Resolution: Fixed Assignee: Neha Patil Fix Version/s: 2.4.0 Issue resolved

[jira] [Resolved] (SPARK-23938) High-order function: map_zip_with(map, map, function) → map

[ https://issues.apache.org/jira/browse/SPARK-23938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23938. --- Resolution: Fixed Assignee: Marek Novotny Fix Version/s: 2.4.0 Issue

[jira] [Commented] (SPARK-25068) High-order function: exists(array, function) → boolean

[ https://issues.apache.org/jira/browse/SPARK-25068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579210#comment-16579210 ] Takuya Ueshin commented on SPARK-25068: --- I added this because I thought this was a missing

[jira] [Created] (SPARK-25096) Loosen nullability if the cast is force-nullable.

Takuya Ueshin created SPARK-25096: - Summary: Loosen nullability if the cast is force-nullable. Key: SPARK-25096 URL: https://issues.apache.org/jira/browse/SPARK-25096 Project: Spark Issue

[jira] [Created] (SPARK-25068) High-order function: exists(array, function) → boolean

Takuya Ueshin created SPARK-25068: - Summary: High-order function: exists(array, function) → boolean Key: SPARK-25068 URL: https://issues.apache.org/jira/browse/SPARK-25068 Project: Spark

[jira] [Resolved] (SPARK-25058) Use Block.isEmpty/nonEmpty to check whether the code is empty or not.

[ https://issues.apache.org/jira/browse/SPARK-25058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-25058. --- Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.4.0 Issue

[jira] [Created] (SPARK-25058) Use Block.isEmpty/nonEmpty to check whether the code is empty or not.

Takuya Ueshin created SPARK-25058: - Summary: Use Block.isEmpty/nonEmpty to check whether the code is empty or not. Key: SPARK-25058 URL: https://issues.apache.org/jira/browse/SPARK-25058 Project:

[jira] [Resolved] (SPARK-23937) High-order function: map_filter(map, function) → MAP

[ https://issues.apache.org/jira/browse/SPARK-23937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23937. --- Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.4.0 Issue resolved

[jira] [Resolved] (SPARK-23913) High-order function: array_intersect(x, y) → array

[ https://issues.apache.org/jira/browse/SPARK-23913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23913. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 Issue

[jira] [Resolved] (SPARK-23911) High-order function: aggregate(array, initialState S, inputFunction, outputFunction) → R

[ https://issues.apache.org/jira/browse/SPARK-23911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23911. --- Resolution: Fixed Assignee: Takuya Ueshin (was: Herman van Hovell) Fix

[jira] [Resolved] (SPARK-23909) High-order function: filter(array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23909. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21965

[jira] [Assigned] (SPARK-23909) High-order function: filter(array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23909: - Assignee: Takuya Ueshin (was: Herman van Hovell) > High-order function: filter(array,

[jira] [Commented] (SPARK-23932) High-order function: zip_with(array, array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568059#comment-16568059 ] Takuya Ueshin commented on SPARK-23932: --- Hi [~crafty-coder], Are you still working on this?

[jira] [Commented] (SPARK-23911) High-order function: reduce(array, initialState S, inputFunction, outputFunction) → R

[ https://issues.apache.org/jira/browse/SPARK-23911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567791#comment-16567791 ] Takuya Ueshin commented on SPARK-23911: --- [~smilegator] [~hvanhovell] I'd use {{aggregate}} instead

[jira] [Resolved] (SPARK-23928) High-order function: shuffle(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23928. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21802

[jira] [Assigned] (SPARK-23928) High-order function: shuffle(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23928: - Assignee: H Lu > High-order function: shuffle(x) → array >

[jira] [Created] (SPARK-24878) Fix reverse function for array type of primitive type containing null.

Takuya Ueshin created SPARK-24878: - Summary: Fix reverse function for array type of primitive type containing null. Key: SPARK-24878 URL: https://issues.apache.org/jira/browse/SPARK-24878 Project:

[jira] [Created] (SPARK-24871) Refactor Concat and MapConcat to avoid creating concatenator object for each row.

Takuya Ueshin created SPARK-24871: - Summary: Refactor Concat and MapConcat to avoid creating concatenator object for each row. Key: SPARK-24871 URL: https://issues.apache.org/jira/browse/SPARK-24871

[jira] [Resolved] (SPARK-23914) High-order function: array_union(x, y) → array

[ https://issues.apache.org/jira/browse/SPARK-23914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23914. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21061

[jira] [Assigned] (SPARK-23914) High-order function: array_union(x, y) → array

[ https://issues.apache.org/jira/browse/SPARK-23914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23914: - Assignee: Kazuaki Ishizaki > High-order function: array_union(x, y) → array >

[jira] [Commented] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work.

[ https://issues.apache.org/jira/browse/SPARK-24781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539633#comment-16539633 ] Takuya Ueshin commented on SPARK-24781: --- Yes, I think so. This is a regression from 2.2 to 2.3. >

[jira] [Updated] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work.

[ https://issues.apache.org/jira/browse/SPARK-24781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-24781: -- Description: When we use a reference from {{Dataset}} in {{filter}} or {{sort}}, which was

[jira] [Updated] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work.

[ https://issues.apache.org/jira/browse/SPARK-24781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-24781: -- Description: When we use a reference from {{Dataset}} in {{filter}} or {{sort}}, which was

[jira] [Updated] (SPARK-24781) Using a reference from Dataset in Filter/Sort might not work.

[ https://issues.apache.org/jira/browse/SPARK-24781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-24781: -- Summary: Using a reference from Dataset in Filter/Sort might not work. (was: Using a

[jira] [Created] (SPARK-24781) Using a reference from Dataset in Filter might not work.

Takuya Ueshin created SPARK-24781: - Summary: Using a reference from Dataset in Filter might not work. Key: SPARK-24781 URL: https://issues.apache.org/jira/browse/SPARK-24781 Project: Spark

[jira] [Resolved] (SPARK-23936) High-order function: map_concat(map1, map2, ..., mapN) → map

[ https://issues.apache.org/jira/browse/SPARK-23936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23936. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21073

[jira] [Assigned] (SPARK-23936) High-order function: map_concat(map1, map2, ..., mapN) → map

[ https://issues.apache.org/jira/browse/SPARK-23936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23936: - Assignee: Bruce Robbins > High-order function: map_concat(map1, map2, ..., mapN) → >

[jira] [Commented] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp

[ https://issues.apache.org/jira/browse/SPARK-24752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536502#comment-16536502 ] Takuya Ueshin commented on SPARK-24752: --- Maybe we should use {{"-MM-dd"}} for the format

[jira] [Created] (SPARK-24737) Type coercion between StructTypes.

Takuya Ueshin created SPARK-24737: - Summary: Type coercion between StructTypes. Key: SPARK-24737 URL: https://issues.apache.org/jira/browse/SPARK-24737 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-24734) Fix containsNull of Concat for array type.

Takuya Ueshin created SPARK-24734: - Summary: Fix containsNull of Concat for array type. Key: SPARK-24734 URL: https://issues.apache.org/jira/browse/SPARK-24734 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-24732) Type coercion between MapTypes.

Takuya Ueshin created SPARK-24732: - Summary: Type coercion between MapTypes. Key: SPARK-24732 URL: https://issues.apache.org/jira/browse/SPARK-24732 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-23927) High-order function: sequence

[ https://issues.apache.org/jira/browse/SPARK-23927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23927. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21155

[jira] [Assigned] (SPARK-23927) High-order function: sequence

[ https://issues.apache.org/jira/browse/SPARK-23927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23927: - Assignee: Alex Vayda > High-order function: sequence > - >

[jira] [Resolved] (SPARK-23934) High-order function: map_from_entries(array>) → map

[ https://issues.apache.org/jira/browse/SPARK-23934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23934. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21282

[jira] [Assigned] (SPARK-23934) High-order function: map_from_entries(array>) → map

[ https://issues.apache.org/jira/browse/SPARK-23934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23934: - Assignee: Marek Novotny > High-order function: map_from_entries(array>) → map >

[jira] [Resolved] (SPARK-23912) High-order function: array_distinct(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23912. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21050

[jira] [Assigned] (SPARK-23912) High-order function: array_distinct(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23912: - Assignee: Huaxin Gao > High-order function: array_distinct(x) → array >

[jira] [Resolved] (SPARK-23933) High-order function: map(array, array) → map

[ https://issues.apache.org/jira/browse/SPARK-23933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23933. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21258

[jira] [Assigned] (SPARK-23933) High-order function: map(array, array) → map

[ https://issues.apache.org/jira/browse/SPARK-23933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23933: - Assignee: Kazuaki Ishizaki > High-order function: map(array, array) → map >

[jira] [Resolved] (SPARK-23931) High-order function: zip(array1, array2[, ...]) → array

[ https://issues.apache.org/jira/browse/SPARK-23931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23931. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21045

[jira] [Assigned] (SPARK-23931) High-order function: zip(array1, array2[, ...]) → array

[ https://issues.apache.org/jira/browse/SPARK-23931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23931: - Assignee: Dylan Guedes > High-order function: zip(array1, array2[, ...]) → array >

[jira] [Resolved] (SPARK-23903) Add support for date extract

[ https://issues.apache.org/jira/browse/SPARK-23903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23903. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21479

[jira] [Assigned] (SPARK-23903) Add support for date extract

[ https://issues.apache.org/jira/browse/SPARK-23903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23903: - Assignee: Yuming Wang > Add support for date extract > >

[jira] [Resolved] (SPARK-23920) High-order function: array_remove(x, element) → array

[ https://issues.apache.org/jira/browse/SPARK-23920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23920. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21069

[jira] [Assigned] (SPARK-23920) High-order function: array_remove(x, element) → array

[ https://issues.apache.org/jira/browse/SPARK-23920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23920: - Assignee: Huaxin Gao > High-order function: array_remove(x, element) → array >

[jira] [Resolved] (SPARK-23900) format_number udf should take user specifed format as argument

[ https://issues.apache.org/jira/browse/SPARK-23900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23900. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21010

[jira] [Assigned] (SPARK-23900) format_number udf should take user specifed format as argument

[ https://issues.apache.org/jira/browse/SPARK-23900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23900: - Assignee: Yuming Wang > format_number udf should take user specifed format as argument

[jira] [Resolved] (SPARK-23901) Data Masking Functions

[ https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23901. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21246

[jira] [Assigned] (SPARK-23901) Data Masking Functions

[ https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23901: - Assignee: Marco Gaido > Data Masking Functions > -- > >

[jira] [Resolved] (SPARK-23935) High-order function: map_entries(map<K, V>) → array<row<K,V>>

[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23935. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21236

[jira] [Assigned] (SPARK-23935) High-order function: map_entries(map<K, V>) → array<row<K,V>>

[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23935: - Assignee: Marek Novotny > High-order function: map_entries(map) → array>

[jira] [Resolved] (SPARK-23925) High-order function: repeat(element, count) → array

[ https://issues.apache.org/jira/browse/SPARK-23925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23925. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21208

[jira] [Assigned] (SPARK-23925) High-order function: repeat(element, count) → array

[ https://issues.apache.org/jira/browse/SPARK-23925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23925: - Assignee: Florent Pepin > High-order function: repeat(element, count) → array >

[jira] [Resolved] (SPARK-23907) Support regr_* functions

[ https://issues.apache.org/jira/browse/SPARK-23907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23907. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21054

[jira] [Assigned] (SPARK-23907) Support regr_* functions

[ https://issues.apache.org/jira/browse/SPARK-23907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-23907: - Assignee: Marco Gaido > Support regr_* functions > > >

<    1   2   3   4   5   6   7   8   9   >