[jira] [Created] (SPARK-34918) Create SQL syntax document for TRT_CAST

2021-03-30 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34918: -- Summary: Create SQL syntax document for TRT_CAST Key: SPARK-34918 URL: https://issues.apache.org/jira/browse/SPARK-34918 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-34917) Create SQL syntax document for CAST

2021-03-30 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34917: -- Summary: Create SQL syntax document for CAST Key: SPARK-34917 URL: https://issues.apache.org/jira/browse/SPARK-34917 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-34896) Return day-time interval from dates subtraction

2021-03-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34896. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31996

[jira] [Updated] (SPARK-34916) Reduce tree traversals in transform/resolve function families

2021-03-30 Thread Yingyi Bu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingyi Bu updated SPARK-34916: -- Description: Transform/resolve functions are called ~280k times per query on average for a TPC-DS

[jira] [Assigned] (SPARK-34909) conv() does not convert negative inputs to unsigned correctly

2021-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34909: --- Assignee: Tim Armstrong > conv() does not convert negative inputs to unsigned correctly >

[jira] [Resolved] (SPARK-34909) conv() does not convert negative inputs to unsigned correctly

2021-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34909. - Fix Version/s: 3.0.3 3.1.2 2.4.8 3.2.0

[jira] [Commented] (SPARK-34915) Cache Maven, SBT and Scala in all jobs that use them

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312056#comment-17312056 ] Apache Spark commented on SPARK-34915: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-34916) Reduce tree traversals in transform/resolve function families

2021-03-30 Thread Yingyi Bu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingyi Bu updated SPARK-34916: -- Fix Version/s: (was: 3.2.0) Shepherd: Herman van Hövell Target Version/s: 3.2.0

[jira] [Commented] (SPARK-34915) Cache Maven, SBT and Scala in all jobs that use them

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312055#comment-17312055 ] Apache Spark commented on SPARK-34915: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-34915) Cache Maven, SBT and Scala in all jobs that use them

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34915: Assignee: Apache Spark > Cache Maven, SBT and Scala in all jobs that use them >

[jira] [Assigned] (SPARK-34915) Cache Maven, SBT and Scala in all jobs that use them

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34915: Assignee: (was: Apache Spark) > Cache Maven, SBT and Scala in all jobs that use them

[jira] [Created] (SPARK-34916) Reduce tree traversals in transform/resolve function families

2021-03-30 Thread Yingyi Bu (Jira)
Yingyi Bu created SPARK-34916: - Summary: Reduce tree traversals in transform/resolve function families Key: SPARK-34916 URL: https://issues.apache.org/jira/browse/SPARK-34916 Project: Spark

[jira] [Created] (SPARK-34915) Cache Maven, SBT and Scala in all jobs that use them

2021-03-30 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34915: Summary: Cache Maven, SBT and Scala in all jobs that use them Key: SPARK-34915 URL: https://issues.apache.org/jira/browse/SPARK-34915 Project: Spark Issue

[jira] [Assigned] (SPARK-34907) Add main class that runs all benchmarks

2021-03-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34907: Assignee: Hyukjin Kwon > Add main class that runs all benchmarks >

[jira] [Resolved] (SPARK-34907) Add main class that runs all benchmarks

2021-03-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34907. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32005

[jira] [Assigned] (SPARK-34908) Add test cases for char and varchar with functions

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34908: Assignee: Apache Spark > Add test cases for char and varchar with functions >

[jira] [Assigned] (SPARK-34908) Add test cases for char and varchar with functions

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34908: Assignee: (was: Apache Spark) > Add test cases for char and varchar with functions >

[jira] [Commented] (SPARK-34908) Add test cases for char and varchar with functions

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312035#comment-17312035 ] Apache Spark commented on SPARK-34908: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Updated] (SPARK-34912) Start spark shell to read file and report an error

2021-03-30 Thread czh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] czh updated SPARK-34912: Summary: Start spark shell to read file and report an error (was: 启动spark-shell读取文件报错) > Start spark shell to

[jira] [Updated] (SPARK-34913) Start spark shell to read file and report an error

2021-03-30 Thread czh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] czh updated SPARK-34913: Summary: Start spark shell to read file and report an error (was: 启动spark-shell读取文件报错) > Start spark shell to

[jira] [Updated] (SPARK-34913) 启动spark-shell读取文件报错

2021-03-30 Thread czh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] czh updated SPARK-34913: Description: Start spark shell to read external file and report an error Class org.apache.hadoop

[jira] [Updated] (SPARK-34912) 启动spark-shell读取文件报错

2021-03-30 Thread czh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] czh updated SPARK-34912: Description: Start spark shell to read external file and report an error   Class org.apache.hadoop

[jira] [Commented] (SPARK-34911) Fix code close issue in monitoring.md

2021-03-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312000#comment-17312000 ] Sean R. Owen commented on SPARK-34911: -- This could have just been a follow up to the other JIRA(s)

[jira] [Updated] (SPARK-34911) Fix code close issue in monitoring.md

2021-03-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34911: - Priority: Trivial (was: Major) > Fix code close issue in monitoring.md >

[jira] [Updated] (SPARK-34913) 启动spark-shell读取文件报错

2021-03-30 Thread czh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] czh updated SPARK-34913: Attachment: 微信截图_20210331110125.png > 启动spark-shell读取文件报错 > --- > > Key:

[jira] [Assigned] (SPARK-34914) Local scheduler backend support update token

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34914: Assignee: (was: Apache Spark) > Local scheduler backend support update token >

[jira] [Assigned] (SPARK-34914) Local scheduler backend support update token

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34914: Assignee: Apache Spark > Local scheduler backend support update token >

[jira] [Commented] (SPARK-34914) Local scheduler backend support update token

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311989#comment-17311989 ] Apache Spark commented on SPARK-34914: -- User 'ulysses-you' has created a pull request for this

[jira] [Created] (SPARK-34914) Local scheduler backend support update token

2021-03-30 Thread ulysses you (Jira)
ulysses you created SPARK-34914: --- Summary: Local scheduler backend support update token Key: SPARK-34914 URL: https://issues.apache.org/jira/browse/SPARK-34914 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34510) .foreachPartition command hangs when ran inside Python package but works when ran from Python file outside the package on EMR

2021-03-30 Thread Yuriy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311978#comment-17311978 ] Yuriy commented on SPARK-34510: --- Sean, the code is not actually performing any S3 operations, if you take

[jira] [Created] (SPARK-34913) 启动spark-shell读取文件报错

2021-03-30 Thread czh (Jira)
czh created SPARK-34913: --- Summary: 启动spark-shell读取文件报错 Key: SPARK-34913 URL: https://issues.apache.org/jira/browse/SPARK-34913 Project: Spark Issue Type: Bug Components: Spark Shell

[jira] [Created] (SPARK-34912) 启动spark-shell读取文件报错

2021-03-30 Thread czh (Jira)
czh created SPARK-34912: --- Summary: 启动spark-shell读取文件报错 Key: SPARK-34912 URL: https://issues.apache.org/jira/browse/SPARK-34912 Project: Spark Issue Type: Bug Components: Spark Shell

[jira] [Updated] (SPARK-34911) Fix code close issue in monitoring.md

2021-03-30 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-34911: -- Component/s: (was: SQL) Spark Core > Fix code close issue in monitoring.md >

[jira] [Commented] (SPARK-34911) Fix code close issue in monitoring.md

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311965#comment-17311965 ] Apache Spark commented on SPARK-34911: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34911) Fix code close issue in monitoring.md

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34911: Assignee: Apache Spark > Fix code close issue in monitoring.md >

[jira] [Commented] (SPARK-34911) Fix code close issue in monitoring.md

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311964#comment-17311964 ] Apache Spark commented on SPARK-34911: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34911) Fix code close issue in monitoring.md

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34911: Assignee: (was: Apache Spark) > Fix code close issue in monitoring.md >

[jira] [Created] (SPARK-34911) Fix code close issue in monitoring.md

2021-03-30 Thread angerszhu (Jira)
angerszhu created SPARK-34911: - Summary: Fix code close issue in monitoring.md Key: SPARK-34911 URL: https://issues.apache.org/jira/browse/SPARK-34911 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-33350) Add support to DiskBlockManager to create merge directory and to get the local shuffle merged data

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311942#comment-17311942 ] Apache Spark commented on SPARK-33350: -- User 'zhouyejoe' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33350) Add support to DiskBlockManager to create merge directory and to get the local shuffle merged data

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33350: Assignee: (was: Apache Spark) > Add support to DiskBlockManager to create merge

[jira] [Assigned] (SPARK-33350) Add support to DiskBlockManager to create merge directory and to get the local shuffle merged data

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33350: Assignee: Apache Spark > Add support to DiskBlockManager to create merge directory and

[jira] [Resolved] (SPARK-34795) Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34795. -- Fix Version/s: 3.2.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Assigned] (SPARK-34860) Multinomial Logistic Regression with intercept support centering

2021-03-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34860: Assignee: zhengruifeng > Multinomial Logistic Regression with intercept support

[jira] [Resolved] (SPARK-34860) Multinomial Logistic Regression with intercept support centering

2021-03-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34860. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31985

[jira] [Commented] (SPARK-34464) `first` function is sorting the dataset while sometimes it is used to get "any value"

2021-03-30 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311845#comment-17311845 ] Pablo Langa Blanco commented on SPARK-34464: Hi [~lfruleux], Here it's a link that explain

[jira] [Updated] (SPARK-34910) JDBC - Add an option for different stride orders

2021-03-30 Thread Jason Yarbrough (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Yarbrough updated SPARK-34910: Summary: JDBC - Add an option for different stride orders (was: Add an option for

[jira] [Created] (SPARK-34910) Add an option for different stride orders

2021-03-30 Thread Jason Yarbrough (Jira)
Jason Yarbrough created SPARK-34910: --- Summary: Add an option for different stride orders Key: SPARK-34910 URL: https://issues.apache.org/jira/browse/SPARK-34910 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism

2021-03-30 Thread Daniel Zhi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311818#comment-17311818 ] Daniel Zhi commented on SPARK-23977: [~ste...@apache.org] Thanks for the info. Below are the related

[jira] [Resolved] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-34906. --- Fix Version/s: 3.2.0 Assignee: Ali Afroozeh Resolution: Fixed >

[jira] [Commented] (SPARK-34909) conv() does not convert negative inputs to unsigned correctly

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311700#comment-17311700 ] Apache Spark commented on SPARK-34909: -- User 'timarmstrong' has created a pull request for this

[jira] [Assigned] (SPARK-34909) conv() does not convert negative inputs to unsigned correctly

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34909: Assignee: (was: Apache Spark) > conv() does not convert negative inputs to unsigned

[jira] [Assigned] (SPARK-34909) conv() does not convert negative inputs to unsigned correctly

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34909: Assignee: Apache Spark > conv() does not convert negative inputs to unsigned correctly >

[jira] [Commented] (SPARK-34909) conv() does not convert negative inputs to unsigned correctly

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311699#comment-17311699 ] Apache Spark commented on SPARK-34909: -- User 'timarmstrong' has created a pull request for this

[jira] [Created] (SPARK-34909) conv() does not convert negative inputs to unsigned correctly

2021-03-30 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-34909: - Summary: conv() does not convert negative inputs to unsigned correctly Key: SPARK-34909 URL: https://issues.apache.org/jira/browse/SPARK-34909 Project: Spark

[jira] [Updated] (SPARK-34908) Add test cases for char and varchar with functions

2021-03-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34908: - Priority: Minor (was: Major) > Add test cases for char and varchar with functions >

[jira] [Created] (SPARK-34908) Add test cases for char and varchar with functions

2021-03-30 Thread Kent Yao (Jira)
Kent Yao created SPARK-34908: Summary: Add test cases for char and varchar with functions Key: SPARK-34908 URL: https://issues.apache.org/jira/browse/SPARK-34908 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-34907) Add main class that runs all benchmarks

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34907: Assignee: (was: Apache Spark) > Add main class that runs all benchmarks >

[jira] [Assigned] (SPARK-34907) Add main class that runs all benchmarks

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34907: Assignee: Apache Spark > Add main class that runs all benchmarks >

[jira] [Commented] (SPARK-34907) Add main class that runs all benchmarks

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311643#comment-17311643 ] Apache Spark commented on SPARK-34907: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-31471) Add a script to run multiple benchmarks

2021-03-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31471. -- Resolution: Duplicate > Add a script to run multiple benchmarks >

[jira] [Created] (SPARK-34907) Add main class that runs all benchmarks

2021-03-30 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34907: Summary: Add main class that runs all benchmarks Key: SPARK-34907 URL: https://issues.apache.org/jira/browse/SPARK-34907 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34828) YARN Shuffle Service: Support configurability of aux service name and service-specific config overrides

2021-03-30 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-34828. --- Fix Version/s: 3.2.0 Assignee: Erik Krogen Resolution: Fixed > YARN Shuffle

[jira] [Updated] (SPARK-34900) Some `spark-submit`  commands used to run benchmarks in the user's guide is wrong

2021-03-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34900: - Fix Version/s: 3.0.3 3.1.2 > Some `spark-submit`  commands used to run

[jira] [Commented] (SPARK-32027) EventLoggingListener threw java.util.ConcurrentModificationException

2021-03-30 Thread Kristopher Kane (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311545#comment-17311545 ] Kristopher Kane commented on SPARK-32027: - Possibly related and fixed with 

[jira] [Comment Edited] (SPARK-34668) Support casting of day-time intervals to strings

2021-03-30 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311544#comment-17311544 ] angerszhu edited comment on SPARK-34668 at 3/30/21, 2:15 PM: - [~maxgekk]

[jira] [Commented] (SPARK-34668) Support casting of day-time intervals to strings

2021-03-30 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311544#comment-17311544 ] angerszhu commented on SPARK-34668: --- [~maxgekk] Should we support cast String to DayTimeIntervalType

[jira] [Updated] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34906: - Description: Spark query plan node hierarchy has specialized traits (or abstract classes) for

[jira] [Resolved] (SPARK-34899) Use origin plan if can not coalesce shuffle partition

2021-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34899. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31994

[jira] [Assigned] (SPARK-34899) Use origin plan if can not coalesce shuffle partition

2021-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34899: --- Assignee: ulysses you > Use origin plan if can not coalesce shuffle partition >

[jira] [Updated] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34906: - Description: Spark query plan node hierarchy has specialized traits (or abstract classes) for

[jira] [Updated] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34906: - Description: Spark query plan node hierarchy has specialized traits (or abstract classes) for

[jira] [Assigned] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34906: Assignee: (was: Apache Spark) > Refactor TreeNode's children handling methods into

[jira] [Assigned] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34906: Assignee: Apache Spark > Refactor TreeNode's children handling methods into specialized

[jira] [Commented] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311535#comment-17311535 ] Apache Spark commented on SPARK-34906: -- User 'dbaliafroozeh' has created a pull request for this

[jira] [Updated] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34906: - Description: Spark query plan node hierarchy has specialized traits (or abstract classes) for

[jira] [Created] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Ali Afroozeh (Jira)
Ali Afroozeh created SPARK-34906: Summary: Refactor TreeNode's children handling methods into specialized traits Key: SPARK-34906 URL: https://issues.apache.org/jira/browse/SPARK-34906 Project: Spark

[jira] [Updated] (SPARK-34906) Refactor TreeNode's children handling methods into specialized traits

2021-03-30 Thread Ali Afroozeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-34906: - Description: Spark query plan node hierarchy has specialized traits (or abstract classes) for

[jira] [Commented] (SPARK-34856) ANSI mode: Allow casting complex types as string type

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311508#comment-17311508 ] Apache Spark commented on SPARK-34856: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-34856) ANSI mode: Allow casting complex types as string type

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311506#comment-17311506 ] Apache Spark commented on SPARK-34856: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-26404) set spark.pyspark.python or PYSPARK_PYTHON doesn't work in k8s client-cluster mode.

2021-03-30 Thread Vincenzo Eduardo Padulano (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311505#comment-17311505 ] Vincenzo Eduardo Padulano commented on SPARK-26404: --- I found the same issue with this

[jira] [Resolved] (SPARK-33308) support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2021-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33308. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30212

[jira] [Resolved] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34884. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31984

[jira] [Assigned] (SPARK-34884) Improve dynamic partition pruning evaluation

2021-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34884: --- Assignee: Yuming Wang > Improve dynamic partition pruning evaluation >

[jira] [Assigned] (SPARK-33308) support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2021-03-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33308: --- Assignee: angerszhu > support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by

[jira] [Updated] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-03-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34905: - Description: Remove the following code from SQLQueryTestSuite: {code:java}

[jira] [Created] (SPARK-34905) Enable ANSI intervals in SQLQueryTestSuite

2021-03-30 Thread Max Gekk (Jira)
Max Gekk created SPARK-34905: Summary: Enable ANSI intervals in SQLQueryTestSuite Key: SPARK-34905 URL: https://issues.apache.org/jira/browse/SPARK-34905 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-34900) Some `spark-submit`  commands used to run benchmarks in the user's guide is wrong

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311424#comment-17311424 ] Apache Spark commented on SPARK-34900: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-34900) Some `spark-submit`  commands used to run benchmarks in the user's guide is wrong

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311423#comment-17311423 ] Apache Spark commented on SPARK-34900: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-34900) Some `spark-submit`  commands used to run benchmarks in the user's guide is wrong

2021-03-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311418#comment-17311418 ] Apache Spark commented on SPARK-34900: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-34904) Old import of LZ4 package inside CompressionCodec.scala

2021-03-30 Thread Michal Zeman (Jira)
Michal Zeman created SPARK-34904: Summary: Old import of LZ4 package inside CompressionCodec.scala Key: SPARK-34904 URL: https://issues.apache.org/jira/browse/SPARK-34904 Project: Spark

[jira] [Updated] (SPARK-34882) RewriteDistinctAggregates can cause a bug if the aggregator does not ignore NULLs

2021-03-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34882: - Affects Version/s: 3.0.3 3.1.2 2.4.8 >