[jira] [Updated] (SPARK-29202) --driver-java-options are not passed to driver process in yarn client mode

[ https://issues.apache.org/jira/browse/SPARK-29202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta updated SPARK-29202: -- Description: Run the below command  ./bin/spark-sql --master yarn --driver-java-options="-ag

[jira] [Created] (SPARK-29202) --driver-java-options are not passed to driver process in yarn client mode

Sandeep Katta created SPARK-29202: - Summary: --driver-java-options are not passed to driver process in yarn client mode Key: SPARK-29202 URL: https://issues.apache.org/jira/browse/SPARK-29202 Project:

[jira] [Updated] (SPARK-29173) Benchmark JDK 11 performance with FilterPushdownBenchmark

[ https://issues.apache.org/jira/browse/SPARK-29173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29173: Parent: SPARK-29194 Issue Type: Sub-task (was: Task) > Benchmark JDK 11 performance with

[jira] [Commented] (SPARK-23710) Upgrade the built-in Hive to 2.3.5 for hadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935207#comment-16935207 ] Dongjoon Hyun commented on SPARK-23710: --- Hi, All. (Especially, [~yumwang]) Can you

[jira] [Comment Edited] (SPARK-23710) Upgrade the built-in Hive to 2.3.5 for hadoop-3.2

[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935207#comment-16935207 ] Dongjoon Hyun edited comment on SPARK-23710 at 9/22/19 4:24 AM: --

[jira] [Commented] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935206#comment-16935206 ] Dongjoon Hyun commented on SPARK-29180: --- That is not Apache Spark issue, [~sandeep

[jira] [Resolved] (SPARK-29190) Optimize `extract`/`date_part` for the milliseconds `field`

[ https://issues.apache.org/jira/browse/SPARK-29190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29190. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25871 [https://

[jira] [Assigned] (SPARK-29190) Optimize `extract`/`date_part` for the milliseconds `field`

[ https://issues.apache.org/jira/browse/SPARK-29190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29190: - Assignee: Maxim Gekk > Optimize `extract`/`date_part` for the milliseconds `field` > --

[jira] [Resolved] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta resolved SPARK-29180. --- Resolution: Invalid User requried to run hive-txn-schema-2.3.0.mysql.sql and hive-txn-schem

[jira] [Commented] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935202#comment-16935202 ] Dongjoon Hyun commented on SPARK-29180: --- Thank you for investigation, [~sandeep.ka

[jira] [Updated] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29180: -- Priority: Minor (was: Major) > drop database throws Exception >

[jira] [Commented] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935201#comment-16935201 ] Sandeep Katta commented on SPARK-29180: --- [~abhishek.akg] I have verified this afte

[jira] [Updated] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta updated SPARK-29180: -- Attachment: image-2019-09-22-09-32-57-532.png > drop database throws Exception >

[jira] [Commented] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935199#comment-16935199 ] Sandeep Katta commented on SPARK-29180: --- ahhh !!!, [~abhishek.akg] after you upgra

[jira] [Comment Edited] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935194#comment-16935194 ] Sandeep Katta edited comment on SPARK-29180 at 9/22/19 3:12 AM: --

[jira] [Comment Edited] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935194#comment-16935194 ] Sandeep Katta edited comment on SPARK-29180 at 9/22/19 3:11 AM: --

[jira] [Commented] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935194#comment-16935194 ] Sandeep Katta commented on SPARK-29180: --- [~dongjoon] I found the reason but thinki

[jira] [Updated] (SPARK-27686) Update migration guide

[ https://issues.apache.org/jira/browse/SPARK-27686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27686: -- Description: The built-in Hive 2.3 fixes the following issues: * HIVE-6727: Table level stats

[jira] [Updated] (SPARK-27686) Update migration guide

[ https://issues.apache.org/jira/browse/SPARK-27686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27686: -- Priority: Minor (was: Major) > Update migration guide > --- > >

[jira] [Commented] (SPARK-29180) drop database throws Exception

[ https://issues.apache.org/jira/browse/SPARK-29180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935186#comment-16935186 ] Dongjoon Hyun commented on SPARK-29180: --- Ping, [~sandeep.katta2007]. > drop datab

[jira] [Closed] (SPARK-27475) dev/deps/spark-deps-hadoop-3.2 is incorrect

[ https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-27475. - > dev/deps/spark-deps-hadoop-3.2 is incorrect > --- > >

[jira] [Resolved] (SPARK-27475) dev/deps/spark-deps-hadoop-3.2 is incorrect

[ https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27475. --- Resolution: Duplicate This is fixed in another JIRA issue's followup via https://github.com

[jira] [Commented] (SPARK-27177) Update jenkins locale to en_US.UTF-8

[ https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935182#comment-16935182 ] Dongjoon Hyun commented on SPARK-27177: --- Hi, All. I moved this out from SPARK-2371

[jira] [Updated] (SPARK-27177) Update jenkins locale to en_US.UTF-8

[ https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27177: -- Parent: (was: SPARK-29194) Issue Type: Bug (was: Sub-task) > Update jenkins local

[jira] [Updated] (SPARK-27177) Update jenkins locale to en_US.UTF-8

[ https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27177: -- Parent Issue: SPARK-29194 (was: SPARK-23710) > Update jenkins locale to en_US.UTF-8 > ---

[jira] [Commented] (SPARK-28704) Test backward compatibility on JDK9+ once we have a version supports JDK9+

[ https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935181#comment-16935181 ] Dongjoon Hyun commented on SPARK-28704: --- Hi, [~yumwang]. I moved this issue into `

[jira] [Updated] (SPARK-28704) Test backward compatibility on JDK9+ once we have a version supports JDK9+

[ https://issues.apache.org/jira/browse/SPARK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28704: -- Parent Issue: SPARK-29194 (was: SPARK-28684) > Test backward compatibility on JDK9+ once we h

[jira] [Commented] (SPARK-21492) Memory leak in SortMergeJoin

[ https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935176#comment-16935176 ] Min Shen commented on SPARK-21492: -- We also saw this issue happening in our cluster. B

[jira] [Created] (SPARK-29201) Add Hadoop 2.6 combination to GitHub Action

Dongjoon Hyun created SPARK-29201: - Summary: Add Hadoop 2.6 combination to GitHub Action Key: SPARK-29201 URL: https://issues.apache.org/jira/browse/SPARK-29201 Project: Spark Issue Type: Tas

[jira] [Updated] (SPARK-19147) Gracefully handle error in task after executor is stopped

[ https://issues.apache.org/jira/browse/SPARK-19147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19147: -- Summary: Gracefully handle error in task after executor is stopped (was: netty throw NPE) >

[jira] [Updated] (SPARK-19147) netty throw NPE

[ https://issues.apache.org/jira/browse/SPARK-19147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19147: -- Fix Version/s: 2.4.5 > netty throw NPE > --- > > Key: SPARK-19147

[jira] [Updated] (SPARK-19147) netty throw NPE

[ https://issues.apache.org/jira/browse/SPARK-19147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19147: -- Labels: (was: bulk-closed) > netty throw NPE > --- > > Key: SPAR

[jira] [Resolved] (SPARK-29121) Support Dot Product for Vectors

[ https://issues.apache.org/jira/browse/SPARK-29121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-29121. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25818 [https://github.c

[jira] [Assigned] (SPARK-29121) Support Dot Product for Vectors

[ https://issues.apache.org/jira/browse/SPARK-29121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-29121: - Assignee: Patrick Pisciuneri > Support Dot Product for Vectors > --

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935119#comment-16935119 ] Xiao Li commented on SPARK-29038: - Building it using parquet does not perform well for i

[jira] [Commented] (SPARK-28502) Error with struct conversion while using pandas_udf

[ https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935065#comment-16935065 ] Nasir Ali commented on SPARK-28502: --- any update? > Error with struct conversion while

[jira] [Resolved] (SPARK-29160) Event log file is written without specific charset which should be ideally UTF-8

[ https://issues.apache.org/jira/browse/SPARK-29160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29160. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25845 [https://gi

[jira] [Comment Edited] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935041#comment-16935041 ] Aman Omer edited comment on SPARK-29053 at 9/21/19 1:31 PM:

[jira] [Comment Edited] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935041#comment-16935041 ] Aman Omer edited comment on SPARK-29053 at 9/21/19 1:31 PM:

[jira] [Commented] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935041#comment-16935041 ] Aman Omer commented on SPARK-29053: --- Back-port to branch 2.4 by [https://github.com/ap

[jira] [Resolved] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-29053. --- Fix Version/s: 3.0.0 Assignee: Aman Omer Resolution: Fixed Resolved by https://githu

[jira] [Updated] (SPARK-19147) netty throw NPE

[ https://issues.apache.org/jira/browse/SPARK-19147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19147: -- Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > netty throw NPE > --

[jira] [Resolved] (SPARK-19147) netty throw NPE

[ https://issues.apache.org/jira/browse/SPARK-19147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19147. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25759 [https://github.c

[jira] [Assigned] (SPARK-19147) netty throw NPE

[ https://issues.apache.org/jira/browse/SPARK-19147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19147: - Assignee: Colin Ma > netty throw NPE > --- > > Key: SPARK-19147 >

[jira] [Created] (SPARK-29200) Optimize `extract`/`date_part` for epoch

Maxim Gekk created SPARK-29200: -- Summary: Optimize `extract`/`date_part` for epoch Key: SPARK-29200 URL: https://issues.apache.org/jira/browse/SPARK-29200 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-29140) Flaky test: org.apache.spark.sql.hive.execution.ObjectHashAggregateSuite.randomized aggregation test - [with partial + unsafe, with distinct] - with grouping keys

[ https://issues.apache.org/jira/browse/SPARK-29140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-29140. -- Fix Version/s: 3.0.0 Assignee: Jungtaek Lim Resolution: Fixed Resolved