[jira] [Updated] (SPARK-29053) Sort does not work on some columns of WEBUI

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29053: -- Summary: Sort does not work on some columns of WEBUI (was: Spark Thrift JDBC/ODBC Server application

[jira] [Resolved] (SPARK-29099) org.apache.spark.sql.catalyst.catalog.CatalogTable.lastAccessTime is not set

[ https://issues.apache.org/jira/browse/SPARK-29099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-29099. -- Resolution: Duplicate > org.apache.spark.sql.catalyst.catalog.CatalogTable.lastAccessTime is n

[jira] [Updated] (SPARK-29053) Sort does not work on some columns of WEBUI

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29053: -- Description: Spark Thrift JDBC/ODBC Server application UI, *Sorting* is not working for *Duration* an

[jira] [Updated] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29053: -- Summary: Sort does not work on some columns (was: Sort does not work on some columns of WEBUI) > Sor

[jira] [Commented] (SPARK-28121) String Functions: decode/encode can not accept 'escape' and 'hex' as charset

[ https://issues.apache.org/jira/browse/SPARK-28121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934143#comment-16934143 ] jiaan.geng commented on SPARK-28121: I'm working on. > String Functions: decode/enc

[jira] [Updated] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29053: -- Description: Spark Thrift JDBC/ODBC Server application UI, *Sorting* is not working for *Duration* an

[jira] [Updated] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29053: -- Attachment: Duration_1.png > Sort does not work on some columns > -- >

[jira] [Updated] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29053: -- Attachment: ExecutionTime_1.png > Sort does not work on some columns > ---

[jira] [Updated] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29053: -- Description: Spark Thrift JDBC/ODBC Server application UI, *Sorting* is not working for *Duration* an

[jira] [Updated] (SPARK-29053) Sort does not work on some columns

[ https://issues.apache.org/jira/browse/SPARK-29053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29053: -- Description: Spark Thrift JDBC/ODBC Server application UI, *Sorting* is not working for *Duration* an

[jira] [Commented] (SPARK-29136) Flaky test: Kafka test suites - metadata not propagated

[ https://issues.apache.org/jira/browse/SPARK-29136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934184#comment-16934184 ] Gabor Somogyi commented on SPARK-29136: --- I've considered this possibility but afte

[jira] [Created] (SPARK-29187) Return null from `date_part()` for the null `field`

Maxim Gekk created SPARK-29187: -- Summary: Return null from `date_part()` for the null `field` Key: SPARK-29187 URL: https://issues.apache.org/jira/browse/SPARK-29187 Project: Spark Issue Type: S

[jira] [Commented] (SPARK-27936) Support local dependency uploading from --py-files

[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934227#comment-16934227 ] Stavros Kontopoulos commented on SPARK-27936: - Will create a PR shortly. >

[jira] [Resolved] (SPARK-28467) Flaky test: org.apache.spark.SparkContextSuite.test driver discovery under local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-28467. -- Resolution: Duplicate Somehow I created SPARK-29139 and submitted a patch. As this was resolve

[jira] [Issue Comment Deleted] (SPARK-27936) Support local dependency uploading from --py-files

[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-27936: Comment: was deleted (was: Will create a PR shortly.) > Support local dependency

[jira] [Created] (SPARK-29188) toPandas get wrong dtypes when applied on empty DF

Radhwane Chebaane created SPARK-29188: - Summary: toPandas get wrong dtypes when applied on empty DF Key: SPARK-29188 URL: https://issues.apache.org/jira/browse/SPARK-29188 Project: Spark

[jira] [Updated] (SPARK-29188) toPandas gets wrong dtypes when applied on empty DF

[ https://issues.apache.org/jira/browse/SPARK-29188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radhwane Chebaane updated SPARK-29188: -- Summary: toPandas gets wrong dtypes when applied on empty DF (was: toPandas get wrong

[jira] [Commented] (SPARK-29103) CheckAnalysis for data source V2 ALTER TABLE ignores case sensitivity

[ https://issues.apache.org/jira/browse/SPARK-29103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934368#comment-16934368 ] pralabhkumar commented on SPARK-29103: -- [~joseph.torres] In method  findNestedFiel

[jira] [Comment Edited] (SPARK-29122) Propagate all the SQL conf to executors in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-29122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934370#comment-16934370 ] Takeshi Yamamuro edited comment on SPARK-29122 at 9/20/19 12:44 PM: --

[jira] [Resolved] (SPARK-29122) Propagate all the SQL conf to executors in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-29122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-29122. -- Fix Version/s: 3.0.0 Target Version/s: 3.0.0 Assignee: Takeshi Yamam

[jira] [Created] (SPARK-29189) Add an option to ignore block locations when listing file

Wang, Gang created SPARK-29189: -- Summary: Add an option to ignore block locations when listing file Key: SPARK-29189 URL: https://issues.apache.org/jira/browse/SPARK-29189 Project: Spark Issue T

[jira] [Updated] (SPARK-29189) Add an option to ignore block locations when listing file

[ https://issues.apache.org/jira/browse/SPARK-29189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang, Gang updated SPARK-29189: --- Description: In our PROD env, we have a pure Spark cluster, I think this is also pretty common, whe

[jira] [Commented] (SPARK-29151) Support fraction resources for resource scheduling

[ https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934419#comment-16934419 ] Thomas Graves commented on SPARK-29151: --- To keep this simple for a design, I think

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934424#comment-16934424 ] Kevin Appel commented on SPARK-27169: - I have run into this similar issue before on

[jira] [Resolved] (SPARK-29062) Add V1_BATCH_WRITE to the TableCapabilityChecks in the Analyzer

[ https://issues.apache.org/jira/browse/SPARK-29062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29062. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25767 [https://gith

[jira] [Assigned] (SPARK-29062) Add V1_BATCH_WRITE to the TableCapabilityChecks in the Analyzer

[ https://issues.apache.org/jira/browse/SPARK-29062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29062: --- Assignee: Burak Yavuz > Add V1_BATCH_WRITE to the TableCapabilityChecks in the Analyzer > -

[jira] [Resolved] (SPARK-26338) Use scala-xml explicitly

[ https://issues.apache.org/jira/browse/SPARK-26338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26338. --- Resolution: Invalid Reopen if there is any detail here > Use scala-xml explicitly > ---

[jira] [Reopened] (SPARK-29082) Spark driver cannot start with only delegation tokens

[ https://issues.apache.org/jira/browse/SPARK-29082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-29082: --- Reopened because we had to revert it for now > Spark driver cannot start with only delegation tokens >

[jira] [Updated] (SPARK-29082) Spark driver cannot start with only delegation tokens

[ https://issues.apache.org/jira/browse/SPARK-29082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-29082: -- Fix Version/s: (was: 3.0.0) > Spark driver cannot start with only delegation tokens >

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934533#comment-16934533 ] Dongjoon Hyun commented on SPARK-29129: --- It was added initially for completeness.

[jira] [Updated] (SPARK-29151) Support fraction resources for task resource scheduling

[ https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-29151: -- Summary: Support fraction resources for task resource scheduling (was: Support fraction resou

[jira] [Updated] (SPARK-29151) Support fraction resources for task resource scheduling

[ https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-29151: -- Description: The current resource scheduling code for GPU/FPGA, etc only supports amounts as

[jira] [Commented] (SPARK-29151) Support fraction resources for task resource scheduling

[ https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934569#comment-16934569 ] Dongjoon Hyun commented on SPARK-29151: --- Thank you for the update! > Support frac

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934567#comment-16934567 ] shane knapp commented on SPARK-29129: - this seems reasonable to me given the circums

[jira] [Commented] (SPARK-29181) Cache preferred locations of checkpointed RDD

[ https://issues.apache.org/jira/browse/SPARK-29181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934575#comment-16934575 ] Dongjoon Hyun commented on SPARK-29181: --- Thanks~ :) > Cache preferred locations o

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934581#comment-16934581 ] Sean Owen commented on SPARK-29129: --- Oh, heh, we have a Hadoop 2 + JDK 11 build? I hav

[jira] [Created] (SPARK-29190) Optimize `extract`/`date_part` for the milliseconds `field`

Maxim Gekk created SPARK-29190: -- Summary: Optimize `extract`/`date_part` for the milliseconds `field` Key: SPARK-29190 URL: https://issues.apache.org/jira/browse/SPARK-29190 Project: Spark Issu

[jira] [Created] (SPARK-29191) Add tag ExtendedSQLTest for SQLQueryTestSuite

Dongjoon Hyun created SPARK-29191: - Summary: Add tag ExtendedSQLTest for SQLQueryTestSuite Key: SPARK-29191 URL: https://issues.apache.org/jira/browse/SPARK-29191 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934744#comment-16934744 ] Ashish commented on SPARK-19984: I faced the similar error. I am using spark 2.4. I am u

[jira] [Created] (SPARK-29192) Extend BenchmarkBase to write JDK9+ results separately

Dongjoon Hyun created SPARK-29192: - Summary: Extend BenchmarkBase to write JDK9+ results separately Key: SPARK-29192 URL: https://issues.apache.org/jira/browse/SPARK-29192 Project: Spark Issu

[jira] [Commented] (SPARK-28794) Document CREATE TABLE in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934752#comment-16934752 ] Xiao Li commented on SPARK-28794: - Any update on this? > Document CREATE TABLE in SQL R

[jira] [Commented] (SPARK-28800) Document REPAIR TABLE statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934754#comment-16934754 ] Xiao Li commented on SPARK-28800: - Any update? > Document REPAIR TABLE statement in SQL

[jira] [Commented] (SPARK-28827) Document SELECT CURRENT_DATABASE in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-28827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934756#comment-16934756 ] Xiao Li commented on SPARK-28827: - Any update? > Document SELECT CURRENT_DATABASE in SQ

[jira] [Resolved] (SPARK-28827) Document SELECT CURRENT_DATABASE in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-28827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28827. - Resolution: Invalid > Document SELECT CURRENT_DATABASE in SQL Reference > --

[jira] [Commented] (SPARK-28827) Document SELECT CURRENT_DATABASE in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-28827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934757#comment-16934757 ] Xiao Li commented on SPARK-28827: - CURRENT_DATABASE is just a function. We do not need t

[jira] [Resolved] (SPARK-28819) Document CREATE OR REPLACE FUNCTION in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-28819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28819. - Resolution: Duplicate They are duplicate.  > Document CREATE OR REPLACE FUNCTION in SQL Reference > ---

[jira] [Commented] (SPARK-28816) Document ADD JAR statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934760#comment-16934760 ] Xiao Li commented on SPARK-28816: - Any update? > Document ADD JAR statement in SQL Refe

[jira] [Updated] (SPARK-28683) Upgrade Scala to 2.12.10

[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28683: -- Parent: SPARK-24417 Issue Type: Sub-task (was: Improvement) > Upgrade Scala to 2.12.1

[jira] [Created] (SPARK-29193) Update fabric8 version to continue docker 4 desktop support

holdenk created SPARK-29193: --- Summary: Update fabric8 version to continue docker 4 desktop support Key: SPARK-29193 URL: https://issues.apache.org/jira/browse/SPARK-29193 Project: Spark Issue Type

[jira] [Updated] (SPARK-29193) Update fabric8 version to 4.3 continue docker 4 desktop support

[ https://issues.apache.org/jira/browse/SPARK-29193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-29193: Description: The current version of the kubernetes client we are using has some issues with not setting o

[jira] [Commented] (SPARK-29193) Update fabric8 version to 4.3 continue docker 4 desktop support

[ https://issues.apache.org/jira/browse/SPARK-29193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934795#comment-16934795 ] holdenk commented on SPARK-29193: - While I've only observed the issue on docker 4 deskto

[jira] [Commented] (SPARK-29193) Update fabric8 version to 4.3 continue docker 4 desktop support

[ https://issues.apache.org/jira/browse/SPARK-29193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934798#comment-16934798 ] holdenk commented on SPARK-29193: - My bad looks, like we fixed this in  SPARK-28921 >

[jira] [Resolved] (SPARK-29193) Update fabric8 version to 4.3 continue docker 4 desktop support

[ https://issues.apache.org/jira/browse/SPARK-29193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-29193. - Fix Version/s: 3.0.0 Resolution: Duplicate > Update fabric8 version to 4.3 continue docker 4 desk

[jira] [Commented] (SPARK-28772) Upgrade breeze to 1.0

[ https://issues.apache.org/jira/browse/SPARK-28772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934804#comment-16934804 ] Sean Owen commented on SPARK-28772: --- We should do this, and I'll open a PR, but it is

[jira] [Updated] (SPARK-28772) Upgrade breeze to 1.0

[ https://issues.apache.org/jira/browse/SPARK-28772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28772: -- Parent: (was: SPARK-25075) Issue Type: Task (was: Sub-task) > Upgrade breeze to 1.0 > ---

[jira] [Commented] (SPARK-28772) Upgrade breeze to 1.0

[ https://issues.apache.org/jira/browse/SPARK-28772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934806#comment-16934806 ] Sean Owen commented on SPARK-28772: --- Wait, no, I've made a mistake, misread this. We d

[jira] [Updated] (SPARK-28772) Upgrade breeze to 1.0

[ https://issues.apache.org/jira/browse/SPARK-28772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28772: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Task) > Upgrade breeze to 1.0 > --

[jira] [Created] (SPARK-29194) JDK11 QA

Dongjoon Hyun created SPARK-29194: - Summary: JDK11 QA Key: SPARK-29194 URL: https://issues.apache.org/jira/browse/SPARK-29194 Project: Spark Issue Type: Task Components: Build, Docu

[jira] [Updated] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

[ https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28900: -- Parent Issue: SPARK-29194 (was: SPARK-24417) > Test Pyspark, SparkR on JDK 11 with run-tests

[jira] [Updated] (SPARK-29192) Extend BenchmarkBase to write JDK9+ results separately

[ https://issues.apache.org/jira/browse/SPARK-29192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29192: -- Parent: SPARK-29194 Issue Type: Sub-task (was: Improvement) > Extend BenchmarkBase to

[jira] [Commented] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

[ https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934810#comment-16934810 ] Dongjoon Hyun commented on SPARK-28900: --- Hi, All. I moved this issue to SPARK-2919

[jira] [Resolved] (SPARK-24417) Build and Run Spark on JDK11

[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-24417. --- Fix Version/s: 3.0.0 Resolution: Fixed This issue is resolved and SPARK-29194 (JDK11

[jira] [Created] (SPARK-29195) Can't config orc.compress.size option for native ORC writer

Eric Sun created SPARK-29195: Summary: Can't config orc.compress.size option for native ORC writer Key: SPARK-29195 URL: https://issues.apache.org/jira/browse/SPARK-29195 Project: Spark Issue Ty

[jira] [Commented] (SPARK-28794) Document CREATE TABLE in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934815#comment-16934815 ] pavithra ramachandran commented on SPARK-28794: --- Yes... I raise a PR soon.

[jira] [Resolved] (SPARK-21045) Spark executor blocked instead of throwing exception because exception occur when python worker send exception info to PythonRDD in Python 2+

[ https://issues.apache.org/jira/browse/SPARK-21045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21045. -- Fix Version/s: 3.0.0 Assignee: Xianjin YE Resolution: Fixed Fixed at https://g

[jira] [Updated] (SPARK-29195) Can't config orc.compress.size option for native ORC writer

[ https://issues.apache.org/jira/browse/SPARK-29195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sun updated SPARK-29195: - Description:  Only codec can be effectively configured via code, but "orc.compress.size" or "orc.row.in

[jira] [Updated] (SPARK-29195) Can't config orc.compress.size option for native ORC writer

[ https://issues.apache.org/jira/browse/SPARK-29195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sun updated SPARK-29195: - Environment: Linux Java 1.8.0 was:Spark 2.3.0 > Can't config orc.compress.size option for native OR

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934822#comment-16934822 ] Dongjoon Hyun commented on SPARK-29129: --- Thank you all. Then, let's remove the fol

[jira] [Reopened] (SPARK-24417) Build and Run Spark on JDK11

[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-24417: --- > Build and Run Spark on JDK11 > > > Key: SPARK-244

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934823#comment-16934823 ] shane knapp commented on SPARK-29129: - i will happily continue to delete jobs! and

[jira] [Resolved] (SPARK-24417) Build and Run Spark on JDK11

[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-24417. --- Resolution: Done > Build and Run Spark on JDK11 > > >

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934825#comment-16934825 ] shane knapp commented on SPARK-29129: - all three have been deleted. > Test failure:

[jira] [Updated] (SPARK-29194) JDK11 QA

[ https://issues.apache.org/jira/browse/SPARK-29194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29194: -- Description: This issue aims to audit JDK11 like JDK8 in order to ensure all user perspective

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934826#comment-16934826 ] Dongjoon Hyun commented on SPARK-29129: --- Thank you, [~shaneknapp]. You are always

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934828#comment-16934828 ] shane knapp commented on SPARK-29129: - [~dongjoon] especially when it involves delet

[jira] [Created] (SPARK-29196) Add JDK11 support on document

Dongjoon Hyun created SPARK-29196: - Summary: Add JDK11 support on document Key: SPARK-29196 URL: https://issues.apache.org/jira/browse/SPARK-29196 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-29063) fillna support for joined table

[ https://issues.apache.org/jira/browse/SPARK-29063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29063. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25768 [https://gi

[jira] [Created] (SPARK-29197) Remove saveModeForDSV2 in DataFrameWriter

Burak Yavuz created SPARK-29197: --- Summary: Remove saveModeForDSV2 in DataFrameWriter Key: SPARK-29197 URL: https://issues.apache.org/jira/browse/SPARK-29197 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-28816) Document ADD JAR statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934830#comment-16934830 ] Huaxin Gao commented on SPARK-28816: Sorry, got sidetracked on something else. Will

[jira] [Commented] (SPARK-28800) Document REPAIR TABLE statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934831#comment-16934831 ] Huaxin Gao commented on SPARK-28800: Sorry, got sidetracked on something else. Will

[jira] [Assigned] (SPARK-29196) Add JDK11 support on document

[ https://issues.apache.org/jira/browse/SPARK-29196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29196: - Assignee: Dongjoon Hyun > Add JDK11 support on document > -

[jira] [Assigned] (SPARK-29192) Extend BenchmarkBase to write JDK9+ results separately

[ https://issues.apache.org/jira/browse/SPARK-29192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29192: - Assignee: Dongjoon Hyun > Extend BenchmarkBase to write JDK9+ results separately >

[jira] [Resolved] (SPARK-29196) Add JDK11 support on document

[ https://issues.apache.org/jira/browse/SPARK-29196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29196. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25875 [https://gi

[jira] [Assigned] (SPARK-29144) Binarizer handle sparse vectors incorrectly with negative threshold

[ https://issues.apache.org/jira/browse/SPARK-29144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-29144: - Assignee: zhengruifeng > Binarizer handle sparse vectors incorrectly with negative threshold >

[jira] [Resolved] (SPARK-29144) Binarizer handle sparse vectors incorrectly with negative threshold

[ https://issues.apache.org/jira/browse/SPARK-29144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-29144. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25829 [https://github.c

[jira] [Resolved] (SPARK-28937) Improve error reporting in Spark Secrets Test Suite

[ https://issues.apache.org/jira/browse/SPARK-28937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-28937. - Fix Version/s: 3.0.0 Resolution: Fixed > Improve error reporting in Spark Secrets Test Suite > --

[jira] [Resolved] (SPARK-28936) Simplify Spark K8s tests by replacing race condition during command execution

[ https://issues.apache.org/jira/browse/SPARK-28936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-28936. - Resolution: Fixed > Simplify Spark K8s tests by replacing race condition during command execution >

[jira] [Updated] (SPARK-28936) Simplify Spark K8s tests by replacing race condition during command execution

[ https://issues.apache.org/jira/browse/SPARK-28936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-28936: Fix Version/s: 3.0.0 > Simplify Spark K8s tests by replacing race condition during command execution > ---

[jira] [Resolved] (SPARK-27659) Allow PySpark toLocalIterator to prefetch data

[ https://issues.apache.org/jira/browse/SPARK-27659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-27659. - Fix Version/s: 3.0.0 Assignee: holdenk Resolution: Fixed > Allow PySpark toLocalIterator

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934882#comment-16934882 ] Jungtaek Lim commented on SPARK-29129: -- Thanks all for taking care of this! Maybe w

[jira] [Resolved] (SPARK-29192) Extend BenchmarkBase to write JDK9+ results separately

[ https://issues.apache.org/jira/browse/SPARK-29192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29192. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25873 [https://

[jira] [Created] (SPARK-29198) Thriftserver throw different exceptions when disabling spark.sql.hive.thriftServer.async

Yuming Wang created SPARK-29198: --- Summary: Thriftserver throw different exceptions when disabling spark.sql.hive.thriftServer.async Key: SPARK-29198 URL: https://issues.apache.org/jira/browse/SPARK-29198

[jira] [Commented] (SPARK-29198) Thriftserver throw different exceptions when disabling spark.sql.hive.thriftServer.async

[ https://issues.apache.org/jira/browse/SPARK-29198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934893#comment-16934893 ] Yuming Wang commented on SPARK-29198: - cc [~angerszhuuu] > Thriftserver throw diffe

[jira] [Assigned] (SPARK-29187) Return null from `date_part()` for the null `field`

[ https://issues.apache.org/jira/browse/SPARK-29187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29187: - Assignee: Maxim Gekk > Return null from `date_part()` for the null `field` > --

[jira] [Resolved] (SPARK-29187) Return null from `date_part()` for the null `field`

[ https://issues.apache.org/jira/browse/SPARK-29187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29187. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25865 [https://

[jira] [Resolved] (SPARK-28772) Upgrade breeze to 1.0

[ https://issues.apache.org/jira/browse/SPARK-28772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28772. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25874 [https://

[jira] [Assigned] (SPARK-28772) Upgrade breeze to 1.0

[ https://issues.apache.org/jira/browse/SPARK-28772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28772: - Assignee: Sean Owen > Upgrade breeze to 1.0 > - > >

[jira] [Created] (SPARK-29199) Add linters and license/dependency checkers to GitHub Action

Dongjoon Hyun created SPARK-29199: - Summary: Add linters and license/dependency checkers to GitHub Action Key: SPARK-29199 URL: https://issues.apache.org/jira/browse/SPARK-29199 Project: Spark

[jira] [Commented] (SPARK-29198) Thriftserver throw different exceptions when disabling spark.sql.hive.thriftServer.async

[ https://issues.apache.org/jira/browse/SPARK-29198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934940#comment-16934940 ] angerszhu commented on SPARK-29198: ---  It's Hive JDBC module's problem. ThriftServer wi

[jira] [Comment Edited] (SPARK-29198) Thriftserver throw different exceptions when disabling spark.sql.hive.thriftServer.async

[ https://issues.apache.org/jira/browse/SPARK-29198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934940#comment-16934940 ] angerszhu edited comment on SPARK-29198 at 9/21/19 5:57 AM:

  1   2   >