[jira] [Commented] (SPARK-33527) Extend the function of decode so as consistent with mainstream databases

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237933#comment-17237933 ] Apache Spark commented on SPARK-33527: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-33527) Extend the function of decode so as consistent with mainstream databases

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237932#comment-17237932 ] Apache Spark commented on SPARK-33527: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33527) Extend the function of decode so as consistent with mainstream databases

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33527: Assignee: Apache Spark > Extend the function of decode so as consistent with mainstream

[jira] [Assigned] (SPARK-33527) Extend the function of decode so as consistent with mainstream databases

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33527: Assignee: (was: Apache Spark) > Extend the function of decode so as consistent with

[jira] [Updated] (SPARK-33527) Extend the function of decode so as consistent with mainstream databases

2020-11-23 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33527: --- Summary: Extend the function of decode so as consistent with mainstream databases (was: Extend the

[jira] [Updated] (SPARK-33527) Extend the function of decode

2020-11-23 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33527: --- Description: In Spark, decode(bin, charset) - Decodes the first argument using the second argument

[jira] [Created] (SPARK-33527) Extend the function of decode

2020-11-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33527: -- Summary: Extend the function of decode Key: SPARK-33527 URL: https://issues.apache.org/jira/browse/SPARK-33527 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-33526) Add config to control if cancel invoke interrupt task on thriftserver

2020-11-23 Thread ulysses you (Jira)
ulysses you created SPARK-33526: --- Summary: Add config to control if cancel invoke interrupt task on thriftserver Key: SPARK-33526 URL: https://issues.apache.org/jira/browse/SPARK-33526 Project: Spark

[jira] [Updated] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-23 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32221: Description: This would avoid failures, in case the files are a bit large or a user

[jira] [Commented] (SPARK-33501) Encoding is not working if multiLine option is true.

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237893#comment-17237893 ] Hyukjin Kwon commented on SPARK-33501: -- 2.3 is EOL. For 2.4, we could maybe think about it. You can

[jira] [Commented] (SPARK-33501) Encoding is not working if multiLine option is true.

2020-11-23 Thread Nilesh Patil (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237882#comment-17237882 ] Nilesh Patil commented on SPARK-33501: -- Yes In 3.0 its working. Is it possible to get fix in 2.3 or

[jira] [Commented] (SPARK-33501) Encoding is not working if multiLine option is true.

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237877#comment-17237877 ] Hyukjin Kwon commented on SPARK-33501: -- Can you try with Spark 3.0? > Encoding is not working if

[jira] [Updated] (SPARK-33501) Encoding is not working if multiLine option is true.

2020-11-23 Thread Nilesh Patil (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nilesh Patil updated SPARK-33501: - Affects Version/s: 2.4.3 > Encoding is not working if multiLine option is true. >

[jira] [Commented] (SPARK-33501) Encoding is not working if multiLine option is true.

2020-11-23 Thread Nilesh Patil (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237869#comment-17237869 ] Nilesh Patil commented on SPARK-33501: -- [~hyukjin.kwon] Please refer attached screen shot. with

[jira] [Updated] (SPARK-33501) Encoding is not working if multiLine option is true.

2020-11-23 Thread Nilesh Patil (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nilesh Patil updated SPARK-33501: - Attachment: Screenshot from 2020-11-24 10-27-17.png > Encoding is not working if multiLine

[jira] [Resolved] (SPARK-33523) Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33523. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30476

[jira] [Updated] (SPARK-33485) running spark application in kerbernetes,bug the application log shows yarn authentications

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33485: - Target Version/s: (was: 3.0.0) > running spark application in kerbernetes,bug the application

[jira] [Commented] (SPARK-33488) Re SPARK-21820. Creating Spark dataframe with carriage return/line feed leaves cr in multiline

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237855#comment-17237855 ] Hyukjin Kwon commented on SPARK-33488: -- In Spark now you can set lineSep option > Re SPARK-21820.

[jira] [Resolved] (SPARK-33488) Re SPARK-21820. Creating Spark dataframe with carriage return/line feed leaves cr in multiline

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33488. -- Resolution: Cannot Reproduce > Re SPARK-21820. Creating Spark dataframe with carriage

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237853#comment-17237853 ] Hyukjin Kwon commented on SPARK-33489: -- cc [~bryanc] FYI. Does Arrow support null type? > Support

[jira] [Resolved] (SPARK-33501) Encoding is not working if multiLine option is true.

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33501. -- Resolution: Cannot Reproduce > Encoding is not working if multiLine option is true. >

[jira] [Commented] (SPARK-33501) Encoding is not working if multiLine option is true.

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237851#comment-17237851 ] Hyukjin Kwon commented on SPARK-33501: -- I can't reproduce this: {code} scala>

[jira] [Updated] (SPARK-33501) Encoding is not working if multiLine option is true.

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33501: - Description: If we read with mulitLine true and encoding with "ISO-8859-1" then we are getting 

[jira] [Resolved] (SPARK-33508) Why the user can not assign other `key.deserializer` and why it should be alway `ByteArrayDeserializer`?

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33508. -- Resolution: Invalid Let's ask questions into mailing lists before filing it as an issue. See

[jira] [Assigned] (SPARK-33524) Change `InMemoryTable` not to use Tuple.hashCode for `BucketTransform`

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33524: - Assignee: Dongjoon Hyun > Change `InMemoryTable` not to use Tuple.hashCode for

[jira] [Resolved] (SPARK-33524) Change `InMemoryTable` not to use Tuple.hashCode for `BucketTransform`

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33524. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237823#comment-17237823 ] Apache Spark commented on SPARK-33525: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33525: Assignee: Apache Spark > Upgrade hive-service-rpc to 3.1.2 >

[jira] [Assigned] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33525: Assignee: (was: Apache Spark) > Upgrade hive-service-rpc to 3.1.2 >

[jira] [Commented] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237822#comment-17237822 ] Apache Spark commented on SPARK-33525: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237815#comment-17237815 ] Yuming Wang commented on SPARK-33525: - We should handle CLI_ODBC_KEYWORDS in SparkSQLCLIService to

[jira] [Created] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2

2020-11-23 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33525: --- Summary: Upgrade hive-service-rpc to 3.1.2 Key: SPARK-33525 URL: https://issues.apache.org/jira/browse/SPARK-33525 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-33524) Change `InMemoryTable` not to use Tuple.hashCode for `BucketTransform`

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33524: -- Summary: Change `InMemoryTable` not to use Tuple.hashCode for `BucketTransform` (was: Change

[jira] [Closed] (SPARK-33516) Upgrade Scala 2.13 from 2.13.3 to 2.13.4

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-33516. - > Upgrade Scala 2.13 from 2.13.3 to 2.13.4 > > >

[jira] [Resolved] (SPARK-33516) Upgrade Scala 2.13 from 2.13.3 to 2.13.4

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33516. --- Resolution: Duplicate > Upgrade Scala 2.13 from 2.13.3 to 2.13.4 >

[jira] [Updated] (SPARK-33513) Upgrade to Scala 2.13.4

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33513: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Upgrade to Scala

[jira] [Updated] (SPARK-33524) Change `BucketTransform` not to use Tuple.hashCode

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33524: -- Component/s: Tests > Change `BucketTransform` not to use Tuple.hashCode >

[jira] [Updated] (SPARK-33524) Change `BucketTransform` not to use Tuple.hashCode

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33524: -- Affects Version/s: 3.0.1 > Change `BucketTransform` not to use Tuple.hashCode >

[jira] [Updated] (SPARK-33524) Change `BucketTransform` not to use Tuple.hashCode

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33524: -- Summary: Change `BucketTransform` not to use Tuple.hashCode (was: Fix DataSourceV2SQLSuite

[jira] [Assigned] (SPARK-33513) Upgrade to Scala 2.13.4

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33513: - Assignee: Dongjoon Hyun > Upgrade to Scala 2.13.4 > --- > >

[jira] [Resolved] (SPARK-33513) Upgrade to Scala 2.13.4

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33513. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30455

[jira] [Assigned] (SPARK-33524) Fix DataSourceV2SQLSuite in Scala 2.13

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33524: Assignee: (was: Apache Spark) > Fix DataSourceV2SQLSuite in Scala 2.13 >

[jira] [Assigned] (SPARK-33524) Fix DataSourceV2SQLSuite in Scala 2.13

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33524: Assignee: Apache Spark > Fix DataSourceV2SQLSuite in Scala 2.13 >

[jira] [Commented] (SPARK-33524) Fix DataSourceV2SQLSuite in Scala 2.13

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237761#comment-17237761 ] Apache Spark commented on SPARK-33524: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33523) Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33523: Assignee: L. C. Hsieh (was: Apache Spark) > Add predicate related benchmark to

[jira] [Assigned] (SPARK-33523) Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33523: Assignee: Apache Spark (was: L. C. Hsieh) > Add predicate related benchmark to

[jira] [Commented] (SPARK-33523) Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237759#comment-17237759 ] Apache Spark commented on SPARK-33523: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-32808) Pass all `sql/core` module UTs in Scala 2.13

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237741#comment-17237741 ] Dongjoon Hyun commented on SPARK-32808: --- I filed SPARK-33524 . > Pass all `sql/core` module UTs

[jira] [Created] (SPARK-33524) Fix DataSourceV2SQLSuite in Scala 2.13

2020-11-23 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33524: - Summary: Fix DataSourceV2SQLSuite in Scala 2.13 Key: SPARK-33524 URL: https://issues.apache.org/jira/browse/SPARK-33524 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32808) Pass all `sql/core` module UTs in Scala 2.13

2020-11-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237740#comment-17237740 ] Dongjoon Hyun commented on SPARK-32808: --- `sql/core` module seems to be broken. I will file a new

[jira] [Created] (SPARK-33523) Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-23 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33523: --- Summary: Add predicate related benchmark to SubExprEliminationBenchmark Key: SPARK-33523 URL: https://issues.apache.org/jira/browse/SPARK-33523 Project: Spark

[jira] [Assigned] (SPARK-33522) Improve exception messages while handling UnresolvedTableOrView

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33522: Assignee: (was: Apache Spark) > Improve exception messages while handling

[jira] [Assigned] (SPARK-33522) Improve exception messages while handling UnresolvedTableOrView

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33522: Assignee: Apache Spark > Improve exception messages while handling UnresolvedTableOrView

[jira] [Commented] (SPARK-33522) Improve exception messages while handling UnresolvedTableOrView

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237709#comment-17237709 ] Apache Spark commented on SPARK-33522: -- User 'imback82' has created a pull request for this issue:

[jira] [Created] (SPARK-33522) Improve exception messages while handling UnresolvedTableOrView

2020-11-23 Thread Terry Kim (Jira)
Terry Kim created SPARK-33522: - Summary: Improve exception messages while handling UnresolvedTableOrView Key: SPARK-33522 URL: https://issues.apache.org/jira/browse/SPARK-33522 Project: Spark

[jira] [Assigned] (SPARK-32918) RPC implementation to support control plane coordination for push-based shuffle

2020-11-23 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-32918: --- Assignee: Ye Zhou > RPC implementation to support control plane

[jira] [Resolved] (SPARK-32918) RPC implementation to support control plane coordination for push-based shuffle

2020-11-23 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-32918. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request

[jira] [Commented] (SPARK-33521) Universal type conversion of V2 partition values

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237678#comment-17237678 ] Apache Spark commented on SPARK-33521: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33521) Universal type conversion of V2 partition values

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237677#comment-17237677 ] Apache Spark commented on SPARK-33521: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33521) Universal type conversion of V2 partition values

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33521: Assignee: Apache Spark > Universal type conversion of V2 partition values >

[jira] [Assigned] (SPARK-33521) Universal type conversion of V2 partition values

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33521: Assignee: (was: Apache Spark) > Universal type conversion of V2 partition values >

[jira] [Created] (SPARK-33521) Universal type conversion of V2 partition values

2020-11-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33521: -- Summary: Universal type conversion of V2 partition values Key: SPARK-33521 URL: https://issues.apache.org/jira/browse/SPARK-33521 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33519) Batch UDF in scala

2020-11-23 Thread Gaetan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaetan updated SPARK-33519: --- Description: Hello, Contrary to Python, there is only one type of Scala UDF, that let us define a Scala

[jira] [Assigned] (SPARK-33430) Support namespaces in JDBC v2 Table Catalog

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33430: Assignee: (was: Apache Spark) > Support namespaces in JDBC v2 Table Catalog >

[jira] [Commented] (SPARK-33430) Support namespaces in JDBC v2 Table Catalog

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237592#comment-17237592 ] Apache Spark commented on SPARK-33430: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33430) Support namespaces in JDBC v2 Table Catalog

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33430: Assignee: Apache Spark > Support namespaces in JDBC v2 Table Catalog >

[jira] [Updated] (SPARK-33519) Batch UDF in scala

2020-11-23 Thread Gaetan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaetan updated SPARK-33519: --- Description: Hello, Contrary to Python, there is only one type of Scala UDF, that let us define a Scala

[jira] [Updated] (SPARK-33519) Batch UDF in scala

2020-11-23 Thread Gaetan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaetan updated SPARK-33519: --- Issue Type: New Feature (was: Wish) > Batch UDF in scala > -- > > Key:

[jira] [Assigned] (SPARK-33520) make CrossValidator/TrainValidateSplit support Python backend estimator/model

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33520: Assignee: (was: Apache Spark) > make CrossValidator/TrainValidateSplit support

[jira] [Commented] (SPARK-33520) make CrossValidator/TrainValidateSplit support Python backend estimator/model

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237455#comment-17237455 ] Apache Spark commented on SPARK-33520: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-33520) make CrossValidator/TrainValidateSplit support Python backend estimator/model

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33520: Assignee: Apache Spark > make CrossValidator/TrainValidateSplit support Python backend

[jira] [Created] (SPARK-33520) make CrossValidator/TrainValidateSplit support Python backend estimator/model

2020-11-23 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-33520: -- Summary: make CrossValidator/TrainValidateSplit support Python backend estimator/model Key: SPARK-33520 URL: https://issues.apache.org/jira/browse/SPARK-33520 Project:

[jira] [Commented] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237449#comment-17237449 ] Apache Spark commented on SPARK-32221: -- User 'ScrapCodes' has created a pull request for this

[jira] [Commented] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237448#comment-17237448 ] Apache Spark commented on SPARK-32221: -- User 'ScrapCodes' has created a pull request for this

[jira] [Assigned] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32221: Assignee: (was: Apache Spark) > Avoid possible errors due to incorrect file size or

[jira] [Assigned] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32221: Assignee: Apache Spark > Avoid possible errors due to incorrect file size or type

[jira] [Commented] (SPARK-33495) jcl-over-slf4j conflicts with commons-logging.jar

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237403#comment-17237403 ] Apache Spark commented on SPARK-33495: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-33495) jcl-over-slf4j conflicts with commons-logging.jar

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33495: Assignee: (was: Apache Spark) > jcl-over-slf4j conflicts with commons-logging.jar >

[jira] [Assigned] (SPARK-33495) jcl-over-slf4j conflicts with commons-logging.jar

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33495: Assignee: Apache Spark > jcl-over-slf4j conflicts with commons-logging.jar >

[jira] [Commented] (SPARK-33495) jcl-over-slf4j conflicts with commons-logging.jar

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237402#comment-17237402 ] Apache Spark commented on SPARK-33495: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-33519) Batch UDF in scala

2020-11-23 Thread Gaetan (Jira)
Gaetan created SPARK-33519: -- Summary: Batch UDF in scala Key: SPARK-33519 URL: https://issues.apache.org/jira/browse/SPARK-33519 Project: Spark Issue Type: Wish Components: Optimizer,

[jira] [Updated] (SPARK-32792) Improve in filter pushdown for ParquetFilters

2020-11-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32792: Description: Support push down `GreaterThanOrEqual` minimum value and `LessThanOrEqual` maximum

[jira] [Commented] (SPARK-33479) Make apiKey of docsearch configurable

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237319#comment-17237319 ] Apache Spark commented on SPARK-33479: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-33479) Make apiKey of docsearch configurable

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237318#comment-17237318 ] Apache Spark commented on SPARK-33479: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-33518) Improve performance of ML ALS recommendForAll by GEMV

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237280#comment-17237280 ] Apache Spark commented on SPARK-33518: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-33518) Improve performance of ML ALS recommendForAll by GEMV

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33518: Assignee: (was: Apache Spark) > Improve performance of ML ALS recommendForAll by

[jira] [Commented] (SPARK-33518) Improve performance of ML ALS recommendForAll by GEMV

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237279#comment-17237279 ] Apache Spark commented on SPARK-33518: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-33518) Improve performance of ML ALS recommendForAll by GEMV

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33518: Assignee: Apache Spark > Improve performance of ML ALS recommendForAll by GEMV >

[jira] [Created] (SPARK-33518) Improve performance of ML ALS recommendForAll by GEMV

2020-11-23 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-33518: Summary: Improve performance of ML ALS recommendForAll by GEMV Key: SPARK-33518 URL: https://issues.apache.org/jira/browse/SPARK-33518 Project: Spark Issue

[jira] [Updated] (SPARK-33517) Incorrect menu item display and link in PySpark Usage Guide for Pandas with Apache Arrow

2020-11-23 Thread liucht-inspur (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liucht-inspur updated SPARK-33517: -- Attachment: image-2020-11-23-18-47-01-591.png > Incorrect menu item display and link in

[jira] [Updated] (SPARK-33517) Incorrect menu item display and link in PySpark Usage Guide for Pandas with Apache Arrow

2020-11-23 Thread liucht-inspur (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liucht-inspur updated SPARK-33517: -- Description: Error setting menu item and link, change "Apache Arrow in Spark" to "Apache

[jira] [Resolved] (SPARK-33511) Respect case sensitivity in resolving partition specs V2

2020-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33511. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30454

[jira] [Assigned] (SPARK-33511) Respect case sensitivity in resolving partition specs V2

2020-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33511: --- Assignee: Maxim Gekk > Respect case sensitivity in resolving partition specs V2 >

[jira] [Resolved] (SPARK-33515) Improve exception messages while handling UnresolvedTable

2020-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33515. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30461

[jira] [Assigned] (SPARK-33515) Improve exception messages while handling UnresolvedTable

2020-11-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33515: --- Assignee: Terry Kim > Improve exception messages while handling UnresolvedTable >

[jira] [Assigned] (SPARK-32481) Support truncate table to move the data to trash

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32481: Assignee: (was: Apache Spark) > Support truncate table to move the data to trash >

[jira] [Assigned] (SPARK-32481) Support truncate table to move the data to trash

2020-11-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32481: Assignee: Apache Spark > Support truncate table to move the data to trash >

[jira] [Reopened] (SPARK-32481) Support truncate table to move the data to trash

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-32481: -- Assignee: (was: Udbhav Agrawal) > Support truncate table to move the data to trash >

[jira] [Updated] (SPARK-32481) Support truncate table to move the data to trash

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32481: - Fix Version/s: (was: 3.1.0) > Support truncate table to move the data to trash >

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

2020-11-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237224#comment-17237224 ] Hyukjin Kwon commented on SPARK-32481: -- Reverted in https://github.com/apache/spark/pull/30463 >

  1   2   >