[jira] [Assigned] (SPARK-34029) Add OrcEncryptionSuite and FakeKeyProvider

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34029: Assignee: (was: Apache Spark) > Add OrcEncryptionSuite and FakeKeyProvider >

[jira] [Assigned] (SPARK-34029) Add OrcEncryptionSuite and FakeKeyProvider

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34029: Assignee: Apache Spark > Add OrcEncryptionSuite and FakeKeyProvider >

[jira] [Updated] (SPARK-34029) Add OrcEncryptionSuite and FakeKeyProvider

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34029: -- Fix Version/s: (was: 3.2.0) > Add OrcEncryptionSuite and FakeKeyProvider >

[jira] [Reopened] (SPARK-34029) Add OrcEncryptionSuite and FakeKeyProvider

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-34029: --- Assignee: (was: Dongjoon Hyun) > Add OrcEncryptionSuite and FakeKeyProvider >

[jira] [Commented] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260284#comment-17260284 ] Dongjoon Hyun commented on SPARK-34037: --- Thanks for the clarification. In that case, this will

[jira] [Commented] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-06 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260280#comment-17260280 ] Chao Sun commented on SPARK-34039: -- I'll submit a patch for this soon. > [DSv2] ReplaceTable should

[jira] [Updated] (SPARK-34041) Miscellaneous cleanup for new PySpark documentation

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34041: - Parent: SPARK-31851 Issue Type: Sub-task (was: Documentation) > Miscellaneous cleanup

[jira] [Created] (SPARK-34041) Miscellaneous cleanup for new PySpark documentation

2021-01-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34041: Summary: Miscellaneous cleanup for new PySpark documentation Key: SPARK-34041 URL: https://issues.apache.org/jira/browse/SPARK-34041 Project: Spark Issue

[jira] [Commented] (SPARK-28123) String Functions: Add support btrim

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260271#comment-17260271 ] Apache Spark commented on SPARK-28123: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260270#comment-17260270 ] Kent Yao commented on SPARK-34037: -- Oh, I mean that when users query for 4 attributes, for example, we

[jira] [Assigned] (SPARK-28123) String Functions: Add support btrim

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28123: Assignee: (was: Apache Spark) > String Functions: Add support btrim >

[jira] [Commented] (SPARK-28123) String Functions: Add support btrim

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260268#comment-17260268 ] Apache Spark commented on SPARK-28123: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-28123) String Functions: Add support btrim

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28123: Assignee: Apache Spark > String Functions: Add support btrim >

[jira] [Commented] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260262#comment-17260262 ] Dongjoon Hyun commented on SPARK-34037: --- What do you mean by `messed up`, [~Qin Yao]? Do you mean

[jira] [Updated] (SPARK-34040) function runCliWithin of CliSuite can not cover some test cases

2021-01-06 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-34040: Description: Here is a test case(query contains '\n') which can not be covered by runCliWithin:

[jira] [Updated] (SPARK-34040) function runCliWithin of CliSuite can not cover some test cases

2021-01-06 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-34040: Description: Here is a test case(query contains two statements splitted by '\n') which can not be

[jira] [Updated] (SPARK-34040) function runCliWithin of CliSuite can not cover some test cases

2021-01-06 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-34040: Description: Here is a test case(query contains '\n') which can not be covered by runCliWithin:

[jira] [Created] (SPARK-34040) function runCliWithin of CliSuite can not cover some test cases

2021-01-06 Thread feiwang (Jira)
feiwang created SPARK-34040: --- Summary: function runCliWithin of CliSuite can not cover some test cases Key: SPARK-34040 URL: https://issues.apache.org/jira/browse/SPARK-34040 Project: Spark Issue

[jira] [Commented] (SPARK-34025) 【UI】JDBC/ODBC server shows -445 session(s) are online

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260249#comment-17260249 ] Hyukjin Kwon commented on SPARK-34025: -- Can you describe the steps to reproduce? > 【UI】JDBC/ODBC

[jira] [Created] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-06 Thread Chao Sun (Jira)
Chao Sun created SPARK-34039: Summary: [DSv2] ReplaceTable should invalidate cache Key: SPARK-34039 URL: https://issues.apache.org/jira/browse/SPARK-34039 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-34031) Union operator missing rowCount when enable CBO

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34031. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31068

[jira] [Assigned] (SPARK-34031) Union operator missing rowCount when enable CBO

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34031: Assignee: Yuming Wang > Union operator missing rowCount when enable CBO >

[jira] [Assigned] (SPARK-34028) Cleanup "unreachable code" compilation warnings

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34028: Assignee: Yang Jie > Cleanup "unreachable code" compilation warnings >

[jira] [Resolved] (SPARK-34028) Cleanup "unreachable code" compilation warnings

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34028. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31064

[jira] [Resolved] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte array

2021-01-06 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-33947. Resolution: Won't Fix > String functions: Trim/Ltrim/Rtrim support byte array >

[jira] [Commented] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte array

2021-01-06 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260239#comment-17260239 ] jiaan.geng commented on SPARK-33947: According to [~srowen]'s suggestion, We not need do this work.

[jira] [Commented] (SPARK-34016) SparkR not on CRAN (again)

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260237#comment-17260237 ] Hyukjin Kwon commented on SPARK-34016: -- This will probably be fixed in

[jira] [Assigned] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34021: Assignee: Hyukjin Kwon > Fix hyper links in SparkR documentation for CRAN submission >

[jira] [Resolved] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34021. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 31058

[jira] [Updated] (SPARK-34018) NPE in ExecutorPodsSnapshot

2021-01-06 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-34018: - Description: Currently the test (finishedExecutorWithRunningSidecar in test utils depends on

[jira] [Commented] (SPARK-34018) finishedExecutorWithRunningSidecar in test utils depends on nulls matching

2021-01-06 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260232#comment-17260232 ] Holden Karau commented on SPARK-34018: -- I think this could maybe happy in a production use case so

[jira] [Resolved] (SPARK-34036) Update ORC data source documentation

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34036. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31075

[jira] [Assigned] (SPARK-34036) Update ORC data source documentation

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34036: - Assignee: Dongjoon Hyun > Update ORC data source documentation >

[jira] [Commented] (SPARK-34007) Downgrade scala-maven-plugin to 4.3.0

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260216#comment-17260216 ] Hyukjin Kwon commented on SPARK-34007: -- Yeah, i was thinking that there might be a better way .. I

[jira] [Closed] (SPARK-34038) Automatically active aarch64 profile when build on Arm platform

2021-01-06 Thread Zhenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenyu Zheng closed SPARK-34038. already fixed > Automatically active aarch64 profile when build on Arm platform >

[jira] [Resolved] (SPARK-34038) Automatically active aarch64 profile when build on Arm platform

2021-01-06 Thread Zhenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenyu Zheng resolved SPARK-34038. -- Resolution: Duplicate > Automatically active aarch64 profile when build on Arm platform >

[jira] [Updated] (SPARK-34038) Automatically active aarch64 profile when build on Arm platform

2021-01-06 Thread Zhenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenyu Zheng updated SPARK-34038: - Description: The support of build on aarch64 platform was added in

[jira] [Created] (SPARK-34038) Automatically active aarch64 profile when build on Arm platform

2021-01-06 Thread Zhenyu Zheng (Jira)
Zhenyu Zheng created SPARK-34038: Summary: Automatically active aarch64 profile when build on Arm platform Key: SPARK-34038 URL: https://issues.apache.org/jira/browse/SPARK-34038 Project: Spark

[jira] [Commented] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

2021-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260198#comment-17260198 ] Hyukjin Kwon commented on SPARK-34012: -- Thanks! > Keep behavior consistent when conf >

[jira] [Updated] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34011: -- Fix Version/s: (was: 3.1.0) 3.1.1 > ALTER TABLE .. RENAME TO PARTITION

[jira] [Updated] (SPARK-34022) Support latest mkdocs in SQL functions doc

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34022: -- Fix Version/s: (was: 3.1.0) 3.1.1 > Support latest mkdocs in SQL

[jira] [Updated] (SPARK-33977) Add doc for "'like any' and 'like all' operators"

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33977: -- Fix Version/s: (was: 3.1.0) 3.1.1 > Add doc for "'like any' and 'like

[jira] [Commented] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260194#comment-17260194 ] Apache Spark commented on SPARK-34037: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Updated] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32221: -- Fix Version/s: (was: 3.1.0) 3.1.1 > Avoid possible errors due to

[jira] [Updated] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33948: -- Fix Version/s: (was: 3.1.0) 3.1.1 > ExpressionEncoderSuite failed in

[jira] [Assigned] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34037: Assignee: (was: Apache Spark) > aggOrder should not be output as a auxiliary

[jira] [Updated] (SPARK-33635) Performance regression in Kafka read

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33635: -- Fix Version/s: (was: 3.1.0) 3.1.1 > Performance regression in Kafka

[jira] [Assigned] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34037: Assignee: Apache Spark > aggOrder should not be output as a auxiliary internal attribute

[jira] [Commented] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260193#comment-17260193 ] Apache Spark commented on SPARK-34037: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Updated] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33029: -- Fix Version/s: (was: 3.1.0) 3.1.1 > Standalone mode blacklist

[jira] [Updated] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34012: -- Fix Version/s: (was: 3.1.0) 3.1.1 > Keep behavior consistent when conf

[jira] [Commented] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260191#comment-17260191 ] Dongjoon Hyun commented on SPARK-34012: --- I updated the version to 3.1.1 , [~hyukjin.kwon]. > Keep

[jira] [Commented] (SPARK-33874) Spark may report PodRunning if there is a sidecar that has not exited

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260190#comment-17260190 ] Dongjoon Hyun commented on SPARK-33874: --- I updated the version to 3.1.1 , [~hyukjin.kwon]. >

[jira] [Updated] (SPARK-33874) Spark may report PodRunning if there is a sidecar that has not exited

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33874: -- Fix Version/s: (was: 3.1.0) 3.1.1 > Spark may report PodRunning if

[jira] [Created] (SPARK-34037) aggOrder should not be output as a auxiliary internal attribute

2021-01-06 Thread Kent Yao (Jira)
Kent Yao created SPARK-34037: Summary: aggOrder should not be output as a auxiliary internal attribute Key: SPARK-34037 URL: https://issues.apache.org/jira/browse/SPARK-34037 Project: Spark

[jira] [Commented] (SPARK-32691) Update commons-crypto to v1.1.0

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260189#comment-17260189 ] Apache Spark commented on SPARK-32691: -- User 'huangtianhua' has created a pull request for this

[jira] [Commented] (SPARK-32691) Update commons-crypto to v1.1.0

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260188#comment-17260188 ] Apache Spark commented on SPARK-32691: -- User 'huangtianhua' has created a pull request for this

[jira] [Closed] (SPARK-34024) datasourceV1 VS dataSourceV2

2021-01-06 Thread Zhenglin luo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenglin luo closed SPARK-34024. > datasourceV1 VS dataSourceV2 > -- > > Key:

[jira] [Assigned] (SPARK-34030) Fold RepartitionExpression num partition should at Optimizer

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34030: Assignee: Apache Spark > Fold RepartitionExpression num partition should at Optimizer >

[jira] [Commented] (SPARK-34030) Fold RepartitionExpression num partition should at Optimizer

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260163#comment-17260163 ] Apache Spark commented on SPARK-34030: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-34030) Fold RepartitionExpression num partition should at Optimizer

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260162#comment-17260162 ] Apache Spark commented on SPARK-34030: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-34030) Fold RepartitionExpression num partition should at Optimizer

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34030: Assignee: (was: Apache Spark) > Fold RepartitionExpression num partition should at

[jira] [Commented] (SPARK-34029) Add OrcEncryptionSuite and FakeKeyProvider

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260148#comment-17260148 ] Apache Spark commented on SPARK-34029: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-33806) limit partition num to 1 when distributing by foldable expressions

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33806: -- Affects Version/s: (was: 3.0.1) (was: 3.1.0)

[jira] [Updated] (SPARK-33806) limit partition num to 1 when distributing by foldable expressions

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33806: -- Issue Type: Improvement (was: Bug) > limit partition num to 1 when distributing by foldable

[jira] [Assigned] (SPARK-34036) Update ORC data source documentation

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34036: Assignee: (was: Apache Spark) > Update ORC data source documentation >

[jira] [Assigned] (SPARK-34036) Update ORC data source documentation

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34036: Assignee: Apache Spark > Update ORC data source documentation >

[jira] [Commented] (SPARK-34036) Update ORC data source documentation

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260139#comment-17260139 ] Apache Spark commented on SPARK-34036: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-34036) Update ORC data source documentation

2021-01-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34036: - Summary: Update ORC data source documentation Key: SPARK-34036 URL: https://issues.apache.org/jira/browse/SPARK-34036 Project: Spark Issue Type:

[jira] [Created] (SPARK-34035) Refactor ScriptTransformation to remove input parameter and replace it by child.output

2021-01-06 Thread angerszhu (Jira)
angerszhu created SPARK-34035: - Summary: Refactor ScriptTransformation to remove input parameter and replace it by child.output Key: SPARK-34035 URL: https://issues.apache.org/jira/browse/SPARK-34035

[jira] [Commented] (SPARK-33806) limit partition num to 1 when distributing by foldable expressions

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260108#comment-17260108 ] Apache Spark commented on SPARK-33806: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-33806) limit partition num to 1 when distributing by foldable expressions

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260107#comment-17260107 ] Apache Spark commented on SPARK-33806: -- User 'ulysses-you' has created a pull request for this

[jira] [Updated] (SPARK-34033) SparkR Daemon Initialization

2021-01-06 Thread Tom Howland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Howland updated SPARK-34033: Description: Provide a way for users to initialize the sparkR daemon before it forks. I'm a

[jira] [Updated] (SPARK-34033) SparkR Daemon Initialization

2021-01-06 Thread Tom Howland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Howland updated SPARK-34033: Description: Provide a way for users to initialize the sparkR daemon before it forks. I'm a

[jira] [Commented] (SPARK-34034) "show create table" doesn't work for v2 table

2021-01-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260095#comment-17260095 ] Shixiong Zhu commented on SPARK-34034: -- NVM. I just realized `show create table` didn't return the

[jira] [Resolved] (SPARK-34034) "show create table" doesn't work for v2 table

2021-01-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-34034. -- Resolution: Not A Problem > "show create table" doesn't work for v2 table >

[jira] [Assigned] (SPARK-33995) Make datetime addition easier for years, weeks, hours, minutes, and seconds

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33995: Assignee: (was: Apache Spark) > Make datetime addition easier for years, weeks,

[jira] [Commented] (SPARK-33995) Make datetime addition easier for years, weeks, hours, minutes, and seconds

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260077#comment-17260077 ] Apache Spark commented on SPARK-33995: -- User 'MrPowers' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33995) Make datetime addition easier for years, weeks, hours, minutes, and seconds

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33995: Assignee: Apache Spark > Make datetime addition easier for years, weeks, hours, minutes,

[jira] [Updated] (SPARK-34034) "show create table" doesn't work for v2 table

2021-01-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-34034: - Description: I was QAing Spark 3.1.0 RC1 and found one regression: "show create table" doesn't

[jira] [Commented] (SPARK-34034) "show create table" doesn't work for v2 table

2021-01-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260061#comment-17260061 ] Shixiong Zhu commented on SPARK-34034: -- [~cloud_fan] > "show create table" doesn't work for v2

[jira] [Updated] (SPARK-34034) "show create table" doesn't work for v2 table

2021-01-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-34034: - Labels: regression (was: regresion) > "show create table" doesn't work for v2 table >

[jira] [Updated] (SPARK-34034) "show create table" doesn't work for v2 table

2021-01-06 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-34034: - Labels: regresion (was: ) > "show create table" doesn't work for v2 table >

[jira] [Created] (SPARK-34034) "show create table" doesn't work for v2 table

2021-01-06 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-34034: Summary: "show create table" doesn't work for v2 table Key: SPARK-34034 URL: https://issues.apache.org/jira/browse/SPARK-34034 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34029) Add OrcEncryptionSuite and FakeKeyProvider

2021-01-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34029. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31065

[jira] [Assigned] (SPARK-34033) SparkR Daemon Initialization

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34033: Assignee: (was: Apache Spark) > SparkR Daemon Initialization >

[jira] [Assigned] (SPARK-34033) SparkR Daemon Initialization

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34033: Assignee: Apache Spark > SparkR Daemon Initialization > > >

[jira] [Commented] (SPARK-34033) SparkR Daemon Initialization

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260047#comment-17260047 ] Apache Spark commented on SPARK-34033: -- User 'WamBamBoozle' has created a pull request for this

[jira] [Commented] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

2021-01-06 Thread Sachit Murarka (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260046#comment-17260046 ] Sachit Murarka commented on SPARK-31786: sure [~dongjoon]. Thanks a lot for response. >

[jira] [Created] (SPARK-34033) SparkR Daemon Initialization

2021-01-06 Thread Tom Howland (Jira)
Tom Howland created SPARK-34033: --- Summary: SparkR Daemon Initialization Key: SPARK-34033 URL: https://issues.apache.org/jira/browse/SPARK-34033 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-34018) finishedExecutorWithRunningSidecar in test utils depends on nulls matching

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34018: Assignee: Holden Karau (was: Apache Spark) > finishedExecutorWithRunningSidecar in test

[jira] [Commented] (SPARK-34018) finishedExecutorWithRunningSidecar in test utils depends on nulls matching

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260029#comment-17260029 ] Apache Spark commented on SPARK-34018: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34018) finishedExecutorWithRunningSidecar in test utils depends on nulls matching

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260030#comment-17260030 ] Apache Spark commented on SPARK-34018: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34018) finishedExecutorWithRunningSidecar in test utils depends on nulls matching

2021-01-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34018: Assignee: Apache Spark (was: Holden Karau) > finishedExecutorWithRunningSidecar in test

[jira] [Commented] (SPARK-34023) Updated to Kryo 5.0.3

2021-01-06 Thread Nick Nezis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260025#comment-17260025 ] Nick Nezis commented on SPARK-34023: Sean, another data point that might help the discussion. This

[jira] [Commented] (SPARK-34023) Updated to Kryo 5.0.3

2021-01-06 Thread Nick Nezis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260003#comment-17260003 ] Nick Nezis commented on SPARK-34023: One last small note that the Kryo developer posted shortly

[jira] [Comment Edited] (SPARK-34023) Updated to Kryo 5.0.3

2021-01-06 Thread Nick Nezis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259996#comment-17259996 ] Nick Nezis edited comment on SPARK-34023 at 1/6/21, 7:14 PM: - Good question.

[jira] [Comment Edited] (SPARK-34023) Updated to Kryo 5.0.3

2021-01-06 Thread Nick Nezis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259996#comment-17259996 ] Nick Nezis edited comment on SPARK-34023 at 1/6/21, 7:14 PM: - Good question.

[jira] [Resolved] (SPARK-34024) datasourceV1 VS dataSourceV2

2021-01-06 Thread Jacek Laskowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski resolved SPARK-34024. - Resolution: Invalid Please post questions to the u...@spark.apache.org mailing list or

[jira] [Commented] (SPARK-34023) Updated to Kryo 5.0.3

2021-01-06 Thread Nick Nezis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1725#comment-1725 ] Nick Nezis commented on SPARK-34023: In the same Google Groups

  1   2   >