[jira] [Commented] (SPARK-25594) OOM in long running applications even with UI disabled

[ https://issues.apache.org/jira/browse/SPARK-25594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150729#comment-17150729 ] Mridul Muralidharan commented on SPARK-25594: - Given regression in functionality if this is

[jira] [Resolved] (SPARK-25594) OOM in long running applications even with UI disabled

[ https://issues.apache.org/jira/browse/SPARK-25594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-25594. - Resolution: Won't Fix > OOM in long running applications even with UI disabled

[jira] [Created] (SPARK-32166) Metastore problem on Spark3.0 with Hive3.0

hzk created SPARK-32166: --- Summary: Metastore problem on Spark3.0 with Hive3.0 Key: SPARK-32166 URL: https://issues.apache.org/jira/browse/SPARK-32166 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

Xianjin YE created SPARK-32165: -- Summary: SessionState leaks SparkListener with multiple SparkSession Key: SPARK-32165 URL: https://issues.apache.org/jira/browse/SPARK-32165 Project: Spark

[jira] [Commented] (SPARK-32164) GeneralizedLinearRegressionSummary optimization

[ https://issues.apache.org/jira/browse/SPARK-32164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150692#comment-17150692 ] Apache Spark commented on SPARK-32164: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-32164) GeneralizedLinearRegressionSummary optimization

[ https://issues.apache.org/jira/browse/SPARK-32164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32164: Assignee: Apache Spark > GeneralizedLinearRegressionSummary optimization >

[jira] [Assigned] (SPARK-32164) GeneralizedLinearRegressionSummary optimization

[ https://issues.apache.org/jira/browse/SPARK-32164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32164: Assignee: (was: Apache Spark) > GeneralizedLinearRegressionSummary optimization >

[jira] [Created] (SPARK-32164) GeneralizedLinearRegressionSummary optimization

zhengruifeng created SPARK-32164: Summary: GeneralizedLinearRegressionSummary optimization Key: SPARK-32164 URL: https://issues.apache.org/jira/browse/SPARK-32164 Project: Spark Issue Type:

[jira] [Commented] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150690#comment-17150690 ] Apache Spark commented on SPARK-27194: -- User 'turboFei' has created a pull request for this issue:

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150689#comment-17150689 ] Apache Spark commented on SPARK-29302: -- User 'turboFei' has created a pull request for this issue:

[jira] [Commented] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150688#comment-17150688 ] Apache Spark commented on SPARK-27194: -- User 'turboFei' has created a pull request for this issue:

[jira] [Updated] (SPARK-32163) Nested pruning should still work for nested column extractors of attributes with cosmetic variations

[ https://issues.apache.org/jira/browse/SPARK-32163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32163: Issue Type: Bug (was: Improvement) > Nested pruning should still work for nested column

[jira] [Assigned] (SPARK-32163) Nested pruning should still work for nested column extractors of attributes with cosmetic variations

[ https://issues.apache.org/jira/browse/SPARK-32163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32163: Assignee: Apache Spark (was: L. C. Hsieh) > Nested pruning should still work for nested

[jira] [Commented] (SPARK-32163) Nested pruning should still work for nested column extractors of attributes with cosmetic variations

[ https://issues.apache.org/jira/browse/SPARK-32163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150678#comment-17150678 ] Apache Spark commented on SPARK-32163: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32163) Nested pruning should still work for nested column extractors of attributes with cosmetic variations

[ https://issues.apache.org/jira/browse/SPARK-32163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32163: Assignee: L. C. Hsieh (was: Apache Spark) > Nested pruning should still work for nested

[jira] [Created] (SPARK-32163) Nested pruning should still work for nested column extractors of attributes with cosmetic variations

L. C. Hsieh created SPARK-32163: --- Summary: Nested pruning should still work for nested column extractors of attributes with cosmetic variations Key: SPARK-32163 URL:

[jira] [Commented] (SPARK-32162) Improve Pandas Grouped Map with Window test output

[ https://issues.apache.org/jira/browse/SPARK-32162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150673#comment-17150673 ] Apache Spark commented on SPARK-32162: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-32162) Improve Pandas Grouped Map with Window test output

[ https://issues.apache.org/jira/browse/SPARK-32162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32162: Assignee: Apache Spark > Improve Pandas Grouped Map with Window test output >

[jira] [Assigned] (SPARK-32162) Improve Pandas Grouped Map with Window test output

[ https://issues.apache.org/jira/browse/SPARK-32162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32162: Assignee: (was: Apache Spark) > Improve Pandas Grouped Map with Window test output >

[jira] [Created] (SPARK-32162) Improve Pandas Grouped Map with Window test output

Bryan Cutler created SPARK-32162: Summary: Improve Pandas Grouped Map with Window test output Key: SPARK-32162 URL: https://issues.apache.org/jira/browse/SPARK-32162 Project: Spark Issue

[jira] [Created] (SPARK-32161) Hide JVM traceback for SparkUpgradeException

Hyukjin Kwon created SPARK-32161: Summary: Hide JVM traceback for SparkUpgradeException Key: SPARK-32161 URL: https://issues.apache.org/jira/browse/SPARK-32161 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150634#comment-17150634 ] Apache Spark commented on SPARK-32160: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32160: Assignee: Apache Spark > Executors should not be able to create SparkContext. >

[jira] [Assigned] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32160: Assignee: (was: Apache Spark) > Executors should not be able to create SparkContext.

[jira] [Commented] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150633#comment-17150633 ] Apache Spark commented on SPARK-32160: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-32160) Executors should not be able to create SparkContext.

Takuya Ueshin created SPARK-32160: - Summary: Executors should not be able to create SparkContext. Key: SPARK-32160 URL: https://issues.apache.org/jira/browse/SPARK-32160 Project: Spark Issue

[jira] [Commented] (SPARK-31666) Cannot map hostPath volumes to container

[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150622#comment-17150622 ] Dongjoon Hyun commented on SPARK-31666: --- So, "Cannot map hostPath volumes to container" is a wrong

[jira] [Resolved] (SPARK-31666) Cannot map hostPath volumes to container

[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31666. --- Resolution: Not A Problem > Cannot map hostPath volumes to container >

[jira] [Commented] (SPARK-31666) Cannot map hostPath volumes to container

[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150621#comment-17150621 ] Dongjoon Hyun commented on SPARK-31666: --- Hi, [~hopper-signifyd]. I found what is going on there.

[jira] [Commented] (SPARK-25262) Support tmpfs for local dirs in k8s

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150605#comment-17150605 ] Apache Spark commented on SPARK-25262: -- User 'hopper-signifyd' has created a pull request for this

[jira] [Comment Edited] (SPARK-31666) Cannot map hostPath volumes to container

[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150601#comment-17150601 ] Dongjoon Hyun edited comment on SPARK-31666 at 7/2/20, 9:50 PM: I linked 

[jira] [Commented] (SPARK-31666) Cannot map hostPath volumes to container

[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150601#comment-17150601 ] Dongjoon Hyun commented on SPARK-31666: --- I linked SPARK-23529 since `hostPath` is added there. >

[jira] [Commented] (SPARK-31666) Cannot map hostPath volumes to container

[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150599#comment-17150599 ] Dongjoon Hyun commented on SPARK-31666: --- FYI, Apache Spark 2.4.0 was released at November 2, 2018.

[jira] [Assigned] (SPARK-32158) Add JSONOptions to toJSON

[ https://issues.apache.org/jira/browse/SPARK-32158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32158: Assignee: Apache Spark > Add JSONOptions to toJSON > - > >

[jira] [Assigned] (SPARK-32158) Add JSONOptions to toJSON

[ https://issues.apache.org/jira/browse/SPARK-32158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32158: Assignee: (was: Apache Spark) > Add JSONOptions to toJSON >

[jira] [Updated] (SPARK-32158) Add JSONOptions to toJSON

[ https://issues.apache.org/jira/browse/SPARK-32158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] German Schiavon Matteo updated SPARK-32158: --- Description: Actually when calling `toJSON` on a dataFrame with null

[jira] [Commented] (SPARK-32158) Add JSONOptions to toJSON

[ https://issues.apache.org/jira/browse/SPARK-32158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150598#comment-17150598 ] Apache Spark commented on SPARK-32158: -- User 'Gschiavon' has created a pull request for this issue:

[jira] [Commented] (SPARK-31666) Cannot map hostPath volumes to container

[ https://issues.apache.org/jira/browse/SPARK-31666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150596#comment-17150596 ] Dongjoon Hyun commented on SPARK-31666: --- Apache Spark 3.0.0 is released last month and Apache

[jira] [Commented] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

[ https://issues.apache.org/jira/browse/SPARK-32159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150593#comment-17150593 ] Dongjoon Hyun commented on SPARK-32159: --- Hi, [~eje]. Shall we set `Target Version` to `3.0.1`? >

[jira] [Commented] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

[ https://issues.apache.org/jira/browse/SPARK-32159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150591#comment-17150591 ] Apache Spark commented on SPARK-32159: -- User 'erikerlandson' has created a pull request for this

[jira] [Assigned] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

[ https://issues.apache.org/jira/browse/SPARK-32159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32159: Assignee: Apache Spark > New udaf(Aggregator) has an integration bug with

[jira] [Commented] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

[ https://issues.apache.org/jira/browse/SPARK-32159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150590#comment-17150590 ] Apache Spark commented on SPARK-32159: -- User 'erikerlandson' has created a pull request for this

[jira] [Assigned] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

[ https://issues.apache.org/jira/browse/SPARK-32159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32159: Assignee: (was: Apache Spark) > New udaf(Aggregator) has an integration bug with

[jira] [Commented] (SPARK-32130) Spark 3.0 json load performance is unacceptable in comparison of Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-32130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150566#comment-17150566 ] Apache Spark commented on SPARK-32130: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-32130) Spark 3.0 json load performance is unacceptable in comparison of Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-32130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150565#comment-17150565 ] Apache Spark commented on SPARK-32130: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150535#comment-17150535 ] Maxim Gekk commented on SPARK-31579: [~suddhuASF] Please, open a PR for master. > Replace floorDiv

[jira] [Commented] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150523#comment-17150523 ] Sudharshann D. commented on SPARK-31579: Hey [~maxgekk]. friendly ping once again! > Replace

[jira] [Updated] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

[ https://issues.apache.org/jira/browse/SPARK-32159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson updated SPARK-32159: --- Description: The new user defined aggregator feature (SPARK-27296) based on calling

[jira] [Updated] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

[ https://issues.apache.org/jira/browse/SPARK-32159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson updated SPARK-32159: --- Description: The new user defined aggregator feature (SPARK-27296) based on calling

[jira] [Commented] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

[ https://issues.apache.org/jira/browse/SPARK-32159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150490#comment-17150490 ] Erik Erlandson commented on SPARK-32159: cc [~cloud_fan] > New udaf(Aggregator) has an

[jira] [Updated] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

[ https://issues.apache.org/jira/browse/SPARK-32159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson updated SPARK-32159: --- Description: The new user defined aggregator feature (SPARK-27296) based on calling

[jira] [Created] (SPARK-32159) New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization

Erik Erlandson created SPARK-32159: -- Summary: New udaf(Aggregator) has an integration bug with UnresolvedMapObjects serialization Key: SPARK-32159 URL: https://issues.apache.org/jira/browse/SPARK-32159

[jira] [Created] (SPARK-32158) Add JSONOptions to toJSON

German Schiavon Matteo created SPARK-32158: -- Summary: Add JSONOptions to toJSON Key: SPARK-32158 URL: https://issues.apache.org/jira/browse/SPARK-32158 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-32156) Refactor two similar test cases from SPARK-31061 in HiveExternalCatalogSuite

[ https://issues.apache.org/jira/browse/SPARK-32156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32156. --- Fix Version/s: (was: 3.0.0) 3.1.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-32156) Refactor two similar test cases from SPARK-31061 in HiveExternalCatalogSuite

[ https://issues.apache.org/jira/browse/SPARK-32156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32156: - Assignee: JinxinTang > Refactor two similar test cases from SPARK-31061 in

[jira] [Closed] (SPARK-32157) Integer overflow when constructing large query plan string

[ https://issues.apache.org/jira/browse/SPARK-32157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis closed SPARK-32157. -- > Integer overflow when constructing large query plan string >

[jira] [Resolved] (SPARK-32157) Integer overflow when constructing large query plan string

[ https://issues.apache.org/jira/browse/SPARK-32157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis resolved SPARK-32157. Resolution: Duplicate > Integer overflow when constructing large query plan string >

[jira] [Commented] (SPARK-30132) Scala 2.13 compile errors from Hadoop LocalFileSystem subclasses

[ https://issues.apache.org/jira/browse/SPARK-30132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150387#comment-17150387 ] Dongjoon Hyun commented on SPARK-30132: --- Nice! Thanks! > Scala 2.13 compile errors from Hadoop

[jira] [Created] (SPARK-32157) Integer overflow when constructing large query plan string

Tanel Kiis created SPARK-32157: -- Summary: Integer overflow when constructing large query plan string Key: SPARK-32157 URL: https://issues.apache.org/jira/browse/SPARK-32157 Project: Spark

[jira] [Resolved] (SPARK-31100) Detect namespace existence when setting namespace

[ https://issues.apache.org/jira/browse/SPARK-31100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31100. - Fix Version/s: 3.1.0 Assignee: Jackey Lee Resolution: Fixed > Detect namespace

[jira] [Commented] (SPARK-25433) Add support for PEX in PySpark

[ https://issues.apache.org/jira/browse/SPARK-25433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150298#comment-17150298 ] Hyukjin Kwon commented on SPARK-25433: -- [~fhoering], I plan to redesign the PySpark documentation

[jira] [Updated] (SPARK-32156) Refactor two similar test cases from SPARK-31061 in HiveExternalCatalogSuite

[ https://issues.apache.org/jira/browse/SPARK-32156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32156: - Summary: Refactor two similar test cases from SPARK-31061 in HiveExternalCatalogSuite (was:

[jira] [Assigned] (SPARK-32121) ExternalShuffleBlockResolverSuite failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-32121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32121: Assignee: Cheng Pan > ExternalShuffleBlockResolverSuite failed on Windows >

[jira] [Resolved] (SPARK-32121) ExternalShuffleBlockResolverSuite failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-32121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32121. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-31061) Impossible to change the provider of a table in the HiveMetaStore

[ https://issues.apache.org/jira/browse/SPARK-31061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150154#comment-17150154 ] Apache Spark commented on SPARK-31061: -- User 'TJX2014' has created a pull request for this issue:

[jira] [Commented] (SPARK-31061) Impossible to change the provider of a table in the HiveMetaStore

[ https://issues.apache.org/jira/browse/SPARK-31061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150157#comment-17150157 ] Apache Spark commented on SPARK-31061: -- User 'TJX2014' has created a pull request for this issue:

[jira] [Commented] (SPARK-31061) Impossible to change the provider of a table in the HiveMetaStore

[ https://issues.apache.org/jira/browse/SPARK-31061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150155#comment-17150155 ] Apache Spark commented on SPARK-31061: -- User 'TJX2014' has created a pull request for this issue:

[jira] [Commented] (SPARK-31061) Impossible to change the provider of a table in the HiveMetaStore

[ https://issues.apache.org/jira/browse/SPARK-31061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150156#comment-17150156 ] Apache Spark commented on SPARK-31061: -- User 'TJX2014' has created a pull request for this issue:

[jira] [Commented] (SPARK-32156) SPARK-31061 has two very similar tests could merge and somewhere could be improved

[ https://issues.apache.org/jira/browse/SPARK-32156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150153#comment-17150153 ] Apache Spark commented on SPARK-32156: -- User 'TJX2014' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32156) SPARK-31061 has two very similar tests could merge and somewhere could be improved

[ https://issues.apache.org/jira/browse/SPARK-32156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32156: Assignee: Apache Spark > SPARK-31061 has two very similar tests could merge and

[jira] [Assigned] (SPARK-32156) SPARK-31061 has two very similar tests could merge and somewhere could be improved

[ https://issues.apache.org/jira/browse/SPARK-32156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32156: Assignee: (was: Apache Spark) > SPARK-31061 has two very similar tests could merge

[jira] [Commented] (SPARK-32156) SPARK-31061 has two very similar tests could merge and somewhere could be improved

[ https://issues.apache.org/jira/browse/SPARK-32156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150150#comment-17150150 ] Apache Spark commented on SPARK-32156: -- User 'TJX2014' has created a pull request for this issue:

[jira] [Created] (SPARK-32156) SPARK-31061 has two very similar tests could merge and somewhere could be improved

JinxinTang created SPARK-32156: -- Summary: SPARK-31061 has two very similar tests could merge and somewhere could be improved Key: SPARK-32156 URL: https://issues.apache.org/jira/browse/SPARK-32156

[jira] [Commented] (SPARK-32154) Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150133#comment-17150133 ] Apache Spark commented on SPARK-32154: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32154) Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32154: Assignee: Apache Spark > Use ExpressionEncoder for the return type of ScalaUDF to

[jira] [Assigned] (SPARK-32154) Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32154: Assignee: (was: Apache Spark) > Use ExpressionEncoder for the return type of

[jira] [Commented] (SPARK-32154) Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150132#comment-17150132 ] Apache Spark commented on SPARK-32154: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Updated] (SPARK-32155) Provide options for offset-based semantics when using structured streaming from a file stream source

[ https://issues.apache.org/jira/browse/SPARK-32155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Highman updated SPARK-32155: Description: Implement the following options while performing structured

[jira] [Created] (SPARK-32155) Provide options for offset-based semantics when using structured streaming from a file stream source

Christopher Highman created SPARK-32155: --- Summary: Provide options for offset-based semantics when using structured streaming from a file stream source Key: SPARK-32155 URL:

[jira] [Updated] (SPARK-32154) Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-32154: - Summary: Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type (was: Use

[jira] [Updated] (SPARK-32154) Use ExpressionEncoder for the return type of ScalaUDF to serialize to catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-32154: - Summary: Use ExpressionEncoder for the return type of ScalaUDF to serialize to catalyst type (was: Use

[jira] [Created] (SPARK-32154) Use ExpressionEncoder to serialize to catalyst type for the return type of ScalaUDF

wuyi created SPARK-32154: Summary: Use ExpressionEncoder to serialize to catalyst type for the return type of ScalaUDF Key: SPARK-32154 URL: https://issues.apache.org/jira/browse/SPARK-32154 Project: Spark

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Description: Build task on Jenkins-worker4 often fails with dependency problem.

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Description: Build task on Jenkins-worker4 often fails with dependency problem.

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Description: Build task on Jenkins-worker4 often fails with dependency problem.

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Description: Build task on Jenkins-worker4 often fails with dependency problem.

[jira] [Commented] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150048#comment-17150048 ] Kousuke Saruta commented on SPARK-32153: [~shaneknapp] Could you look into this? > .m2

[jira] [Updated] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32153: --- Issue Type: Bug (was: Improvement) > .m2 repository corruption can happen on

[jira] [Updated] (SPARK-32152) ./bin/spark-sql got error with reading hive metastore

[ https://issues.apache.org/jira/browse/SPARK-32152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jung bak updated SPARK-32152: - Description: 1. Fist of all, I built Spark3.0.0 from source with below command. {quote}{{./build/mvn 

[jira] [Created] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

Kousuke Saruta created SPARK-32153: -- Summary: .m2 repository corruption can happen on Jenkins-worker4 Key: SPARK-32153 URL: https://issues.apache.org/jira/browse/SPARK-32153 Project: Spark

[jira] [Created] (SPARK-32152) ./bin/spark-sql got error with reading hive metastore

jung bak created SPARK-32152: Summary: ./bin/spark-sql got error with reading hive metastore Key: SPARK-32152 URL: https://issues.apache.org/jira/browse/SPARK-32152 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32148) LEFT JOIN generating non-deterministic and unexpected result (regression in Spark 3.0)

[ https://issues.apache.org/jira/browse/SPARK-32148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149960#comment-17149960 ] Michael commented on SPARK-32148: - [~kabhwan] thanks a lot for taking care of this so fast! After the

[jira] [Commented] (SPARK-32148) LEFT JOIN generating non-deterministic and unexpected result (regression in Spark 3.0)

[ https://issues.apache.org/jira/browse/SPARK-32148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149948#comment-17149948 ] Jungtaek Lim commented on SPARK-32148: -- Just submitted a fix. Unfortunately existing UTs don't seem

[jira] [Updated] (SPARK-32148) LEFT JOIN generating non-deterministic and unexpected result (regression in Spark 3.0)

[ https://issues.apache.org/jira/browse/SPARK-32148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-32148: - Labels: correctness (was: ) > LEFT JOIN generating non-deterministic and unexpected result

[jira] [Assigned] (SPARK-32148) LEFT JOIN generating non-deterministic and unexpected result (regression in Spark 3.0)

[ https://issues.apache.org/jira/browse/SPARK-32148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32148: Assignee: Apache Spark > LEFT JOIN generating non-deterministic and unexpected result

[jira] [Assigned] (SPARK-32148) LEFT JOIN generating non-deterministic and unexpected result (regression in Spark 3.0)

[ https://issues.apache.org/jira/browse/SPARK-32148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32148: Assignee: (was: Apache Spark) > LEFT JOIN generating non-deterministic and

[jira] [Commented] (SPARK-32148) LEFT JOIN generating non-deterministic and unexpected result (regression in Spark 3.0)

[ https://issues.apache.org/jira/browse/SPARK-32148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149935#comment-17149935 ] Apache Spark commented on SPARK-32148: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-32148) LEFT JOIN generating non-deterministic and unexpected result (regression in Spark 3.0)

[ https://issues.apache.org/jira/browse/SPARK-32148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149934#comment-17149934 ] Apache Spark commented on SPARK-32148: -- User 'HeartSaVioR' has created a pull request for this