[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022719#comment-17022719 ] Tobias Hermann commented on SPARK-30421: [~dongjoon] No, that's different. To make it

[jira] [Issue Comment Deleted] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobias Hermann updated SPARK-30421: --- Comment: was deleted (was: [~dongjoon] Thanks, I think that's not good. So I just opened a

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022715#comment-17022715 ] Tobias Hermann commented on SPARK-30421: [~dongjoon] Thanks, I think that's not good. So I just

[jira] [Created] (SPARK-30631) Mitigate SQL injections - can't parameterize query parameters for JDBC connectors

Jorge created SPARK-30631: - Summary: Mitigate SQL injections - can't parameterize query parameters for JDBC connectors Key: SPARK-30631 URL: https://issues.apache.org/jira/browse/SPARK-30631 Project: Spark

[jira] [Created] (SPARK-30630) Deprecate numTrees in GBT

Huaxin Gao created SPARK-30630: -- Summary: Deprecate numTrees in GBT Key: SPARK-30630 URL: https://issues.apache.org/jira/browse/SPARK-30630 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-30627) Disable all the V2 file sources in Spark 3.0 by default

[ https://issues.apache.org/jira/browse/SPARK-30627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30627. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27348

[jira] [Reopened] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-14643: - Assignee: (was: Josh Rosen) > Remove overloaded methods which become ambiguous in Scala 2.12 >

[jira] [Updated] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14643: Priority: Blocker (was: Major) > Remove overloaded methods which become ambiguous in Scala 2.12 >

[jira] [Updated] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14643: Target Version/s: 3.0.0 > Remove overloaded methods which become ambiguous in Scala 2.12 >

[jira] [Commented] (SPARK-30421) Dropped columns still available for filtering

[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022694#comment-17022694 ] Dongjoon Hyun commented on SPARK-30421: --- Technically, Python `pandas` follows the same lazy

[jira] [Commented] (SPARK-30612) can't resolve qualified column name with v2 tables

[ https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022678#comment-17022678 ] Burak Yavuz commented on SPARK-30612: - I prefer SubqueryAlias. We need to support all degrees of the

[jira] [Commented] (SPARK-30617) Is there any possible that spark no longer restrict enumerate types of spark.sql.catalogImplementation

[ https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022676#comment-17022676 ] Dongjoon Hyun commented on SPARK-30617: --- Thanks, [~994184...@qq.com]. I added the existing JIRAs.

[jira] [Commented] (SPARK-30612) can't resolve qualified column name with v2 tables

[ https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022675#comment-17022675 ] Terry Kim commented on SPARK-30612: --- Thanks [~brkyvz] There are two approaches we can take. One is to

[jira] [Updated] (SPARK-30617) Is there any possible that spark no longer restrict enumerate types of spark.sql.catalogImplementation

[ https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30617: -- Affects Version/s: (was: 2.4.4) 3.0.0 > Is there any possible that

[jira] [Updated] (SPARK-30617) Is there any possible that spark no longer restrict enumerate types of spark.sql.catalogImplementation

[ https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30617: -- Fix Version/s: (was: 2.4.6) (was: 3.1.0) > Is there any possible

[jira] [Created] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

Maciej Szymkiewicz created SPARK-30629: -- Summary: cleanClosure on recursive call leads to node stack overflow Key: SPARK-30629 URL: https://issues.apache.org/jira/browse/SPARK-30629 Project:

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022631#comment-17022631 ] Dongjoon Hyun commented on SPARK-28921: --- Thank you for updating, [~thesuperzapper]. What problem

[jira] [Commented] (SPARK-30218) Columns used in inequality conditions for joins not resolved correctly in case of common lineage

[ https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022630#comment-17022630 ] Dongjoon Hyun commented on SPARK-30218: --- How do you disambiguate them? Could you describe your

[jira] [Comment Edited] (SPARK-30218) Columns used in inequality conditions for joins not resolved correctly in case of common lineage

[ https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022630#comment-17022630 ] Dongjoon Hyun edited comment on SPARK-30218 at 1/24/20 1:16 AM: How do

[jira] [Commented] (SPARK-30625) Add `escapeChar` parameter to the `like` function

[ https://issues.apache.org/jira/browse/SPARK-30625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022628#comment-17022628 ] Dongjoon Hyun commented on SPARK-30625: --- +1 > Add `escapeChar` parameter to the `like` function >

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022625#comment-17022625 ] Mathew Wicks commented on SPARK-28921: -- It is not enough to replace the kuberntes-client.jar in

[jira] [Comment Edited] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022625#comment-17022625 ] Mathew Wicks edited comment on SPARK-28921 at 1/24/20 1:03 AM: --- It is not

[jira] [Commented] (SPARK-30615) normalize the column name in AlterTable

[ https://issues.apache.org/jira/browse/SPARK-30615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022617#comment-17022617 ] Terry Kim commented on SPARK-30615: --- Thanks [~brkyvz] for heads up. > normalize the column name in

[jira] [Created] (SPARK-30628) File source V2: Support partition pruning with subqueries

Gengliang Wang created SPARK-30628: -- Summary: File source V2: Support partition pruning with subqueries Key: SPARK-30628 URL: https://issues.apache.org/jira/browse/SPARK-30628 Project: Spark

[jira] [Commented] (SPARK-30218) Columns used in inequality conditions for joins not resolved correctly in case of common lineage

[ https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022596#comment-17022596 ] Rahul Kumar Challapalli commented on SPARK-30218: - We currently are detecting that there

[jira] [Created] (SPARK-30627) Disable all the V2 file sources in Spark 3.0 by default

Gengliang Wang created SPARK-30627: -- Summary: Disable all the V2 file sources in Spark 3.0 by default Key: SPARK-30627 URL: https://issues.apache.org/jira/browse/SPARK-30627 Project: Spark

[jira] [Resolved] (SPARK-30298) bucket join cannot work for self-join with views

[ https://issues.apache.org/jira/browse/SPARK-30298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-30298. -- Fix Version/s: 3.0.0 Assignee: Terry Kim Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-28396) Add PathCatalog for data source V2

[ https://issues.apache.org/jira/browse/SPARK-28396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-28396. Resolution: Won't Fix > Add PathCatalog for data source V2 >

[jira] [Commented] (SPARK-30625) Add `escapeChar` parameter to the `like` function

[ https://issues.apache.org/jira/browse/SPARK-30625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022579#comment-17022579 ] Takeshi Yamamuro commented on SPARK-30625: -- Yea, supporting that looks fine to me. > Add

[jira] [Commented] (SPARK-30615) normalize the column name in AlterTable

[ https://issues.apache.org/jira/browse/SPARK-30615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022577#comment-17022577 ] Burak Yavuz commented on SPARK-30615: - I actually had a PR in progress on this. Let me push that >

[jira] [Commented] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022576#comment-17022576 ] Nicholas Chammas commented on SPARK-19248: -- Thanks for getting to the bottom of the issue,

[jira] [Commented] (SPARK-30275) Add gitlab-ci.yml file for reproducible builds

[ https://issues.apache.org/jira/browse/SPARK-30275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022569#comment-17022569 ] Jim Kleckner commented on SPARK-30275: -- * Builds on my Mac use whatever I have installed on my

[jira] [Commented] (SPARK-28403) Executor Allocation Manager can add an extra executor when speculative tasks

[ https://issues.apache.org/jira/browse/SPARK-28403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022527#comment-17022527 ] Thomas Graves commented on SPARK-28403: --- so after looking at the pr for this, this logic may have

[jira] [Assigned] (SPARK-30603) Keep the reserved properties of namespaces and tables private

[ https://issues.apache.org/jira/browse/SPARK-30603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30603: - Assignee: Kent Yao > Keep the reserved properties of namespaces and tables private >

[jira] [Resolved] (SPARK-30603) Keep the reserved properties of namespaces and tables private

[ https://issues.apache.org/jira/browse/SPARK-30603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30603. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27318

[jira] [Resolved] (SPARK-30570) Update scalafmt to 1.0.3 with onlyChangedFiles feature

[ https://issues.apache.org/jira/browse/SPARK-30570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30570. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27279

[jira] [Assigned] (SPARK-30570) Update scalafmt to 1.0.3 with onlyChangedFiles feature

[ https://issues.apache.org/jira/browse/SPARK-30570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30570: - Assignee: Cody Koeninger > Update scalafmt to 1.0.3 with onlyChangedFiles feature >

[jira] [Comment Edited] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022430#comment-17022430 ] Jeff Evans edited comment on SPARK-19248 at 1/23/20 8:06 PM: - After some

[jira] [Comment Edited] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022430#comment-17022430 ] Jeff Evans edited comment on SPARK-19248 at 1/23/20 7:53 PM: - After some

[jira] [Comment Edited] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022430#comment-17022430 ] Jeff Evans edited comment on SPARK-19248 at 1/23/20 7:53 PM: - After some

[jira] [Commented] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0

[ https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022430#comment-17022430 ] Jeff Evans commented on SPARK-19248: After some debugging, I figured out what's going on here. The

[jira] [Commented] (SPARK-30626) [K8S] Spark driver pod doesn't have SPARK_APPLICATION_ID env

[ https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022426#comment-17022426 ] Jiaxin Shan commented on SPARK-30626: - I have an improvement change for this and let me create a PR

[jira] [Updated] (SPARK-30626) [K8S] Spark driver pod doesn't have SPARK_APPLICATION_ID env

[ https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaxin Shan updated SPARK-30626: Summary: [K8S] Spark driver pod doesn't have SPARK_APPLICATION_ID env (was: [K8S] Spark driver

[jira] [Updated] (SPARK-30626) [K8S] Spark driver pod doesn't have SPARK_APPLICATION_ID

[ https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaxin Shan updated SPARK-30626: Description: This should be a minor improvement. The use case is we want to look up environment

[jira] [Created] (SPARK-30626) [K8S] Spark driver pod doesn't have SPARK_APPLICATION_ID

Jiaxin Shan created SPARK-30626: --- Summary: [K8S] Spark driver pod doesn't have SPARK_APPLICATION_ID Key: SPARK-30626 URL: https://issues.apache.org/jira/browse/SPARK-30626 Project: Spark Issue

[jira] [Commented] (SPARK-27913) Spark SQL's native ORC reader implements its own schema evolution

[ https://issues.apache.org/jira/browse/SPARK-27913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022354#comment-17022354 ] Ivelin Tchangalov commented on SPARK-27913: --- I'm curious if there's any progress or solution

[jira] [Commented] (SPARK-30625) Add `escapeChar` parameter to the `like` function

[ https://issues.apache.org/jira/browse/SPARK-30625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022398#comment-17022398 ] Maxim Gekk commented on SPARK-30625: I have implemented the feature but I am not sure it is useful.

[jira] [Commented] (SPARK-27282) Spark incorrect results when using UNION with GROUP BY clause

[ https://issues.apache.org/jira/browse/SPARK-27282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022348#comment-17022348 ] Sofia commented on SPARK-27282: --- No idea [~tgraves], I'm still working with spark-sql and spark-core ==> 

[jira] [Created] (SPARK-30625) Add `escapeChar` parameter to the `like` function

Maxim Gekk created SPARK-30625: -- Summary: Add `escapeChar` parameter to the `like` function Key: SPARK-30625 URL: https://issues.apache.org/jira/browse/SPARK-30625 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30612) can't resolve qualified column name with v2 tables

[ https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022343#comment-17022343 ] Burak Yavuz commented on SPARK-30612: - SPARK-30314 should help make this work easier > can't

[jira] [Commented] (SPARK-29206) Number of shuffle Netty server threads should be a multiple of number of chunk fetch handler threads

[ https://issues.apache.org/jira/browse/SPARK-29206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022342#comment-17022342 ] Min Shen commented on SPARK-29206: -- With more investigation into the Netty side issues, we are

[jira] [Commented] (SPARK-30275) Add gitlab-ci.yml file for reproducible builds

[ https://issues.apache.org/jira/browse/SPARK-30275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022296#comment-17022296 ] Sean R. Owen commented on SPARK-30275: -- How is it different from just building the software

[jira] [Assigned] (SPARK-28794) Document CREATE TABLE in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28794: Assignee: pavithra ramachandran > Document CREATE TABLE in SQL Reference. >

[jira] [Resolved] (SPARK-28794) Document CREATE TABLE in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28794. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26759

[jira] [Updated] (SPARK-28794) Document CREATE TABLE in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28794: - Priority: Minor (was: Major) > Document CREATE TABLE in SQL Reference. >

[jira] [Resolved] (SPARK-30620) avoid unnecessary serialization in AggregateExpression

[ https://issues.apache.org/jira/browse/SPARK-30620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30620. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27342

[jira] [Updated] (SPARK-30556) Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

[ https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30556: -- Affects Version/s: 2.3.4 > Copy sparkContext.localproperties to child thread >

[jira] [Commented] (SPARK-30556) Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

[ https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022273#comment-17022273 ] Dongjoon Hyun commented on SPARK-30556: --- Thank you for confirming, [~ajithshetty]. This is

[jira] [Updated] (SPARK-30556) Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

[ https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30556: -- Fix Version/s: 2.4.5 > Copy sparkContext.localproperties to child thread >

[jira] [Updated] (SPARK-30601) Add a Google Maven Central as a primary repository

[ https://issues.apache.org/jira/browse/SPARK-30601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30601: -- Fix Version/s: 2.4.5 > Add a Google Maven Central as a primary repository >

[jira] [Created] (SPARK-30624) JDBCV2 with catalog functionalities

Wenchen Fan created SPARK-30624: --- Summary: JDBCV2 with catalog functionalities Key: SPARK-30624 URL: https://issues.apache.org/jira/browse/SPARK-30624 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-30623) Spark external shuffle allow disable of separate event loop group

Thomas Graves created SPARK-30623: - Summary: Spark external shuffle allow disable of separate event loop group Key: SPARK-30623 URL: https://issues.apache.org/jira/browse/SPARK-30623 Project: Spark

[jira] [Resolved] (SPARK-30557) Add public documentation for SPARK_SUBMIT_OPTS

[ https://issues.apache.org/jira/browse/SPARK-30557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-30557. -- Resolution: Won't Fix > Add public documentation for SPARK_SUBMIT_OPTS >

[jira] [Created] (SPARK-30622) commands should return dummy statistics

Wenchen Fan created SPARK-30622: --- Summary: commands should return dummy statistics Key: SPARK-30622 URL: https://issues.apache.org/jira/browse/SPARK-30622 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-30605) move defaultNamespace from SupportsNamespace to CatalogPlugin

[ https://issues.apache.org/jira/browse/SPARK-30605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30605. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27319

[jira] [Created] (SPARK-30621) Dynamic Pruning thread propagates the localProperties to task

Ajith S created SPARK-30621: --- Summary: Dynamic Pruning thread propagates the localProperties to task Key: SPARK-30621 URL: https://issues.apache.org/jira/browse/SPARK-30621 Project: Spark Issue

[jira] [Created] (SPARK-30620) avoid unnecessary serialization in AggregateExpression

Wenchen Fan created SPARK-30620: --- Summary: avoid unnecessary serialization in AggregateExpression Key: SPARK-30620 URL: https://issues.apache.org/jira/browse/SPARK-30620 Project: Spark Issue

[jira] [Updated] (SPARK-30592) Interval support for csv and json functions

[ https://issues.apache.org/jira/browse/SPARK-30592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30592: Description: to_json already supports intervals in Spark 2.4. To be consistent, we should support

[jira] [Resolved] (SPARK-30546) Make interval type more future-proof

[ https://issues.apache.org/jira/browse/SPARK-30546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30546. - Fix Version/s: 3.0.0 Assignee: Kent Yao Resolution: Fixed > Make interval type

[jira] [Updated] (SPARK-30546) Make interval type more future-proof

[ https://issues.apache.org/jira/browse/SPARK-30546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30546: Description: We've decided to not follow the SQL standard to define the interval type in 3.0. We

[jira] [Updated] (SPARK-30546) Make interval type more future-proof

[ https://issues.apache.org/jira/browse/SPARK-30546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30546: Summary: Make interval type more future-proof (was: Make interval type more future-proofing) >

[jira] [Commented] (SPARK-30556) Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

[ https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021937#comment-17021937 ] Ajith S commented on SPARK-30556: - Yes, it exist in lower version like 2.3.x too > Copy

[jira] [Commented] (SPARK-30556) Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

[ https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021936#comment-17021936 ] Ajith S commented on SPARK-30556: - Raised backport PR for branch 2.4 

[jira] [Created] (SPARK-30619) org.slf4j.Logger and org.apache.commons.collections classes not built as part of hadoop-provided profile

Abhishek Rao created SPARK-30619: Summary: org.slf4j.Logger and org.apache.commons.collections classes not built as part of hadoop-provided profile Key: SPARK-30619 URL:

[jira] [Commented] (SPARK-29175) Make maven central repository in IsolatedClientLoader configurable

[ https://issues.apache.org/jira/browse/SPARK-29175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021909#comment-17021909 ] Yuanjian Li commented on SPARK-29175: - Thanks for the review, change the config name in the

[jira] [Commented] (SPARK-30617) Is there any possible that spark no longer restrict enumerate types of spark.sql.catalogImplementation

[ https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021899#comment-17021899 ] weiwenda commented on SPARK-30617: -- one solution at [https://github.com/apache/spark/pull/27338] > Is

[jira] [Created] (SPARK-30618) Why does SparkSQL allow `WHERE` to be table alias?

Chunjun Xiao created SPARK-30618: Summary: Why does SparkSQL allow `WHERE` to be table alias? Key: SPARK-30618 URL: https://issues.apache.org/jira/browse/SPARK-30618 Project: Spark Issue

[jira] [Created] (SPARK-30617) Is there any possible that spark no longer restrict enumerate types of spark.sql.catalogImplementation

weiwenda created SPARK-30617: Summary: Is there any possible that spark no longer restrict enumerate types of spark.sql.catalogImplementation Key: SPARK-30617 URL: https://issues.apache.org/jira/browse/SPARK-30617

[jira] [Resolved] (SPARK-30543) RandomForest add Param bootstrap to control sampling method

[ https://issues.apache.org/jira/browse/SPARK-30543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30543. -- Resolution: Resolved > RandomForest add Param bootstrap to control sampling method >

[jira] [Assigned] (SPARK-30543) RandomForest add Param bootstrap to control sampling method

[ https://issues.apache.org/jira/browse/SPARK-30543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30543: Assignee: zhengruifeng > RandomForest add Param bootstrap to control sampling method >