[
https://issues.apache.org/jira/browse/SPARK-30543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng reassigned SPARK-30543:
Assignee: zhengruifeng
> RandomForest add Param bootstrap to control sampling method
> --
[
https://issues.apache.org/jira/browse/SPARK-30543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng resolved SPARK-30543.
--
Resolution: Resolved
> RandomForest add Param bootstrap to control sampling method
> -
weiwenda created SPARK-30617:
Summary: Is there any possible that spark no longer restrict
enumerate types of spark.sql.catalogImplementation
Key: SPARK-30617
URL: https://issues.apache.org/jira/browse/SPARK-30617
Chunjun Xiao created SPARK-30618:
Summary: Why does SparkSQL allow `WHERE` to be table alias?
Key: SPARK-30618
URL: https://issues.apache.org/jira/browse/SPARK-30618
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021899#comment-17021899
]
weiwenda commented on SPARK-30617:
--
one solution at [https://github.com/apache/spark/pu
[
https://issues.apache.org/jira/browse/SPARK-29175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021909#comment-17021909
]
Yuanjian Li commented on SPARK-29175:
-
Thanks for the review, change the config name
Abhishek Rao created SPARK-30619:
Summary: org.slf4j.Logger and org.apache.commons.collections
classes not built as part of hadoop-provided profile
Key: SPARK-30619
URL: https://issues.apache.org/jira/browse/SPARK
[
https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021937#comment-17021937
]
Ajith S commented on SPARK-30556:
-
Yes, it exist in lower version like 2.3.x too
> Copy
[
https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021936#comment-17021936
]
Ajith S commented on SPARK-30556:
-
Raised backport PR for branch 2.4 [https://github.com
[
https://issues.apache.org/jira/browse/SPARK-30546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30546:
Summary: Make interval type more future-proof (was: Make interval type
more future-proofing)
> M
[
https://issues.apache.org/jira/browse/SPARK-30546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30546:
Description:
We've decided to not follow the SQL standard to define the interval type in
3.0. We
[
https://issues.apache.org/jira/browse/SPARK-30546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30546.
-
Fix Version/s: 3.0.0
Assignee: Kent Yao
Resolution: Fixed
> Make interval type m
[
https://issues.apache.org/jira/browse/SPARK-30592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30592:
Description: to_json already supports intervals in Spark 2.4. To be
consistent, we should support
Wenchen Fan created SPARK-30620:
---
Summary: avoid unnecessary serialization in AggregateExpression
Key: SPARK-30620
URL: https://issues.apache.org/jira/browse/SPARK-30620
Project: Spark
Issue Ty
Ajith S created SPARK-30621:
---
Summary: Dynamic Pruning thread propagates the localProperties to
task
Key: SPARK-30621
URL: https://issues.apache.org/jira/browse/SPARK-30621
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-30605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30605.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27319
[https://gith
Wenchen Fan created SPARK-30622:
---
Summary: commands should return dummy statistics
Key: SPARK-30622
URL: https://issues.apache.org/jira/browse/SPARK-30622
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-30557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas resolved SPARK-30557.
--
Resolution: Won't Fix
> Add public documentation for SPARK_SUBMIT_OPTS
> -
Thomas Graves created SPARK-30623:
-
Summary: Spark external shuffle allow disable of separate event
loop group
Key: SPARK-30623
URL: https://issues.apache.org/jira/browse/SPARK-30623
Project: Spark
Wenchen Fan created SPARK-30624:
---
Summary: JDBCV2 with catalog functionalities
Key: SPARK-30624
URL: https://issues.apache.org/jira/browse/SPARK-30624
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-30601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30601:
--
Fix Version/s: 2.4.5
> Add a Google Maven Central as a primary repository
> --
[
https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30556:
--
Fix Version/s: 2.4.5
> Copy sparkContext.localproperties to child thread
> inSubqueryExec.exe
[
https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30556:
--
Affects Version/s: 2.3.4
> Copy sparkContext.localproperties to child thread
> inSubqueryExec
[
https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022273#comment-17022273
]
Dongjoon Hyun commented on SPARK-30556:
---
Thank you for confirming, [~ajithshetty].
[
https://issues.apache.org/jira/browse/SPARK-30620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30620.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27342
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-28794.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26759
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-28794:
-
Priority: Minor (was: Major)
> Document CREATE TABLE in SQL Reference.
> --
[
https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-28794:
Assignee: pavithra ramachandran
> Document CREATE TABLE in SQL Reference.
> -
[
https://issues.apache.org/jira/browse/SPARK-30275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022296#comment-17022296
]
Sean R. Owen commented on SPARK-30275:
--
How is it different from just building the
[
https://issues.apache.org/jira/browse/SPARK-29206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022342#comment-17022342
]
Min Shen commented on SPARK-29206:
--
With more investigation into the Netty side issues,
[
https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022343#comment-17022343
]
Burak Yavuz commented on SPARK-30612:
-
SPARK-30314 should help make this work easier
Maxim Gekk created SPARK-30625:
--
Summary: Add `escapeChar` parameter to the `like` function
Key: SPARK-30625
URL: https://issues.apache.org/jira/browse/SPARK-30625
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-27282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022348#comment-17022348
]
Sofia commented on SPARK-27282:
---
No idea [~tgraves], I'm still working with spark-sql and
[
https://issues.apache.org/jira/browse/SPARK-30625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022398#comment-17022398
]
Maxim Gekk commented on SPARK-30625:
I have implemented the feature but I am not sur
[
https://issues.apache.org/jira/browse/SPARK-27913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022354#comment-17022354
]
Ivelin Tchangalov commented on SPARK-27913:
---
I'm curious if there's any progre
Jiaxin Shan created SPARK-30626:
---
Summary: [K8S] Spark driver pod doesn't have SPARK_APPLICATION_ID
Key: SPARK-30626
URL: https://issues.apache.org/jira/browse/SPARK-30626
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiaxin Shan updated SPARK-30626:
Description:
This should be a minor improvement.
The use case is we want to look up environment v
[
https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiaxin Shan updated SPARK-30626:
Summary: [K8S] Spark driver pod doesn't have SPARK_APPLICATION_ID env
(was: [K8S] Spark driver po
[
https://issues.apache.org/jira/browse/SPARK-30626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022426#comment-17022426
]
Jiaxin Shan commented on SPARK-30626:
-
I have an improvement change for this and let
[
https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022430#comment-17022430
]
Jeff Evans commented on SPARK-19248:
After some debugging, I figured out what's goin
[
https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022430#comment-17022430
]
Jeff Evans edited comment on SPARK-19248 at 1/23/20 7:53 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022430#comment-17022430
]
Jeff Evans edited comment on SPARK-19248 at 1/23/20 7:53 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022430#comment-17022430
]
Jeff Evans edited comment on SPARK-19248 at 1/23/20 8:06 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-30570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30570:
-
Assignee: Cody Koeninger
> Update scalafmt to 1.0.3 with onlyChangedFiles feature
> ---
[
https://issues.apache.org/jira/browse/SPARK-30570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30570.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27279
[https://
[
https://issues.apache.org/jira/browse/SPARK-30603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30603.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27318
[https://
[
https://issues.apache.org/jira/browse/SPARK-30603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30603:
-
Assignee: Kent Yao
> Keep the reserved properties of namespaces and tables private
> --
[
https://issues.apache.org/jira/browse/SPARK-28403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022527#comment-17022527
]
Thomas Graves commented on SPARK-28403:
---
so after looking at the pr for this, this
[
https://issues.apache.org/jira/browse/SPARK-30275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022569#comment-17022569
]
Jim Kleckner commented on SPARK-30275:
--
* Builds on my Mac use whatever I have inst
[
https://issues.apache.org/jira/browse/SPARK-19248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022576#comment-17022576
]
Nicholas Chammas commented on SPARK-19248:
--
Thanks for getting to the bottom of
[
https://issues.apache.org/jira/browse/SPARK-30615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022577#comment-17022577
]
Burak Yavuz commented on SPARK-30615:
-
I actually had a PR in progress on this. Let
[
https://issues.apache.org/jira/browse/SPARK-30625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022579#comment-17022579
]
Takeshi Yamamuro commented on SPARK-30625:
--
Yea, supporting that looks fine to
[
https://issues.apache.org/jira/browse/SPARK-28396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-28396.
Resolution: Won't Fix
> Add PathCatalog for data source V2
> -
[
https://issues.apache.org/jira/browse/SPARK-30298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-30298.
--
Fix Version/s: 3.0.0
Assignee: Terry Kim
Resolution: Fixed
Resolved by
Gengliang Wang created SPARK-30627:
--
Summary: Disable all the V2 file sources in Spark 3.0 by default
Key: SPARK-30627
URL: https://issues.apache.org/jira/browse/SPARK-30627
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022596#comment-17022596
]
Rahul Kumar Challapalli commented on SPARK-30218:
-
We currently are dete
Gengliang Wang created SPARK-30628:
--
Summary: File source V2: Support partition pruning with subqueries
Key: SPARK-30628
URL: https://issues.apache.org/jira/browse/SPARK-30628
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022617#comment-17022617
]
Terry Kim commented on SPARK-30615:
---
Thanks [~brkyvz] for heads up.
> normalize the c
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022625#comment-17022625
]
Mathew Wicks commented on SPARK-28921:
--
It is not enough to replace the kuberntes-c
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022625#comment-17022625
]
Mathew Wicks edited comment on SPARK-28921 at 1/24/20 1:03 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-30625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022628#comment-17022628
]
Dongjoon Hyun commented on SPARK-30625:
---
+1
> Add `escapeChar` parameter to the `
[
https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022630#comment-17022630
]
Dongjoon Hyun commented on SPARK-30218:
---
How do you disambiguate them? Could you d
[
https://issues.apache.org/jira/browse/SPARK-30218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022630#comment-17022630
]
Dongjoon Hyun edited comment on SPARK-30218 at 1/24/20 1:16 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022631#comment-17022631
]
Dongjoon Hyun commented on SPARK-28921:
---
Thank you for updating, [~thesuperzapper]
Maciej Szymkiewicz created SPARK-30629:
--
Summary: cleanClosure on recursive call leads to node stack
overflow
Key: SPARK-30629
URL: https://issues.apache.org/jira/browse/SPARK-30629
Project: Spar
[
https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30617:
--
Fix Version/s: (was: 2.4.6)
(was: 3.1.0)
> Is there any possible th
[
https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30617:
--
Affects Version/s: (was: 2.4.4)
3.0.0
> Is there any possible that
[
https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022675#comment-17022675
]
Terry Kim commented on SPARK-30612:
---
Thanks [~brkyvz]
There are two approaches we can
[
https://issues.apache.org/jira/browse/SPARK-30617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022676#comment-17022676
]
Dongjoon Hyun commented on SPARK-30617:
---
Thanks, [~994184...@qq.com]. I added the
[
https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022678#comment-17022678
]
Burak Yavuz commented on SPARK-30612:
-
I prefer SubqueryAlias. We need to support al
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022694#comment-17022694
]
Dongjoon Hyun commented on SPARK-30421:
---
Technically, Python `pandas` follows the
[
https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-14643:
Priority: Blocker (was: Major)
> Remove overloaded methods which become ambiguous in Scala 2.12
> ---
[
https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-14643:
Target Version/s: 3.0.0
> Remove overloaded methods which become ambiguous in Scala 2.12
> ---
[
https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reopened SPARK-14643:
-
Assignee: (was: Josh Rosen)
> Remove overloaded methods which become ambiguous in Scala 2.12
> ---
[
https://issues.apache.org/jira/browse/SPARK-30627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30627.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27348
[https://
Huaxin Gao created SPARK-30630:
--
Summary: Deprecate numTrees in GBT
Key: SPARK-30630
URL: https://issues.apache.org/jira/browse/SPARK-30630
Project: Spark
Issue Type: Improvement
Compo
Jorge created SPARK-30631:
-
Summary: Mitigate SQL injections - can't parameterize query
parameters for JDBC connectors
Key: SPARK-30631
URL: https://issues.apache.org/jira/browse/SPARK-30631
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tobias Hermann updated SPARK-30421:
---
Comment: was deleted
(was: [~dongjoon] Thanks, I think that's not good. So I just opened a P
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022715#comment-17022715
]
Tobias Hermann commented on SPARK-30421:
[~dongjoon] Thanks, I think that's not
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022719#comment-17022719
]
Tobias Hermann commented on SPARK-30421:
[~dongjoon] No, that's different. To ma
80 matches
Mail list logo