[
https://issues.apache.org/jira/browse/SPARK-30196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010438#comment-17010438
]
Hyukjin Kwon commented on SPARK-30196:
--
(y)
> Bump lz4-java version to 1.7.0
> ---
[
https://issues.apache.org/jira/browse/SPARK-30425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30425.
--
Resolution: Duplicate
> FileScan of Data Source V2 doesn't implement Partition Pruning
> -
[
https://issues.apache.org/jira/browse/SPARK-30455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010424#comment-17010424
]
Ankit Raj Boudh commented on SPARK-30455:
-
i will raise for this.
> Select All
[
https://issues.apache.org/jira/browse/SPARK-30455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010424#comment-17010424
]
Ankit Raj Boudh edited comment on SPARK-30455 at 1/8/20 7:06 AM:
-
Ankit Raj Boudh created SPARK-30455:
---
Summary: Select All should unselect after un-selecting any
selected item from list.
Key: SPARK-30455
URL: https://issues.apache.org/jira/browse/SPARK-30455
Proj
[
https://issues.apache.org/jira/browse/SPARK-30425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010414#comment-17010414
]
Gengliang Wang commented on SPARK-30425:
[~sandeep.katta2007]Yes
[~jerrychenhf]
[
https://issues.apache.org/jira/browse/SPARK-30454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010412#comment-17010412
]
pavithra ramachandran commented on SPARK-30454:
---
I shall raise the PR
> N
pavithra ramachandran created SPARK-30454:
-
Summary: Null Dereference in HiveSQLException
Key: SPARK-30454
URL: https://issues.apache.org/jira/browse/SPARK-30454
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-30425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010408#comment-17010408
]
Sandeep Katta commented on SPARK-30425:
---
[~gengliang]
> FileScan of Data Source V
[
https://issues.apache.org/jira/browse/SPARK-30425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010407#comment-17010407
]
Sandeep Katta commented on SPARK-30425:
---
is this duplicate of
[SPARK-30428|https:
[
https://issues.apache.org/jira/browse/SPARK-28478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010387#comment-17010387
]
David Vrba commented on SPARK-28478:
[~cloud_fan] what do you think about this? Is i
[
https://issues.apache.org/jira/browse/SPARK-30408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
APeng Zhang updated SPARK-30408:
Description:
OrderBy in sortBy clause will be removed by EliminateSorts.
code to reproduce:
{code
[
https://issues.apache.org/jira/browse/SPARK-30427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30427:
--
Description:
Currently, when spark need to calculate the statistics (eg. sizeInBytes) of
table partit
[
https://issues.apache.org/jira/browse/SPARK-30427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hu Fuwang updated SPARK-30427:
--
Summary: Add config item for limiting partition number when calculating
statistics through File System
[
https://issues.apache.org/jira/browse/SPARK-30196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010373#comment-17010373
]
Takeshi Yamamuro commented on SPARK-30196:
--
Yea, it seems yes (I can reproduce
[
https://issues.apache.org/jira/browse/SPARK-28137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010351#comment-17010351
]
Takeshi Yamamuro commented on SPARK-28137:
--
See: [https://github.com/apache/spa
[
https://issues.apache.org/jira/browse/SPARK-28137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-28137.
--
Resolution: Won't Fix
> Data Type Formatting Functions: `to_number`
>
[
https://issues.apache.org/jira/browse/SPARK-29878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010317#comment-17010317
]
Dong Wang commented on SPARK-29878:
---
So are these unnecessary caches tolerable?
These
[
https://issues.apache.org/jira/browse/SPARK-30125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010304#comment-17010304
]
Yuanjian Li commented on SPARK-30125:
-
Also link #26940 with this Jira.
> Remove Po
[
https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30450.
---
Fix Version/s: 3.0.0
2.4.5
Resolution: Fixed
Issue resolved by pul
[
https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30429.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27117
[https://
[
https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30429:
-
Assignee: L. C. Hsieh
> WideSchemaBenchmark fails with OOM
> --
[
https://issues.apache.org/jira/browse/SPARK-30453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30453.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27124
[https://
[
https://issues.apache.org/jira/browse/SPARK-30453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30453:
-
Assignee: Hyukjin Kwon
> Update AppVeyor R version to 3.6.2
> -
[
https://issues.apache.org/jira/browse/SPARK-30302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-30302.
--
Fix Version/s: 3.0.0
Assignee: Zhenhua Wang
Resolution: Fixed
Resolved
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010271#comment-17010271
]
Takeshi Yamamuro commented on SPARK-30421:
--
Based on the current implementation
[
https://issues.apache.org/jira/browse/SPARK-30381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng resolved SPARK-30381.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27103
[https://gi
Hyukjin Kwon created SPARK-30453:
Summary: Update AppVeyor R version to 3.6.2
Key: SPARK-30453
URL: https://issues.apache.org/jira/browse/SPARK-30453
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28264:
Assignee: Hyukjin Kwon (was: Reynold Xin)
> Revisiting Python / pandas UDF
> ---
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010227#comment-17010227
]
Aman Omer commented on SPARK-30421:
---
cc [~maropu]
> Dropped columns still available f
[
https://issues.apache.org/jira/browse/SPARK-26249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010223#comment-17010223
]
Takeshi Yamamuro commented on SPARK-26249:
--
I'll close this because the corresp
[
https://issues.apache.org/jira/browse/SPARK-26249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-26249.
--
Resolution: Won't Fix
> Extension Points Enhancements to inject a rule in order and to
[
https://issues.apache.org/jira/browse/SPARK-28825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-28825.
--
Fix Version/s: 3.0.0
Assignee: pavithra ramachandran
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-28825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro updated SPARK-28825:
-
Affects Version/s: (was: 2.4.3)
3.0.0
> Document EXPLAIN Stat
[
https://issues.apache.org/jira/browse/SPARK-24884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-24884.
--
Resolution: Won't Fix
> Implement regexp_extract_all
>
>
[
https://issues.apache.org/jira/browse/SPARK-24884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010193#comment-17010193
]
Takeshi Yamamuro commented on SPARK-24884:
--
I'll close this because the corresp
Huaxin Gao created SPARK-30452:
--
Summary: Add predict and numFeatures in Python
IsotonicRegressionModel
Key: SPARK-30452
URL: https://issues.apache.org/jira/browse/SPARK-30452
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-29167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-29167.
--
Resolution: Won't Fix
> Metrics of Analyzer/Optimizer use Scientific counting is not h
[
https://issues.apache.org/jira/browse/SPARK-29167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010187#comment-17010187
]
Takeshi Yamamuro commented on SPARK-29167:
--
I'll close this because no committe
[
https://issues.apache.org/jira/browse/SPARK-30417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010156#comment-17010156
]
Xingbo Jiang commented on SPARK-30417:
--
Good catch! `max(conf.get(EXECUTOR_CORES) /
[
https://issues.apache.org/jira/browse/SPARK-30417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010146#comment-17010146
]
Thomas Graves commented on SPARK-30417:
---
The only way for standalone mode would be
[
https://issues.apache.org/jira/browse/SPARK-30417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010142#comment-17010142
]
Yuchen Huo commented on SPARK-30417:
[~tgraves] Sure. Is there a more stable way to
[
https://issues.apache.org/jira/browse/SPARK-30382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30382.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27042
[https://
[
https://issues.apache.org/jira/browse/SPARK-30382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30382:
-
Assignee: Ajith S
> start-thriftserver throws ClassNotFoundException
>
Thomas Graves created SPARK-30451:
-
Summary: Stage level Sched:
ExecutorResourceRequests/TaskResourceRequests should have functions to remove
requests
Key: SPARK-30451
URL: https://issues.apache.org/jira/browse/S
[
https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai updated SPARK-30450:
-
Affects Version/s: (was: 2.4.4)
3.0.0
> Exclude .git folder for python linter
[
https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai updated SPARK-30450:
-
Priority: Minor (was: Major)
> Exclude .git folder for python linter
>
[
https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai reassigned SPARK-30450:
Assignee: Eric Chang
> Exclude .git folder for python linter
> --
Eric Chang created SPARK-30450:
--
Summary: Exclude .git folder for python linter
Key: SPARK-30450
URL: https://issues.apache.org/jira/browse/SPARK-30450
Project: Spark
Issue Type: Bug
C
[
https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009988#comment-17009988
]
Steve Loughran commented on SPARK-2984:
---
bq. As part of your recommendation, is it
[
https://issues.apache.org/jira/browse/SPARK-30448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009989#comment-17009989
]
Thomas Graves commented on SPARK-30448:
---
Note this actually overlaps with
https:/
[
https://issues.apache.org/jira/browse/SPARK-30442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009963#comment-17009963
]
Maxim Gekk commented on SPARK-30442:
> This can cause issues, particularly with aws
[
https://issues.apache.org/jira/browse/SPARK-30449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar Tiwari updated SPARK-30449:
-
Flags: Important
> Introducing get_dummies method in pyspark
> -
[
https://issues.apache.org/jira/browse/SPARK-30449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009924#comment-17009924
]
Krishna Kumar Tiwari commented on SPARK-30449:
--
I am already working on thi
[
https://issues.apache.org/jira/browse/SPARK-30449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar Tiwari updated SPARK-30449:
-
Issue Type: Task (was: New Feature)
> Introducing get_dummies method in pyspark
Krishna Kumar Tiwari created SPARK-30449:
Summary: Introducing get_dummies method in pyspark
Key: SPARK-30449
URL: https://issues.apache.org/jira/browse/SPARK-30449
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-30448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009901#comment-17009901
]
Thomas Graves commented on SPARK-30448:
---
note there are other calculations through
[
https://issues.apache.org/jira/browse/SPARK-30446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009896#comment-17009896
]
Thomas Graves commented on SPARK-30446:
---
working on this
> Accelerator aware sche
Thomas Graves created SPARK-30448:
-
Summary: accelerator aware scheduling enforce cores as limiting
resource
Key: SPARK-30448
URL: https://issues.apache.org/jira/browse/SPARK-30448
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30039:
---
Assignee: Pablo Langa Blanco
> CREATE FUNCTION should look up catalog/table like v2 comman
[
https://issues.apache.org/jira/browse/SPARK-30039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30039.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26890
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-30443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke Richter updated SPARK-30443:
-
Description:
Our Spark code is causing a "Managed memory leak detected" warning to appear,
even
[
https://issues.apache.org/jira/browse/SPARK-30443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke Richter updated SPARK-30443:
-
Attachment: a.csv.zip
b.csv.zip
c.csv.zip
> "Managed memory leak
[
https://issues.apache.org/jira/browse/SPARK-30437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-30437.
--
Resolution: Won't Fix
> Uneven spaces for some fields in EXPLAIN FORMATTED
> -
[
https://issues.apache.org/jira/browse/SPARK-27604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Toth updated SPARK-27604:
---
Issue Type: Improvement (was: Bug)
> Enhance constant and constraint propagation
>
[
https://issues.apache.org/jira/browse/SPARK-27604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Toth updated SPARK-27604:
---
Description: There is some room for improvement as constant propagation
could allow substitution of
Peter Toth created SPARK-30447:
--
Summary: Constant propagation nullability issue
Key: SPARK-30447
URL: https://issues.apache.org/jira/browse/SPARK-30447
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-30446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009830#comment-17009830
]
Thomas Graves commented on SPARK-30446:
---
Yeah so running on standalone if you set
[
https://issues.apache.org/jira/browse/SPARK-30431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30431.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27102
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-30431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30431:
---
Assignee: Kent Yao
> Update SqlBase.g4 to create commentSpec pattern as same as locationSpe
[
https://issues.apache.org/jira/browse/SPARK-30446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009742#comment-17009742
]
Thomas Graves commented on SPARK-30446:
---
I think there may also be issues in it wi
Thomas Graves created SPARK-30446:
-
Summary: Accelerator aware scheduling checkResourcesPerTask
doesn't cover all cases
Key: SPARK-30446
URL: https://issues.apache.org/jira/browse/SPARK-30446
Project:
Thomas Graves created SPARK-30445:
-
Summary: Accelerator aware scheduling handle setting configs to 0
better
Key: SPARK-30445
URL: https://issues.apache.org/jira/browse/SPARK-30445
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30338.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26993
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009468#comment-17009468
]
L. C. Hsieh commented on SPARK-30429:
-
Thanks for pinging me. Looking into this.
>
75 matches
Mail list logo