[
https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28204.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25003
[
https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28204:
Assignee: Hyukjin Kwon
> Make separate two test cases for column pruning in binary files
[
https://issues.apache.org/jira/browse/SPARK-28208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875335#comment-16875335
]
Dongjoon Hyun commented on SPARK-28208:
---
As I commented on ORC-525, this is unexpected behavior
Marcelo Vanzin created SPARK-28214:
--
Summary: Flaky test:
org.apache.spark.streaming.CheckpointSuite.basic rdd checkpoints + dstream
graph checkpoint recovery
Key: SPARK-28214
URL:
[
https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-28206:
Target Version/s: 3.0.0
> "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc
>
[
https://issues.apache.org/jira/browse/SPARK-28200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-28200:
---
Summary: Decimal overflow handling in ExpressionEncoder (was: Overflow
handling in
[
https://issues.apache.org/jira/browse/SPARK-28213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28213:
Assignee: Apache Spark
> Remove duplication between columnar and ColumnarBatchScan
>
[
https://issues.apache.org/jira/browse/SPARK-28213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28213:
Assignee: (was: Apache Spark)
> Remove duplication between columnar and
Robert Joseph Evans created SPARK-28213:
---
Summary: Remove duplication between columnar and ColumnarBatchScan
Key: SPARK-28213
URL: https://issues.apache.org/jira/browse/SPARK-28213
Project:
[
https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875198#comment-16875198
]
Jungtaek Lim commented on SPARK-28192:
--
Totally interested! Once I decide to implement this with
[
https://issues.apache.org/jira/browse/SPARK-27945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-27945:
-
Assignee: Robert Joseph Evans
> Make minimal changes to support columnar processing
>
[
https://issues.apache.org/jira/browse/SPARK-27945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27945.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> Make minimal changes to support columnar
[
https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28209:
Assignee: Apache Spark
> Shuffle Storage API: Writes
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28209:
Assignee: (was: Apache Spark)
> Shuffle Storage API: Writes
>
Matt Cheah created SPARK-28212:
--
Summary: Shuffle Storage API: Shuffle Cleanup
Key: SPARK-28212
URL: https://issues.apache.org/jira/browse/SPARK-28212
Project: Spark
Issue Type: Sub-task
Matt Cheah created SPARK-28211:
--
Summary: Shuffle Storage API: Driver Lifecycle
Key: SPARK-28211
URL: https://issues.apache.org/jira/browse/SPARK-28211
Project: Spark
Issue Type: Sub-task
Matt Cheah created SPARK-28210:
--
Summary: Shuffle Storage API: Reads
Key: SPARK-28210
URL: https://issues.apache.org/jira/browse/SPARK-28210
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah updated SPARK-25299:
---
Description:
In Spark, the shuffle primitive requires Spark executors to persist data to the
local
[
https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875106#comment-16875106
]
Matt Cheah commented on SPARK-25299:
I also noticed the SPIP document wasn't ever posted on this
[
https://issues.apache.org/jira/browse/SPARK-28208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28208:
Assignee: (was: Apache Spark)
> When upgrading to ORC 1.5.6, the reader needs to be
[
https://issues.apache.org/jira/browse/SPARK-28208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28208:
Assignee: Apache Spark
> When upgrading to ORC 1.5.6, the reader needs to be closed.
>
Matt Cheah created SPARK-28209:
--
Summary: Shuffle Storage API: Writes
Key: SPARK-28209
URL: https://issues.apache.org/jira/browse/SPARK-28209
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875101#comment-16875101
]
Matt Cheah commented on SPARK-25299:
Let's start by making sub-issues. I have a patch staged for
Owen O'Malley created SPARK-28208:
-
Summary: When upgrading to ORC 1.5.6, the reader needs to be
closed.
Key: SPARK-28208
URL: https://issues.apache.org/jira/browse/SPARK-28208
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp closed SPARK-28114.
---
> Add Jenkins job for `Hadoop-3.2` profile
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-22207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kanika dhuria reopened SPARK-22207:
---
Same issue is seen in spark 2.4
> High memory usage when converting relational data to
[
https://issues.apache.org/jira/browse/SPARK-28207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin deleted SPARK-28207:
---
> https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-rohit
>
Roufique Hossain created SPARK-28207:
Summary:
https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-rohit
Key: SPARK-28207
URL: https://issues.apache.org/jira/browse/SPARK-28207
[
https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-28206:
--
Attachment: Screen Shot 2019-06-28 at 9.55.13 AM.png
> "@pandas_udf" in doctest is rendered
[
https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-28206:
--
Issue Type: Bug (was: Documentation)
> "@pandas_udf" in doctest is rendered as ":pandas_udf"
[
https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-28206:
--
Summary: "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API
doc (was:
[
https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-28206:
--
Summary: "@pandas_udf" in doctest is rendered as ":pandas_udf" in html
(was: "@" is rendered
Xiangrui Meng created SPARK-28206:
-
Summary: "@" is rendered as ":" in doctest
Key: SPARK-28206
URL: https://issues.apache.org/jira/browse/SPARK-28206
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875046#comment-16875046
]
Ryan Blue commented on SPARK-28192:
---
It sounds like what you want is for a source to be able to
[
https://issues.apache.org/jira/browse/SPARK-28145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-28145.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24952
[
https://issues.apache.org/jira/browse/SPARK-28145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-28145:
-
Assignee: Onur Satici
> Executor pods polling source can fail to replace dead executors
>
[
https://issues.apache.org/jira/browse/SPARK-28205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28205:
Assignee: Apache Spark
> useV1SourceList configuration should be for all data sources
>
[
https://issues.apache.org/jira/browse/SPARK-28205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28205:
Assignee: (was: Apache Spark)
> useV1SourceList configuration should be for all data
Gengliang Wang created SPARK-28205:
--
Summary: useV1SourceList configuration should be for all data
sources
Key: SPARK-28205
URL: https://issues.apache.org/jira/browse/SPARK-28205
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28204:
Assignee: (was: Apache Spark)
> Make separate two test cases for column pruning in
[
https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28204:
Assignee: Apache Spark
> Make separate two test cases for column pruning in binary files
[
https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28204:
-
Description:
SPARK-27534 missed to address my own comments at
[
https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28204:
-
Issue Type: Test (was: New Feature)
> Make separate two test cases for column pruning in
[
https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-28204:
-
Component/s: Tests
> Make separate two test cases for column pruning in binary files
>
Hyukjin Kwon created SPARK-28204:
Summary: Make separate two test cases for column pruning in binary
files
Key: SPARK-28204
URL: https://issues.apache.org/jira/browse/SPARK-28204
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28203:
Assignee: (was: Apache Spark)
> PythonRDD should respect SparkContext's conf when
[
https://issues.apache.org/jira/browse/SPARK-28203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28203:
Assignee: Apache Spark
> PythonRDD should respect SparkContext's conf when passing user
[
https://issues.apache.org/jira/browse/SPARK-28107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28107:
Assignee: (was: Apache Spark)
> Interval type conversion syntax support
>
[
https://issues.apache.org/jira/browse/SPARK-28107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28107:
Assignee: Apache Spark
> Interval type conversion syntax support
>
[
https://issues.apache.org/jira/browse/SPARK-28107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874842#comment-16874842
]
Apache Spark commented on SPARK-28107:
--
User 'lipzhu' has created a pull request for this issue:
Xianjin YE created SPARK-28203:
--
Summary: PythonRDD should respect SparkContext's conf when passing
user confMap
Key: SPARK-28203
URL: https://issues.apache.org/jira/browse/SPARK-28203
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-28077.
---
Resolution: Fixed
Assignee: jiaan.geng
Fix Version/s: 3.0.0
Issue resolved
[
https://issues.apache.org/jira/browse/SPARK-28083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28083:
Assignee: Apache Spark
> ANSI SQL: LIKE predicate: ESCAPE clause
>
[
https://issues.apache.org/jira/browse/SPARK-28083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28083:
Assignee: (was: Apache Spark)
> ANSI SQL: LIKE predicate: ESCAPE clause
>
[
https://issues.apache.org/jira/browse/SPARK-28202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28202:
Assignee: Apache Spark
> [Core] [Test] Avoid noises of system props in SparkConfSuite
>
[
https://issues.apache.org/jira/browse/SPARK-28202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28202:
Assignee: (was: Apache Spark)
> [Core] [Test] Avoid noises of system props in
ShuMing Li created SPARK-28202:
--
Summary: [Core] [Test] Avoid noises of system props in
SparkConfSuite
Key: SPARK-28202
URL: https://issues.apache.org/jira/browse/SPARK-28202
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874765#comment-16874765
]
Marco Gaido commented on SPARK-28201:
-
I'll create a PR for this ASAP.
> Revisit MakeDecimal
Marco Gaido created SPARK-28201:
---
Summary: Revisit MakeDecimal behavior on overflow
Key: SPARK-28201
URL: https://issues.apache.org/jira/browse/SPARK-28201
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-28198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28198:
Assignee: (was: Apache Spark)
> Add mapPartitionsInPandas to allow an iterator of
[
https://issues.apache.org/jira/browse/SPARK-28198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28198:
Assignee: Apache Spark
> Add mapPartitionsInPandas to allow an iterator of DataFrames
>
[
https://issues.apache.org/jira/browse/SPARK-28185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28185.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24986
[
https://issues.apache.org/jira/browse/SPARK-28185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28185:
Assignee: Weichen Xu
> Trigger pandas iterator UDF closing stuff when iterator stop
Marco Gaido created SPARK-28200:
---
Summary: Overflow handling in `ExpressionEncoder`
Key: SPARK-28200
URL: https://issues.apache.org/jira/browse/SPARK-28200
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28199:
Assignee: Apache Spark
> Remove usage of ProcessingTime in Spark codebase
>
[
https://issues.apache.org/jira/browse/SPARK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28199:
Assignee: (was: Apache Spark)
> Remove usage of ProcessingTime in Spark codebase
>
[
https://issues.apache.org/jira/browse/SPARK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874741#comment-16874741
]
Jungtaek Lim commented on SPARK-28199:
--
Working on this. Actually I worked this as minor one but
Jungtaek Lim created SPARK-28199:
Summary: Remove usage of ProcessingTime in Spark codebase
Key: SPARK-28199
URL: https://issues.apache.org/jira/browse/SPARK-28199
Project: Spark
Issue Type:
Hyukjin Kwon created SPARK-28198:
Summary: Add mapPartitionsInPandas to allow an iterator of
DataFrames
Key: SPARK-28198
URL: https://issues.apache.org/jira/browse/SPARK-28198
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874703#comment-16874703
]
Saisai Shao commented on SPARK-25299:
-
Votes were passed, so what is our plan for code submission?
zhangbin created SPARK-28197:
Summary: Failed to query on external JSon Partitioned table
Key: SPARK-28197
URL: https://issues.apache.org/jira/browse/SPARK-28197
Project: Spark
Issue Type: Bug
71 matches
Mail list logo