[jira] [Resolved] (SPARK-28204) Make separate two test cases for column pruning in binary files

2019-06-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28204. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25003

[jira] [Assigned] (SPARK-28204) Make separate two test cases for column pruning in binary files

2019-06-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28204: Assignee: Hyukjin Kwon > Make separate two test cases for column pruning in binary files

[jira] [Commented] (SPARK-28208) When upgrading to ORC 1.5.6, the reader needs to be closed.

2019-06-28 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875335#comment-16875335 ] Dongjoon Hyun commented on SPARK-28208: --- As I commented on ORC-525, this is unexpected behavior

[jira] [Created] (SPARK-28214) Flaky test: org.apache.spark.streaming.CheckpointSuite.basic rdd checkpoints + dstream graph checkpoint recovery

2019-06-28 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-28214: -- Summary: Flaky test: org.apache.spark.streaming.CheckpointSuite.basic rdd checkpoints + dstream graph checkpoint recovery Key: SPARK-28214 URL:

[jira] [Updated] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-06-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28206: Target Version/s: 3.0.0 > "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc >

[jira] [Updated] (SPARK-28200) Decimal overflow handling in ExpressionEncoder

2019-06-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-28200: --- Summary: Decimal overflow handling in ExpressionEncoder (was: Overflow handling in

[jira] [Assigned] (SPARK-28213) Remove duplication between columnar and ColumnarBatchScan

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28213: Assignee: Apache Spark > Remove duplication between columnar and ColumnarBatchScan >

[jira] [Assigned] (SPARK-28213) Remove duplication between columnar and ColumnarBatchScan

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28213: Assignee: (was: Apache Spark) > Remove duplication between columnar and

[jira] [Created] (SPARK-28213) Remove duplication between columnar and ColumnarBatchScan

2019-06-28 Thread Robert Joseph Evans (JIRA)
Robert Joseph Evans created SPARK-28213: --- Summary: Remove duplication between columnar and ColumnarBatchScan Key: SPARK-28213 URL: https://issues.apache.org/jira/browse/SPARK-28213 Project:

[jira] [Commented] (SPARK-28192) Data Source - State - Write side

2019-06-28 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875198#comment-16875198 ] Jungtaek Lim commented on SPARK-28192: -- Totally interested! Once I decide to implement this with

[jira] [Assigned] (SPARK-27945) Make minimal changes to support columnar processing

2019-06-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-27945: - Assignee: Robert Joseph Evans > Make minimal changes to support columnar processing >

[jira] [Resolved] (SPARK-27945) Make minimal changes to support columnar processing

2019-06-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-27945. --- Resolution: Fixed Fix Version/s: 3.0.0 > Make minimal changes to support columnar

[jira] [Assigned] (SPARK-28209) Shuffle Storage API: Writes

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28209: Assignee: Apache Spark > Shuffle Storage API: Writes > --- > >

[jira] [Assigned] (SPARK-28209) Shuffle Storage API: Writes

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28209: Assignee: (was: Apache Spark) > Shuffle Storage API: Writes >

[jira] [Created] (SPARK-28212) Shuffle Storage API: Shuffle Cleanup

2019-06-28 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-28212: -- Summary: Shuffle Storage API: Shuffle Cleanup Key: SPARK-28212 URL: https://issues.apache.org/jira/browse/SPARK-28212 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28211) Shuffle Storage API: Driver Lifecycle

2019-06-28 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-28211: -- Summary: Shuffle Storage API: Driver Lifecycle Key: SPARK-28211 URL: https://issues.apache.org/jira/browse/SPARK-28211 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28210) Shuffle Storage API: Reads

2019-06-28 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-28210: -- Summary: Shuffle Storage API: Reads Key: SPARK-28210 URL: https://issues.apache.org/jira/browse/SPARK-28210 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-25299) Use remote storage for persisting shuffle data

2019-06-28 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-25299: --- Description: In Spark, the shuffle primitive requires Spark executors to persist data to the local

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

2019-06-28 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875106#comment-16875106 ] Matt Cheah commented on SPARK-25299: I also noticed the SPIP document wasn't ever posted on this

[jira] [Assigned] (SPARK-28208) When upgrading to ORC 1.5.6, the reader needs to be closed.

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28208: Assignee: (was: Apache Spark) > When upgrading to ORC 1.5.6, the reader needs to be

[jira] [Assigned] (SPARK-28208) When upgrading to ORC 1.5.6, the reader needs to be closed.

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28208: Assignee: Apache Spark > When upgrading to ORC 1.5.6, the reader needs to be closed. >

[jira] [Created] (SPARK-28209) Shuffle Storage API: Writes

2019-06-28 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-28209: -- Summary: Shuffle Storage API: Writes Key: SPARK-28209 URL: https://issues.apache.org/jira/browse/SPARK-28209 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

2019-06-28 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875101#comment-16875101 ] Matt Cheah commented on SPARK-25299: Let's start by making sub-issues. I have a patch staged for

[jira] [Created] (SPARK-28208) When upgrading to ORC 1.5.6, the reader needs to be closed.

2019-06-28 Thread Owen O'Malley (JIRA)
Owen O'Malley created SPARK-28208: - Summary: When upgrading to ORC 1.5.6, the reader needs to be closed. Key: SPARK-28208 URL: https://issues.apache.org/jira/browse/SPARK-28208 Project: Spark

[jira] [Closed] (SPARK-28114) Add Jenkins job for `Hadoop-3.2` profile

2019-06-28 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp closed SPARK-28114. --- > Add Jenkins job for `Hadoop-3.2` profile > > >

[jira] [Reopened] (SPARK-22207) High memory usage when converting relational data to Hierarchical data

2019-06-28 Thread kanika dhuria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanika dhuria reopened SPARK-22207: --- Same issue is seen in spark 2.4 > High memory usage when converting relational data to

[jira] [Deleted] (SPARK-28207) https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-rohit

2019-06-28 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin deleted SPARK-28207: --- > https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-rohit >

[jira] [Created] (SPARK-28207) https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-rohit

2019-06-28 Thread Roufique Hossain (JIRA)
Roufique Hossain created SPARK-28207: Summary: https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-rohit Key: SPARK-28207 URL: https://issues.apache.org/jira/browse/SPARK-28207

[jira] [Updated] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-28206: -- Attachment: Screen Shot 2019-06-28 at 9.55.13 AM.png > "@pandas_udf" in doctest is rendered

[jira] [Updated] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-28206: -- Issue Type: Bug (was: Documentation) > "@pandas_udf" in doctest is rendered as ":pandas_udf"

[jira] [Updated] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-28206: -- Summary: "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc (was:

[jira] [Updated] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html

2019-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-28206: -- Summary: "@pandas_udf" in doctest is rendered as ":pandas_udf" in html (was: "@" is rendered

[jira] [Created] (SPARK-28206) "@" is rendered as ":" in doctest

2019-06-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-28206: - Summary: "@" is rendered as ":" in doctest Key: SPARK-28206 URL: https://issues.apache.org/jira/browse/SPARK-28206 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28192) Data Source - State - Write side

2019-06-28 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875046#comment-16875046 ] Ryan Blue commented on SPARK-28192: --- It sounds like what you want is for a source to be able to

[jira] [Resolved] (SPARK-28145) Executor pods polling source can fail to replace dead executors

2019-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28145. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24952

[jira] [Assigned] (SPARK-28145) Executor pods polling source can fail to replace dead executors

2019-06-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28145: - Assignee: Onur Satici > Executor pods polling source can fail to replace dead executors >

[jira] [Assigned] (SPARK-28205) useV1SourceList configuration should be for all data sources

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28205: Assignee: Apache Spark > useV1SourceList configuration should be for all data sources >

[jira] [Assigned] (SPARK-28205) useV1SourceList configuration should be for all data sources

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28205: Assignee: (was: Apache Spark) > useV1SourceList configuration should be for all data

[jira] [Created] (SPARK-28205) useV1SourceList configuration should be for all data sources

2019-06-28 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-28205: -- Summary: useV1SourceList configuration should be for all data sources Key: SPARK-28205 URL: https://issues.apache.org/jira/browse/SPARK-28205 Project: Spark

[jira] [Assigned] (SPARK-28204) Make separate two test cases for column pruning in binary files

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28204: Assignee: (was: Apache Spark) > Make separate two test cases for column pruning in

[jira] [Assigned] (SPARK-28204) Make separate two test cases for column pruning in binary files

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28204: Assignee: Apache Spark > Make separate two test cases for column pruning in binary files

[jira] [Updated] (SPARK-28204) Make separate two test cases for column pruning in binary files

2019-06-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28204: - Description: SPARK-27534 missed to address my own comments at

[jira] [Updated] (SPARK-28204) Make separate two test cases for column pruning in binary files

2019-06-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28204: - Issue Type: Test (was: New Feature) > Make separate two test cases for column pruning in

[jira] [Updated] (SPARK-28204) Make separate two test cases for column pruning in binary files

2019-06-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28204: - Component/s: Tests > Make separate two test cases for column pruning in binary files >

[jira] [Created] (SPARK-28204) Make separate two test cases for column pruning in binary files

2019-06-28 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-28204: Summary: Make separate two test cases for column pruning in binary files Key: SPARK-28204 URL: https://issues.apache.org/jira/browse/SPARK-28204 Project: Spark

[jira] [Assigned] (SPARK-28203) PythonRDD should respect SparkContext's conf when passing user confMap

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28203: Assignee: (was: Apache Spark) > PythonRDD should respect SparkContext's conf when

[jira] [Assigned] (SPARK-28203) PythonRDD should respect SparkContext's conf when passing user confMap

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28203: Assignee: Apache Spark > PythonRDD should respect SparkContext's conf when passing user

[jira] [Assigned] (SPARK-28107) Interval type conversion syntax support

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28107: Assignee: (was: Apache Spark) > Interval type conversion syntax support >

[jira] [Assigned] (SPARK-28107) Interval type conversion syntax support

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28107: Assignee: Apache Spark > Interval type conversion syntax support >

[jira] [Commented] (SPARK-28107) Interval type conversion syntax support

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874842#comment-16874842 ] Apache Spark commented on SPARK-28107: -- User 'lipzhu' has created a pull request for this issue:

[jira] [Created] (SPARK-28203) PythonRDD should respect SparkContext's conf when passing user confMap

2019-06-28 Thread Xianjin YE (JIRA)
Xianjin YE created SPARK-28203: -- Summary: PythonRDD should respect SparkContext's conf when passing user confMap Key: SPARK-28203 URL: https://issues.apache.org/jira/browse/SPARK-28203 Project: Spark

[jira] [Resolved] (SPARK-28077) ANSI SQL: OVERLAY function(T312)

2019-06-28 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-28077. --- Resolution: Fixed Assignee: jiaan.geng Fix Version/s: 3.0.0 Issue resolved

[jira] [Assigned] (SPARK-28083) ANSI SQL: LIKE predicate: ESCAPE clause

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28083: Assignee: Apache Spark > ANSI SQL: LIKE predicate: ESCAPE clause >

[jira] [Assigned] (SPARK-28083) ANSI SQL: LIKE predicate: ESCAPE clause

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28083: Assignee: (was: Apache Spark) > ANSI SQL: LIKE predicate: ESCAPE clause >

[jira] [Assigned] (SPARK-28202) [Core] [Test] Avoid noises of system props in SparkConfSuite

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28202: Assignee: Apache Spark > [Core] [Test] Avoid noises of system props in SparkConfSuite >

[jira] [Assigned] (SPARK-28202) [Core] [Test] Avoid noises of system props in SparkConfSuite

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28202: Assignee: (was: Apache Spark) > [Core] [Test] Avoid noises of system props in

[jira] [Created] (SPARK-28202) [Core] [Test] Avoid noises of system props in SparkConfSuite

2019-06-28 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28202: -- Summary: [Core] [Test] Avoid noises of system props in SparkConfSuite Key: SPARK-28202 URL: https://issues.apache.org/jira/browse/SPARK-28202 Project: Spark

[jira] [Commented] (SPARK-28201) Revisit MakeDecimal behavior on overflow

2019-06-28 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874765#comment-16874765 ] Marco Gaido commented on SPARK-28201: - I'll create a PR for this ASAP. > Revisit MakeDecimal

[jira] [Created] (SPARK-28201) Revisit MakeDecimal behavior on overflow

2019-06-28 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-28201: --- Summary: Revisit MakeDecimal behavior on overflow Key: SPARK-28201 URL: https://issues.apache.org/jira/browse/SPARK-28201 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-28198) Add mapPartitionsInPandas to allow an iterator of DataFrames

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28198: Assignee: (was: Apache Spark) > Add mapPartitionsInPandas to allow an iterator of

[jira] [Assigned] (SPARK-28198) Add mapPartitionsInPandas to allow an iterator of DataFrames

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28198: Assignee: Apache Spark > Add mapPartitionsInPandas to allow an iterator of DataFrames >

[jira] [Resolved] (SPARK-28185) Trigger pandas iterator UDF closing stuff when iterator stop early

2019-06-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28185. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24986

[jira] [Assigned] (SPARK-28185) Trigger pandas iterator UDF closing stuff when iterator stop early

2019-06-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28185: Assignee: Weichen Xu > Trigger pandas iterator UDF closing stuff when iterator stop

[jira] [Created] (SPARK-28200) Overflow handling in `ExpressionEncoder`

2019-06-28 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-28200: --- Summary: Overflow handling in `ExpressionEncoder` Key: SPARK-28200 URL: https://issues.apache.org/jira/browse/SPARK-28200 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-28199) Remove usage of ProcessingTime in Spark codebase

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28199: Assignee: Apache Spark > Remove usage of ProcessingTime in Spark codebase >

[jira] [Assigned] (SPARK-28199) Remove usage of ProcessingTime in Spark codebase

2019-06-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28199: Assignee: (was: Apache Spark) > Remove usage of ProcessingTime in Spark codebase >

[jira] [Commented] (SPARK-28199) Remove usage of ProcessingTime in Spark codebase

2019-06-28 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874741#comment-16874741 ] Jungtaek Lim commented on SPARK-28199: -- Working on this. Actually I worked this as minor one but

[jira] [Created] (SPARK-28199) Remove usage of ProcessingTime in Spark codebase

2019-06-28 Thread Jungtaek Lim (JIRA)
Jungtaek Lim created SPARK-28199: Summary: Remove usage of ProcessingTime in Spark codebase Key: SPARK-28199 URL: https://issues.apache.org/jira/browse/SPARK-28199 Project: Spark Issue Type:

[jira] [Created] (SPARK-28198) Add mapPartitionsInPandas to allow an iterator of DataFrames

2019-06-28 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-28198: Summary: Add mapPartitionsInPandas to allow an iterator of DataFrames Key: SPARK-28198 URL: https://issues.apache.org/jira/browse/SPARK-28198 Project: Spark

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

2019-06-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874703#comment-16874703 ] Saisai Shao commented on SPARK-25299: - Votes were passed, so what is our plan for code submission?

[jira] [Created] (SPARK-28197) Failed to query on external JSon Partitioned table

2019-06-28 Thread zhangbin (JIRA)
zhangbin created SPARK-28197: Summary: Failed to query on external JSon Partitioned table Key: SPARK-28197 URL: https://issues.apache.org/jira/browse/SPARK-28197 Project: Spark Issue Type: Bug