[jira] [Created] (SPARK-24291) Data source table is not displaying records when files are uploaded to table location

Sushanta Sen created SPARK-24291: Summary: Data source table is not displaying records when files are uploaded to table location Key: SPARK-24291 URL: https://issues.apache.org/jira/browse/SPARK-24291

[jira] [Commented] (SPARK-24278) Create table if not exists is throwing table already exists exception

[ https://issues.apache.org/jira/browse/SPARK-24278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476837#comment-16476837 ] Sushanta Sen commented on SPARK-24278: -- But then it need not to print all the error logs in the sql

[jira] [Comment Edited] (SPARK-24278) Create table if not exists is throwing table already exists exception

[ https://issues.apache.org/jira/browse/SPARK-24278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476828#comment-16476828 ] sandeep katta edited comment on SPARK-24278 at 5/16/18 4:57 AM: As per

[jira] [Commented] (SPARK-24278) Create table if not exists is throwing table already exists exception

[ https://issues.apache.org/jira/browse/SPARK-24278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476828#comment-16476828 ] sandeep katta commented on SPARK-24278: --- As per the code analysis,this is the Exception trace

[jira] [Commented] (SPARK-23455) Default Params in ML should be saved separately

[ https://issues.apache.org/jira/browse/SPARK-23455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476753#comment-16476753 ] Liang-Chi Hsieh commented on SPARK-23455: - According to [~josephkb]'s comment at

[jira] [Commented] (SPARK-23455) Default Params in ML should be saved separately

[ https://issues.apache.org/jira/browse/SPARK-23455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476747#comment-16476747 ] Felix Cheung commented on SPARK-23455: -- does this affect R? > Default Params in ML should be saved

[jira] [Assigned] (SPARK-24115) improve instrumentation for spark.ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-24115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24115: Assignee: Apache Spark > improve instrumentation for spark.ml.tuning >

[jira] [Commented] (SPARK-24115) improve instrumentation for spark.ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-24115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476710#comment-16476710 ] Apache Spark commented on SPARK-24115: -- User 'MrBago' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24115) improve instrumentation for spark.ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-24115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24115: Assignee: (was: Apache Spark) > improve instrumentation for spark.ml.tuning >

[jira] [Resolved] (SPARK-24289) Unable to Infer schema

[ https://issues.apache.org/jira/browse/SPARK-24289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24289. -- Resolution: Duplicate > Unable to Infer schema > -- > >

[jira] [Updated] (SPARK-24289) Unable to Infer schema

[ https://issues.apache.org/jira/browse/SPARK-24289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24289: - Fix Version/s: (was: 2.2.1) > Unable to Infer schema > -- > >

[jira] [Resolved] (SPARK-24286) DataFrameReader.csv - Add missing `delimiter` alias for `sep` in doc

[ https://issues.apache.org/jira/browse/SPARK-24286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24286. -- Resolution: Won't Fix > DataFrameReader.csv - Add missing `delimiter` alias for `sep` in doc >

[jira] [Resolved] (SPARK-24058) Default Params in ML should be saved separately: Python API

[ https://issues.apache.org/jira/browse/SPARK-24058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-24058. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21153

[jira] [Assigned] (SPARK-24058) Default Params in ML should be saved separately: Python API

[ https://issues.apache.org/jira/browse/SPARK-24058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-24058: - Assignee: Liang-Chi Hsieh > Default Params in ML should be saved separately:

[jira] [Assigned] (SPARK-24146) spark.ml parity for sequential pattern mining - PrefixSpan: Python API

[ https://issues.apache.org/jira/browse/SPARK-24146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-24146: - Assignee: Weichen Xu > spark.ml parity for sequential pattern mining - PrefixSpan:

[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer/MesosClusterDispatcher

[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-23943: --- Fix Version/s: (was: 2.4.0) > Improve observability of

[jira] [Updated] (SPARK-23988) [Mesos] Improve handling of appResource in mesos dispatcher when using Docker

[ https://issues.apache.org/jira/browse/SPARK-23988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-23988: --- Target Version/s: (was: 2.3.1, 2.4.0) > [Mesos] Improve handling of appResource in mesos

[jira] [Updated] (SPARK-23943) Improve observability of MesosRestServer/MesosClusterDispatcher

[ https://issues.apache.org/jira/browse/SPARK-23943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-23943: --- Target Version/s: (was: 2.3.1, 2.4.0) > Improve observability of

[jira] [Assigned] (SPARK-24287) Spark -packages option should support classifier, no-transitive, and custom conf

[ https://issues.apache.org/jira/browse/SPARK-24287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24287: Assignee: Apache Spark > Spark -packages option should support classifier, no-transitive,

[jira] [Commented] (SPARK-24287) Spark -packages option should support classifier, no-transitive, and custom conf

[ https://issues.apache.org/jira/browse/SPARK-24287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476500#comment-16476500 ] Apache Spark commented on SPARK-24287: -- User 'fangshil' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24287) Spark -packages option should support classifier, no-transitive, and custom conf

[ https://issues.apache.org/jira/browse/SPARK-24287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24287: Assignee: (was: Apache Spark) > Spark -packages option should support classifier,

[jira] [Resolved] (SPARK-24231) Python API: Provide evaluateEachIteration method or equivalent for spark.ml GBTs

[ https://issues.apache.org/jira/browse/SPARK-24231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-24231. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 21335

[jira] [Assigned] (SPARK-24231) Python API: Provide evaluateEachIteration method or equivalent for spark.ml GBTs

[ https://issues.apache.org/jira/browse/SPARK-24231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-24231: - Assignee: Lu Wang > Python API: Provide evaluateEachIteration method or equivalent for

[jira] [Commented] (SPARK-23601) Remove .md5 files from release

[ https://issues.apache.org/jira/browse/SPARK-23601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476472#comment-16476472 ] Apache Spark commented on SPARK-23601: -- User 'vanzin' has created a pull request for this issue:

[jira] [Updated] (SPARK-24287) Spark -packages option should support classifier, no-transitive, and custom conf

[ https://issues.apache.org/jira/browse/SPARK-24287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24287: --- Summary: Spark -packages option should support classifier, no-transitive, and custom conf (was:

[jira] [Updated] (SPARK-24287) Spark 2.x -packages option should support classifier, no-transitive, and custom conf

[ https://issues.apache.org/jira/browse/SPARK-24287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24287: --- Description: We should extend Spark's -package option to support: # Turn-off transitive dependency

[jira] [Updated] (SPARK-24287) Spark 2.x -packages option should support classifier, no-transitive, and custom conf

[ https://issues.apache.org/jira/browse/SPARK-24287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fangshi Li updated SPARK-24287: --- Description: We should extend Spark's -package option to support: # Turn-off transitive dependency

[jira] [Commented] (SPARK-24288) Enable preventing predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476372#comment-16476372 ] Maryann Xue commented on SPARK-24288: - I agree with you, [~TomaszGaweda], that making this a special

[jira] [Commented] (SPARK-24288) Enable preventing predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476368#comment-16476368 ] Maryann Xue commented on SPARK-24288: - Feel free to assign this to me then, [~smilegator]. > Enable

[jira] [Issue Comment Deleted] (SPARK-23928) High-order function: shuffle(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] H Lu updated SPARK-23928: - Comment: was deleted (was: [~mn-mikke] Should I consider None/null element in the array? ) > High-order

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476356#comment-16476356 ] H Lu commented on SPARK-23928: -- [~mn-mikke] Should I consider None/null element in the array?  > High-order

[jira] [Updated] (SPARK-24290) Instrumentation Improvement: add logNamedValue taking Array types

[ https://issues.apache.org/jira/browse/SPARK-24290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Wang updated SPARK-24290: Summary: Instrumentation Improvement: add logNamedValue taking Array types (was: add a method

[jira] [Created] (SPARK-24290) add a method Instrumentation.logNamedValue taking Array types

Lu Wang created SPARK-24290: --- Summary: add a method Instrumentation.logNamedValue taking Array types Key: SPARK-24290 URL: https://issues.apache.org/jira/browse/SPARK-24290 Project: Spark Issue

[jira] [Commented] (SPARK-24288) Enable preventing predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476303#comment-16476303 ] Xiao Li commented on SPARK-24288: - cc [~maryannxue] You might be interested in this. > Enable

[jira] [Updated] (SPARK-24288) Enable preventing predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-24288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24288: Target Version/s: 2.4.0 > Enable preventing predicate pushdown > > >

[jira] [Assigned] (SPARK-24234) create the bottom-of-task RDD with row buffer

[ https://issues.apache.org/jira/browse/SPARK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24234: Assignee: Apache Spark > create the bottom-of-task RDD with row buffer >

[jira] [Assigned] (SPARK-24234) create the bottom-of-task RDD with row buffer

[ https://issues.apache.org/jira/browse/SPARK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24234: Assignee: (was: Apache Spark) > create the bottom-of-task RDD with row buffer >

[jira] [Commented] (SPARK-24234) create the bottom-of-task RDD with row buffer

[ https://issues.apache.org/jira/browse/SPARK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476285#comment-16476285 ] Apache Spark commented on SPARK-24234: -- User 'jose-torres' has created a pull request for this

[jira] [Commented] (SPARK-24286) DataFrameReader.csv - Add missing `delimiter` alias for `sep` in doc

[ https://issues.apache.org/jira/browse/SPARK-24286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476279#comment-16476279 ] Apache Spark commented on SPARK-24286: -- User 'rohtakdev' has created a pull request for this issue:

[jira] [Commented] (SPARK-24286) DataFrameReader.csv - Add missing `delimiter` alias for `sep` in doc

[ https://issues.apache.org/jira/browse/SPARK-24286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476280#comment-16476280 ] Poorak Kashyap commented on SPARK-24286: Added a PR - https://github.com/apache/spark/pull/21336

[jira] [Assigned] (SPARK-24286) DataFrameReader.csv - Add missing `delimiter` alias for `sep` in doc

[ https://issues.apache.org/jira/browse/SPARK-24286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24286: Assignee: Apache Spark > DataFrameReader.csv - Add missing `delimiter` alias for `sep` in

[jira] [Assigned] (SPARK-24286) DataFrameReader.csv - Add missing `delimiter` alias for `sep` in doc

[ https://issues.apache.org/jira/browse/SPARK-24286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24286: Assignee: (was: Apache Spark) > DataFrameReader.csv - Add missing `delimiter` alias

[jira] [Assigned] (SPARK-24231) Python API: Provide evaluateEachIteration method or equivalent for spark.ml GBTs

[ https://issues.apache.org/jira/browse/SPARK-24231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24231: Assignee: Apache Spark > Python API: Provide evaluateEachIteration method or equivalent

[jira] [Commented] (SPARK-24231) Python API: Provide evaluateEachIteration method or equivalent for spark.ml GBTs

[ https://issues.apache.org/jira/browse/SPARK-24231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476250#comment-16476250 ] Apache Spark commented on SPARK-24231: -- User 'ludatabricks' has created a pull request for this

[jira] [Assigned] (SPARK-24231) Python API: Provide evaluateEachIteration method or equivalent for spark.ml GBTs

[ https://issues.apache.org/jira/browse/SPARK-24231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24231: Assignee: (was: Apache Spark) > Python API: Provide evaluateEachIteration method or

[jira] [Created] (SPARK-24289) Unable to Infer schema

Muraliraja created SPARK-24289: -- Summary: Unable to Infer schema Key: SPARK-24289 URL: https://issues.apache.org/jira/browse/SPARK-24289 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-24288) Enable preventing predicate pushdown

Tomasz Gawęda created SPARK-24288: - Summary: Enable preventing predicate pushdown Key: SPARK-24288 URL: https://issues.apache.org/jira/browse/SPARK-24288 Project: Spark Issue Type: New

[jira] [Created] (SPARK-24287) Spark 2.x -packages option should support classifier, no-transitive, and custom conf

Fangshi Li created SPARK-24287: -- Summary: Spark 2.x -packages option should support classifier, no-transitive, and custom conf Key: SPARK-24287 URL: https://issues.apache.org/jira/browse/SPARK-24287

[jira] [Assigned] (SPARK-24040) support single partition aggregates

[ https://issues.apache.org/jira/browse/SPARK-24040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-24040: Assignee: Jose Torres > support single partition aggregates >

[jira] [Resolved] (SPARK-24040) support single partition aggregates

[ https://issues.apache.org/jira/browse/SPARK-24040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-24040. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21239

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476213#comment-16476213 ] H Lu commented on SPARK-23928: -- [~mn-mikke] I use the modern version of Fisher-Yates. Thanks a lot! >

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.10.0

[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476188#comment-16476188 ] shane knapp commented on SPARK-23874: - thanks for the update!  i'm definitely keeping an eye on this

[jira] [Created] (SPARK-24286) DataFrameReader.csv - Add missing `delimiter` alias for `sep` in doc

Poorak Kashyap created SPARK-24286: -- Summary: DataFrameReader.csv - Add missing `delimiter` alias for `sep` in doc Key: SPARK-24286 URL: https://issues.apache.org/jira/browse/SPARK-24286 Project:

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476108#comment-16476108 ] Marek Novotny commented on SPARK-23928: --- [~hzlu] Cool. (Re: Testing) Sounds good to me. It would be

[jira] [Comment Edited] (SPARK-24107) ChunkedByteBuffer.writeFully method has not reset the limit value

[ https://issues.apache.org/jira/browse/SPARK-24107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475350#comment-16475350 ] Josh Rosen edited comment on SPARK-24107 at 5/15/18 4:25 PM: - To work around

[jira] [Created] (SPARK-24285) Flaky test: ContinuousSuite.query without test harness

Dongjoon Hyun created SPARK-24285: - Summary: Flaky test: ContinuousSuite.query without test harness Key: SPARK-24285 URL: https://issues.apache.org/jira/browse/SPARK-24285 Project: Spark

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.10.0

[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476052#comment-16476052 ] Xiao Li commented on SPARK-23874: - [~bryanc] Thanks! I see. Ideally, such a regression should be fixed in

[jira] [Updated] (SPARK-23504) Flaky test: RateSourceV2Suite.basic microbatch execution

[ https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23504: -- Description: Seen on an unrelated change:

[jira] [Updated] (SPARK-24259) ArrayWriter for Arrow produces wrong output

[ https://issues.apache.org/jira/browse/SPARK-24259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24259: Component/s: PySpark > ArrayWriter for Arrow produces wrong output >

[jira] [Comment Edited] (SPARK-23928) High-order function: shuffle(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476043#comment-16476043 ] H Lu edited comment on SPARK-23928 at 5/15/18 3:48 PM: --- I will submit a pull

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476043#comment-16476043 ] H Lu commented on SPARK-23928: -- I will submit a pull request by today. Sorry about the delay. By the way,

[jira] [Created] (SPARK-24284) java.util.NoSuchElementException in Spark Streaming with Kafka

Ujjal Satpathy created SPARK-24284: -- Summary: java.util.NoSuchElementException in Spark Streaming with Kafka Key: SPARK-24284 URL: https://issues.apache.org/jira/browse/SPARK-24284 Project: Spark

[jira] [Updated] (SPARK-24283) Make standard scaler work without legacy MLlib

[ https://issues.apache.org/jira/browse/SPARK-24283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-24283: Labels: starter (was: ) > Make standard scaler work without legacy MLlib >

[jira] [Created] (SPARK-24283) Make standard scaler work without legacy MLlib

holdenk created SPARK-24283: --- Summary: Make standard scaler work without legacy MLlib Key: SPARK-24283 URL: https://issues.apache.org/jira/browse/SPARK-24283 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24282) Add support for PMML export for the Standard Scaler Stage

[ https://issues.apache.org/jira/browse/SPARK-24282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475957#comment-16475957 ] holdenk commented on SPARK-24282: - I'm going to work on this one. > Add support for PMML export for the

[jira] [Assigned] (SPARK-24282) Add support for PMML export for the Standard Scaler Stage

[ https://issues.apache.org/jira/browse/SPARK-24282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-24282: --- Assignee: holdenk > Add support for PMML export for the Standard Scaler Stage >

[jira] [Created] (SPARK-24282) Add support for PMML export for the Standard Scaler Stage

holdenk created SPARK-24282: --- Summary: Add support for PMML export for the Standard Scaler Stage Key: SPARK-24282 URL: https://issues.apache.org/jira/browse/SPARK-24282 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24273) Failure while using .checkpoint method

[ https://issues.apache.org/jira/browse/SPARK-24273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475941#comment-16475941 ] Kazuaki Ishizaki commented on SPARK-24273: -- Thank you for reporting this issue? Would it be

[jira] [Commented] (SPARK-23778) SparkContext.emptyRDD confuses SparkContext.union

[ https://issues.apache.org/jira/browse/SPARK-23778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475934#comment-16475934 ] Apache Spark commented on SPARK-23778: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23778) SparkContext.emptyRDD confuses SparkContext.union

[ https://issues.apache.org/jira/browse/SPARK-23778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23778: Assignee: (was: Apache Spark) > SparkContext.emptyRDD confuses SparkContext.union >

[jira] [Assigned] (SPARK-23778) SparkContext.emptyRDD confuses SparkContext.union

[ https://issues.apache.org/jira/browse/SPARK-23778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23778: Assignee: Apache Spark > SparkContext.emptyRDD confuses SparkContext.union >

[jira] [Updated] (SPARK-23778) SparkContext.emptyRDD confuses SparkContext.union

[ https://issues.apache.org/jira/browse/SPARK-23778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-23778: Priority: Trivial (was: Minor) > SparkContext.emptyRDD confuses SparkContext.union >

[jira] [Updated] (SPARK-24259) ArrayWriter for Arrow produces wrong output

[ https://issues.apache.org/jira/browse/SPARK-24259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24259: Affects Version/s: (was: 2.4.0) 2.3.0 > ArrayWriter for Arrow produces

[jira] [Commented] (SPARK-24236) continuous replacement for ShuffleExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-24236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475902#comment-16475902 ] Apache Spark commented on SPARK-24236: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-24236) continuous replacement for ShuffleExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-24236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24236: Assignee: Apache Spark > continuous replacement for ShuffleExchangeExec >

[jira] [Assigned] (SPARK-24236) continuous replacement for ShuffleExchangeExec

[ https://issues.apache.org/jira/browse/SPARK-24236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24236: Assignee: (was: Apache Spark) > continuous replacement for ShuffleExchangeExec >

[jira] [Updated] (SPARK-24259) ArrayWriter for Arrow produces wrong output

[ https://issues.apache.org/jira/browse/SPARK-24259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24259: Labels: correctness (was: ) > ArrayWriter for Arrow produces wrong output >

[jira] [Resolved] (SPARK-24259) ArrayWriter for Arrow produces wrong output

[ https://issues.apache.org/jira/browse/SPARK-24259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24259. - Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 Issue resolved by pull

[jira] [Assigned] (SPARK-24259) ArrayWriter for Arrow produces wrong output

[ https://issues.apache.org/jira/browse/SPARK-24259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24259: --- Assignee: Liang-Chi Hsieh > ArrayWriter for Arrow produces wrong output >

[jira] [Created] (SPARK-24281) Option to disable Spark UI's web filter in YARN-client mode

Zoltán Zvara created SPARK-24281: Summary: Option to disable Spark UI's web filter in YARN-client mode Key: SPARK-24281 URL: https://issues.apache.org/jira/browse/SPARK-24281 Project: Spark

[jira] [Commented] (SPARK-24231) Python API: Provide evaluateEachIteration method or equivalent for spark.ml GBTs

[ https://issues.apache.org/jira/browse/SPARK-24231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475841#comment-16475841 ] Krishna Kalyan commented on SPARK-24231: [~WeichenXu123] I would like to take up this task. 

[jira] [Commented] (SPARK-23681) Switch OrcFileFormat to newer hadoop.mapreduce output classes

[ https://issues.apache.org/jira/browse/SPARK-23681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475790#comment-16475790 ] Steve Loughran commented on SPARK-23681: sorry, been offline * yes, cut the version * lower on my

[jira] [Assigned] (SPARK-24276) semanticHash() returns different values for semantically the same IS IN

[ https://issues.apache.org/jira/browse/SPARK-24276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24276: Assignee: Apache Spark > semanticHash() returns different values for semantically the

[jira] [Commented] (SPARK-24276) semanticHash() returns different values for semantically the same IS IN

[ https://issues.apache.org/jira/browse/SPARK-24276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475756#comment-16475756 ] Apache Spark commented on SPARK-24276: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24276) semanticHash() returns different values for semantically the same IS IN

[ https://issues.apache.org/jira/browse/SPARK-24276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24276: Assignee: (was: Apache Spark) > semanticHash() returns different values for

[jira] [Assigned] (SPARK-22234) Distinct window functions are not supported

[ https://issues.apache.org/jira/browse/SPARK-22234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22234: Assignee: Apache Spark > Distinct window functions are not supported >

[jira] [Commented] (SPARK-22234) Distinct window functions are not supported

[ https://issues.apache.org/jira/browse/SPARK-22234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475710#comment-16475710 ] Apache Spark commented on SPARK-22234: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22234) Distinct window functions are not supported

[ https://issues.apache.org/jira/browse/SPARK-22234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22234: Assignee: (was: Apache Spark) > Distinct window functions are not supported >

[jira] [Commented] (SPARK-23932) High-order function: zip_with(array, array, function<T, U, R>) → array

[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475688#comment-16475688 ] Carlos Peña commented on SPARK-23932: - I would like to take this one > High-order function:

[jira] [Commented] (SPARK-24260) Support for multi-statement SQL in SparkSession.sql API

[ https://issues.apache.org/jira/browse/SPARK-24260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475687#comment-16475687 ] Ravindra Nath Kakarla commented on SPARK-24260: --- Can we override the return value the

[jira] [Commented] (SPARK-24260) Support for multi-statement SQL in SparkSession.sql API

[ https://issues.apache.org/jira/browse/SPARK-24260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475678#comment-16475678 ] Marco Gaido commented on SPARK-24260: - I don't think it is a good idea. Ho can you return the result

[jira] [Updated] (SPARK-24279) Incompatible byte code errors, when using test-jar of spark sql.

[ https://issues.apache.org/jira/browse/SPARK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-24279: Component/s: Tests > Incompatible byte code errors, when using test-jar of spark sql. >

[jira] [Created] (SPARK-24280) Speed up indexing of files in object stores by using listFiles(path, recursive=true)

Steve Loughran created SPARK-24280: -- Summary: Speed up indexing of files in object stores by using listFiles(path, recursive=true) Key: SPARK-24280 URL: https://issues.apache.org/jira/browse/SPARK-24280

[jira] [Updated] (SPARK-24279) Incompatible byte code errors, when using test-jar of spark sql.

[ https://issues.apache.org/jira/browse/SPARK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-24279: Description: Using test libraries available with spark sql streaming, produces weird

[jira] [Created] (SPARK-24279) Incompatible byte code errors, when using test-jar of spark sql.

Prashant Sharma created SPARK-24279: --- Summary: Incompatible byte code errors, when using test-jar of spark sql. Key: SPARK-24279 URL: https://issues.apache.org/jira/browse/SPARK-24279 Project:

[jira] [Commented] (SPARK-24278) Create table if not exists is throwing table already exists exception

[ https://issues.apache.org/jira/browse/SPARK-24278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475510#comment-16475510 ] sandeep katta commented on SPARK-24278: --- I will be working on this Jira > Create table if not

[jira] [Created] (SPARK-24278) Create table if not exists is throwing table already exists exception

Sushanta Sen created SPARK-24278: Summary: Create table if not exists is throwing table already exists exception Key: SPARK-24278 URL: https://issues.apache.org/jira/browse/SPARK-24278 Project: Spark

[jira] [Commented] (SPARK-24241) Do not fail fast when dynamic resource allocation enabled with 0 executor

[ https://issues.apache.org/jira/browse/SPARK-24241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475480#comment-16475480 ] Saisai Shao commented on SPARK-24241: - Issue resolved by pull request 21290

[jira] [Resolved] (SPARK-24241) Do not fail fast when dynamic resource allocation enabled with 0 executor

[ https://issues.apache.org/jira/browse/SPARK-24241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-24241. - Resolution: Fixed > Do not fail fast when dynamic resource allocation enabled with 0 executor >

[jira] [Updated] (SPARK-24241) Do not fail fast when dynamic resource allocation enabled with 0 executor

[ https://issues.apache.org/jira/browse/SPARK-24241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-24241: Fix Version/s: 2.4.0 > Do not fail fast when dynamic resource allocation enabled with 0 executor >

  1   2   >