[jira] [Commented] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310872#comment-16310872 ] Felix Cheung commented on SPARK-16693: -- I thought we did but I couldn't find any record. I suppose

[jira] [Commented] (SPARK-22771) SQL concat for binary

[ https://issues.apache.org/jira/browse/SPARK-22771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310847#comment-16310847 ] Apache Spark commented on SPARK-22771: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22953) Duplicated secret volumes in Spark pods when init-containers are used

[ https://issues.apache.org/jira/browse/SPARK-22953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22953: Assignee: (was: Apache Spark) > Duplicated secret volumes in Spark pods when

[jira] [Commented] (SPARK-22953) Duplicated secret volumes in Spark pods when init-containers are used

[ https://issues.apache.org/jira/browse/SPARK-22953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310835#comment-16310835 ] Apache Spark commented on SPARK-22953: -- User 'liyinan926' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22953) Duplicated secret volumes in Spark pods when init-containers are used

[ https://issues.apache.org/jira/browse/SPARK-22953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22953: Assignee: Apache Spark > Duplicated secret volumes in Spark pods when init-containers are

[jira] [Resolved] (SPARK-22933) R Structured Streaming API for withWatermark, trigger, partitionBy

[ https://issues.apache.org/jira/browse/SPARK-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22933. -- Resolution: Fixed Fix Version/s: 2.3.0 Target Version/s: 2.3.0 > R Structured

[jira] [Commented] (SPARK-18844) Add more binary classification metrics to BinaryClassificationMetrics

[ https://issues.apache.org/jira/browse/SPARK-18844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310776#comment-16310776 ] Sandeep Kumar Choudhary commented on SPARK-18844: - I am working on this JIRA. > Add more

[jira] [Resolved] (SPARK-22944) improve FoldablePropagation

[ https://issues.apache.org/jira/browse/SPARK-22944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22944. - Resolution: Fixed Fix Version/s: 2.3.0 > improve FoldablePropagation >

[jira] [Created] (SPARK-22953) Duplicated secret volumes in Spark pods when init-containers are used

Yinan Li created SPARK-22953: Summary: Duplicated secret volumes in Spark pods when init-containers are used Key: SPARK-22953 URL: https://issues.apache.org/jira/browse/SPARK-22953 Project: Spark

[jira] [Assigned] (SPARK-22940) Test suite HiveExternalCatalogVersionsSuite fails on platforms that don't have wget installed

[ https://issues.apache.org/jira/browse/SPARK-22940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22940: Assignee: (was: Apache Spark) > Test suite HiveExternalCatalogVersionsSuite fails on

[jira] [Commented] (SPARK-22940) Test suite HiveExternalCatalogVersionsSuite fails on platforms that don't have wget installed

[ https://issues.apache.org/jira/browse/SPARK-22940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310717#comment-16310717 ] Apache Spark commented on SPARK-22940: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-22940) Test suite HiveExternalCatalogVersionsSuite fails on platforms that don't have wget installed

[ https://issues.apache.org/jira/browse/SPARK-22940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22940: Assignee: Apache Spark > Test suite HiveExternalCatalogVersionsSuite fails on platforms

[jira] [Commented] (SPARK-22711) _pickle.PicklingError: args[0] from __newobj__ args has the wrong class from cloudpickle.py

[ https://issues.apache.org/jira/browse/SPARK-22711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310706#comment-16310706 ] Prateek commented on SPARK-22711: - Sorry. I will update it. > _pickle.PicklingError: args[0] from

[jira] [Commented] (SPARK-11215) Add multiple columns support to StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310690#comment-16310690 ] Apache Spark commented on SPARK-11215: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-22952) Deprecate stageAttemptId in favour of stageAttemptNumber

[ https://issues.apache.org/jira/browse/SPARK-22952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310672#comment-16310672 ] Xianjin YE commented on SPARK-22952: I will send pr soon > Deprecate stageAttemptId in favour of

[jira] [Created] (SPARK-22952) Deprecate stageAttemptId in favour of stageAttemptNumber

Xianjin YE created SPARK-22952: -- Summary: Deprecate stageAttemptId in favour of stageAttemptNumber Key: SPARK-22952 URL: https://issues.apache.org/jira/browse/SPARK-22952 Project: Spark Issue

[jira] [Updated] (SPARK-22950) user classpath first cause no class found exception

[ https://issues.apache.org/jira/browse/SPARK-22950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-22950: - Description: {code:java} bin/spark-submit --class some.class.enbaled.hive.Support --master yarn

[jira] [Commented] (SPARK-22950) user classpath first cause no class found exception

[ https://issues.apache.org/jira/browse/SPARK-22950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310630#comment-16310630 ] Apache Spark commented on SPARK-22950: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22950) user classpath first cause no class found exception

[ https://issues.apache.org/jira/browse/SPARK-22950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22950: Assignee: (was: Apache Spark) > user classpath first cause no class found exception >

[jira] [Assigned] (SPARK-22950) user classpath first cause no class found exception

[ https://issues.apache.org/jira/browse/SPARK-22950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22950: Assignee: Apache Spark > user classpath first cause no class found exception >

[jira] [Commented] (SPARK-21475) Change the usage of FileInputStream/OutputStream to Files.newInput/OutputStream in the critical path

[ https://issues.apache.org/jira/browse/SPARK-21475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310619#comment-16310619 ] Apache Spark commented on SPARK-21475: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Updated] (SPARK-22951) count() after dropDuplicates() on emptyDataFrame returns incorrect value

[ https://issues.apache.org/jira/browse/SPARK-22951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Dreibelbis updated SPARK-22951: --- Summary: count() after dropDuplicates() on emptyDataFrame returns incorrect value

[jira] [Created] (SPARK-22951) count() after dropDuplicates() on emptyDataFrame() returns incorrect value

Michael Dreibelbis created SPARK-22951: -- Summary: count() after dropDuplicates() on emptyDataFrame() returns incorrect value Key: SPARK-22951 URL: https://issues.apache.org/jira/browse/SPARK-22951

[jira] [Created] (SPARK-22950) user classpath first cause no class found exception

Kent Yao created SPARK-22950: Summary: user classpath first cause no class found exception Key: SPARK-22950 URL: https://issues.apache.org/jira/browse/SPARK-22950 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21926) Compatibility between ML Transformers and Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-21926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-21926: -- Target Version/s: (was: 2.3.0) > Compatibility between ML Transformers and

[jira] [Commented] (SPARK-21926) Compatibility between ML Transformers and Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-21926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310582#comment-16310582 ] Joseph K. Bradley commented on SPARK-21926: --- This will be mostly done in Spark 2.3, but there

[jira] [Commented] (SPARK-22797) Add multiple column support to PySpark Bucketizer

[ https://issues.apache.org/jira/browse/SPARK-22797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310580#comment-16310580 ] Joseph K. Bradley commented on SPARK-22797: --- [~mlnick] Shall we retarget this and the other

[jira] [Updated] (SPARK-22883) ML test for StructuredStreaming: spark.ml.feature, A-M

[ https://issues.apache.org/jira/browse/SPARK-22883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22883: -- Target Version/s: (was: 2.3.0) > ML test for StructuredStreaming: spark.ml.feature,

[jira] [Commented] (SPARK-22887) ML test for StructuredStreaming: spark.ml.fpm

[ https://issues.apache.org/jira/browse/SPARK-22887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310579#comment-16310579 ] Joseph K. Bradley commented on SPARK-22887: --- Not currently, I think, so please go ahead! It

[jira] [Updated] (SPARK-22735) Add VectorSizeHint to ML features documentation

[ https://issues.apache.org/jira/browse/SPARK-22735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22735: -- Shepherd: Joseph K. Bradley > Add VectorSizeHint to ML features documentation >

[jira] [Updated] (SPARK-22882) ML test for StructuredStreaming: spark.ml.classification

[ https://issues.apache.org/jira/browse/SPARK-22882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22882: -- Target Version/s: (was: 2.3.0) > ML test for StructuredStreaming:

[jira] [Updated] (SPARK-22887) ML test for StructuredStreaming: spark.ml.fpm

[ https://issues.apache.org/jira/browse/SPARK-22887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22887: -- Target Version/s: (was: 2.3.0) > ML test for StructuredStreaming: spark.ml.fpm >

[jira] [Updated] (SPARK-22885) ML test for StructuredStreaming: spark.ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-22885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22885: -- Target Version/s: (was: 2.3.0) > ML test for StructuredStreaming: spark.ml.tuning >

[jira] [Updated] (SPARK-22886) ML test for StructuredStreaming: spark.ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-22886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22886: -- Target Version/s: (was: 2.3.0) > ML test for StructuredStreaming:

[jira] [Updated] (SPARK-22735) Add VectorSizeHint to ML features documentation

[ https://issues.apache.org/jira/browse/SPARK-22735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22735: -- Issue Type: Documentation (was: Improvement) > Add VectorSizeHint to ML features

[jira] [Updated] (SPARK-22735) Add VectorSizeHint to ML features documentation

[ https://issues.apache.org/jira/browse/SPARK-22735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22735: -- Component/s: Documentation > Add VectorSizeHint to ML features documentation >

[jira] [Updated] (SPARK-22884) ML test for StructuredStreaming: spark.ml.clustering

[ https://issues.apache.org/jira/browse/SPARK-22884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22884: -- Target Version/s: (was: 2.3.0) > ML test for StructuredStreaming:

[jira] [Updated] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22915: -- Target Version/s: (was: 2.3.0) > ML test for StructuredStreaming: spark.ml.feature,

[jira] [Updated] (SPARK-15571) Pipeline unit test improvements

[ https://issues.apache.org/jira/browse/SPARK-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15571: -- Summary: Pipeline unit test improvements (was: Pipeline unit test improvements for

[jira] [Updated] (SPARK-15571) Pipeline unit test improvements for 2.3

[ https://issues.apache.org/jira/browse/SPARK-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15571: -- Shepherd: (was: Joseph K. Bradley) > Pipeline unit test improvements for 2.3 >

[jira] [Updated] (SPARK-15571) Pipeline unit test improvements for 2.3

[ https://issues.apache.org/jira/browse/SPARK-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15571: -- Target Version/s: (was: 2.3.0) > Pipeline unit test improvements for 2.3 >

[jira] [Resolved] (SPARK-20960) make ColumnVector public

[ https://issues.apache.org/jira/browse/SPARK-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20960. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.3.0 > make ColumnVector public

[jira] [Assigned] (SPARK-22949) Reduce memory requirement for TrainValidationSplit

[ https://issues.apache.org/jira/browse/SPARK-22949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22949: Assignee: Apache Spark > Reduce memory requirement for TrainValidationSplit >

[jira] [Assigned] (SPARK-22949) Reduce memory requirement for TrainValidationSplit

[ https://issues.apache.org/jira/browse/SPARK-22949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22949: Assignee: (was: Apache Spark) > Reduce memory requirement for TrainValidationSplit >

[jira] [Commented] (SPARK-22949) Reduce memory requirement for TrainValidationSplit

[ https://issues.apache.org/jira/browse/SPARK-22949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310465#comment-16310465 ] Apache Spark commented on SPARK-22949: -- User 'MrBago' has created a pull request for this issue:

[jira] [Created] (SPARK-22949) Reduce memory requirement for TrainValidationSplit

Bago Amirbekian created SPARK-22949: --- Summary: Reduce memory requirement for TrainValidationSplit Key: SPARK-22949 URL: https://issues.apache.org/jira/browse/SPARK-22949 Project: Spark

[jira] [Commented] (SPARK-22947) SPIP: as-of join in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310423#comment-16310423 ] Michael Armbrust commented on SPARK-22947: -- +1 to [~rxin]'s question. This seems like it might

[jira] [Commented] (SPARK-22947) SPIP: as-of join in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310388#comment-16310388 ] Reynold Xin commented on SPARK-22947: - Li, Why are these not just normal inner joins with conditions

[jira] [Created] (SPARK-22948) "SparkPodInitContainer" shouldn't be in "rest" package

Marcelo Vanzin created SPARK-22948: -- Summary: "SparkPodInitContainer" shouldn't be in "rest" package Key: SPARK-22948 URL: https://issues.apache.org/jira/browse/SPARK-22948 Project: Spark

[jira] [Updated] (SPARK-22928) API Documentation issue for org.apache.spark.sql.streaming.Trigger

[ https://issues.apache.org/jira/browse/SPARK-22928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ganesh Chand updated SPARK-22928: - Affects Version/s: 1.6.3 2.0.0 2.2.1 > API

[jira] [Updated] (SPARK-22928) API Documentation issue for org.apache.spark.sql.streaming.Trigger

[ https://issues.apache.org/jira/browse/SPARK-22928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ganesh Chand updated SPARK-22928: - Description: 1) {{Trigger.java}} link is broken in the documentation -

[jira] [Assigned] (SPARK-22930) Improve the description of Vectorized UDFs for non-deterministic cases

[ https://issues.apache.org/jira/browse/SPARK-22930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22930: Assignee: Apache Spark > Improve the description of Vectorized UDFs for non-deterministic

[jira] [Assigned] (SPARK-22930) Improve the description of Vectorized UDFs for non-deterministic cases

[ https://issues.apache.org/jira/browse/SPARK-22930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22930: Assignee: (was: Apache Spark) > Improve the description of Vectorized UDFs for

[jira] [Commented] (SPARK-22930) Improve the description of Vectorized UDFs for non-deterministic cases

[ https://issues.apache.org/jira/browse/SPARK-22930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310341#comment-16310341 ] Apache Spark commented on SPARK-22930: -- User 'icexelloss' has created a pull request for this issue:

[jira] [Updated] (SPARK-22928) API Documentation issue for org.apache.spark.sql.streaming.Trigger

[ https://issues.apache.org/jira/browse/SPARK-22928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ganesh Chand updated SPARK-22928: - Description: 1) {{Trigger.java}} link is broken in the documentation -

[jira] [Resolved] (SPARK-21809) Change Stage Page to use datatables to support sorting columns and searching

[ https://issues.apache.org/jira/browse/SPARK-21809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nuochen Lyu resolved SPARK-21809. - Resolution: Fixed > Change Stage Page to use datatables to support sorting columns and searching

[jira] [Commented] (SPARK-22887) ML test for StructuredStreaming: spark.ml.fpm

[ https://issues.apache.org/jira/browse/SPARK-22887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310258#comment-16310258 ] Sandor Murakozi commented on SPARK-22887: - Is anyone working on this? If not I would like to

[jira] [Updated] (SPARK-22947) SPIP: as-of join in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-22947: --- Description: h2. Background and Motivation Time series analysis is one of the most common analysis on

[jira] [Updated] (SPARK-22947) SPIP: as-of join in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-22947: --- Description: h2. Background and Motivation Time series analysis is one of the most common analysis on

[jira] [Updated] (SPARK-22947) SPIP: as-of join in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-22947: --- Attachment: SPIP_ as-of join in Spark SQL (1).pdf > SPIP: as-of join in Spark SQL >

[jira] [Created] (SPARK-22947) SPIP: as-of join in Spark SQL

Li Jin created SPARK-22947: -- Summary: SPIP: as-of join in Spark SQL Key: SPARK-22947 URL: https://issues.apache.org/jira/browse/SPARK-22947 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-22896) Improvement in String interpolation

[ https://issues.apache.org/jira/browse/SPARK-22896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310119#comment-16310119 ] Dongjoon Hyun commented on SPARK-22896: --- Thank you! > Improvement in String interpolation >

[jira] [Commented] (SPARK-22553) Drop FROM in nonReserved

[ https://issues.apache.org/jira/browse/SPARK-22553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310068#comment-16310068 ] Suchith J N commented on SPARK-22553: - The change breaks 3 tests 1. *TableIdentifierParserSuite* :

[jira] [Commented] (SPARK-22896) Improvement in String interpolation

[ https://issues.apache.org/jira/browse/SPARK-22896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310055#comment-16310055 ] Sean Owen commented on SPARK-22896: --- Oops, right. Also merged to 2.3. > Improvement in String

[jira] [Commented] (SPARK-22896) Improvement in String interpolation

[ https://issues.apache.org/jira/browse/SPARK-22896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310038#comment-16310038 ] Dongjoon Hyun commented on SPARK-22896: --- [~srowen]. This is in `master` branch only. Can we have

[jira] [Issue Comment Deleted] (SPARK-22553) Drop FROM in nonReserved

[ https://issues.apache.org/jira/browse/SPARK-22553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suchith J N updated SPARK-22553: Comment: was deleted (was: Shall I submit a PR?) > Drop FROM in nonReserved >

[jira] [Resolved] (SPARK-22896) Improvement in String interpolation

[ https://issues.apache.org/jira/browse/SPARK-22896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22896. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20070

[jira] [Assigned] (SPARK-22896) Improvement in String interpolation

[ https://issues.apache.org/jira/browse/SPARK-22896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22896: - Assignee: Chetan Khatri > Improvement in String interpolation >

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309910#comment-16309910 ] Thomas Graves commented on SPARK-22683: --- [~jcuquemelle] . just to confirm your applications

[jira] [Commented] (SPARK-22826) [SQL] findWiderTypeForTwo Fails over StructField of Array

[ https://issues.apache.org/jira/browse/SPARK-22826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309794#comment-16309794 ] Aleksander Eskilson commented on SPARK-22826: - This bug would affect 2.3.0, and so would also

[jira] [Created] (SPARK-22946) Recursive withColumn calls cause org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

Harpreet Chopra created SPARK-22946: --- Summary: Recursive withColumn calls cause org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB Key: SPARK-22946 URL:

[jira] [Assigned] (SPARK-22945) add java UDF APIs in the functions object

[ https://issues.apache.org/jira/browse/SPARK-22945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22945: Assignee: Wenchen Fan (was: Apache Spark) > add java UDF APIs in the functions object >

[jira] [Commented] (SPARK-22945) add java UDF APIs in the functions object

[ https://issues.apache.org/jira/browse/SPARK-22945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309730#comment-16309730 ] Apache Spark commented on SPARK-22945: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22945) add java UDF APIs in the functions object

[ https://issues.apache.org/jira/browse/SPARK-22945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22945: Assignee: Apache Spark (was: Wenchen Fan) > add java UDF APIs in the functions object >

[jira] [Created] (SPARK-22945) add java UDF APIs in the functions object

Wenchen Fan created SPARK-22945: --- Summary: add java UDF APIs in the functions object Key: SPARK-22945 URL: https://issues.apache.org/jira/browse/SPARK-22945 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions

[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20236. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.3.0 > Overwrite a partitioned

[jira] [Resolved] (SPARK-22934) Make optional clauses order insensitive for CREATE TABLE SQL statement

[ https://issues.apache.org/jira/browse/SPARK-22934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22934. - Resolution: Fixed Fix Version/s: 2.3.0 > Make optional clauses order insensitive for CREATE TABLE

[jira] [Resolved] (SPARK-17833) 'monotonicallyIncreasingId()' should be deterministic

[ https://issues.apache.org/jira/browse/SPARK-17833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17833. --- Resolution: Duplicate > 'monotonicallyIncreasingId()' should be deterministic >

[jira] [Commented] (SPARK-22936) providing HttpStreamSource and HttpStreamSink

[ https://issues.apache.org/jira/browse/SPARK-22936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309682#comment-16309682 ] Sean Owen commented on SPARK-22936: --- The typical place to list these is https://spark-packages.org/ >

[jira] [Comment Edited] (SPARK-22942) Spark Sql UDF throwing NullPointer when adding a filter on a columns that uses that UDF

[ https://issues.apache.org/jira/browse/SPARK-22942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309663#comment-16309663 ] Matthew Fishkin edited comment on SPARK-22942 at 1/3/18 1:50 PM: - So the

[jira] [Comment Edited] (SPARK-22942) Spark Sql UDF throwing NullPointer when adding a filter on a columns that uses that UDF

[ https://issues.apache.org/jira/browse/SPARK-22942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309663#comment-16309663 ] Matthew Fishkin edited comment on SPARK-22942 at 1/3/18 1:49 PM: - So the

[jira] [Commented] (SPARK-22942) Spark Sql UDF throwing NullPointer when adding a filter on a columns that uses that UDF

[ https://issues.apache.org/jira/browse/SPARK-22942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309663#comment-16309663 ] Matthew Fishkin commented on SPARK-22942: - So the fact that [val rightBreakdown =

[jira] [Assigned] (SPARK-22938) Assert that SQLConf.get is accessed only on the driver.

[ https://issues.apache.org/jira/browse/SPARK-22938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22938: --- Assignee: Juliusz Sompolski > Assert that SQLConf.get is accessed only on the driver. >

[jira] [Resolved] (SPARK-22938) Assert that SQLConf.get is accessed only on the driver.

[ https://issues.apache.org/jira/browse/SPARK-22938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22938. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20136

[jira] [Comment Edited] (SPARK-22936) providing HttpStreamSource and HttpStreamSink

[ https://issues.apache.org/jira/browse/SPARK-22936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309220#comment-16309220 ] bluejoe edited comment on SPARK-22936 at 1/3/18 1:31 PM: - The latest

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309585#comment-16309585 ] Hyukjin Kwon commented on SPARK-7721: - [~rxin] What do you think about doing a script and then

[jira] [Commented] (SPARK-22711) _pickle.PicklingError: args[0] from __newobj__ args has the wrong class from cloudpickle.py

[ https://issues.apache.org/jira/browse/SPARK-22711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309582#comment-16309582 ] Hyukjin Kwon commented on SPARK-22711: -- Thanks [~PrateekRM]. However, seems it's not quite

[jira] [Commented] (SPARK-19228) inferSchema function processed csv date column as string and "dateFormat" DataSource option is ignored

[ https://issues.apache.org/jira/browse/SPARK-19228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309509#comment-16309509 ] Apache Spark commented on SPARK-19228: -- User 'sergey-rubtsov' has created a pull request for this

[jira] [Commented] (SPARK-17833) 'monotonicallyIncreasingId()' should be deterministic

[ https://issues.apache.org/jira/browse/SPARK-17833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309411#comment-16309411 ] Sujith Jay Nair commented on SPARK-17833: - This issue is resolved in 2.0, as mentioned in

[jira] [Commented] (SPARK-22898) collect_set aggregation on bucketed table causes an exchange stage

[ https://issues.apache.org/jira/browse/SPARK-22898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309407#comment-16309407 ] Modi Tamam commented on SPARK-22898: Sure, no problem. I did double check it on 2.2.1, and it looks

[jira] [Commented] (SPARK-22714) Spark API Not responding when Fatal exception occurred in event loop

[ https://issues.apache.org/jira/browse/SPARK-22714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309366#comment-16309366 ] Sujith Jay Nair commented on SPARK-22714: - Hi [~todesking], is this reproducible outside of Spark

[jira] [Commented] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309363#comment-16309363 ] Saisai Shao commented on SPARK-22876: - This looks like a bug, ideally we should get number of

[jira] [Assigned] (SPARK-22944) improve FoldablePropagation

[ https://issues.apache.org/jira/browse/SPARK-22944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22944: Assignee: Wenchen Fan (was: Apache Spark) > improve FoldablePropagation >

[jira] [Assigned] (SPARK-22944) improve FoldablePropagation

[ https://issues.apache.org/jira/browse/SPARK-22944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22944: Assignee: Apache Spark (was: Wenchen Fan) > improve FoldablePropagation >

[jira] [Commented] (SPARK-22944) improve FoldablePropagation

[ https://issues.apache.org/jira/browse/SPARK-22944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309314#comment-16309314 ] Apache Spark commented on SPARK-22944: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-22944) improve FoldablePropagation

Wenchen Fan created SPARK-22944: --- Summary: improve FoldablePropagation Key: SPARK-22944 URL: https://issues.apache.org/jira/browse/SPARK-22944 Project: Spark Issue Type: Improvement