[jira] [Comment Edited] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305108#comment-16305108 ] Hyukjin Kwon edited comment on SPARK-7721 at 12/28/17 7:11 AM: -

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305108#comment-16305108 ] Hyukjin Kwon commented on SPARK-7721: - I roughly checked the coverage results and seem

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305103#comment-16305103 ] Hyukjin Kwon commented on SPARK-7721: - Hey [~rxin], I think I made it now by few modif

[jira] [Resolved] (SPARK-22757) Init-container in the driver/executor pods for downloading remote dependencies

[ https://issues.apache.org/jira/browse/SPARK-22757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-22757. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19954 [https://g

[jira] [Assigned] (SPARK-22757) Init-container in the driver/executor pods for downloading remote dependencies

[ https://issues.apache.org/jira/browse/SPARK-22757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-22757: - Assignee: Yinan Li > Init-container in the driver/executor pods for downloading remote d

[jira] [Resolved] (SPARK-22909) Move Structured Streaming v2 APIs to streaming package

[ https://issues.apache.org/jira/browse/SPARK-22909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22909. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20093 [https://githu

[jira] [Commented] (SPARK-22883) ML test for StructuredStreaming: spark.ml.feature, A-M

[ https://issues.apache.org/jira/browse/SPARK-22883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305032#comment-16305032 ] Joseph K. Bradley commented on SPARK-22883: --- I'll work on this. > ML test for

[jira] [Comment Edited] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

[ https://issues.apache.org/jira/browse/SPARK-22913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305018#comment-16305018 ] Ameen Tayyebi edited comment on SPARK-22913 at 12/28/17 3:31 AM: --

[jira] [Commented] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

[ https://issues.apache.org/jira/browse/SPARK-22913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305018#comment-16305018 ] Ameen Tayyebi commented on SPARK-22913: --- Note: I'll be away since December 30th unt

[jira] [Commented] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

[ https://issues.apache.org/jira/browse/SPARK-22913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305017#comment-16305017 ] Apache Spark commented on SPARK-22913: -- User 'ameent' has created a pull request for

[jira] [Assigned] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

[ https://issues.apache.org/jira/browse/SPARK-22913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22913: Assignee: Apache Spark > Hive Partition Pruning, Fractional and Timestamp types >

[jira] [Assigned] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

[ https://issues.apache.org/jira/browse/SPARK-22913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22913: Assignee: (was: Apache Spark) > Hive Partition Pruning, Fractional and Timestamp types

[jira] [Resolved] (SPARK-22899) OneVsRestModel transform on streaming data failed.

[ https://issues.apache.org/jira/browse/SPARK-22899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-22899. --- Resolution: Fixed Fix Version/s: 2.3.0 Resolved by https://github.com/apache/s

[jira] [Assigned] (SPARK-22899) OneVsRestModel transform on streaming data failed.

[ https://issues.apache.org/jira/browse/SPARK-22899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-22899: - Assignee: Weichen Xu > OneVsRestModel transform on streaming data failed. >

[jira] [Updated] (SPARK-22888) OneVsRestModel does not work with Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-22888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22888: -- Target Version/s: (was: 2.3.0) > OneVsRestModel does not work with Structured Streami

[jira] [Resolved] (SPARK-22888) OneVsRestModel does not work with Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-22888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-22888. --- Resolution: Duplicate > OneVsRestModel does not work with Structured Streaming >

[jira] [Updated] (SPARK-22905) Fix ChiSqSelectorModel save implementation

[ https://issues.apache.org/jira/browse/SPARK-22905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22905: -- Shepherd: Joseph K. Bradley > Fix ChiSqSelectorModel save implementation >

[jira] [Updated] (SPARK-22905) Fix ChiSqSelectorModel save implementation

[ https://issues.apache.org/jira/browse/SPARK-22905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22905: -- Component/s: (was: ML) > Fix ChiSqSelectorModel save implementation > -

[jira] [Commented] (SPARK-22916) shouldn't bias towards build right if user does not specify

[ https://issues.apache.org/jira/browse/SPARK-22916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304963#comment-16304963 ] Apache Spark commented on SPARK-22916: -- User 'liufengdb' has created a pull request

[jira] [Assigned] (SPARK-22916) shouldn't bias towards build right if user does not specify

[ https://issues.apache.org/jira/browse/SPARK-22916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22916: Assignee: Apache Spark > shouldn't bias towards build right if user does not specify > ---

[jira] [Assigned] (SPARK-22916) shouldn't bias towards build right if user does not specify

[ https://issues.apache.org/jira/browse/SPARK-22916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22916: Assignee: (was: Apache Spark) > shouldn't bias towards build right if user does not sp

[jira] [Created] (SPARK-22916) shouldn't bias towards build right if user does not specify

Feng Liu created SPARK-22916: Summary: shouldn't bias towards build right if user does not specify Key: SPARK-22916 URL: https://issues.apache.org/jira/browse/SPARK-22916 Project: Spark Issue Ty

[jira] [Updated] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

[ https://issues.apache.org/jira/browse/SPARK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22915: -- Description: *For featurizers with names from N - Z* Task for adding Structured Stream

[jira] [Updated] (SPARK-22883) ML test for StructuredStreaming: spark.ml.feature, A-M

[ https://issues.apache.org/jira/browse/SPARK-22883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22883: -- Summary: ML test for StructuredStreaming: spark.ml.feature, A-M (was: ML test for Stru

[jira] [Updated] (SPARK-22883) ML test for StructuredStreaming: spark.ml.feature, A-M

[ https://issues.apache.org/jira/browse/SPARK-22883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22883: -- Description: *For featurizers with names from A - M* Task for adding Structured Stream

[jira] [Created] (SPARK-22915) ML test for StructuredStreaming: spark.ml.feature, N-Z

Joseph K. Bradley created SPARK-22915: - Summary: ML test for StructuredStreaming: spark.ml.feature, N-Z Key: SPARK-22915 URL: https://issues.apache.org/jira/browse/SPARK-22915 Project: Spark

[jira] [Assigned] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

[ https://issues.apache.org/jira/browse/SPARK-22914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22914: Assignee: Apache Spark > Subbing for spark.history.ui.port does not resolve by default > -

[jira] [Assigned] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

[ https://issues.apache.org/jira/browse/SPARK-22914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22914: Assignee: (was: Apache Spark) > Subbing for spark.history.ui.port does not resolve by

[jira] [Commented] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

[ https://issues.apache.org/jira/browse/SPARK-22914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304863#comment-16304863 ] Apache Spark commented on SPARK-22914: -- User 'gerashegalov' has created a pull reque

[jira] [Created] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

Gera Shegalov created SPARK-22914: - Summary: Subbing for spark.history.ui.port does not resolve by default Key: SPARK-22914 URL: https://issues.apache.org/jira/browse/SPARK-22914 Project: Spark

[jira] [Created] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

Ameen Tayyebi created SPARK-22913: - Summary: Hive Partition Pruning, Fractional and Timestamp types Key: SPARK-22913 URL: https://issues.apache.org/jira/browse/SPARK-22913 Project: Spark Issu

[jira] [Commented] (SPARK-22912) Support v2 streaming sources and sinks in MicroBatchExecution

[ https://issues.apache.org/jira/browse/SPARK-22912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304817#comment-16304817 ] Apache Spark commented on SPARK-22912: -- User 'jose-torres' has created a pull reques

[jira] [Assigned] (SPARK-22912) Support v2 streaming sources and sinks in MicroBatchExecution

[ https://issues.apache.org/jira/browse/SPARK-22912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22912: Assignee: (was: Apache Spark) > Support v2 streaming sources and sinks in MicroBatchEx

[jira] [Assigned] (SPARK-22912) Support v2 streaming sources and sinks in MicroBatchExecution

[ https://issues.apache.org/jira/browse/SPARK-22912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22912: Assignee: Apache Spark > Support v2 streaming sources and sinks in MicroBatchExecution > -

[jira] [Created] (SPARK-22912) Support v2 streaming sources and sinks in MicroBatchExecution

Jose Torres created SPARK-22912: --- Summary: Support v2 streaming sources and sinks in MicroBatchExecution Key: SPARK-22912 URL: https://issues.apache.org/jira/browse/SPARK-22912 Project: Spark

[jira] [Created] (SPARK-22911) Migrate structured streaming sources to new DataSourceV2 APIs

Jose Torres created SPARK-22911: --- Summary: Migrate structured streaming sources to new DataSourceV2 APIs Key: SPARK-22911 URL: https://issues.apache.org/jira/browse/SPARK-22911 Project: Spark

[jira] [Assigned] (SPARK-22908) add basic continuous kafka source

[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22908: Assignee: (was: Apache Spark) > add basic continuous kafka source > --

[jira] [Assigned] (SPARK-22908) add basic continuous kafka source

[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22908: Assignee: Apache Spark > add basic continuous kafka source > -

[jira] [Commented] (SPARK-22908) add basic continuous kafka source

[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304811#comment-16304811 ] Apache Spark commented on SPARK-22908: -- User 'jose-torres' has created a pull reques

[jira] [Commented] (SPARK-22126) Fix model-specific optimization support for ML tuning

[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304765#comment-16304765 ] Apache Spark commented on SPARK-22126: -- User 'MrBago' has created a pull request for

[jira] [Created] (SPARK-22910) Wrong results in Spark Job because failed to move to Trash

Ohad Raviv created SPARK-22910: -- Summary: Wrong results in Spark Job because failed to move to Trash Key: SPARK-22910 URL: https://issues.apache.org/jira/browse/SPARK-22910 Project: Spark Issue

[jira] [Updated] (SPARK-22909) Move Structured Streaming v2 APIs to streaming package

[ https://issues.apache.org/jira/browse/SPARK-22909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-22909: - Target Version/s: 2.3.0 > Move Structured Streaming v2 APIs to streaming package > --

[jira] [Updated] (SPARK-22909) Move Structured Streaming v2 APIs to streaming package

[ https://issues.apache.org/jira/browse/SPARK-22909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-22909: - Priority: Blocker (was: Major) > Move Structured Streaming v2 APIs to streaming package > --

[jira] [Commented] (SPARK-20392) Slow performance when calling fit on ML pipeline for dataset with many columns but few rows

[ https://issues.apache.org/jira/browse/SPARK-20392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304734#comment-16304734 ] Apache Spark commented on SPARK-20392: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-22909) Move Structured Streaming v2 APIs to streaming package

[ https://issues.apache.org/jira/browse/SPARK-22909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304729#comment-16304729 ] Apache Spark commented on SPARK-22909: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-22909) Move Structured Streaming v2 APIs to streaming package

[ https://issues.apache.org/jira/browse/SPARK-22909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22909: Assignee: Apache Spark (was: Shixiong Zhu) > Move Structured Streaming v2 APIs to streami

[jira] [Assigned] (SPARK-22909) Move Structured Streaming v2 APIs to streaming package

[ https://issues.apache.org/jira/browse/SPARK-22909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22909: Assignee: Shixiong Zhu (was: Apache Spark) > Move Structured Streaming v2 APIs to streami

[jira] [Created] (SPARK-22909) Move Structured Streaming v2 APIs to streaming package

Shixiong Zhu created SPARK-22909: Summary: Move Structured Streaming v2 APIs to streaming package Key: SPARK-22909 URL: https://issues.apache.org/jira/browse/SPARK-22909 Project: Spark Issue

[jira] [Created] (SPARK-22908) add basic continuous kafka source

Jose Torres created SPARK-22908: --- Summary: add basic continuous kafka source Key: SPARK-22908 URL: https://issues.apache.org/jira/browse/SPARK-22908 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-22465) Cogroup of two disproportionate RDDs could lead into 2G limit BUG

[ https://issues.apache.org/jira/browse/SPARK-22465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304569#comment-16304569 ] Apache Spark commented on SPARK-22465: -- User 'jiangxb1987' has created a pull reques

[jira] [Commented] (SPARK-22907) MetadataFetchFailedException broadcast is already present

[ https://issues.apache.org/jira/browse/SPARK-22907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304396#comment-16304396 ] Apache Spark commented on SPARK-22907: -- User 'liupc' has created a pull request for

[jira] [Assigned] (SPARK-22907) MetadataFetchFailedException broadcast is already present

[ https://issues.apache.org/jira/browse/SPARK-22907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22907: Assignee: (was: Apache Spark) > MetadataFetchFailedException broadcast is already pres

[jira] [Assigned] (SPARK-22907) MetadataFetchFailedException broadcast is already present

[ https://issues.apache.org/jira/browse/SPARK-22907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22907: Assignee: Apache Spark > MetadataFetchFailedException broadcast is already present > -

[jira] [Updated] (SPARK-22903) AlreadyBeingCreatedException in stage retry caused by wrong attemptNumber

[ https://issues.apache.org/jira/browse/SPARK-22903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liupengcheng updated SPARK-22903: - Flags: Important > AlreadyBeingCreatedException in stage retry caused by wrong attemptNumber > --

[jira] [Commented] (SPARK-22907) MetadataFetchFailedException broadcast is already present

[ https://issues.apache.org/jira/browse/SPARK-22907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304389#comment-16304389 ] liupengcheng commented on SPARK-22907: -- I think we should cleanup the garbage broadc

[jira] [Created] (SPARK-22907) MetadataFetchFailedException broadcast is already present

liupengcheng created SPARK-22907: Summary: MetadataFetchFailedException broadcast is already present Key: SPARK-22907 URL: https://issues.apache.org/jira/browse/SPARK-22907 Project: Spark Iss

[jira] [Assigned] (SPARK-22906) External shuffle IP different from Host ip

[ https://issues.apache.org/jira/browse/SPARK-22906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22906: Assignee: (was: Apache Spark) > External shuffle IP different from Host ip > -

[jira] [Assigned] (SPARK-22906) External shuffle IP different from Host ip

[ https://issues.apache.org/jira/browse/SPARK-22906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22906: Assignee: Apache Spark > External shuffle IP different from Host ip >

[jira] [Commented] (SPARK-22906) External shuffle IP different from Host ip

[ https://issues.apache.org/jira/browse/SPARK-22906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304382#comment-16304382 ] Apache Spark commented on SPARK-22906: -- User 'pianista215' has created a pull reques

[jira] [Created] (SPARK-22906) External shuffle IP different from Host ip

Unai Sarasola created SPARK-22906: - Summary: External shuffle IP different from Host ip Key: SPARK-22906 URL: https://issues.apache.org/jira/browse/SPARK-22906 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-22906) External shuffle IP different from Host ip

[ https://issues.apache.org/jira/browse/SPARK-22906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Unai Sarasola updated SPARK-22906: -- Priority: Minor (was: Major) > External shuffle IP different from Host ip > --

[jira] [Commented] (SPARK-21136) Misleading error message for typo in SQL

[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304378#comment-16304378 ] Denys Zadorozhnyi commented on SPARK-21136: --- I dug up into this issue in Spark