[jira] [Updated] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Schakmann Rene updated SPARK-19680: --- Description: I'm using spark streaming with kafka to acutally create a toplist. I want to re

[jira] [Updated] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Schakmann Rene updated SPARK-19680: --- Description: I'm using spark streaming with kafka to acutally create a toplist. I want to re

[jira] [Updated] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Schakmann Rene updated SPARK-19680: --- Description: I'm using spark streaming with kafka to acutally create a toplist. I want to re

[jira] [Updated] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Schakmann Rene updated SPARK-19680: --- Description: I'm using spark streaming with kafka to acutally create a toplist. I want to re

[jira] [Updated] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

[ https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Schakmann Rene updated SPARK-19680: --- Description: I'm using spark streaming with kafka to acutally create a toplist. I want to re

[jira] [Created] (SPARK-19680) Offsets out of range with no configured reset policy for partitions

Schakmann Rene created SPARK-19680: -- Summary: Offsets out of range with no configured reset policy for partitions Key: SPARK-19680 URL: https://issues.apache.org/jira/browse/SPARK-19680 Project: Spar

[jira] [Comment Edited] (SPARK-14174) Accelerate KMeans via Mini-Batch EM

[ https://issues.apache.org/jira/browse/SPARK-14174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876202#comment-15876202 ] RJ Nowling edited comment on SPARK-14174 at 2/21/17 4:08 PM: -

[jira] [Commented] (SPARK-14174) Accelerate KMeans via Mini-Batch EM

[ https://issues.apache.org/jira/browse/SPARK-14174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876202#comment-15876202 ] RJ Nowling commented on SPARK-14174: I did the initial implementation for SPARK-2308.

[jira] [Commented] (SPARK-19668) Multiple NGram sizes

[ https://issues.apache.org/jira/browse/SPARK-19668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876080#comment-15876080 ] Jacek KK commented on SPARK-19668: -- That's how i have it implemented in my project (by s

[jira] [Commented] (SPARK-2984) FileNotFoundException on _temporary directory

[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875962#comment-15875962 ] Laurent Hoss commented on SPARK-2984: - related issue (still open): SPARK-10109 > File

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875960#comment-15875960 ] Laurent Hoss commented on SPARK-10109: -- seems related to SPARK-2984 (though closed,

[jira] [Assigned] (SPARK-19679) Destroy broadcasted object without blocking

[ https://issues.apache.org/jira/browse/SPARK-19679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19679: Assignee: (was: Apache Spark) > Destroy broadcasted object without blocking >

[jira] [Assigned] (SPARK-19679) Destroy broadcasted object without blocking

[ https://issues.apache.org/jira/browse/SPARK-19679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19679: Assignee: Apache Spark > Destroy broadcasted object without blocking > ---

[jira] [Commented] (SPARK-19679) Destroy broadcasted object without blocking

[ https://issues.apache.org/jira/browse/SPARK-19679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875901#comment-15875901 ] Apache Spark commented on SPARK-19679: -- User 'zhengruifeng' has created a pull reque

[jira] [Created] (SPARK-19679) Destroy broadcasted object without blocking

zhengruifeng created SPARK-19679: Summary: Destroy broadcasted object without blocking Key: SPARK-19679 URL: https://issues.apache.org/jira/browse/SPARK-19679 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-15547) Encoder validation is too strict for inner nested structs

[ https://issues.apache.org/jira/browse/SPARK-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875823#comment-15875823 ] songxin commented on SPARK-15547: - yes ,you are absolutely right! > Encoder validation i

[jira] [Assigned] (SPARK-19678) remove MetastoreRelation

[ https://issues.apache.org/jira/browse/SPARK-19678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19678: Assignee: Apache Spark (was: Wenchen Fan) > remove MetastoreRelation > --

[jira] [Assigned] (SPARK-19678) remove MetastoreRelation

[ https://issues.apache.org/jira/browse/SPARK-19678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19678: Assignee: Wenchen Fan (was: Apache Spark) > remove MetastoreRelation > --

[jira] [Commented] (SPARK-19678) remove MetastoreRelation

[ https://issues.apache.org/jira/browse/SPARK-19678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875756#comment-15875756 ] Apache Spark commented on SPARK-19678: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-19678) remove MetastoreRelation

Wenchen Fan created SPARK-19678: --- Summary: remove MetastoreRelation Key: SPARK-19678 URL: https://issues.apache.org/jira/browse/SPARK-19678 Project: Spark Issue Type: Improvement Comp

[jira] [Comment Edited] (SPARK-19644) Memory leak in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875702#comment-15875702 ] Deenbandhu Agarwal edited comment on SPARK-19644 at 2/21/17 9:54 AM: --

[jira] [Commented] (SPARK-19644) Memory leak in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875702#comment-15875702 ] Deenbandhu Agarwal commented on SPARK-19644: I have analysed the issue more.

[jira] [Commented] (SPARK-19666) Exception when calling createDataFrame with typed RDD

[ https://issues.apache.org/jira/browse/SPARK-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875674#comment-15875674 ] Takeshi Yamamuro commented on SPARK-19666: -- Thanks! > Exception when calling cr

[jira] [Assigned] (SPARK-18608) Spark ML algorithms that check RDD cache level for internal caching double-cache data

[ https://issues.apache.org/jira/browse/SPARK-18608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18608: Assignee: Apache Spark > Spark ML algorithms that check RDD cache level for internal cachi

[jira] [Assigned] (SPARK-19666) Exception when calling createDataFrame with typed RDD

[ https://issues.apache.org/jira/browse/SPARK-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19666: Assignee: (was: Apache Spark) > Exception when calling createDataFrame with typed RDD

[jira] [Assigned] (SPARK-18608) Spark ML algorithms that check RDD cache level for internal caching double-cache data

[ https://issues.apache.org/jira/browse/SPARK-18608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18608: Assignee: (was: Apache Spark) > Spark ML algorithms that check RDD cache level for int

[jira] [Commented] (SPARK-19666) Exception when calling createDataFrame with typed RDD

[ https://issues.apache.org/jira/browse/SPARK-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875672#comment-15875672 ] Hyukjin Kwon commented on SPARK-19666: -- Ah, yes. I just tested some cases too. I cou

[jira] [Assigned] (SPARK-19666) Exception when calling createDataFrame with typed RDD

[ https://issues.apache.org/jira/browse/SPARK-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19666: Assignee: Apache Spark > Exception when calling createDataFrame with typed RDD > -

[jira] [Commented] (SPARK-19666) Exception when calling createDataFrame with typed RDD

[ https://issues.apache.org/jira/browse/SPARK-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875670#comment-15875670 ] Apache Spark commented on SPARK-19666: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-18608) Spark ML algorithms that check RDD cache level for internal caching double-cache data

[ https://issues.apache.org/jira/browse/SPARK-18608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875669#comment-15875669 ] Apache Spark commented on SPARK-18608: -- User 'zhengruifeng' has created a pull reque

[jira] [Commented] (SPARK-19666) Exception when calling createDataFrame with typed RDD

[ https://issues.apache.org/jira/browse/SPARK-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875645#comment-15875645 ] Takeshi Yamamuro commented on SPARK-19666: -- In my case, when I passed a invalid

[jira] [Comment Edited] (SPARK-18113) Sending AskPermissionToCommitOutput failed, driver enter into task deadloop

[ https://issues.apache.org/jira/browse/SPARK-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875599#comment-15875599 ] jin xing edited comment on SPARK-18113 at 2/21/17 9:00 AM: --- [~x

[jira] [Commented] (SPARK-14682) Provide evaluateEachIteration method or equivalent for spark.ml GBTs

[ https://issues.apache.org/jira/browse/SPARK-14682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875618#comment-15875618 ] Vincent commented on SPARK-14682: - any update? > Provide evaluateEachIteration method or

[jira] [Commented] (SPARK-19666) Exception when calling createDataFrame with typed RDD

[ https://issues.apache.org/jira/browse/SPARK-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875604#comment-15875604 ] Hyukjin Kwon commented on SPARK-19666: -- Hm, probably the {{__Message}} is an invalid

[jira] [Commented] (SPARK-18113) Sending AskPermissionToCommitOutput failed, driver enter into task deadloop

[ https://issues.apache.org/jira/browse/SPARK-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875599#comment-15875599 ] jin xing commented on SPARK-18113: -- [~xukun] I got the scenario you described. ??Afte

[jira] [Assigned] (SPARK-19677) HDFSBackedStateStoreProvider fails to overwrite existing file

[ https://issues.apache.org/jira/browse/SPARK-19677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19677: Assignee: (was: Apache Spark) > HDFSBackedStateStoreProvider fails to overwrite existi

[jira] [Assigned] (SPARK-19677) HDFSBackedStateStoreProvider fails to overwrite existing file

[ https://issues.apache.org/jira/browse/SPARK-19677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19677: Assignee: Apache Spark > HDFSBackedStateStoreProvider fails to overwrite existing file > -

[jira] [Commented] (SPARK-19677) HDFSBackedStateStoreProvider fails to overwrite existing file

[ https://issues.apache.org/jira/browse/SPARK-19677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875594#comment-15875594 ] Apache Spark commented on SPARK-19677: -- User 'vitillo' has created a pull request fo

[jira] [Created] (SPARK-19677) HDFSBackedStateStoreProvider fails to overwrite existing file

Roberto Agostino Vitillo created SPARK-19677: Summary: HDFSBackedStateStoreProvider fails to overwrite existing file Key: SPARK-19677 URL: https://issues.apache.org/jira/browse/SPARK-19677

[jira] [Updated] (SPARK-19677) HDFSBackedStateStoreProvider fails to overwrite existing file

[ https://issues.apache.org/jira/browse/SPARK-19677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roberto Agostino Vitillo updated SPARK-19677: - Description: I got the exception below after restarting a crashed Structu

[jira] [Commented] (SPARK-19676) Flaky test: FsHistoryProviderSuite.SPARK-3697: ignore directories that cannot be read.

[ https://issues.apache.org/jira/browse/SPARK-19676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875568#comment-15875568 ] Apache Spark commented on SPARK-19676: -- User 'uncleGen' has created a pull request f

[jira] [Assigned] (SPARK-19676) Flaky test: FsHistoryProviderSuite.SPARK-3697: ignore directories that cannot be read.

[ https://issues.apache.org/jira/browse/SPARK-19676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19676: Assignee: Apache Spark > Flaky test: FsHistoryProviderSuite.SPARK-3697: ignore directories

[jira] [Commented] (SPARK-3697) HistoryServer cann't list event Log when there was a no permissions directory in the $spark.eventLog.dir

[ https://issues.apache.org/jira/browse/SPARK-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875569#comment-15875569 ] Apache Spark commented on SPARK-3697: - User 'uncleGen' has created a pull request for

[jira] [Assigned] (SPARK-19676) Flaky test: FsHistoryProviderSuite.SPARK-3697: ignore directories that cannot be read.

[ https://issues.apache.org/jira/browse/SPARK-19676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19676: Assignee: (was: Apache Spark) > Flaky test: FsHistoryProviderSuite.SPARK-3697: ignore

[jira] [Created] (SPARK-19676) Flaky test: FsHistoryProviderSuite.SPARK-3697: ignore directories that cannot be read.

Genmao Yu created SPARK-19676: - Summary: Flaky test: FsHistoryProviderSuite.SPARK-3697: ignore directories that cannot be read. Key: SPARK-19676 URL: https://issues.apache.org/jira/browse/SPARK-19676 Proj

[jira] [Comment Edited] (SPARK-18454) Changes to improve Nearest Neighbor Search for LSH

[ https://issues.apache.org/jira/browse/SPARK-18454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875552#comment-15875552 ] Nick Pentreath edited comment on SPARK-18454 at 2/21/17 8:00 AM: --

<    1   2