[jira] [Commented] (SPARK-10251) Some internal spark classes are not registered with kryo

[ https://issues.apache.org/jira/browse/SPARK-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738390#comment-14738390 ] Marius Soutier commented on SPARK-10251: Any chance for a backport to 1.4.2? > Some internal

[jira] [Commented] (SPARK-7600) Stopping Streaming Context (sometimes) crashes master

[ https://issues.apache.org/jira/browse/SPARK-7600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553999#comment-14553999 ] Marius Soutier commented on SPARK-7600: --- Yes it is, that might be the problem

[jira] [Comment Edited] (SPARK-7600) Stopping Streaming Context (sometimes) crashes master

[ https://issues.apache.org/jira/browse/SPARK-7600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553999#comment-14553999 ] Marius Soutier edited comment on SPARK-7600 at 5/21/15 9:52 AM:

[jira] [Created] (SPARK-7600) Stopping Streaming Context (sometimes) crashes master

Marius Soutier created SPARK-7600: - Summary: Stopping Streaming Context (sometimes) crashes master Key: SPARK-7600 URL: https://issues.apache.org/jira/browse/SPARK-7600 Project: Spark Issue

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541951#comment-14541951 ] Marius Soutier commented on SPARK-6613: --- It's still happening with 1.3.1. Starting

[jira] [Updated] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-6613: -- Affects Version/s: 1.3.1 Starting stream from checkpoint causes Streaming tab to throw error

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532663#comment-14532663 ] Marius Soutier commented on SPARK-3928: --- DataFrames now expect varagrs, i.e.

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532704#comment-14532704 ] Marius Soutier commented on SPARK-3928: --- Wildcards were never supported and it seems

[jira] [Comment Edited] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532663#comment-14532663 ] Marius Soutier edited comment on SPARK-3928 at 5/7/15 1:54 PM:

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532969#comment-14532969 ] Marius Soutier commented on SPARK-3928: --- Because parquetFile now takes a varargs

[jira] [Created] (SPARK-7167) Receivers are not distributed efficiently

Marius Soutier created SPARK-7167: - Summary: Receivers are not distributed efficiently Key: SPARK-7167 URL: https://issues.apache.org/jira/browse/SPARK-7167 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7167) Receivers are not distributed efficiently when starting from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-7167: -- Summary: Receivers are not distributed efficiently when starting from checkpoint (was:

[jira] [Updated] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-6613: -- Affects Version/s: 1.2.2 Starting stream from checkpoint causes Streaming tab to throw error

[jira] [Comment Edited] (SPARK-7167) Receivers are not distributed efficiently when starting from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513976#comment-14513976 ] Marius Soutier edited comment on SPARK-7167 at 4/27/15 12:09 PM:

[jira] [Commented] (SPARK-7167) Receivers are not distributed efficiently when starting from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513976#comment-14513976 ] Marius Soutier commented on SPARK-7167: --- Maybe the slowdown is only incidental,

[jira] [Updated] (SPARK-7167) Receivers are not distributed efficiently when starting from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-7167: -- Attachment: Screen Shot 2015-04-27 at 14.10.05.jpg Receivers are not distributed efficiently

[jira] [Updated] (SPARK-7028) Add filterNot to RDD

[ https://issues.apache.org/jira/browse/SPARK-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-7028: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Add filterNot to RDD

[jira] [Created] (SPARK-7028) Add filterNot to RDD

Marius Soutier created SPARK-7028: - Summary: Add filterNot to RDD Key: SPARK-7028 URL: https://issues.apache.org/jira/browse/SPARK-7028 Project: Spark Issue Type: Bug Reporter:

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392234#comment-14392234 ] Marius Soutier commented on SPARK-6613: --- It's combination of actorStreams and

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390423#comment-14390423 ] Marius Soutier commented on SPARK-6613: --- Bug report. Starting stream from

[jira] [Created] (SPARK-6648) Reading Parquet files with different sub-files doesn't work

Marius Soutier created SPARK-6648: - Summary: Reading Parquet files with different sub-files doesn't work Key: SPARK-6648 URL: https://issues.apache.org/jira/browse/SPARK-6648 Project: Spark

[jira] [Updated] (SPARK-6648) Reading Parquet files with different sub-files doesn't work

[ https://issues.apache.org/jira/browse/SPARK-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-6648: -- Description: When reading from multiple parquet files (via

[jira] [Updated] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-6613: -- Description: When continuing my streaming job from a checkpoint, the job runs, but the

[jira] [Updated] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-6613: -- Description: When continuing my streaming job from a checkpoint, the job runs, but the

[jira] [Created] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

Marius Soutier created SPARK-6613: - Summary: Starting stream from checkpoint causes Streaming tab to throw error Key: SPARK-6613 URL: https://issues.apache.org/jira/browse/SPARK-6613 Project: Spark

[jira] [Commented] (SPARK-6504) Cannot read Parquet files generated from different versions at once

[ https://issues.apache.org/jira/browse/SPARK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382073#comment-14382073 ] Marius Soutier commented on SPARK-6504: --- Not easily, but 1.3.1 is supposed to be

[jira] [Commented] (SPARK-6504) Cannot read Parquet files generated from different versions at once

[ https://issues.apache.org/jira/browse/SPARK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382027#comment-14382027 ] Marius Soutier commented on SPARK-6504: --- No, as far as I understand, Spark 1.3

[jira] [Created] (SPARK-6504) Cannot read Parquet files generated from different versions at once

Marius Soutier created SPARK-6504: - Summary: Cannot read Parquet files generated from different versions at once Key: SPARK-6504 URL: https://issues.apache.org/jira/browse/SPARK-6504 Project: Spark

[jira] [Comment Edited] (SPARK-6304) Checkpointing doesn't retain driver port

[ https://issues.apache.org/jira/browse/SPARK-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14364713#comment-14364713 ] Marius Soutier edited comment on SPARK-6304 at 3/17/15 7:36 AM:

[jira] [Commented] (SPARK-6304) Checkpointing doesn't retain driver port

[ https://issues.apache.org/jira/browse/SPARK-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14364713#comment-14364713 ] Marius Soutier commented on SPARK-6304: --- Got it, thanks. Checkpointing doesn't

[jira] [Commented] (SPARK-6304) Checkpointing doesn't retain driver port

[ https://issues.apache.org/jira/browse/SPARK-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363047#comment-14363047 ] Marius Soutier commented on SPARK-6304: --- Yeah but if the user doesn't set the port,

[jira] [Commented] (SPARK-6304) Checkpointing doesn't retain driver port

[ https://issues.apache.org/jira/browse/SPARK-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362928#comment-14362928 ] Marius Soutier commented on SPARK-6304: --- I'm just reporting the bug. As you said,

[jira] [Commented] (SPARK-6304) Checkpointing doesn't retain driver port

[ https://issues.apache.org/jira/browse/SPARK-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362918#comment-14362918 ] Marius Soutier commented on SPARK-6304: --- Simple, I'm using `actorStream` and want to

[jira] [Created] (SPARK-6304) Checkpointing doesn't retain driver port

Marius Soutier created SPARK-6304: - Summary: Checkpointing doesn't retain driver port Key: SPARK-6304 URL: https://issues.apache.org/jira/browse/SPARK-6304 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6304) Checkpointing doesn't retain driver port

[ https://issues.apache.org/jira/browse/SPARK-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-6304: -- Description: In a check-pointed Streaming application running on a fixed driver port, the

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181185#comment-14181185 ] Marius Soutier commented on SPARK-3928: --- This would be more than nice. Currently,