[jira] [Commented] (SPARK-22611) Spark Kinesis ProvisionedThroughputExceededException leads to dropped records

2017-11-27 Thread Richard Moorhead (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266971#comment-16266971 ] Richard Moorhead commented on SPARK-22611: -- Further investigation seems to indicate that setting

[jira] [Commented] (SPARK-22611) Spark Kinesis ProvisionedThroughputExceededException leads to dropped records

2017-11-26 Thread Richard Moorhead (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266389#comment-16266389 ] Richard Moorhead commented on SPARK-22611: -- Thats correct. The Spark Streaming UI shows a

[jira] [Created] (SPARK-22611) Spark Kinesis ProvisionedThroughputExceededException leads to dropped records

2017-11-26 Thread Richard Moorhead (JIRA)
Richard Moorhead created SPARK-22611: Summary: Spark Kinesis ProvisionedThroughputExceededException leads to dropped records Key: SPARK-22611 URL: https://issues.apache.org/jira/browse/SPARK-22611

[jira] [Closed] (SPARK-20777) Spark Streaming NullPointerException when restoring from hdfs checkpoint

2017-05-17 Thread Richard Moorhead (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Moorhead closed SPARK-20777. Resolution: Won't Fix Issue was multiple rdd transformations werent checkpointed from

[jira] [Created] (SPARK-20777) Spark Streaming NullPointerException when restoring from hdfs checkpoint

2017-05-16 Thread Richard Moorhead (JIRA)
Richard Moorhead created SPARK-20777: Summary: Spark Streaming NullPointerException when restoring from hdfs checkpoint Key: SPARK-20777 URL: https://issues.apache.org/jira/browse/SPARK-20777

[jira] [Commented] (SPARK-9215) Implement WAL-free Kinesis receiver that give at-least once guarantee

2017-05-16 Thread Richard Moorhead (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012591#comment-16012591 ] Richard Moorhead commented on SPARK-9215: - WAL is not necessary for fault tolerant Kinesis

[jira] [Updated] (SPARK-18108) Partition discovery fails with explicitly written long partitions

2016-10-28 Thread Richard Moorhead (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Moorhead updated SPARK-18108: - Issue Type: Bug (was: Question) > Partition discovery fails with explicitly written

[jira] [Updated] (SPARK-18108) Partition discovery fails with explicitly written long partitions

2016-10-25 Thread Richard Moorhead (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Moorhead updated SPARK-18108: - Attachment: stacktrace.out > Partition discovery fails with explicitly written long

[jira] [Created] (SPARK-18108) Partition discovery fails with explicitly written long partitions

2016-10-25 Thread Richard Moorhead (JIRA)
Richard Moorhead created SPARK-18108: Summary: Partition discovery fails with explicitly written long partitions Key: SPARK-18108 URL: https://issues.apache.org/jira/browse/SPARK-18108 Project: