[jira] [Reopened] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp

[ https://issues.apache.org/jira/browse/SPARK-20168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yash Sharma reopened SPARK-20168: - The last patch in the kinesis streaming receiver sets the timestamp for the mode AT_TIMESTAMP

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333809#comment-16333809 ] Yash Sharma commented on SPARK-23050: - Hi [~ste...@apache.org], Thanks for bringing this great

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324711#comment-16324711 ] Yash Sharma commented on SPARK-23050: - [~marmbrus], [~shixi...@databricks.com] When we say read via

[jira] [Comment Edited] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324711#comment-16324711 ] Yash Sharma edited comment on SPARK-23050 at 1/12/18 11:13 PM: --- [~marmbrus

[jira] [Updated] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yash Sharma updated SPARK-23050: Description: Spark Structured streaming with S3 file source duplicates data because of eventual

[jira] [Created] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

Yash Sharma created SPARK-23050: --- Summary: Structured Streaming with S3 file source duplicates data because of eventual consistency. Key: SPARK-23050 URL: https://issues.apache.org/jira/browse/SPARK-23050

[jira] [Commented] (SPARK-16441) Spark application hang when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025792#comment-16025792 ] Yash Sharma commented on SPARK-16441: - Hitting this issue as well, willing to help if any required

[jira] [Created] (SPARK-20855) Update the Spark kinesis docs to use the KinesisInputDStream builder instead of deprecated KinesisUtils

Yash Sharma created SPARK-20855: --- Summary: Update the Spark kinesis docs to use the KinesisInputDStream builder instead of deprecated KinesisUtils Key: SPARK-20855 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Created] (SPARK-20189) Fix spark kinesis testcases to remove deprecated createStream and use Builders

Yash Sharma created SPARK-20189: --- Summary: Fix spark kinesis testcases to remove deprecated createStream and use Builders Key: SPARK-20189 URL: https://issues.apache.org/jira/browse/SPARK-20189 Project

[jira] [Created] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp

Yash Sharma created SPARK-20168: --- Summary: Enable kinesis to start stream from Initial position specified by a timestamp Key: SPARK-20168 URL: https://issues.apache.org/jira/browse/SPARK-20168 Project

[jira] [Commented] (SPARK-20140) Remove hardcoded kinesis retry wait and max retries

[ https://issues.apache.org/jira/browse/SPARK-20140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947015#comment-15947015 ] Yash Sharma commented on SPARK-20140: - Proposing : https://github.com/apache/spark/pull/17467 Please

[jira] [Created] (SPARK-20140) Remove hardcoded kinesis retry wait and max retries

Yash Sharma created SPARK-20140: --- Summary: Remove hardcoded kinesis retry wait and max retries Key: SPARK-20140 URL: https://issues.apache.org/jira/browse/SPARK-20140 Project: Spark Issue Type

subscribe to spark issues

subscribe to spark issues

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927240#comment-15927240 ] Yash Sharma commented on SPARK-7736: This does not seem Fixed. The application still completes