[jira] [Issue Comment Deleted] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23050: Comment: was deleted (was: [~ste...@apache.org], I can start working on

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579242#comment-16579242 ] bharath kumar avusherla commented on SPARK-23050: - [~ste...@apache.org], I can start 

[jira] [Closed] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output?

[ https://issues.apache.org/jira/browse/SPARK-25052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla closed SPARK-25052. --- > Is there any possibility that spark structured streaming generate duplicates

[jira] [Comment Edited] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573700#comment-16573700 ] bharath kumar avusherla edited comment on SPARK-23050 at 8/8/18 6:51 PM:

[jira] [Commented] (SPARK-23050) Structured Streaming with S3 file source duplicates data because of eventual consistency.

[ https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573700#comment-16573700 ] bharath kumar avusherla commented on SPARK-23050: - Is there any way we can avoid

[jira] [Commented] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output?

[ https://issues.apache.org/jira/browse/SPARK-25052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572608#comment-16572608 ] bharath kumar avusherla commented on SPARK-25052: - i also thought about it. Hence I

[jira] [Created] (SPARK-25052) Is there any possibility that spark structured streaming generate duplicates in the output?

bharath kumar avusherla created SPARK-25052: --- Summary: Is there any possibility that spark structured streaming generate duplicates in the output? Key: SPARK-25052 URL:

[jira] [Resolved] (SPARK-24476) java.net.SocketTimeoutException: Read timed out under jets3t while running the Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla resolved SPARK-24476. - Resolution: Fixed > java.net.SocketTimeoutException: Read timed out

[jira] [Comment Edited] (SPARK-24476) java.net.SocketTimeoutException: Read timed out under jets3t while running the Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509708#comment-16509708 ] bharath kumar avusherla edited comment on SPARK-24476 at 6/12/18 2:48 PM:

[jira] [Commented] (SPARK-24476) java.net.SocketTimeoutException: Read timed out under jets3t while running the Spark Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509708#comment-16509708 ] bharath kumar avusherla commented on SPARK-24476: - Our initial try was enable the

[jira] [Updated] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23869: Description: Left outer join on two streams not emitting the null

[jira] [Updated] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23869: Description: Left outer join on two streams not emitting the null

[jira] [Updated] (SPARK-24476) java.net.SocketTimeoutException: Read timed out Exception while running the Spark Structured Streaming in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-24476: Description: We are working on spark streaming application using spark

[jira] [Updated] (SPARK-24476) java.net.SocketTimeoutException: Read timed out Exception while running the Spark Structured Streaming in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-24476: Description: We are working on spark streaming application using spark

[jira] [Updated] (SPARK-24476) java.net.SocketTimeoutException: Read timed out Exception while running the Spark Structured Streaming in 2.3.0

[ https://issues.apache.org/jira/browse/SPARK-24476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-24476: Attachment: socket-timeout-exception > java.net.SocketTimeoutException:

[jira] [Created] (SPARK-24476) java.net.SocketTimeoutException: Read timed out Exception while running the Spark Structured Streaming in 2.3.0

bharath kumar avusherla created SPARK-24476: --- Summary: java.net.SocketTimeoutException: Read timed out Exception while running the Spark Structured Streaming in 2.3.0 Key: SPARK-24476 URL:

[jira] [Comment Edited] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464802#comment-16464802 ] bharath kumar avusherla edited comment on SPARK-24189 at 5/5/18 3:40 PM:

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464802#comment-16464802 ] bharath kumar avusherla commented on SPARK-24189: - Yup. I have added above dependency and

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464795#comment-16464795 ] bharath kumar avusherla commented on SPARK-24189: - [~mgaido] I'm using below maven

[jira] [Comment Edited] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464781#comment-16464781 ] bharath kumar avusherla edited comment on SPARK-24189 at 5/5/18 2:23 PM:

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464781#comment-16464781 ] bharath kumar avusherla commented on SPARK-24189: - I have tried both ways..

[jira] [Created] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

bharath kumar avusherla created SPARK-24189: --- Summary: Spark Strcutured Streaming not working with the Kafka Transactions Key: SPARK-24189 URL: https://issues.apache.org/jira/browse/SPARK-24189

[jira] [Closed] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla closed SPARK-23869. --- > Spark 2.3.0 left outer join not emitting null values instead waiting for the

[jira] [Resolved] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla resolved SPARK-23869. - Resolution: Invalid > Spark 2.3.0 left outer join not emitting null

[jira] [Issue Comment Deleted] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23869: Comment: was deleted (was: Hey,  Any luck on this? Am I missing

[jira] [Updated] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23869: Issue Type: Bug (was: Test) > Spark 2.3.0 left outer join not emitting

[jira] [Updated] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23869: Description: Left outer join on two streams not emitting the null outputs.

[jira] [Commented] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426417#comment-16426417 ] bharath kumar avusherla commented on SPARK-23869: - Hey,  Any luck on this? Am I missing

[jira] [Updated] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23869: Description: Left outer join on two streams not emitting the null outputs.

[jira] [Updated] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23869: Issue Type: Test (was: Bug) > Spark 2.3.0 left outer join not emitting

[jira] [Updated] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23869: Priority: Major (was: Blocker) > Spark 2.3.0 left outer join not emitting

[jira] [Updated] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

[ https://issues.apache.org/jira/browse/SPARK-23869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23869: Description: Left outer join on two streams not emitting the null outputs.

[jira] [Created] (SPARK-23869) Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream

bharath kumar avusherla created SPARK-23869: --- Summary: Spark 2.3.0 left outer join not emitting null values instead waiting for the record in other stream Key: SPARK-23869 URL:

[jira] [Updated] (SPARK-23814) Couldn't read file with colon in name and new line character in one of the field.

[ https://issues.apache.org/jira/browse/SPARK-23814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23814: Description: When the file name has colon and new line character in data,

[jira] [Updated] (SPARK-23814) Couldn't read file with colon in name and new line character in one of the field.

[ https://issues.apache.org/jira/browse/SPARK-23814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23814: Description: When the file name has colon and new line character in data,

[jira] [Updated] (SPARK-23814) Couldn't read file with colon in name and new line character in one of the field.

[ https://issues.apache.org/jira/browse/SPARK-23814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bharath kumar avusherla updated SPARK-23814: Description: When the file name has colon and new line character in data,

[jira] [Created] (SPARK-23814) Couldn't read file with colon in name and new line character in one of the field.

bharath kumar avusherla created SPARK-23814: --- Summary: Couldn't read file with colon in name and new line character in one of the field. Key: SPARK-23814 URL: