[jira] [Updated] (SPARK-36212) Add exception for Kafka readstream when decryption fails

2021-07-19 Thread Jon LaFlamme (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-36212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jon LaFlamme updated SPARK-36212:
-
Fix Version/s: (was: 3.1.0)
   3.0.0

> Add exception for Kafka readstream when decryption fails
> 
>
> Key: SPARK-36212
> URL: https://issues.apache.org/jira/browse/SPARK-36212
> Project: Spark
>  Issue Type: Task
>  Components: Structured Streaming
>Affects Versions: 3.0.0
> Environment: Spark 3.0.0
>Reporter: Jon LaFlamme
>Priority: Minor
>  Labels: exceptions, warnings
> Fix For: 3.0.0
>
>   Original Estimate: 3h
>  Remaining Estimate: 3h
>
> A silent failure is possible when reading from a Kafka broker under the 
> following circumstances:
> SDF.isStreaming = True
> SDF.printSchema() => returns expected schema
> Query results are empty.
> Issue: Tsl Decryption has failed, but there is no exception or warning.
> Request: Add a warning throw an exception when decryption fails, such that 
> developers can efficiently diagnose the readstream problem.
>  
> This is my first ticket submitted. Please notify me if I should change 
> anything in this ticket to make it more conformant to community standards. 
> I'm still a beginner with Spark.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-36212) Add exception for Kafka readstream when decryption fails

2021-07-19 Thread Jon LaFlamme (Jira)
Jon LaFlamme created SPARK-36212:


 Summary: Add exception for Kafka readstream when decryption fails
 Key: SPARK-36212
 URL: https://issues.apache.org/jira/browse/SPARK-36212
 Project: Spark
  Issue Type: Task
  Components: Structured Streaming
Affects Versions: 3.0.0
 Environment: Spark 3.0.0
Reporter: Jon LaFlamme
 Fix For: 3.1.0


A silent failure is possible when reading from a Kafka broker under the 
following circumstances:

SDF.isStreaming = True

SDF.printSchema() => returns expected schema

Query results are empty.

Issue: Tsl Decryption has failed, but there is no exception or warning.

Request: Add a warning throw an exception when decryption fails, such that 
developers can efficiently diagnose the readstream problem.

 

This is my first ticket submitted. Please notify me if I should change anything 
in this ticket to make it more conformant to community standards. I'm still a 
beginner with Spark.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org