[
https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779408#comment-16779408
]
Gabor Somogyi edited comment on SPARK-26783 at 2/27/19 2:56 PM:
----------------------------------------------------------------
I've gone through the whole chain on v2.4.0 and it looks good (the batch part
only because the original issue was there).
The only thing what I can assume [~sindiri] has seen is [this
line|https://github.com/apache/spark/blob/b0450d07bd5a77a519a662351ca5b5d562e61a58/external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala#L460]
when mentioned the following:
{quote}the variable that needs to be used is "failondataloss" (all in lower
case)
{quote}
I'm closing this issue. Please come back if you have further info or correct me
if my assumption is wrong.
was (Author: gsomogyi):
I've gone through the whole chain on v2.4.0 and it looks good (the batch part
only because the original issue was there).
The only thing what I can assume [~sindiri] has seen is [this
line|https://github.com/apache/spark/blob/b0450d07bd5a77a519a662351ca5b5d562e61a58/external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala#L460]
when mentioned the following:
{quote}the variable that needs to be used is "failondataloss" (all in lower
case)
{quote}
I'm closing this issue. Please come back and correct me if you have further
info or my assumption is wrong.
> Kafka parameter documentation doesn't match with the reality (upper/lowercase)
> ------------------------------------------------------------------------------
>
> Key: SPARK-26783
> URL: https://issues.apache.org/jira/browse/SPARK-26783
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming
> Affects Versions: 3.0.0
> Reporter: Gabor Somogyi
> Priority: Minor
>
> A good example for this is "failOnDataLoss" which is reported in SPARK-23685.
> I've just checked and there are several other parameters which suffer from
> the same issue.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
