Hi Team,
I am facing this issue again.
I am using Spark 3.0.1 with Python.
Could you please suggest why it says the below error:
*Current Committed Offsets: {KafkaV2[Subscribe[my-topic]]:
{“my-topic”:{“1":1498,“0”:1410}}}Current Available Offsets:
{KafkaV2[Subscribe[my-topic]]: {“my-topic”:{“1
Please see that driver side for example resolved in 3.1.0...
G
On Fri, Mar 12, 2021 at 1:03 PM Sachit Murarka
wrote:
> Hi Gabor,
>
> Thanks a lot for the response. I am using Spark 3.0.1 and this is spark
> structured streaming.
>
> Kind Regards,
> Sachit Murarka
>
>
> On Fri, Mar 12, 2021 at
Hi Gabor,
Thanks a lot for the response. I am using Spark 3.0.1 and this is spark
structured streaming.
Kind Regards,
Sachit Murarka
On Fri, Mar 12, 2021 at 5:30 PM Gabor Somogyi
wrote:
> Since you've not provided any version I guess you're using 2.x and you're
> hitting this issue: https://i
Since you've not provided any version I guess you're using 2.x and you're
hitting this issue: https://issues.apache.org/jira/browse/SPARK-28367
The executor side must be resolved out of the box in the latest Spark
version however on driver side one must set "
spark.sql.streaming.kafka.useDeprecated
