t; Lingzhe Sun
>
>
> *From:* Mich Talebzadeh
> *Date:* 2023-01-30 02:14
> *To:* Lingzhe Sun
> *CC:* ashok34...@yahoo.com; User
> *Subject:* Re: Re: spark+kafka+dynamic resource allocation
> Hi,
>
> Spark Structured Streaming currently does not support dynamic allocation
: ashok34...@yahoo.com; User
Subject: Re: Re: spark+kafka+dynamic resource allocation
Hi,
Spark Structured Streaming currently does not support dynamic allocation (see
SPARK-24815: Structured Streaming should support dynamic allocation). which is
still open
Autoscaling in Cloud offerings like Google
* 2023-01-29 04:01
> *To:* User ; Lingzhe Sun
> *Subject:* Re: spark+kafka+dynamic resource allocation
> Hi,
>
> Worth checking this link
>
>
> https://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation
>
> On Saturday, 28 January 2023 at 06:18:2
Thank you for the response. But the reference does not seem to be answering any
of those questions.
BS
Lingzhe Sun
From: ashok34...@yahoo.com
Date: 2023-01-29 04:01
To: User; Lingzhe Sun
Subject: Re: spark+kafka+dynamic resource allocation
Hi,
Worth checking this link
https
Hi,
Worth checking this link
https://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation
On Saturday, 28 January 2023 at 06:18:28 GMT, Lingzhe Sun
wrote:
#yiv9684413148 body {line-height:1.5;}#yiv9684413148 ol, #yiv9684413148 ul
Hi all,
I'm wondering if dynamic resource allocation works in spark+kafka streaming
applications. Here're some questions:
Will structured streaming be supported?
Is the number of consumers always equal to the number of the partitions of
subscribed topic (let's say there's only one topic)?
If
