Re: Spark Structured streaming - Kakfa - slowness with query 0

2020-10-21 Thread Yuri Oleynikov (‫יורי אולייניקוב‬‎)
;>>> keep processing data as it comes in the input. If a streaming job is >>>>> working well, it will typically generate output at a certain cadence >>>>> >>>>> >>>>> >>>>> From: KhajaAsmath Mohammed >>>

Re: Spark Structured streaming - Kakfa - slowness with query 0

2020-10-21 Thread KhajaAsmath Mohammed
>> processing data as it comes in the input. If a streaming job is working >>>> well, it will typically generate output at a certain cadence >>>> >>>> >>>> >>>> From: KhajaAsmath Mohammed >>>> Date: Tuesday, October 20, 20

Re: Spark Structured streaming - Kakfa - slowness with query 0

2020-10-20 Thread lec ssmi
generate output at a certain cadence >> >> >> >> *From: *KhajaAsmath Mohammed >> *Date: *Tuesday, October 20, 2020 at 1:23 PM >> *To: *"user @spark" >> *Subject: *[EXTERNAL] Spark Structured streaming - Kakfa - slowness with >> query 0 >> >&g

Re: Spark Structured streaming - Kakfa - slowness with query 0

2020-10-20 Thread KhajaAsmath Mohammed
math Mohammed >> Date: Tuesday, October 20, 2020 at 1:23 PM >> To: "user @spark" >> Subject: [EXTERNAL] Spark Structured streaming - Kakfa - slowness with query >> 0 >> >> >> >> CAUTION: This email originated from outside of the organ

Re: Spark Structured streaming - Kakfa - slowness with query 0

2020-10-20 Thread lec ssmi
generate output at a certain cadence > > > > *From: *KhajaAsmath Mohammed > *Date: *Tuesday, October 20, 2020 at 1:23 PM > *To: *"user @spark" > *Subject: *[EXTERNAL] Spark Structured streaming - Kakfa - slowness with > query 0 > > > > *CAUTION*: Thi

Re: Spark Structured streaming - Kakfa - slowness with query 0

2020-10-20 Thread Lalwani, Jayesh
spark" Subject: [EXTERNAL] Spark Structured streaming - Kakfa - slowness with query 0 CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Hi, I have started using spark

Spark Structured streaming - Kakfa - slowness with query 0

2020-10-20 Thread KhajaAsmath Mohammed
Hi, I have started using spark structured streaming for reading data from kaka and the job is very slow. Number of output rows keeps increasing in query 0 and the job is running forever. any suggestions for this please? [image: image.png] Thanks, Asmath