Re: Scheduling Time > Processing Time

2021-06-20 Thread Mohamadreza Rostami
Hi, I think it’s because of locality time out. In streaming tasks you must decrease the locality time out. Sent from my iPhone > On Jun 20, 2021, at 11:55 PM, Siva Tarun Ponnada wrote: > >  > Hi Team, > I have a spark streaming job which I am running in a single node > cluster. I

Scheduling Time > Processing Time

2021-06-20 Thread Siva Tarun Ponnada
Hi Team, I have a spark streaming job which I am running in a single node cluster. I often see the schedulingTime > Processing Time in streaming statistics after a few minutes of my application startup. What does that mean? Should I increase the no:of receivers? Regards Taun

Re: Unsubscribe

2021-06-20 Thread Alun ap Rhisiart
Guys, can we please stop asking other list members to unsubscribe you? You have to unsubscribe yourself from mailing lists. The address is actually in the header for every email you get from a list, but in case you miss it, it is this line: List-Unsubscribe:

RE: Unsubscribe

2021-06-20 Thread yiling
From: gvss [mailto:srikanthg...@gmail.com] Sent: Sunday, June 20, 2021 10:16 PM To: Arnaud Wolf Cc: user@spark.apache.org Subject: Re: Unsubscribe On Sun, 20 Jun 2021, 19:44 Arnaud Wolf, wrote:

Re: Unsubscribe

2021-06-20 Thread gvss
On Sun, 20 Jun 2021, 19:44 Arnaud Wolf, wrote: >

Unsubscribe

2021-06-20 Thread Arnaud Wolf

Re: Insert into table with one the value is derived from DB function using spark

2021-06-20 Thread Mich Talebzadeh
Actually I found a solution to this issue *Challenge* Insert data from Spark dataframe when one or more columns in theOracle table rely on some derived_colums dependent on data in one or more dataframe columns. Standard JDBC from Spark to Oracle does batch insert of dataframe into Oracle *so it