Thanks Sean, that makes sense.
Regards,
Nasrulla
-Original Message-
From: Sean Owen
Sent: Tuesday, May 21, 2019 6:24 PM
To: Nasrulla Khan Haris
Cc: dev@spark.apache.org
Subject: Re: RDD object Out of scope.
I'm not clear what you're asking. An RDD itself is just an object in the JVM
wrote:
>
> I am trying to find the code that cleans up uncached RDD.
>
>
>
> Thanks,
>
> Nasrulla
>
>
>
> From: Charoes
> Sent: Tuesday, May 21, 2019 5:10 PM
> To: Nasrulla Khan Haris
> Cc: Wenchen Fan ; dev@spark.apache.org
> Subject: Re: RDD
I am trying to find the code that cleans up uncached RDD.
Thanks,
Nasrulla
From: Charoes
Sent: Tuesday, May 21, 2019 5:10 PM
To: Nasrulla Khan Haris
Cc: Wenchen Fan ; dev@spark.apache.org
Subject: Re: RDD object Out of scope.
If you cached a RDD and hold a reference of that RDD in your code
:
> Thanks for reply Wenchen, I am curious as what happens when RDD goes out
> of scope when it is not cached.
>
>
>
> Nasrulla
>
>
>
> *From:* Wenchen Fan
> *Sent:* Tuesday, May 21, 2019 6:28 AM
> *To:* Nasrulla Khan Haris
> *Cc:* dev@spark.apache.org
&
Thanks for reply Wenchen, I am curious as what happens when RDD goes out of
scope when it is not cached.
Nasrulla
From: Wenchen Fan
Sent: Tuesday, May 21, 2019 6:28 AM
To: Nasrulla Khan Haris
Cc: dev@spark.apache.org
Subject: Re: RDD object Out of scope.
RDD is kind of a pointer
RDD is kind of a pointer to the actual data. Unless it's cached, we don't
need to clean up the RDD.
On Tue, May 21, 2019 at 1:48 PM Nasrulla Khan Haris
wrote:
> HI Spark developers,
>
>
>
> Can someone point out the code where RDD objects go out of scope ?. I
> found the contextcleaner
>
