Re: Green dot in web UI DAG visualization

[Nicholas Chammas]

https://issues.apache.org/jira/browse/SPARK-18495

On Thu, Nov 17, 2016 at 12:23 PM Nicholas Chammas <
nicholas.cham...@gmail.com> wrote:

> Nice catch Suhas, and thanks for the reference. Sounds like we need a
> tweak to the UI so this little feature is self-documenting.
>
> Will file a JIRA, unless someone else wants to take this one and file the
> JIRA themselves.
>
> On Thu, Nov 17, 2016 at 12:21 PM Suhas Gaddam 
> wrote:
>
> "Second, one of the RDDs is cached in the first stage (denoted by the
> green highlight). Since the enclosing operation involves reading from HDFS,
> caching this RDD means future computations on this RDD can access at least
> a subset of the original file from memory instead of from HDFS."
>
> from
> https://databricks.com/blog/2015/06/22/understanding-your-spark-application-through-visualization.html
>
> On Thu, Nov 17, 2016 at 9:19 AM, Reynold Xin  wrote:
>
> Ha funny. Never noticed that.
>
>
> On Thursday, November 17, 2016, Nicholas Chammas <
> nicholas.cham...@gmail.com> wrote:
>
> Hmm... somehow the image didn't show up.
>
> How about now?
>
> [image: Screen Shot 2016-11-17 at 11.57.14 AM.png]
>
> On Thu, Nov 17, 2016 at 12:14 PM Herman van Hövell tot Westerflier <
> hvanhov...@databricks.com> wrote:
>
> Should I be able to see something?
>
> On Thu, Nov 17, 2016 at 9:10 AM, Nicholas Chammas <
> nicholas.cham...@gmail.com> wrote:
>
> Some questions about this DAG visualization:
>
> [image: Screen Shot 2016-11-17 at 11.57.14 AM.png]
>
> 1. What's the meaning of the green dot?
> 2. Should this be documented anywhere (if it isn't already)? Preferably a
> tooltip or something directly in the UI would explain the significance.
>
> Nick
>
>
>
>

Re: Green dot in web UI DAG visualization

[Nicholas Chammas]

Nice catch Suhas, and thanks for the reference. Sounds like we need a tweak
to the UI so this little feature is self-documenting.

Will file a JIRA, unless someone else wants to take this one and file the
JIRA themselves.

On Thu, Nov 17, 2016 at 12:21 PM Suhas Gaddam 
wrote:

> "Second, one of the RDDs is cached in the first stage (denoted by the
> green highlight). Since the enclosing operation involves reading from HDFS,
> caching this RDD means future computations on this RDD can access at least
> a subset of the original file from memory instead of from HDFS."
>
> from
> https://databricks.com/blog/2015/06/22/understanding-your-spark-application-through-visualization.html
>
> On Thu, Nov 17, 2016 at 9:19 AM, Reynold Xin  wrote:
>
> Ha funny. Never noticed that.
>
>
> On Thursday, November 17, 2016, Nicholas Chammas <
> nicholas.cham...@gmail.com> wrote:
>
> Hmm... somehow the image didn't show up.
>
> How about now?
>
> [image: Screen Shot 2016-11-17 at 11.57.14 AM.png]
>
> On Thu, Nov 17, 2016 at 12:14 PM Herman van Hövell tot Westerflier <
> hvanhov...@databricks.com> wrote:
>
> Should I be able to see something?
>
> On Thu, Nov 17, 2016 at 9:10 AM, Nicholas Chammas <
> nicholas.cham...@gmail.com> wrote:
>
> Some questions about this DAG visualization:
>
> [image: Screen Shot 2016-11-17 at 11.57.14 AM.png]
>
> 1. What's the meaning of the green dot?
> 2. Should this be documented anywhere (if it isn't already)? Preferably a
> tooltip or something directly in the UI would explain the significance.
>
> Nick
>
>
>
>

Re: Green dot in web UI DAG visualization

[Suhas Gaddam]

"Second, one of the RDDs is cached in the first stage (denoted by the green
highlight). Since the enclosing operation involves reading from HDFS,
caching this RDD means future computations on this RDD can access at least
a subset of the original file from memory instead of from HDFS."

from
https://databricks.com/blog/2015/06/22/understanding-your-spark-application-through-visualization.html

On Thu, Nov 17, 2016 at 9:19 AM, Reynold Xin  wrote:

> Ha funny. Never noticed that.
>
>
> On Thursday, November 17, 2016, Nicholas Chammas <
> nicholas.cham...@gmail.com> wrote:
>
>> Hmm... somehow the image didn't show up.
>>
>> How about now?
>>
>> [image: Screen Shot 2016-11-17 at 11.57.14 AM.png]
>>
>> On Thu, Nov 17, 2016 at 12:14 PM Herman van Hövell tot Westerflier <
>> hvanhov...@databricks.com> wrote:
>>
>>> Should I be able to see something?
>>>
>>> On Thu, Nov 17, 2016 at 9:10 AM, Nicholas Chammas <
>>> nicholas.cham...@gmail.com> wrote:
>>>
 Some questions about this DAG visualization:

 [image: Screen Shot 2016-11-17 at 11.57.14 AM.png]

 1. What's the meaning of the green dot?
 2. Should this be documented anywhere (if it isn't already)? Preferably
 a tooltip or something directly in the UI would explain the significance.

 Nick


>>>

Re: Green dot in web UI DAG visualization

[Reynold Xin]

Ha funny. Never noticed that.

On Thursday, November 17, 2016, Nicholas Chammas 
wrote:

> Hmm... somehow the image didn't show up.
>
> How about now?
>
> [image: Screen Shot 2016-11-17 at 11.57.14 AM.png]
>
> On Thu, Nov 17, 2016 at 12:14 PM Herman van Hövell tot Westerflier <
> hvanhov...@databricks.com
> > wrote:
>
>> Should I be able to see something?
>>
>> On Thu, Nov 17, 2016 at 9:10 AM, Nicholas Chammas <
>> nicholas.cham...@gmail.com
>> > wrote:
>>
>>> Some questions about this DAG visualization:
>>>
>>> [image: Screen Shot 2016-11-17 at 11.57.14 AM.png]
>>>
>>> 1. What's the meaning of the green dot?
>>> 2. Should this be documented anywhere (if it isn't already)? Preferably
>>> a tooltip or something directly in the UI would explain the significance.
>>>
>>> Nick
>>>
>>>
>>

Re: Green dot in web UI DAG visualization

[Nicholas Chammas]

Hmm... somehow the image didn't show up.

How about now?

[image: Screen Shot 2016-11-17 at 11.57.14 AM.png]

On Thu, Nov 17, 2016 at 12:14 PM Herman van Hövell tot Westerflier <
hvanhov...@databricks.com> wrote:

Should I be able to see something?

On Thu, Nov 17, 2016 at 9:10 AM, Nicholas Chammas <
nicholas.cham...@gmail.com> wrote:

Some questions about this DAG visualization:

[image: Screen Shot 2016-11-17 at 11.57.14 AM.png]

1. What's the meaning of the green dot?
2. Should this be documented anywhere (if it isn't already)? Preferably a
tooltip or something directly in the UI would explain the significance.

Nick

Re: Green dot in web UI DAG visualization

[Herman van Hövell tot Westerflier]

Should I be able to see something?

On Thu, Nov 17, 2016 at 9:10 AM, Nicholas Chammas <
nicholas.cham...@gmail.com> wrote:

> Some questions about this DAG visualization:
>
> [image: Screen Shot 2016-11-17 at 11.57.14 AM.png]
>
> 1. What's the meaning of the green dot?
> 2. Should this be documented anywhere (if it isn't already)? Preferably a
> tooltip or something directly in the UI would explain the significance.
>
> Nick
>
>

Green dot in web UI DAG visualization

[Nicholas Chammas]

Some questions about this DAG visualization:

[image: Screen Shot 2016-11-17 at 11.57.14 AM.png]

1. What's the meaning of the green dot?
2. Should this be documented anywhere (if it isn't already)? Preferably a
tooltip or something directly in the UI would explain the significance.

Nick