Re: An alternate UI for Spark.

2015-09-13 Thread Ryan Williams
You can check out Spree for one data point about how this can be done; it is a near-clone of the Spark web UI that updates in real-time. It uses JsonRelay , a SparkListener that sends events as JSON over the networ

An alternate UI for Spark.

2015-09-13 Thread Prashant Sharma
Hi all, TLDR; Some of my colleagues at Imaginea are interested in building an alternate UI for Spark. Basically allow people or groups to build an alternate UI for Spark. More Details: Looking at feasibility, it feels definitely possible to do. But we need a consensus on a public(can be experimen

Re: HyperLogLogUDT

2015-09-13 Thread Yin Huai
The user implementing a UDAF does not need to consider what is the underlying buffer. Our aggregate operator will figure out if the buffer data types of all aggregate functions used by a query are supported by the UnsafeRow. If so, we will use the UnsafeRow as the buffer. Regarding the performance

Re: (send this email to subscribe)

2015-09-13 Thread Ted Yu
See first section of http://spark.apache.org/community.html Cheers > On Sep 13, 2015, at 6:43 PM, 蒋林 wrote: > > Hi,I need subscribe email list,please send me,thank you > > >

(send this email to subscribe)

2015-09-13 Thread 蒋林
Hi,I need subscribe email list,please send me,thank you