Re: Live Streamed Code Review today at 11am Pacific

2018-03-09 Thread Holden Karau
If anyone wants to watch the recording: https://www.youtube.com/watch?v=lugG_2QU6YU I'll do one next week as well - March 16th @ 11am - https://www.youtube.com/watch?v=pXzVtEUjrLc On Fri, Mar 9, 2018 at 9:28 AM, Holden Karau wrote: > Hi folks, > > If your curious in learning more about how Spar

[DISCUSS] Structured Streaming writers in DataSourceV2

2018-03-09 Thread Joseph Torres
Hi all, I've been working for the past few months on figuring out a DataSourceV2 compatible interface for Structured Streaming sinks. I've written a document proposing an overarching design; please take a look and le

Re: [MLlib] QuantRegForest

2018-03-09 Thread Joseph Bradley
Hi Hadrien, That does sound useful, but just to warn you, it can take a while to get new algorithms into MLlib itself. You can definitely make a case for that on the Spark JIRA. In the meantime, I'd recommend submitting it to Spark Packages https://spark-packages.org/ which won't require waitin

Re: Welcoming some new committers

2018-03-09 Thread Joseph Bradley
Congratulations! On Mon, Mar 5, 2018 at 2:19 PM, Seth Hendrickson < seth.hendrickso...@gmail.com> wrote: > Thanks all! :D > > On Mon, Mar 5, 2018 at 9:01 AM, Bryan Cutler wrote: > >> Thanks everyone, this is very exciting! I'm looking forward to working >> with you all and helping out more in t

Live Streamed Code Review today at 11am Pacific

2018-03-09 Thread Holden Karau
Hi folks, If your curious in learning more about how Spark is developed, I’m going to expirement doing a live code review where folks can watch and see how that part of our process works. I have two volunteers already for having their PRs looked at live, and if you have a Spark PR your working on

[MLlib] QuantRegForest

2018-03-09 Thread Hadrien
Hi, we implemented a QuantRegForest to be used with Spark. We coded it in scala. I don't know if you could be interrested but we offer to share it with you (btw the original implementation is in R and called quantregForest : https://cran.r-project.org/web/packages/quantregForest/index.html) Can't