I want to contribute code for PySpark! Utilities and things to perform repeatable experiments for machine learning, and joins with RDDs and things like that.
On Mon, Jul 10, 2017 at 10:59 AM Matthew Hayes < matthew.terence.ha...@gmail.com> wrote: > I think DataFu is pretty close to graduating from incubator. We completed > the maturity evaluation > https://cwiki.apache.org/confluence/display/DATAFU/Maturity+Evaluation and > I've drafted a graduation resolution > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68716826 > that needs to be reviewed. I'm not sure what else needs to be done besides > that. John do you have any suggestion on next steps? > > Eyal, expanding DataFu to include Spark-related code makes sense to me. I > recall Russell had the same suggestion. > > -Matt > > On Mon, Jul 10, 2017 at 3:45 AM, Eyal Allweil < > eyal_allw...@yahoo.com.invalid> wrote: > > > Hi John (and everyone else), > > > > There isn't a lot of traffic, but over the past few months the community > > has been working on preparing for graduation - I think we're almost > there. > > There was one JIRA issue opened this past month by a new contributor, > which > > I've already reviewed and need to commit. There are other issues with > > patches that need to be decided on or reviewed. > > > > I think the project is still viable, but part of the lessening of > interest > > in it is because of a general decline in Apache Pig as a platform. > > Personally I'd like to expand DataFu to include Spark-related code, > which I > > think will bring new contributions and contributors. Currently there > isn't > > an open-source "home" for auxiliary Spark code, and just as DataFu has > been > > that home for Pig, it could be for Spark. > > Thoughts? > > Regards,Eyal > > > > > > > > > > On Monday, July 10, 2017 1:28 PM, John D. Ament < > johndam...@apache.org> > > wrote: > > > > > > All, > > > > I'd like to know the current status of DataFu. It looks like the list > > traffic has died down quite a bit, are you still a viable project? > > > > John > > > > > > > > > -- Russell Jurney @rjurney <http://twitter.com/rjurney> russell.jur...@gmail.com LI <http://linkedin.com/in/russelljurney> FB <http://facebook.com/jurney> datasyndrome.com
