Re: MADlib Top Level Project Graduation

2017-07-31 Thread Joseph Hellerstein
Merv Adrian from Gartner tweeted today, which is rather a big deal. We can
wait for the press release, or simply jump on that bandwagon and all tweet
today.

Frank, what's your guidance?

J

On Fri, Jul 28, 2017 at 5:02 PM, Frank McQuillan 
wrote:

> I updated the front page of the web site with the TLP announcement
> http://madlib.incubator.apache.org/
>
> When I get back from vacation in 2 weeks, I will work with our mentor Roman
> Shaposhnik to TLP-ify the rest of the infra and help with the press release
>
> Frank
>
> On Fri, Jul 28, 2017 at 2:53 PM, Frank McQuillan 
> wrote:
>
> > There will be a press release put out by the ASF, it is being written now
> > but there have been some delays with people out on summer vacation.
> >
> > I will update the web site this afternoon with the news.  I was planning
> > to wait for the press release, but think I will update it now and add a
> > link to the press release later when  it comes out.
> >
> > Frank
> >
> > On Fri, Jul 28, 2017 at 2:24 PM, Ivan Novick  wrote:
> >
> >> I just tweeted it and referenced @joe_hellerstein
> >> <https://twitter.com/joe_hellerstein>
> >>
> >> Let's make some noise.
> >>
> >> I am sure there will be more, but we can start on our own.
> >>
> >> On Fri, Jul 28, 2017 at 2:18 PM, Joseph Hellerstein <
> >> hellerst...@berkeley.edu> wrote:
> >>
> >>> Is this public? Is anybody planning on putting a news item on a web
> page
> >>> or
> >>> something?
> >>>
> >>> Would be good to brag on social media, once that's in place.
> >>>
> >>> J
> >>>
> >>> On Wed, Jul 26, 2017 at 12:39 AM, Kazmi,Auon H  wrote:
> >>>
> >>> > Congrats developers!
> >>> >
> >>> > 
> >>> > From: Woo Jung 
> >>> > Sent: Monday, July 24, 2017 5:56:35 PM
> >>> > To: u...@madlib.incubator.apache.org
> >>> > Cc: dev@madlib.incubator.apache.org
> >>> > Subject: Re: MADlib Top Level Project Graduation
> >>> >
> >>> > Congratulations MADlib -- Oh, the places you'll go! :)
> >>> >
> >>> > On Mon, Jul 24, 2017 at 2:29 PM, Greg Chase 
> >>> wrote:
> >>> >
> >>> > > Congrats MADlib team! Very proud of you!
> >>> > >
> >>> > > On Mon, Jul 24, 2017 at 2:09 PM, Jarrod Vawdrey <
> jvawd...@pivotal.io
> >>> >
> >>> > > wrote:
> >>> > >
> >>> > >> Awesome!!! Congrats team.
> >>> > >>
> >>> > >> Jarrod Vawdrey
> >>> > >> (678) 651-0795
> >>> > >>
> >>> > >> > On Jul 24, 2017, at 3:57 PM, Joseph Hellerstein <
> >>> > >> hellerst...@berkeley.edu> wrote:
> >>> > >> >
> >>> > >> > Very cool!
> >>> > >> >
> >>> > >> > On Mon, Jul 24, 2017 at 2:11 PM, Anirudh Kondaveeti <
> >>> > >> akondave...@pivotal.io>
> >>> > >> > wrote:
> >>> > >> >
> >>> > >> >> Congrats team!
> >>> > >> >>
> >>> > >> >>> On Mon, Jul 24, 2017 at 11:06 AM, Ivan Novick <
> >>> inov...@pivotal.io>
> >>> > >> wrote:
> >>> > >> >>>
> >>> > >> >>> nice work all!
> >>> > >> >>>
> >>> > >> >>> On Mon, Jul 24, 2017 at 11:04 AM, Marshall Presser <
> >>> > >> mpres...@pivotal.io>
> >>> > >> >>> wrote:
> >>> > >> >>>
> >>> > >> >>>> Woof, woof, woof!  Congrats to the team.
> >>> > >> >>>> MEP
> >>> > >> >>>>
> >>> > >> >>>> On Mon, Jul 24, 2017 at 1:46 PM, FENG, Xixuan (Aaron) <
> >>> > >> >>>> xixuan.f...@gmail.com> wrote:
> >>> > >> >>>>
> >>> > >> >>>>> Dear MADlib community,
> >>> > >> >>>>>
> >>> > >> >>>>> I am pleased to report that on July 19, the ASF board
> >>> established

Re: MADlib Top Level Project Graduation

2017-07-28 Thread Joseph Hellerstein
Is this public? Is anybody planning on putting a news item on a web page or
something?

Would be good to brag on social media, once that's in place.

J

On Wed, Jul 26, 2017 at 12:39 AM, Kazmi,Auon H  wrote:

> Congrats developers!
>
> 
> From: Woo Jung 
> Sent: Monday, July 24, 2017 5:56:35 PM
> To: u...@madlib.incubator.apache.org
> Cc: dev@madlib.incubator.apache.org
> Subject: Re: MADlib Top Level Project Graduation
>
> Congratulations MADlib -- Oh, the places you'll go! :)
>
> On Mon, Jul 24, 2017 at 2:29 PM, Greg Chase  wrote:
>
> > Congrats MADlib team! Very proud of you!
> >
> > On Mon, Jul 24, 2017 at 2:09 PM, Jarrod Vawdrey 
> > wrote:
> >
> >> Awesome!!! Congrats team.
> >>
> >> Jarrod Vawdrey
> >> (678) 651-0795
> >>
> >> > On Jul 24, 2017, at 3:57 PM, Joseph Hellerstein <
> >> hellerst...@berkeley.edu> wrote:
> >> >
> >> > Very cool!
> >> >
> >> > On Mon, Jul 24, 2017 at 2:11 PM, Anirudh Kondaveeti <
> >> akondave...@pivotal.io>
> >> > wrote:
> >> >
> >> >> Congrats team!
> >> >>
> >> >>> On Mon, Jul 24, 2017 at 11:06 AM, Ivan Novick 
> >> wrote:
> >> >>>
> >> >>> nice work all!
> >> >>>
> >> >>> On Mon, Jul 24, 2017 at 11:04 AM, Marshall Presser <
> >> mpres...@pivotal.io>
> >> >>> wrote:
> >> >>>
> >> >>>> Woof, woof, woof!  Congrats to the team.
> >> >>>> MEP
> >> >>>>
> >> >>>> On Mon, Jul 24, 2017 at 1:46 PM, FENG, Xixuan (Aaron) <
> >> >>>> xixuan.f...@gmail.com> wrote:
> >> >>>>
> >> >>>>> Dear MADlib community,
> >> >>>>>
> >> >>>>> I am pleased to report that on July 19, the ASF board established
> >> >>>>> Apache MADlib as a Top Level Project, which was approved by
> >> unanimous
> >> >>>>> vote of the directors present.
> >> >>>>>
> >> >>>>> MADlib entered incubation in the fall of 2015 and made 5 releases
> >> as an
> >> >>>>> incubating project.  Along the way, we have worked hard to ensure
> >> that
> >> >> the
> >> >>>>> project is being developed according to the principles of the
> Apache
> >> >> Way.
> >> >>>>> We will continue to do so in the future as a TLP,  to the best of
> >> our
> >> >>>>> ability.
> >> >>>>>
> >> >>>>> Thank you to all of you for your contributions to the project,
> and I
> >> >>>>> look forward to working with you as part of this community!
> >> >>>>>
> >> >>>>> Aaron Feng
> >> >>>>> Vice President, Apache MADlib
> >> >>>>>
> >> >>>>
> >> >>>>
> >> >>>>
> >> >>>> --
> >> >>>> Marshall Presser
> >> >>>> Pivotal Data Engineering
> >> >>>> mpresser@pivotal .io
> >> >>>> 240.401.1750 <(240)%20401-1750>
> >> >>>>
> >> >>>>
> >> >>>
> >> >>>
> >> >>> --
> >> >>> Ivan Novick, Product Manager Pivotal Greenplum
> >> >>> inov...@pivotal.io --  (Mobile) 408-230-6491 <(408)%20230-6491>
> >> >>> https://www.youtube.com/GreenplumDatabase
> >> >>>
> >> >>>
> >> >>
> >> >>
> >> >> --
> >> >> Anirudh Kondaveeti, Ph.D. | Principal Data Scientist | Pivotal Data
> >> Science
> >> >> Team akondave...@pivotal.io | c - 650 483 3985
> >> >>
> >>
> >
> >
>


Re: MADlib Top Level Project Graduation

2017-07-24 Thread Joseph Hellerstein
Very cool!

On Mon, Jul 24, 2017 at 2:11 PM, Anirudh Kondaveeti 
wrote:

> Congrats team!
>
> On Mon, Jul 24, 2017 at 11:06 AM, Ivan Novick  wrote:
>
> > nice work all!
> >
> > On Mon, Jul 24, 2017 at 11:04 AM, Marshall Presser 
> > wrote:
> >
> >> Woof, woof, woof!  Congrats to the team.
> >> MEP
> >>
> >> On Mon, Jul 24, 2017 at 1:46 PM, FENG, Xixuan (Aaron) <
> >> xixuan.f...@gmail.com> wrote:
> >>
> >>> Dear MADlib community,
> >>>
> >>> I am pleased to report that on July 19, the ASF board established
> >>> Apache MADlib as a Top Level Project, which was approved by unanimous
> >>> vote of the directors present.
> >>>
> >>> MADlib entered incubation in the fall of 2015 and made 5 releases as an
> >>> incubating project.  Along the way, we have worked hard to ensure that
> the
> >>> project is being developed according to the principles of the Apache
> Way.
> >>> We will continue to do so in the future as a TLP,  to the best of our
> >>> ability.
> >>>
> >>> Thank you to all of you for your contributions to the project, and I
> >>> look forward to working with you as part of this community!
> >>>
> >>> Aaron Feng
> >>> Vice President, Apache MADlib
> >>>
> >>
> >>
> >>
> >> --
> >> Marshall Presser
> >> Pivotal Data Engineering
> >> mpresser@pivotal .io
> >> 240.401.1750 <(240)%20401-1750>
> >>
> >>
> >
> >
> > --
> > Ivan Novick, Product Manager Pivotal Greenplum
> > inov...@pivotal.io --  (Mobile) 408-230-6491 <(408)%20230-6491>
> > https://www.youtube.com/GreenplumDatabase
> >
> >
>
>
> --
> Anirudh Kondaveeti, Ph.D. | Principal Data Scientist | Pivotal Data Science
> Team akondave...@pivotal.io | c - 650 483 3985
>


Re: [VOTE] MADlib v1.11-rc3

2017-05-05 Thread Joseph Hellerstein
dmg install smooth with OSX Postgres.app. Looks clean.

+1

On Fri, May 5, 2017 at 9:34 AM, Frank McQuillan 
wrote:

> I just want to comment on a couple items raised in the RC1 and RC2 votes
> that pertain to RC3:
>
> (1)
> “I happened to open the file "CMakeLists.txt" in the root directory
> and noticed it does not have the standard ASF header. I know there
> were IP issues resolved globally for the project recently. I
> noticed many of them are excluded in the pom.xml file. Regardless
> of the IP issues, shouldn't these files contain the ASF header?”
>
> Since this file existed before MADlib’s move to ASF, it does not need an
> ASF header as per the guidance from ASF on this topic
> https://issues.apache.org/jira/browse/LEGAL-293
>
> (2)
> “The DMG(apache-madlib-1.11-incubating-bin-Darwin.dmg) contains a
> pkg file named "madlib-1.11-Darwin.pkg". Shouldn't it be called
> "apache-madlib-1.11-incubating-Darwin.pkg"?
>
> Similarly, the DMG base folder name is madlib-1.11.Darwin.“
>
> As per guidance from Roman our mentor, it is not necessary to rename all
> packages and files.  Also, this may affect some functional tests that look
> for certain file names.
>
> (3)
> “There are still three outstanding Jira issues in an "Unresolved" state
> with a fix version of v1.11.  Are they going to be resolved soon? They can
> be seen with the following url:
>
> https://issues.apache.org/jira/browse/MADLIB/fixforversion/12339592/?
> selectedTab=com.atlassian.jira.jira-projects-plugin:version-summary-panel
> ”
>
> Regarding the JIRAs that are not closed, the actual work has been done so
> there is nothing material pending.  But I did not close them because I
> wanted Roman to do that, since he was the one overseeing them.
>
> (4)
> Convenience binaries are being voted on, as Rashmi’s email calls out.
>
> (5)
> I tried out the RC3 dmg and found that install, reinstall, upgrade work
> fine with the soft link on my OS X box on PG 9.6
>
> So...
>
>
> +1
>
>
>
>
> On Thu, May 4, 2017 at 6:10 PM, Rashmi Raghu  wrote:
>
> > Hello MADlib community,
> >
> > We have created a MADlib 1.11 RC-3, with the artifacts below (source and
> > convenience binaries) up for a vote.
> >
> > Note that voting for the RC-2 release has been cancelled due to the need
> > for minor corrections based on community feedback. Sorry for the
> > inconvenience.
> >
> > RC-3 replaces RC-2 with the following minor changes:
> > * Ensure product naming is consistently 'Apache MADlib (incubating)'
> > * Git revision tag changed to rc/1.11-rc3
> >
> > This will be the 5th release for Apache MADlib (incubating).
> >
> > The main goals of this release are:
> > * new module (PageRank for graph analytics with grouping support
> included)
> > * improvements to existing modules (add grouping support to Single Source
> > Shortest Path, reduce memory footprint of DT and RF, include NULL
> features
> > in training DT, add support for array and svec output for Pivot module,
> > utility to unnest 2-D arrays into rows of 1-D arrays)
> > * platform updates (GPDB 5)
> > * updates for Apache Top Level Project readiness and build process on
> > Apache infrastructure
> > * bug fixes
> > * doc improvements
> >
> > For more information including release notes, please see:
> > https://cwiki.apache.org/confluence/display/MADLIB/MADlib+1.11
> >
> > *** Please download, review and vote by Tue May 09, 2017 @ 6pm PDT ***
> >
> > We're voting upon the source and convenience binaries below:
> >
> > Source Repository (tag):  rc/1.11-rc3
> > https://github.com/apache/incubator-madlib/tree/rc/1.11-rc3
> >
> > Source Files and convenience Binaries:
> > https://dist.apache.org/repos/dist/dev/incubator/madlib/1.
> > 11-incubating-rc3/
> >
> > Commit:
> > https://github.com/apache/incubator-madlib/commit/
> > 8e2778a3921aa99f009962756881ce4bea5eee16
> >
> > KEYS file containing PGP Keys we use to sign the release:
> > https://dist.apache.org/repos/dist/dev/incubator/madlib/KEYS
> >
> > To help in tallying the vote, PMC members please be sure to indicate
> > "(binding)" with the vote.
> >
> > [ ] +1  approve
> > [ ] +0  no opinion
> > [ ] -1  disapprove (and reason why)
> >
> >
> > Regards,
> > Rashmi Raghu
> >
> > --
> > Rashmi Raghu, Ph.D.
> > Pivotal Data Science
> >
>


Re: [VOTE] MADlib v1.10-rc2

2017-03-06 Thread Joseph Hellerstein
+1

On Fri, Mar 3, 2017 at 8:26 PM, Ed Espino  wrote:

> I had some time and had been wanting to perform a MADlib build.  Here are
> my notes from my quick review of MADlib v1.10-rc2. Sorry if the information
> is a bit scattered.
>
> Regards,
> -=ed espino
>
> ==
> Checksums are good
> ==
> PGP signature is good
> ==
> Extracted tarball base directory (apache-madlib-src-1.10-incubating)
> good
> ==
> LICENSE
>
>   Shouldn't the components with files in licenses/third_party be
>   referenced in LICENSE file?
>
> Boost_Software_License_v1.txt
> Eigen_v3.1.2.txt
> PyXB_v1.2.3.txt
> PyYAML_v3.10.txt
> Python_License_v2.7.1.txt
> UseLATEX_v1.9.4.txt
> _M_widen_init.txt
> argparse_v1.2.1.txt
>
> From README.md, I only saw an incomplete reference to the third party
> components.
>
>   Third Party Components
>   MADlib incorporates material from the following third-party components
>
>   argparse 1.2.1 "provides an easy, declarative interface for creating
> command line tools"
>   Boost 1.47.0 (or newer) "provides peer-reviewed portable C++ source
> libraries"
>   Eigen 3.2.2 "is a C++ template library for linear algebra"
>   PyYAML 3.10 "is a YAML parser and emitter for Python"
>   PyXB 1.2.4 "is a Python library for XML Schema Bindings"
>
> ==
> DISCLAIMER good
> ==
> NOTICE good
> ==
> BUILD, INSTALL and INSTALL-CHECK
>
> I was able to build the package and successfully ran MADlib
> install-check against PostgreSQL 9.6.2.
>
> Issue: There is no obvious reference to the PostgreSQL libxml
>dependency in dev documentation. The madpack install-check
>has failures (see below) if "--with-libxml" configure
>option is not specified for PostgreSQL.
>
>install-check errors encountered due to PostgreSQL
>configuration without "--with-libxml" option:
>
>  psql:/tmp/madlib.0UIPlZ/pmml/test/table_to_pmml.sql_in.tmp:73:
> ERROR:  unsupported XML feature
>  DETAIL:  This functionality requires the server to be built with
> libxml support.
>  HINT:  You need to rebuild PostgreSQL using --with-libxml.
>  CONTEXT:  while creating return value
>  PL/Python function "pmml"
>
> Issue: AUTO DOWNLOADED PACKAGES
>
>   I was performing the build from a simple perspective. Download
>   source, configure, make and glance at docs (in this order).
>
>   As we have dealt with auto-downloaded files in the HAWQ project, I
>   was a surprised that the following packages were automatically
>   downloaded for me. On the HAWQ project we were instructed to require
>   these as pre-requisites and or make them optional included via
>   command line options (configure).  I'm guessing other packages would
>   have been automatically downloaded if they were not found on system
>   (eg: boost).
>
>   Automatically downloaded packages:
>
>   https://github.com/madlib/eigen/archive/branches/3.2.tar.gz
>   http://sourceforge.net/projects/pyxb/files/PyXB-1.2.4.tar.gz
>
> Issue: As "make" was running, the following message was a bit alarming:
>PyXB: Removing GPL component from code base
>
> This comes from the script src/patch/PyXB.sh run after PyXB source
> is downloaded.
>
>   ...
>   echo "PyXB: Removing GPL component from code base"
>   rm -f doc/extapi.py
>   rm -f doc/extapi.pyc
>
> ==
> JIRA: There is one open Jira for the fix-version v1.10:
> https://issues.apache.org/jira/browse/MADLIB-1005
> ==
> PRODUCT VERSION
>
>   After building from source, shouldn't the version contain the string
>   "incubating" somwehere?
>
> /usr/local/madlib/bin/madpack version
> madpack.py : INFO : MADlib tools version= 1.10.0
> (/usr/local/madlib/Versions/1.10.0/bin/../madpack/madpack.py)
>
> ==
>
> --
> Attached to this email: For reference: here is the entire build log
> (including PostgreSQL 9.6.2) and test run attempts. Several of the
> issues above can be seen in the log.
> --
>
>
> On Fri, Mar 3, 2017 at 4:20 PM, Orhan Kislal  wrote:
>
>> +1
>>
>> On Fri, Mar 3, 2017 at 4:14 PM, Rahul Iyer  wrote:
>>
>> > +1
>> >
>> > On Fri, Mar 3, 2017 at 11:17 AM, Frank McQuillan > >
>> > wrote:
>> >
>> > > Hello