Hi Anton, Here are the steps. I am using the centos7 image, the ubuntu image should be quite similar.
su postgres source /usr/local/gpdb6/greenplum_path.sh # This will put psql and pg_config in your path rm -f /tmp/.s.PGSQL.600* # This will clean up the old GPDB locks cd /gpdb6/gpdb/gpAux/gpdemo make clean make cluster # This will give you a fresh cluster source gpdemo-env.sh # This will set up the ports master data dir etc. createdb madlibdb cd /madlib # This is where I mount the madlib src directory mkdir buildc7 cd buildc7 cmake ../ # This should pick up the GPDB6 pg_config and show "Adding Greenplum 6 (x86_64) to target list" make -j8; make -j8 # The first parallel make will fail because of a boost dependency. You can change the value depending on your CPU ./src/bin/madpack -p greenplum -c /madlibdb install # This will install your local madlib to the madlibdb database I hope this helps. IIRC this was the GPDB configuration line I used: `./configure --enable-depend --with-python --disable-gpfdist --without-zstd --with-libxml --prefix /usr/local/gpdb6 --with-includes=/usr/local/include --with-libraries=/usr/local/lib CFLAGS="-O0 -fno-omit-frame-pointer" --without-readline --disable-orca` Best, Orhan On Thu, Feb 13, 2020 at 5:20 PM Anton K <[email protected]> wrote: > Hello Orhan! > Thank you for the response! > > I've read docs about building gpdb and madlib. I've reviewed the > containers and found installations of postgres and gpdb and I know how to > make madlib without database requirements. > > But my major question is about how to build madlib with database. This > process was described nowhere as I see. > > We see in documentation: > Step N: "An installed version of Greenplum Database or PostgreSQL (64-bit) > 9.2+ with plpython support enabled. " > Step N+1: "cd madlib && cmake && make" > > > *This is unclear. * > > 1. How database source code should be prepared? > 2. What flags/options/arguments we should set to building madlib with > database support? > > I tried to reverse engineering the docker containers and I see that you > checkout database code from repo, build it (with which flags?) and then (I > suppose) do "make madlib" with special arguments. > > Could you please give me the full "bash history" of what you are doing to > build madlib? It will be really helpful! > > Thanks! > > Anton > > On Fri, Feb 14, 2020 at 1:00 AM Orhan Kislal <[email protected]> wrote: > >> Hi Anton, >> >> Currently, we don't have dockerfiles for GPDB6 + MADlib. The docker >> images you mentioned are created for the release process and they have >> multiple databases installed. Greenplum installations are in /usr/local/ >> and the source code folders should be in the root or home folder. You will >> need a non-root user and the images have either `gpadmin` or `postgres` >> user already setup. The demo-clusters are created and you can enable them >> by sourcing the env script. For more info please take a look at the GPDB >> github readme. You can compile madlib with the help of the following wiki: >> >> https://cwiki.apache.org/confluence/display/MADLIB/Installation+Guide#InstallationGuide-CompileFromSourceCompilingFromSource >> <https://urldefense.proofpoint.com/v2/url?u=https-3A__cwiki.apache.org_confluence_display_MADLIB_Installation-2BGuide-23InstallationGuide-2DCompileFromSourceCompilingFromSource&d=DwMFaQ&c=lnl9vOaLMzsy2niBC8-h_K-7QJuNJEsFrzdndhuJ3Sw&r=_MobDWzCAkodzAg86J8C5Z2NSqSNZcwqFISZmrTVQyk&m=WCu3-kLQ9dDXBJIH7cBQr7Bd0JtRuT-Df-UmSBFIX7Q&s=iDU5o90n-8nnJw1pzTGDAnDfDWoBZfYTWZ1gNoTrqRo&e=> >> >> The MADlib source code isn't in the image because I usually mount the >> madlib folder from my PC to make sure whatever changes I make are in >> effect. In case you want to try postgres as well, you can find the >> installations in `/usr/pgsql-11/bin` and the data folder at >> `/var/lib/pgsql/11/data`. >> >> I hope this will help you to get up and running. Please feel free to send >> a message to the user and/or dev mailing boards if you have any questions. >> >> Best, >> >> Orhan Kislal >> >> On Wed, Feb 12, 2020 at 4:15 PM Nandish Jayaram <[email protected]> >> wrote: >> >>> Hi Anton, >>> >>> Thank you for trying out MADlib. I might not know the exact answer to >>> your >>> question, but folks on the dev mailing list (CCed) should be able to help >>> you out. >>> >>> Regards >>> Nandish >>> >>> On Fri, Feb 7, 2020 at 11:01 AM Anton Kirillov <[email protected]> >>> wrote: >>> >>> > Hello Nandish! >>> > >>> > I'm trying to build MADlib 1.16 with Greenplum 6.3. I've reviewed >>> madlib >>> > repo, greenplum repo and pivotal repo and found no clear instructions. >>> > >>> > I see there are a docker containers: >>> > >>> > - https://hub.docker.com/r/madlib/ubuntu18-postgres-gpdb >>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__hub.docker.com_r_madlib_ubuntu18-2Dpostgres-2Dgpdb&d=DwMFaQ&c=lnl9vOaLMzsy2niBC8-h_K-7QJuNJEsFrzdndhuJ3Sw&r=_MobDWzCAkodzAg86J8C5Z2NSqSNZcwqFISZmrTVQyk&m=WCu3-kLQ9dDXBJIH7cBQr7Bd0JtRuT-Df-UmSBFIX7Q&s=jcr6u4qCbjCMVb1yw89g9Xjp0cb67OIL6rPRA2o9jIY&e=> >>> > - https://hub.docker.com/r/madlib/centos7-postgres-gpdb >>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__hub.docker.com_r_madlib_centos7-2Dpostgres-2Dgpdb&d=DwMFaQ&c=lnl9vOaLMzsy2niBC8-h_K-7QJuNJEsFrzdndhuJ3Sw&r=_MobDWzCAkodzAg86J8C5Z2NSqSNZcwqFISZmrTVQyk&m=WCu3-kLQ9dDXBJIH7cBQr7Bd0JtRuT-Df-UmSBFIX7Q&s=Wfkff9JnXjI4fUvxoXlh3OuvfUHjquJj-takAhWiZzU&e=> >>> > >>> > which contain a result of madlib building process. But without >>> Dockerfile. >>> > >>> > Could you please help me: where I can find Dockerfiles for this >>> containers? >>> > Or maybe you know the author and his contacts? >>> > >>> > Thanks! >>> > >>> > Anton >>> > >>> >>
