When I was testing release 1.3 last year, I remember getting a similar
issue. Thrift was installed but something in the make was not working
correctly.
To get around the problem temporarily, I manually exported the
THRIFT_INC_DIR and THRIFT_LIB_DIR:
export THRIFT_LIB_DIR=<location>
export THRIFT_INC_DIR=<location>
The build then succeeded.
There were several later changes made in the setup files that eventually did
not require this workaround.
If you manually set these envvars, does the build work?
Roberta
-----Original Message-----
From: Gunnar Tapper [mailto:[email protected]]
Sent: Monday, March 7, 2016 5:28 PM
To: [email protected]
Subject: Re: Parallel Make Failures
I created a new VM and did a new git clone. As stated, include and lib are
not built for Thrift. Also, it seems to me that the qmake change might be
broken. See below.
[centos@trafbuild ~]$ cd incubator-trafodion/ [centos@trafbuild
incubator-trafodion]$ source ./env.sh
If you are ready to build Trafodion, perform one of the following
options:
make all (Build Trafodion, DCS, and REST) OR
make package (Build Trafodion, DCS, REST, and Client drivers) OR
make package-all (Build Trafodion, DCS, REST, Client drivers, and
Tests)
If Trafodion has been built and you want test:
Execute the install_local_hadoop script which performs a single node
install using a popular Hadoop distribution
cd /home/centos/incubator-trafodion/core/sqf/sql/scripts
install_local_hadoop [-p <port option>]
install_traf_components
configure Trafodion and start the processes
HAVE FUN!
You can also choose to install_local_hadoop before building Trafodion.
[centos@trafbuild incubator-trafodion]$ make all -j 1 Building all Trafodion
components cd core && make all
make[1]: Entering directory `/home/centos/incubator-trafodion/core'
./bldenvchk.sh;
*** Warning: QT_TOOLKIT does not point to an existing directory.
*** Warning: SQL Compiler Debugger will not be built.
*** Error: THRIFT_LIB_DIR directory not found:
//home/centos/trafodion-build-tools/thrift-0.9.0/lib
*** Error: THRIFT_INC_DIR directory not found:
//home/centos/trafodion-build-tools/thrift-0.9.0/include
make[1]: *** [sqroot] Error 1
make[1]: Leaving directory `/home/centos/incubator-trafodion/core'
make: *** [all] Error 2
[centos@trafbuild incubator-trafodion]$ echo $QT_TOOLKIT
[centos@trafbuild incubator-trafodion]$ ls
~/trafodion-build-tools/thrift-0.9.0/
bin
On Mon, Mar 7, 2016 at 3:16 PM, Steve Varnau <[email protected]> wrote:
> The traf_tools_setup.sh script has not changed in the in the last few
> days.
> I hope that the download location for thrift have not changed. The
> only thing I can see that has been changing is the wiki instructions
> for setting up the environment.
>
> I see at least one thing wrong on wiki. For instance, it says that
> CentOS
> 6.7 won't work. That is not correct. There was a mistaken impression
> that
> 6.7 has newer gcc. Not true.
>
> With the very latest code (as of this morning), the qt-devel and
> qt-config should no longer be needed.
>
> --Steve
>
>
> > -----Original Message-----
> > From: Gunnar Tapper [mailto:[email protected]]
> > Sent: Monday, March 7, 2016 2:03 PM
> > To: [email protected]
> > Subject: Re: Parallel Make Failures
> >
> > Alas, things are getting worse rather than better... :(
> >
> > I create a new VM, installed all required packages, did a git clone
> > of trafodion, and then I ran install/traf_tools_setup.sh. Now,
> > Thrift isn't building the include and lib folders. I run the exact
> > same command on the version that I downloaded last Thursday and that
> > works just fine.
> >
> > Did anything change that I should be aware of?
> >
> > Gunnar
> >
> > On Mon, Mar 7, 2016 at 12:17 PM, Gunnar Tapper
> > <[email protected]>
> > wrote:
> >
> > > Well, today, the build doesn't work at all regardless of what -j
> > > or -l options I use. It constantly fails on:
> > >
> > > Generating C++ code from yacc file ../sqlci/sqlci_yacc.y
> > > ##(SQL)
> > > ../sqlci/sqlci_yacc.y: warning: 1 reduce/reduce conflict
> > > [-Wconflicts-rr]
> > > ##(SQL)
> > > /home/centos/traf-tools/bison_3_linux/bin/bison:
> > > /home/centos/trafodion//bison_3_linux/share/bison/m4sugar/m4sugar.m4:
> > > cannot open: No such file or directory ##(SQL)
> > > mv: cannot stat `sqlcilib/linux/64bit/debug/sqlci_yacc.cpp': No
> > > such file or directory ##(SQL)
> > > sed: can't read sqlcilib/linux/64bit/debug/sqlci_yacc.cpp.tmp: No such
> > > file or directory ##(SQL)
> > > sed: can't read sqlcilib/linux/64bit/debug/sqlci_yacc.hpp: No such
> > > file or
> > > directory ##(SQL)
> > > rm: cannot remove `sqlcilib/linux/64bit/debug/sqlci_yacc.hpp': No such
> > > file or directory ##(SQL)
> > > rm: cannot remove `sqlcilib/linux/64bit/debug/sqlci_yacc.cpp.tmp':
> > > No such
> > > file or directory ##(SQL)
> > > make[4]: *** [sqlcilib/linux/64bit/debug/sqlci_yacc.h] Error 1
> > > ##(SQL)
> > > make[4]: Leaving directory
> > > `/home/centos/incubator-trafodion/core/sql/nskgmake' ##(SQL)
> > > make[3]: *** [all] Error 2 ##(SQL)
> > > make[3]: Leaving directory
> > > `/home/centos/incubator-trafodion/core/sqf/sql'
> > > ##(SQL)
> > > make[2]: *** [make_sql] Error 2
> > > make[2]: Leaving directory `/home/centos/incubator-trafodion/core/sqf'
> > > make[1]: *** [foundation] Error 2
> > > make[1]: Leaving directory `/home/centos/incubator-trafodion/core'
> > > make: *** [all] Error 2
> > >
> > >
> > > On Mon, Mar 7, 2016 at 12:05 PM, Amanda Moran
> > <[email protected]>
> > > wrote:
> > >
> > >> On redhat 7.1 this command still works:
> > >>
> > >> [ec2-user@ip-10-0-0-175 ~]$ cat /etc/redhat-release Red Hat
> > >> Enterprise Linux Server release 7.1 (Maipo)
> > >>
> > >> [ec2-user@ip-10-0-0-175 ~]$ grep processor /proc/cpuinfo | wc -l
> > >> 4
> > >>
> > >>
> > >> On Mon, Mar 7, 2016 at 9:56 AM, Steve Varnau
> > >> <[email protected]>
> > >> wrote:
> > >>
> > >> > > It seems that the parallel make fails on 8 GB machines.
> > >> >
> > >> > I think your first sentence overstates the determinism of the
> problem
> > >> > a
> > >> > bit.
> > >> > I ran a normal, default build on 8GB machine last week and had
> > >> > no
> > >> problem.
> > >> > There must be an environmental problem, but I don't think we
> > >> > fully understand it yet.
> > >> >
> > >> > The aggressiveness of the make parallelism is set in
> > >> core/sqf/sqenvcom.sh.
> > >> > It sets the parallel factor based on how many CPUs are on your
> > >> > machine:
> > >> >
> > >> > # Set default build parallelism # Can be overridden on make
> > >> > commandline cpucnt=$(grep processor /proc/cpuinfo | wc -l)
> > >> > # no number means unlimited, and will swamp the system
> > >> > export MAKEFLAGS="-j$cpucnt"
> > >> >
> > >> > If that calculation is wrong, maybe that could cause a problem.
> > >> >
> > >> > --Steve
> > >> >
> > >> >
> > >> > > -----Original Message-----
> > >> > > From: Gunnar Tapper [mailto:[email protected]]
> > >> > > Sent: Monday, March 7, 2016 9:35 AM
> > >> > > To: [email protected]
> > >> > > Subject: Parallel Make Failures
> > >> > >
> > >> > > Hi,
> > >> > >
> > >> > > It seems that the parallel make fails on 8 GB machines. At
> > >> > > least,
> > >> Nitin
> > >> > > and
> > >> > > I both ran into make failures that did not appear when
> > >> > > running serial make.
> > >> > > I've also seen similar failures when building the code on 12
> > >> > > GB
> > >> machines.
> > >> > >
> > >> > > Based on previous discussions, the Trafodion Contributor
> > >> > > Guide
> > >> recommends
> > >> > > rerunning make a few times if running issues.
> > >> > >
> > >> > > I most wonder if there's a way to reduce the aggressiveness
> > >> > > of the
> > >> make
> > >> > in
> > >> > > general. Could we, for example, come up with a table that
> > >> > > correlates system size to define the -l option or something
> > >> > > similar?
> > >> > >
> > >> > > --
> > >> > > Thanks,
> > >> > >
> > >> > > Gunnar
> > >> > > *If you think you can you can, if you think you can't you're
> > >> > > right.*
> > >> >
> > >>
> > >>
> > >>
> > >> --
> > >> Thanks,
> > >>
> > >> Amanda Moran
> > >>
> > >
> > >
> > >
> > > --
> > > Thanks,
> > >
> > > Gunnar
> > > *If you think you can you can, if you think you can't you're
> > > right.*
> > >
> >
> >
> >
> > --
> > Thanks,
> >
> > Gunnar
> > *If you think you can you can, if you think you can't you're right.*
>
--
Thanks,
Gunnar
*If you think you can you can, if you think you can't you're right.*
