Do I set these variables before running the tools setup? On Mon, Mar 7, 2016 at 6:55 PM, Roberta Marton <[email protected]> wrote:
> When I was testing release 1.3 last year, I remember getting a similar > issue. Thrift was installed but something in the make was not working > correctly. > To get around the problem temporarily, I manually exported the > THRIFT_INC_DIR and THRIFT_LIB_DIR: > > export THRIFT_LIB_DIR=<location> > export THRIFT_INC_DIR=<location> > > The build then succeeded. > There were several later changes made in the setup files that eventually > did > not require this workaround. > > If you manually set these envvars, does the build work? > > Roberta > > -----Original Message----- > From: Gunnar Tapper [mailto:[email protected]] > Sent: Monday, March 7, 2016 5:28 PM > To: [email protected] > Subject: Re: Parallel Make Failures > > I created a new VM and did a new git clone. As stated, include and lib are > not built for Thrift. Also, it seems to me that the qmake change might be > broken. See below. > > [centos@trafbuild ~]$ cd incubator-trafodion/ [centos@trafbuild > incubator-trafodion]$ source ./env.sh > > If you are ready to build Trafodion, perform one of the following > options: > > make all (Build Trafodion, DCS, and REST) OR > make package (Build Trafodion, DCS, REST, and Client drivers) OR > make package-all (Build Trafodion, DCS, REST, Client drivers, and > Tests) > > If Trafodion has been built and you want test: > > Execute the install_local_hadoop script which performs a single node > install using a popular Hadoop distribution > > cd /home/centos/incubator-trafodion/core/sqf/sql/scripts > install_local_hadoop [-p <port option>] > install_traf_components > configure Trafodion and start the processes > HAVE FUN! > > You can also choose to install_local_hadoop before building Trafodion. > > [centos@trafbuild incubator-trafodion]$ make all -j 1 Building all > Trafodion > components cd core && make all > make[1]: Entering directory `/home/centos/incubator-trafodion/core' > ./bldenvchk.sh; > *** Warning: QT_TOOLKIT does not point to an existing directory. > *** Warning: SQL Compiler Debugger will not be built. > *** Error: THRIFT_LIB_DIR directory not found: > //home/centos/trafodion-build-tools/thrift-0.9.0/lib > *** Error: THRIFT_INC_DIR directory not found: > //home/centos/trafodion-build-tools/thrift-0.9.0/include > make[1]: *** [sqroot] Error 1 > make[1]: Leaving directory `/home/centos/incubator-trafodion/core' > make: *** [all] Error 2 > > [centos@trafbuild incubator-trafodion]$ echo $QT_TOOLKIT > > [centos@trafbuild incubator-trafodion]$ ls > ~/trafodion-build-tools/thrift-0.9.0/ > bin > > > On Mon, Mar 7, 2016 at 3:16 PM, Steve Varnau <[email protected]> > wrote: > > > The traf_tools_setup.sh script has not changed in the in the last few > > days. > > I hope that the download location for thrift have not changed. The > > only thing I can see that has been changing is the wiki instructions > > for setting up the environment. > > > > I see at least one thing wrong on wiki. For instance, it says that > > CentOS > > 6.7 won't work. That is not correct. There was a mistaken impression > > that > > 6.7 has newer gcc. Not true. > > > > With the very latest code (as of this morning), the qt-devel and > > qt-config should no longer be needed. > > > > --Steve > > > > > > > -----Original Message----- > > > From: Gunnar Tapper [mailto:[email protected]] > > > Sent: Monday, March 7, 2016 2:03 PM > > > To: [email protected] > > > Subject: Re: Parallel Make Failures > > > > > > Alas, things are getting worse rather than better... :( > > > > > > I create a new VM, installed all required packages, did a git clone > > > of trafodion, and then I ran install/traf_tools_setup.sh. Now, > > > Thrift isn't building the include and lib folders. I run the exact > > > same command on the version that I downloaded last Thursday and that > > > works just fine. > > > > > > Did anything change that I should be aware of? > > > > > > Gunnar > > > > > > On Mon, Mar 7, 2016 at 12:17 PM, Gunnar Tapper > > > <[email protected]> > > > wrote: > > > > > > > Well, today, the build doesn't work at all regardless of what -j > > > > or -l options I use. It constantly fails on: > > > > > > > > Generating C++ code from yacc file ../sqlci/sqlci_yacc.y > > > > ##(SQL) > > > > ../sqlci/sqlci_yacc.y: warning: 1 reduce/reduce conflict > > > > [-Wconflicts-rr] > > > > ##(SQL) > > > > /home/centos/traf-tools/bison_3_linux/bin/bison: > > > > /home/centos/trafodion//bison_3_linux/share/bison/m4sugar/m4sugar.m4: > > > > cannot open: No such file or directory ##(SQL) > > > > mv: cannot stat `sqlcilib/linux/64bit/debug/sqlci_yacc.cpp': No > > > > such file or directory ##(SQL) > > > > sed: can't read sqlcilib/linux/64bit/debug/sqlci_yacc.cpp.tmp: No > such > > > > file or directory ##(SQL) > > > > sed: can't read sqlcilib/linux/64bit/debug/sqlci_yacc.hpp: No such > > > > file or > > > > directory ##(SQL) > > > > rm: cannot remove `sqlcilib/linux/64bit/debug/sqlci_yacc.hpp': No > such > > > > file or directory ##(SQL) > > > > rm: cannot remove `sqlcilib/linux/64bit/debug/sqlci_yacc.cpp.tmp': > > > > No such > > > > file or directory ##(SQL) > > > > make[4]: *** [sqlcilib/linux/64bit/debug/sqlci_yacc.h] Error 1 > > > > ##(SQL) > > > > make[4]: Leaving directory > > > > `/home/centos/incubator-trafodion/core/sql/nskgmake' ##(SQL) > > > > make[3]: *** [all] Error 2 ##(SQL) > > > > make[3]: Leaving directory > > > > `/home/centos/incubator-trafodion/core/sqf/sql' > > > > ##(SQL) > > > > make[2]: *** [make_sql] Error 2 > > > > make[2]: Leaving directory > `/home/centos/incubator-trafodion/core/sqf' > > > > make[1]: *** [foundation] Error 2 > > > > make[1]: Leaving directory `/home/centos/incubator-trafodion/core' > > > > make: *** [all] Error 2 > > > > > > > > > > > > On Mon, Mar 7, 2016 at 12:05 PM, Amanda Moran > > > <[email protected]> > > > > wrote: > > > > > > > >> On redhat 7.1 this command still works: > > > >> > > > >> [ec2-user@ip-10-0-0-175 ~]$ cat /etc/redhat-release Red Hat > > > >> Enterprise Linux Server release 7.1 (Maipo) > > > >> > > > >> [ec2-user@ip-10-0-0-175 ~]$ grep processor /proc/cpuinfo | wc -l > > > >> 4 > > > >> > > > >> > > > >> On Mon, Mar 7, 2016 at 9:56 AM, Steve Varnau > > > >> <[email protected]> > > > >> wrote: > > > >> > > > >> > > It seems that the parallel make fails on 8 GB machines. > > > >> > > > > >> > I think your first sentence overstates the determinism of the > > problem > > > >> > a > > > >> > bit. > > > >> > I ran a normal, default build on 8GB machine last week and had > > > >> > no > > > >> problem. > > > >> > There must be an environmental problem, but I don't think we > > > >> > fully understand it yet. > > > >> > > > > >> > The aggressiveness of the make parallelism is set in > > > >> core/sqf/sqenvcom.sh. > > > >> > It sets the parallel factor based on how many CPUs are on your > > > >> > machine: > > > >> > > > > >> > # Set default build parallelism # Can be overridden on make > > > >> > commandline cpucnt=$(grep processor /proc/cpuinfo | wc -l) > > > >> > # no number means unlimited, and will swamp the system > > > >> > export MAKEFLAGS="-j$cpucnt" > > > >> > > > > >> > If that calculation is wrong, maybe that could cause a problem. > > > >> > > > > >> > --Steve > > > >> > > > > >> > > > > >> > > -----Original Message----- > > > >> > > From: Gunnar Tapper [mailto:[email protected]] > > > >> > > Sent: Monday, March 7, 2016 9:35 AM > > > >> > > To: [email protected] > > > >> > > Subject: Parallel Make Failures > > > >> > > > > > >> > > Hi, > > > >> > > > > > >> > > It seems that the parallel make fails on 8 GB machines. At > > > >> > > least, > > > >> Nitin > > > >> > > and > > > >> > > I both ran into make failures that did not appear when > > > >> > > running serial make. > > > >> > > I've also seen similar failures when building the code on 12 > > > >> > > GB > > > >> machines. > > > >> > > > > > >> > > Based on previous discussions, the Trafodion Contributor > > > >> > > Guide > > > >> recommends > > > >> > > rerunning make a few times if running issues. > > > >> > > > > > >> > > I most wonder if there's a way to reduce the aggressiveness > > > >> > > of the > > > >> make > > > >> > in > > > >> > > general. Could we, for example, come up with a table that > > > >> > > correlates system size to define the -l option or something > > > >> > > similar? > > > >> > > > > > >> > > -- > > > >> > > Thanks, > > > >> > > > > > >> > > Gunnar > > > >> > > *If you think you can you can, if you think you can't you're > > > >> > > right.* > > > >> > > > > >> > > > >> > > > >> > > > >> -- > > > >> Thanks, > > > >> > > > >> Amanda Moran > > > >> > > > > > > > > > > > > > > > > -- > > > > Thanks, > > > > > > > > Gunnar > > > > *If you think you can you can, if you think you can't you're > > > > right.* > > > > > > > > > > > > > > > > -- > > > Thanks, > > > > > > Gunnar > > > *If you think you can you can, if you think you can't you're right.* > > > > > > -- > Thanks, > > Gunnar > *If you think you can you can, if you think you can't you're right.* > -- Thanks, Gunnar *If you think you can you can, if you think you can't you're right.*
