On Thu, May 26, 2016 at 10:14 AM, Hans Zeller <[email protected]> wrote:
> When I ran the RAT tool, I just specified the names of the directory > without using $MY_SQROOT/../../. Here is the command I used, from the > directory in which I untarred the file: > > java -jar apache-rat-0.11/apache-rat-0.11.jar -E > apache-trafodion-2.0.0-incubating/.rat-excludes --dir > apache-trafodion-2.0.0-incubating >rat_log > > Thanks Hans. This worked (my $MY_SQROOT was empty string after sourcing the env.sh). St.Ack > > Hans > > On Thu, May 26, 2016 at 10:11 AM, Sandhya Sundaresan < > [email protected]> wrote: > > > Hi Stack, > > After you source in env.sh , can you change your current directory to > > $MY_SQROOT and reattempt the RAT command ? > > I found the RAT tool to be a bit finicky about the relative directory > > paths. > > We should also add that running RAT on a workspace that you have done a > > build in will make the RAT tool choke on some of the binaries. > > Thanks > > Sandhya > > > > > > -----Original Message----- > > From: [email protected] [mailto:[email protected]] On Behalf Of > Stack > > Sent: Thursday, May 26, 2016 9:48 AM > > To: [email protected] > > Subject: Re: [VOTE] Apache Trafodion release 2.0.0 - release candidate 3 > > > > (Apologize for taking so long responding to this vote) > > > > First, thanks for that RAT_README and now for the dumb question: > > > > I sourced env.sh and then > > > > $ java -jar ~/bin/apache-rat-0.11/apache-rat-0.11.jar -E > > $MY_SQROOT/../../.rat-excludes -d $MY_SQROOT/../.. > > Exception in thread "main" java.io.FileNotFoundException: File > > '/../../.rat-excludes' does not exist > > at > > org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:254) > > at org.apache.commons.io.FileUtils.readLines(FileUtils.java:1695) > > at org.apache.commons.io.FileUtils.readLines(FileUtils.java:1712) > > at org.apache.rat.Report.main(Report.java:96) > > > > ... so I did this: > > > > $ java -jar ~/bin/apache-rat-0.11/apache-rat-0.11.jar -E ./.rat-excludes > > -d > > $MY_SQROOT/../.. > > > > > > ... and got below. Anyone else see this? I'm doing something wrong? > > > > St. > > > > > > Exception in thread "main" org.apache.rat.api.RatException: Cannot > analyse > > header > > at > > > > > org.apache.rat.report.claim.util.ClaimReporterMultiplexer.report(ClaimReporterMultiplexer.java:44) > > at > > org.apache.rat.walker.DirectoryWalker.report(DirectoryWalker.java:147) > > at > > > > > org.apache.rat.walker.DirectoryWalker.processNonDirectories(DirectoryWalker.java:131) > > at > > org.apache.rat.walker.DirectoryWalker.process(DirectoryWalker.java:98) > > at > > > > > org.apache.rat.walker.DirectoryWalker.processDirectory(DirectoryWalker.java:71) > > at > > > > > org.apache.rat.walker.DirectoryWalker.processDirectories(DirectoryWalker.java:114) > > at > > org.apache.rat.walker.DirectoryWalker.process(DirectoryWalker.java:99) > > at > > org.apache.rat.walker.DirectoryWalker.run(DirectoryWalker.java:83) > > at org.apache.rat.Report.report(Report.java:418) > > at org.apache.rat.Report.report(Report.java:394) > > at org.apache.rat.Report.report(Report.java:366) > > at org.apache.rat.Report.styleReport(Report.java:346) > > at org.apache.rat.Report.main(Report.java:109) > > Caused by: org.apache.rat.document.RatDocumentAnalysisException: Cannot > > analyse header > > at > > > > > org.apache.rat.analysis.DocumentHeaderAnalyser.analyse(DocumentHeaderAnalyser.java:47) > > at > > > > > org.apache.rat.analysis.DefaultAnalyserFactory$DefaultAnalyser.analyse(DefaultAnalyserFactory.java:60) > > at > > > > > org.apache.rat.document.impl.util.DocumentAnalyserMultiplexer.analyse(DocumentAnalyserMultiplexer.java:36) > > at > > > > > org.apache.rat.report.claim.util.ClaimReporterMultiplexer.report(ClaimReporterMultiplexer.java:42) > > ... 12 more > > Caused by: org.apache.rat.analysis.RatHeaderAnalysisException: Cannot > read > > header for FileDocument ( file = /../../dev/autofs name = > /../../dev/autofs > > metaData = org.apache.rat.api.MetaData@5e265ba4 ) > > at > > org.apache.rat.analysis.HeaderCheckWorker.read(HeaderCheckWorker.java:95) > > at > > > > > org.apache.rat.analysis.DocumentHeaderAnalyser.analyse(DocumentHeaderAnalyser.java:43) > > ... 15 more > > Caused by: java.io.IOException: Invalid argument > > at java.io.FileInputStream.readBytes(Native Method) > > at java.io.FileInputStream.read(FileInputStream.java:255) > > at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) > > at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) > > at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) > > at java.io.InputStreamReader.read(InputStreamReader.java:184) > > at java.io.BufferedReader.fill(BufferedReader.java:161) > > at java.io.BufferedReader.readLine(BufferedReader.java:324) > > at java.io.BufferedReader.readLine(BufferedReader.java:389) > > at > > > > > org.apache.rat.analysis.HeaderCheckWorker.readLine(HeaderCheckWorker.java:108) > > at > > org.apache.rat.analysis.HeaderCheckWorker.read(HeaderCheckWorker.java:84) > > ... 16 more > > ERROR: 'Pipe broken' > > ERROR: 'com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: > > Pipe broken' > > Exception in thread "Thread-0" > org.apache.rat.ReportFailedRuntimeException: > > javax.xml.transform.TransformerException: > > com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Pipe > broken > > at > org.apache.rat.ReportTransformer.run(ReportTransformer.java:59) > > at java.lang.Thread.run(Thread.java:745) > > Caused by: javax.xml.transform.TransformerException: > > javax.xml.transform.TransformerException: > > com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Pipe > broken > > at > > > > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:749) > > at > > > > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:351) > > at > > org.apache.rat.ReportTransformer.transform(ReportTransformer.java:64) > > at > org.apache.rat.ReportTransformer.run(ReportTransformer.java:57) > > ... 1 more > > Caused by: javax.xml.transform.TransformerException: > > com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: Pipe > broken > > at > > > > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.getDOM(TransformerImpl.java:578) > > at > > > > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:739) > > ... 4 more > > Caused by: com.sun.org.apache.xml.internal.utils.WrappedRuntimeException: > > Pipe broken > > at > > > > > com.sun.org.apache.xalan.internal.xsltc.dom.XSLTCDTMManager.getDTM(XSLTCDTMManager.java:427) > > at > > > > > com.sun.org.apache.xalan.internal.xsltc.dom.XSLTCDTMManager.getDTM(XSLTCDTMManager.java:215) > > at > > > > > com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.getDOM(TransformerImpl.java:556) > > > > > > On Wed, May 25, 2016 at 12:10 PM, Amanda Moran <[email protected]> > > wrote: > > > > > I also noticed that traf_apache_mods stops and restarts HBase. If > > > there are no changes made to any of the configuration files, then this > > > step is not needed. > > > > > > When you copy over the hbase-trx*jar file there needs to be a restart. > > > > > > On Wed, May 25, 2016 at 11:34 AM, Roberta Marton > > > <[email protected] > > > > > > > wrote: > > > > > > > +0 > > > > > > > > Since we have a little more time, I ran tests using Vanilla Apache > > > > on a single node system using: > > > > > > > > Hadoop 2.6.0 > > > > HBase 1.0.2 > > > > Zookeeper 3.4.6 > > > > > > > > I was able to install Vanilla Hadoop, download and build Trafodion. > > > > I encountered the following issues when running trafodion_install > > > > using executables built with the 2.0.0 src tar: > > > > > > > > ==> Error - chmod failed, the INSTALL_LOG showed: > > > > > > > > ***INFO: copying hbase-trx-apache*.jar to all nodes > > > > chmod: cannot access `/hbase-trx-apache*.jar': No such file or > > > > directory > > > > chmod: cannot access `/trafodion-utility-*.jar': No such file or > > > directory > > > > > > > > There is an error in the traf_apache_mods script > > > > > > > > ==> Error: "JAVA_HOME is not set": > > > > > > > > I ran HBase, Hadoop, Zookeeper, and Trafodion as the same ID. > > > > Several of the install steps failed doing ssh commands as the HDFS > > > > and ZOOKEEPER users. > > > > This problem was resolved by adding manully changing the > > > > traf_apache_mods script by adding a "--login" in the ssh commands. > > > > > > > > ==> Error: initializing trafodion: > > > > > > > > *** ERROR[1398] Error -99999 occured while accessing the hbase > > > > subsystem. > > > > Fix that error and make sure hbase is up and running. Error Details: > . > > > > > > > > This happened because I did not add Trafodion co-processor > > > > information to the hbase-site.xml file before running > > trafodion_install. > > > > The installation did report: > > > > > > > > > > > > > > > ***IMPORTANT********************************************************** > > > ************* > > > > > > > > ***INFO: Settings below need to be set for Trafodion to work on > > > > Apache Hadoop/HBase > > > > ***INFO: In hdfs-site.xml set dfs.namenode.acls.enabled to true. > > > > ***INFO: In zoo.cfg set maxClientCnxns to 0 > > > > ***INFO: Create /opt/apache/zookeeper-3.4.6/conf/zookeeeper-env.sh > > > > and > > > set > > > > JAVA_HOME > > > > ***INFO: In hbase-site.xml set hbase.coprocessor.region.classes to > > > > org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionObserver, > > > > org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionEndpoint, > > > > org.apache.hadoop.hbase.coprocessor.AggregateImplementation > > > > ***INFO: In hbase-site.xml set hbase.hregion.impl to > > > > org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegi > > > > on > > > > > > > > > > > > > > > ***IMPORTANT********************************************************** > > > ************* > > > > > > > > However, it kept going. Probably should have failed if START > > > > Trafodion option is specified. I also noticed that traf_apache_mods > > > > stops and restarts HBase. If there are no changes made to any of > > > > the configuration files, then this step is not needed. > > > > > > > > ==> Error: ssh access check failed in traf_config_setup > > > > > > > > In this case, I know ssh access worked, so just commented out the > > > > error check. Other ssh checks later did pass. I did not > > > > investigate the > > > cause. > > > > > > > > > > > > We also need to update documentation on this especially, if we want > > > > customer to manually update the hbase-site.xml file. > > > > > > > > Roberta > > > > > > > > -----Original Message----- > > > > From: Steve Varnau [mailto:[email protected]] > > > > Sent: Monday, May 23, 2016 3:12 PM > > > > To: [email protected] > > > > Subject: RE: [VOTE] Apache Trafodion release 2.0.0 - release > > > > candidate 3 > > > > > > > > Sounds good. I was hoping we could get a mentor's input. Thanks, > > > > St.Ack. > > > > > > > > --Steve > > > > > > > > > > > > > -----Original Message----- > > > > > From: [email protected] [mailto:[email protected]] On Behalf > > > > > Of Stack > > > > > Sent: Monday, May 23, 2016 2:47 PM > > > > > To: [email protected] > > > > > Subject: Re: [VOTE] Apache Trafodion release 2.0.0 - release > > > > > candidate > > > > > 3 > > > > > > > > > > On Mon, May 23, 2016 at 12:30 PM, Steve Varnau > > > > > <[email protected]> > > > > > wrote: > > > > > > > > > > > Thanks to all who have taken time to review and test out this > > > > > > release candidate. All votes so far have been +1. > > > > > > > > > > > > The timing is not great, however, since HBaseCon is this week. > > > > > > That may impact folks' opportunity to look at it. > > > > > > > > > > > > > > > > > Smile > > > > > > > > > > > > > > > > > > > > > My thinking is that we should not close the voting yet to give > > > > > > others time to look at it, especially those more familiar with > > > > > > Apache releases and rules for convenience binaries. > > > > > > > > > > > > If there are folks still intending to help on this review/vote, > > > > > > let us know how much time you might need. Thanks! > > > > > > > > > > > > > > > > > If you don't mind, can I have till EOD Weds to take a look? Pardon > > > > > my not having looked at it up to this. > > > > > > > > > > Thanks Steve, > > > > > St.Ack > > > > > > > > > > > > > > > > > > > > > --Steve > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > > From: Steve Varnau [mailto:[email protected]] > > > > > > > Sent: Wednesday, May 18, 2016 12:12 PM > > > > > > > To: '[email protected]' > > > > > > > <[email protected]> > > > > > > > Subject: [VOTE] Apache Trafodion release 2.0.0 - release > > > > > > > candidate > > > > > > > 3 > > > > > > > > > > > > > > This is a call to vote on release 2.0.0 of Apache Trafodion > > > > > > (incubating). Once > > > > > > > the community approves a release candidate, a similar vote > > > > > > > will be taken > > > > > > in the > > > > > > > Apache Incubator community. > > > > > > > > > > > > > > Changes since RC2: > > > > > > > [TRAFODION-1992] Re-packaging server tar file broke > > > > > > > install_traf_components > > > > > > > [TRAFODION-1993] Expand DCS and REST directories > > > > > > > [TRAFODION-1997] Prevent Cloudera install on 5.5/6 > > > > > > > > > > > > > > In addition, it is clarified that 2.0.0 is compatible with > > > > > > > these > > > > > > Hadoop/HBase > > > > > > > distros (others may be added in next patch or minor release). > > > > > > > * Apache Hadoop with HBase 1.0 > > > > > > > * Cloudera 5.4 > > > > > > > * Hortonworks 2.3 > > > > > > > > > > > > > > As previous release, Trafodion 2.0 works with JDK 1.7 or 1.8, > > > > > > > and RedHat/Centos 6.x. (Does not work on RH7 as yet.) > > > > > > > > > > > > > > Thanks to all the contributors! Lots of improvements in this > > > release. > > > > > > > The JIRA release notes: > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId > > > > > > =123 > > > > > > 18620& > > > > > > v > > > > > > > ersion=12333044 > > > > > > > If things are missing from that list, please be sure that all > > > > > > > your > > > > > > > 2.0 > > > > > > JIRAs are > > > > > > > properly closed. > > > > > > > > > > > > > > The tag for this candidate is "2.0.0rc3". Git repository: > > > > > > > git://git.apache.org/incubator-trafodion.git > > > > > > > https://git-wip-us.apache.org/repos/asf?p=incubator- > > > > > > > trafodion.git;a=tag;h=1a8942ceeee91e58212968d94478db18005568f4 > > > > > > > > > > > > > > Release artifacts are: > > > > > > > > > > > > > https://dist.apache.org/repos/dist/dev/incubator/trafodion/trafo > > > > > > dion > > > > > > -2.0.0 > > > > > > -RC3 > > > > > > > Artifacts are signed with my key (7F14AF20), which is in > > > > > > > https://dist.apache.org/repos/dist/release/incubator/trafodion > > > > > > > /KEY S This is the first release we are including convenience > > > > > > > binaries built > > > > > > from the > > > > > > > source code artifact. > > > > > > > > > > > > > > Instructions for > > > > > > > Setting up build environment: > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build > > > > > +Env > > > > > iron > > > > > > > ment > > > > > > > Building: > > > > > > > https://cwiki.apache.org/confluence/display/TRAFODION/Build+So > > > > > > > urce > > > > > > > > > > > > > > [ ] +1 approve > > > > > > > [ ] +0 no opinion > > > > > > > [ ] -1 disapprove (and reason why) > > > > > > > > > > > > > > Vote will be open for at least 72 hours, unless cancelled. > > > > > > > > > > > > > > > > > > > > > --Steve > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > Thanks, > > > > > > Amanda Moran > > > > > >
