Thanks Tony for a detailed analysis. I think the issue is with the client.properties pointing to a different port.
Pls change the client.properties in conf folder and make sure its pointing to http://localhost:15000 assuming you have not enabled TLS. Please find my comments below. On Thu, Oct 23, 2014 at 8:11 AM, Tony Reix <[email protected]> wrote: > Hi Venkatesh, > > Often, with Hadoop Java code, there are some small issues dealing with > security and IBM JVM. > That's why I'm checking that Falcon works fine on Ubuntu/PPC64LE and > RHEL7/PPC64BE, both with IBM JVM 1.7 . > We have not tested with IBM JDK, we have tested with Oracle JDK 1.6, 1.7, Open JDK 1.7. > I've found no issue with Falcon Unit tests. > So, now, I'm trying to put Falcon at work and check that there are no > hidden issues. > > # bin/falcon admin -version > Falcon server build version: > {"properties":[{"key":"Version","value":"0.5-incubating-rrelease"},{"key":"Mode","value":"distributed"}]} > > Looks good so far. > # cat $FALCON_HOME/logs/falcon.out.2014102216221413987744 > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/opt/falcon-distributed-0.5-incubating/server/webapp/falcon/WEB-INF/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/opt/falcon-distributed-0.5-incubating/server/webapp/falcon/WEB-INF/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/opt/falcon-distributed-0.5-incubating/server/webapp/falcon/WEB-INF/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > oct. 22, 2014 4:22:28 PM > com.sun.jersey.server.impl.application.WebApplicationImpl _initiate > INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 > AM' > oct. 22, 2014 4:22:29 PM > com.sun.jersey.server.impl.application.WebApplicationImpl _initiate > INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 > AM' > > > About using: src/package.sh Hadoop-version Oozie-version , as explained > in: > http://falcon.incubator.apache.org/0.5-incubating/InstallationSteps.html > , that does not work as-is, since there is an issue for downloading > apache-tomcat-6.0.37.tar.gz and put it at: > target/oozie-4.0.1/distro/downloads/tomcat-6.0.37.tar.gz . > This is a common issue I see often with Hadoop packages. > Solution is: put apache-tomcat by hand, and remove the "clean" in "mvn > clean install". > However, within Falcon, that does not seem to work, since the "downloads" > directory seems to be removed. So, I had to: 1) launch src/package.sh > and, while it is still compiling: 2) continuously create the "downloads" > directory and put the apache-tomcat-6.0.37.tar.gz file in this directory > with the appropriate name. A real pain. > Sorry, this is maven magic to work around oozie not being published to maven repo. I know its PITA but I just tested a patch by Peeyush and this worked as expected. Can you please create a jira so we can follow up and not drop this. > > Anyway, I succeeded in building the tar-ball, and I put it on my test > machine. > > # ll target > total 280176 > -rw-r--r--. 1 root root 95344375 Oct 23 16:37 > apache-falcon-0.5-incubating-bin.tar.gz > -rw-r--r--. 1 root root 191549421 Oct 23 16:37 > apache-falcon-0.5-incubating-sources.tar.gz > drwxr-xr-x. 2 root root 6 Oct 23 16:37 archive-tmp > drwxr-xr-x. 3 root root 21 Oct 23 15:25 > maven-shared-archive-resources > drwxr-xr-x. 20 502 wheel 4096 Oct 23 16:20 oozie-4.0.1 > > > # bin/falcon-start -port 15000 > Hadoop is installed, adding hadoop classpath to falcon classpath > /opt/falcon-0.5-incubating > falcon started using hadoop version: Hadoop 2.4.1 > > # bin/falcon entity -submit -type cluster -file > examples/entity/filesystem/standalone-cluster.xml > Error: Unable to initialize Falcon Client object > I think the jersey client is unable to initialize the client for the given url. You cna override this with -url $FALCON_URL > > > That still does not work ! > > *Logs :* > > # ll -tr logs > total 36 > -rw-r--r-- 1 root root 5 23 oct. 16:41 falcon.pid > -rw-r--r-- 1 root root 0 23 oct. 16:41 falcon.security.audit.log > -rw-r--r-- 1 root root 0 23 oct. 16:41 falcon.metric.log > -rw-r--r-- 1 root root 0 23 oct. 16:41 falcon.audit.log > drwxr-xr-x 2 root root 6 23 oct. 16:41 retry > -rw-r--r-- 1 root root 2116 23 oct. 16:41 > falcon.out.2014102316411414075311 > -rw-r--r-- 1 root root 25876 23 oct. 16:46 falcon.application.log > > > # cat logs/falcon.out.2014102316411414075311 > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/opt/falcon-0.5-incubating/server/webapp/falcon/WEB-INF/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/opt/falcon-0.5-incubating/server/webapp/falcon/WEB-INF/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/opt/falcon-0.5-incubating/server/webapp/falcon/WEB-INF/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > oct. 23, 2014 4:41:55 PM com.sun.jersey.api.core.PackagesResourceConfig > init > INFO: Scanning for root resource and provider classes in the packages: > org.apache.falcon.resource.admin > org.apache.falcon.resource.provider > org.apache.falcon.resource.proxy > org.apache.falcon.resource.metadata > oct. 23, 2014 4:41:55 PM com.sun.jersey.api.core.ScanningResourceConfig > logClasses > INFO: Root resource classes found: > class org.apache.falcon.resource.proxy.InstanceManagerProxy > class org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy > class org.apache.falcon.resource.metadata.LineageMetadataResource > class org.apache.falcon.resource.admin.AdminResource > oct. 23, 2014 4:41:55 PM com.sun.jersey.api.core.ScanningResourceConfig > logClasses > INFO: Provider classes found: > class org.apache.falcon.resource.provider.JAXBContextResolver > oct. 23, 2014 4:41:55 PM > com.sun.jersey.server.impl.application.WebApplicationImpl _initiate > INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 > AM' > Server came up clean. > > > falcon.application.log is attached to this email. I see no ERROR. > > > Details of the "bin/falcon entity -submit -type cluster -file > examples/entity/filesystem" command: > .... > /usr/lib/jvm/ibm-java-ppc64-71/bin/java -Xmx1024m -cp > '/opt/falcon-0.5-incubating/conf:/opt/falcon-0.5-incubating/client/lib/*:falcon/WEB-INF/lib/*:falcon.war/WEB-INF/lib/*' > -Dfalcon.log.dir=/root -Dfalcon.app.type=client > org.apache.falcon.cli.FalconCLI entity -submit -type cluster -file > examples/entity/filesystem/standalone-cluster.xml > > > Which files are there: > > [root@laurel5 falcon-0.5-incubating]# ll > total 64 > drwxr-xr-x 2 502 wheel 4096 23 oct. 16:52 bin > -rwxrwxrwx 1 502 wheel 19491 15 sept. 08:01 CHANGES.txt > drwxr-xr-x 3 root root 16 23 oct. 16:41 client > drwxr-xr-x 2 502 wheel 137 20 oct. 17:53 conf > drwxr-xr-x 5 root root 55 23 oct. 16:41 data > -rwxrwxrwx 1 502 wheel 694 15 sept. 08:01 DISCLAIMER.txt > drwxr-xr-x 7 root root 4096 21 oct. 17:32 docs > drwxr-xr-x 5 502 wheel 40 15 sept. 08:01 examples > drwxrwxrwx 2 root root 4096 22 oct. 11:21 hadooplibs > -rwxrwxrwx 1 502 wheel 12281 15 sept. 08:01 LICENSE.txt > drwxr-xr-x 3 root root 4096 23 oct. 16:52 logs > -rwxrwxrwx 1 502 wheel 181 15 sept. 08:01 NOTICE.txt > drwxr-xr-x 3 root root 19 23 oct. 16:41 oozie > -rwxrwxrwx 1 502 wheel 5823 15 sept. 08:01 README > drwxr-xr-x 3 root root 19 23 oct. 16:41 server > > How can I get more traces ? > > Thanks, > > Tony > ------------------------------ > *De :* [email protected] [[email protected]] de la part de > Seetharam Venkatesh [[email protected]] > *Date d'envoi :* mercredi 22 octobre 2014 18:38 > *À :* Tony Reix; [email protected] > *Cc:* [email protected] > *Objet :* Re: Falcon > > Hi Tony, > > Sorry that you are having issues. It'd be better to send it to dev ML > and I have copied that. Also, why are you trying to build falcon since we > have the released bits for 0.5 version. > > Lets dig this further. > > * try executing 'bin/falcon admin -version' > > * logs are at $FALCON_HOME/logs > specifically look at falcon.out.xxxx and see if the server started ok > > * the web page will not have anything since this is a fresh install and > does not have entities added > > * lets follow the examples and add a few entities > > Let us know how this goes. > > Thanks! > > On Wed, Oct 22, 2014 at 8:26 AM, Tony Reix <[email protected]> wrote: > >> Hi Venkatesh, >> >> I am trying to run Falcon examples, and I have issues. >> I've googled the issue and only found something close but different: >> >> http://mail-archives.apache.org/mod_mbox/falcon-dev/201404.mbox/%[email protected]%3E >> >> I'm following: >> http://falcon.incubator.apache.org/0.5-incubating/InstallationSteps.html >> . >> >> >> I have a Hadoop 2.4.1 cluster running (checked by running Pi computation). >> And I've compiled Falcon saying Hadoop version is 2.4.1 . >> >> I did: >> bin/falcon-start -port 15000 >> bin/prism-start -port 16000 >> >> I have: >> # bin/prism-status >> Hadoop is installed, adding hadoop classpath to falcon classpath >> Falcon server is running (on http://laurel5:16000/) >> >> # bin/falcon-status >> Hadoop is installed, adding hadoop classpath to falcon classpath >> >> >> When browsing "http://localhost:15000/";, I only see : >> Apache Falcon >> >> appearing on the page. >> >> What should I expect ? >> >> Where can I find some images showing the expected page ? >> >> >> >> When trying to run the example, I have: >> >> >> # sh -x bin/falcon entity -submit -type cluster -file >> examples/entity/filesystem/standalone-cluster.xml >> + PRG=bin/falcon >> + '[' -h bin/falcon ']' >> ++ dirname bin/falcon >> + BASEDIR=bin >> ++ cd bin/.. >> ++ pwd >> + BASEDIR=/opt/falcon-distributed-0.5-incubating >> + . /opt/falcon-distributed-0.5-incubating/bin/falcon-config.sh client >> ++ PRG=bin/falcon >> ++ '[' -h bin/falcon ']' >> +++ dirname bin/falcon >> ++ BASEDIR=bin >> +++ cd bin/.. >> +++ pwd >> ++ BASEDIR=/opt/falcon-distributed-0.5-incubating >> ++ '[' -z '' ']' >> ++ FALCON_CONF=/opt/falcon-distributed-0.5-incubating/conf >> ++ export FALCON_CONF >> ++ '[' -f /opt/falcon-distributed-0.5-incubating/conf/falcon-env.sh ']' >> ++ . /opt/falcon-distributed-0.5-incubating/conf/falcon-env.sh >> +++ export JAVA_HOME=/usr/lib/jvm/ibm-java-ppc64-71 >> +++ JAVA_HOME=/usr/lib/jvm/ibm-java-ppc64-71 >> ++ test -z /usr/lib/jvm/ibm-java-ppc64-71 >> ++ JAVA_BIN=/usr/lib/jvm/ibm-java-ppc64-71/bin/java >> ++ JAR_BIN=/usr/lib/jvm/ibm-java-ppc64-71/bin/jar >> ++ export JAVA_BIN >> ++ '[' '!' -e /usr/lib/jvm/ibm-java-ppc64-71/bin/java ']' >> ++ '[' '!' -e /usr/lib/jvm/ibm-java-ppc64-71/bin/jar ']' >> ++ DEFAULT_JAVA_HEAP_MAX=-Xmx1024m >> ++ FALCON_OPTS='-Xmx1024m ' >> ++ type=client >> ++ shift >> ++ case $type in >> ++ >> FALCONCPPATH='/opt/falcon-distributed-0.5-incubating/conf:/opt/falcon-distributed-0.5-incubating/client/lib/*' >> +++ ls /opt/falcon-distributed-0.5-incubating/server/webapp >> ++ for i in '`ls ${BASEDIR}/server/webapp`' >> ++ >> FALCONCPPATH='/opt/falcon-distributed-0.5-incubating/conf:/opt/falcon-distributed-0.5-incubating/client/lib/*:falcon/WEB-INF/lib/*' >> ++ for i in '`ls ${BASEDIR}/server/webapp`' >> ++ >> FALCONCPPATH='/opt/falcon-distributed-0.5-incubating/conf:/opt/falcon-distributed-0.5-incubating/client/lib/*:falcon/WEB-INF/lib/*:falcon.war/WEB-INF/lib/*' >> ++ for i in '`ls ${BASEDIR}/server/webapp`' >> ++ >> FALCONCPPATH='/opt/falcon-distributed-0.5-incubating/conf:/opt/falcon-distributed-0.5-incubating/client/lib/*:falcon/WEB-INF/lib/*:falcon.war/WEB-INF/lib/*:prism/WEB-INF/lib/*' >> ++ for i in '`ls ${BASEDIR}/server/webapp`' >> ++ >> FALCONCPPATH='/opt/falcon-distributed-0.5-incubating/conf:/opt/falcon-distributed-0.5-incubating/client/lib/*:falcon/WEB-INF/lib/*:falcon.war/WEB-INF/lib/*:prism/WEB-INF/lib/*:prism.war/WEB-INF/lib/*' >> ++ FALCON_OPTS='-Xmx1024m ' >> ++ export FALCONCPPATH >> ++ export FALCON_OPTS >> + JAVA_PROPERTIES='-Xmx1024m ' >> + [[ entity =~ ^-D ]] >> + /usr/lib/jvm/ibm-java-ppc64-71/bin/java -Xmx1024m -cp >> '/opt/falcon-distributed-0.5-incubating/conf:/opt/falcon-distributed-0.5-incubating/client/lib/*:falcon/WEB-INF/lib/*:falcon.war/WEB-INF/lib/*:prism/WEB-INF/lib/*:prism.war/WEB-INF/lib/*' >> -Dfalcon.log.dir=/root -Dfalcon.app.type=client >> org.apache.falcon.cli.FalconCLI entity -submit -type cluster -file >> examples/entity/filesystem/standalone-cluster.xml >> Error: Bad Request; >> local/org.apache.falcon.FalconException::com.sun.jersey.api.client.ClientHandlerException: >> java.net.ConnectException: Connexion refused >> >> >> Can you help ? >> >> How can I dig in the issue ? >> >> Where are the logs ? >> >> How to have debug traces ? >> >> >> Thanks, >> >> >> Tony >> >> >> > > > -- > Regards, > Venkatesh > > “Perfection (in design) is achieved not when there is nothing more to > add, but rather when there is nothing more to take away.” > - Antoine de Saint-Exupéry > -- Regards, Venkatesh “Perfection (in design) is achieved not when there is nothing more to add, but rather when there is nothing more to take away.” - Antoine de Saint-Exupéry
