Hello Epfl Team,
After running the benchmark I see error "Can not contact hadoop-6-11(also
when change it to IP 192.168.100.13 the same problem). The issue was solved
by editing the file $FABAN_HOME/bin/Linux removing the last part and of the
file and adding only interface name(eth0 in my case).But now the error
message is ":WARNING:Retry connecting to CmdAgent@hadoop-6-11, count
X".Here is full scenario. I use three ubuntu based Virtual Machines(VM) as
Faban Master, Backend Database and Frontend server with following
components.
Client Machine (Hadoop-6-10, 192.168.100.3)
- Faban Master
Backend Machine (hadoop-6-13, 192.168.100.15)
- MySQL
- Tomcat
- Geocoder Emulator
Frontend Machine( hadoop-6-11, 192.168.100.13)
- Olio Implementatioin in PHP(web application)
- Nginx
- APC
- PHP
All the installation and configuration is successfully done according
to http://parsa.epfl.ch/cloudsuite/web.html
I have to run the Web Serving Benchmark from command line , attached is
my run.xml file. The java path is the same in all machines. SSH is enabled
between machines without prompting for password. I queried your mail
archive but could not solve the problem yet.
Here is the problem I get in Client machine when I run the Faban.
*************************************************
Client Machine
ubuntu@hadoop-6-10:~/web-release/apache-olio-php-src-0.2/workload/php/trunk/deploy$
$FABAN_HOME/bin/fabancli submit OlioDriver default run.xml
OlioDriver.2R
ubuntu@hadoop-6-10:~/web-release/apache-olio-php-src-0.2/workload/php/trunk/deploy$
$FABAN_HOME/bin/fabancli showlogs OlioDriver.2R -ft
14:02:26:INFO:Starting OlioDriver run using
/home/ubuntu/web-release/faban/output/OlioDriver.2R/
14:02:26:INFO:START TIME : Mon May 27 14:02:26 UTC 2013
14:02:26:INFO:Starting Registry.
14:02:26:INFO:Registry started.
14:02:56:INFO:CmdService: Configured FileAgent@hadoop-6-10 on server
hadoop-6-10
14:03:06:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 1.
14:03:16:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 2.
14:03:26:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 3.
14:03:36:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 4.
14:03:46:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 5.
14:03:56:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 6.
14:04:06:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 7.
14:04:16:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 8.
14:04:26:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 9.
14:04:36:WARNING:Retry connecting to CmdAgent@hadoop-6-11, count 10.
14:04:36:SEVERE:Could not connect to CmdAgent@hadoop-6-11
14:04:36:SEVERE:CmdService setup failed. Exiting
14:04:44:INFO:[/home/ubuntu/web-release/faban/bin/fenxi, process,
/home/ubuntu/web-release/faban/output/OlioDriver.2R/,
/home/ubuntu/web-release/faban/output/OlioDriver.2R//post/, OlioDriver.2R]
stdout:
Creating database ... 2.34s
Parsing raw files ... 0.01s
Processing profile default_profile ...OK
Opening Database ... 1.28s
Executing queries ... 0.07s
Generating html pages ... 0.21s
14:04:44:INFO:Killing benchmark
14:04:44:INFO:killing CmdAgent@hadoop-6-10
14:04:45:INFO:OlioDriver Completed/Terminated
ubuntu@hadoop-6-10
:~/web-release/apache-olio-php-src-0.2/workload/php/trunk/deploy$
**********************************************************************
Frontend Machine(for your information)
ubuntu@hadoop-6-11:~$ sudo netstat -pan | grep ":9000"
tcp 0 0 127.0.0.1:9000 0.0.0.0:* LISTEN
12013/php-fpm.conf)
ubuntu@hadoop-6-11:~$ sudo netstat -pan | grep ":80"
tcp 0 0 0.0.0.0:80 <http://0.0.0.0/> 0.0.0.0:*
LISTEN 7090/nginx
ubuntu@hadoop-6-11:~$
***********************************************************************
Backend Machine(for your information)
ubuntu@hadoop-6-13:~$ $CATALINA_HOME/bin/startup.sh
Using CATALINA_BASE: /home/ubuntu/web-release/apache-tomcat-6.0.35
Using CATALINA_HOME: /home/ubuntu/web-release/apache-tomcat-6.0.35
Using CATALINA_TMPDIR: /home/ubuntu/web-release/apache-tomcat-6.0.35/temp
Using JRE_HOME: /home/ubuntu/jdk1.7.0_17
Using CLASSPATH:
/home/ubuntu/web-release/apache-tomcat-6.0.35/bin/bootstrap.jar
ubuntu@hadoop-6-13:~$ jps
19834 Bootstrap
26908 Jps
ubuntu@hadoop-6-13:~$
***************************************************************************
All the setup is done on Ubuntu VMs over 3 different physical machines.
Any Idea how to solve the issue ?
Regards
Zubair
Leonardo
<?xml version="1.0" encoding="UTF-8"?>
<!--
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements. See the NOTICE file
* distributed with this work for additional information
* regarding copyright ownership. The ASF licenses this file
* to you under the Apache License, Version 2.0 (the
* "License"); you may not use this file except in compliance
* with the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*
-->
<olio>
<jvmConfig xmlns="http://faban.sunsource.net/ns/fabanharness";>
<javaHome>/home/ubuntu/jdk1.7.0_17</javaHome>
<jvmOptions>-Xmx3g -Xms256m -XX:+DisableExplicitGC</jvmOptions>
</jvmConfig>
<fa:runConfig definition="org.apache.olio.workload.driver.UIDriver" xmlns="http://faban.sunsource.net/ns/fabandriver"; xmlns:fa="http://faban.sunsource.net/ns/faban"; xmlns:fh="http://faban.sunsource.net/ns/fabanharness";>
<fh:description>Enter description for this run here</fh:description>
<fa:hostConfig>
<fa:host>localhost</fa:host>
<fh:enabled>true</fh:enabled>
<fh:cpus>0</fh:cpus>
<fh:tools>vmstat 10</fh:tools>
<fh:userCommands/>
</fa:hostConfig>
<fa:scale>25</fa:scale>
<fa:runControl>
<fa:rampUp>30</fa:rampUp>
<fa:steadyState>300</fa:steadyState>
<fa:rampDown>10</fa:rampDown>
</fa:runControl>
<outputDir>/tmp</outputDir>
<audit>false</audit>
<threadStart>
<delay>100</delay>
<simultaneous>false</simultaneous>
<parallel>false</parallel>
</threadStart>
<stats>
<maxRunTime>6</maxRunTime>
<interval>30</interval>
</stats>
<runtimeStats enabled="false">
<interval>25</interval>
</runtimeStats>
<driverConfig name="UIDriver">
<agents>1</agents>
<stats>
<interval>30</interval>
</stats>
<runtimeStats target="9988"/>
<properties>
<property name="serverType">php</property>
</properties>
</driverConfig>
</fa:runConfig>
<webServer>
<fa:hostConfig xmlns="http://faban.sunsource.net/ns/fabanharness"; xmlns:fa="http://faban.sunsource.net/ns/faban";>
<fa:hostPorts>hadoop-6-11:80</fa:hostPorts>
<enabled>true</enabled>
<cpus>0</cpus>
<tools>10; mpstat 10; nicstat 10; iostat -x 10</tools>
<userCommands/>
</fa:hostConfig>
<type> </type>
<fh:service xmlns:fh="http://faban.sunsource.net/ns/fabanharness";>
<fh:name>ApacheHttpdService</fh:name>
<fh:tools>NONE</fh:tools>
<fh:restart>true</fh:restart>
<fh:config>
<cmdPath>/usr/apache2/2.2/bin/apachectl</cmdPath>
<logsDir>/usr/local/nginx/logs</logsDir>
<sessionDir>/tmp/http_sessions</sessionDir>
<confPath>/usr/local/nginx/conf/nginx.conf</confPath>
<phpIniPath>/home/ubuntu/web-release/www/etc/php.ini</phpIniPath>
</fh:config>
</fh:service>
</webServer>
<dbServer>
<fa:hostConfig xmlns="http://faban.sunsource.net/ns/fabanharness"; xmlns:fa="http://faban.sunsource.net/ns/faban";>
<fa:host>hadoop-6-13</fa:host>
<enabled>true</enabled>
<cpus>0</cpus>
<tools></tools>
<userCommands/>
</fa:hostConfig>
<dbDriver>com.mysql.jdbc.Driver</dbDriver>
<connectURL>jdbc:mysql://hadoop-6-13/olio?user=olio&password=olio&relaxAutoCommit=true&sessionVariables=FOREIGN_KEY_CHECKS=0</connectURL>
<autoCommit>true</autoCommit>
<reloadDB>false</reloadDB>
<scale>100</scale>
<fh:service xmlns:fh="http://faban.sunsource.net/ns/fabanharness";>
<fh:name>MySQLService</fh:name>
<fh:tools>Mysqlstats</fh:tools>
<fh:restart>false</fh:restart>
<fh:config>
<serverHome>/var/mysql</serverHome>
<user>olio</user>
<password>olio</password>
<confPath>/etc/my.cnf</confPath>
</fh:config>
</fh:service>
</dbServer>
<dataStorage>
<fa:hostConfig xmlns="http://faban.sunsource.net/ns/fabanharness"; xmlns:fa="http://faban.sunsource.net/ns/faban";>
<fa:host>hadoop-6-11</fa:host>
<enabled>true</enabled>
<cpus>0</cpus>
<tools>NONE</tools>
<userCommands></userCommands>
</fa:hostConfig>
<reloadMedia>false</reloadMedia>
<mediaDir>/home/ubuntu/web-release/filestore</mediaDir>
</dataStorage>
<cacheServers>
<fa:hostConfig xmlns="http://faban.sunsource.net/ns/fabanharness"; xmlns:fa="http://faban.sunsource.net/ns/faban";>
<fa:hostPorts></fa:hostPorts>
<enabled>true</enabled>
<cpus>0</cpus>
<tools>NONE</tools>
<userCommands/>
</fa:hostConfig>
<fh:service xmlns:fh="http://faban.sunsource.net/ns/fabanharness";>
<fh:name>MemcachedService</fh:name>
<fh:tools>MemcacheStats -i 10</fh:tools>
<fh:restart>true</fh:restart>
<fh:config>
<cmdPath>/usr/lib/memcached</cmdPath>
<serverMemSize>256</serverMemSize>
</fh:config>
</fh:service>
</cacheServers>
</olio>
