AWS API setup

[Carlos Reategui]

I can't seem to find docs to properly install the AWS API.

I started with this:
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.0/html/Installation_Guide/aws-ec2-user-setup.html
but got nowhere because port 7080 was not available.

I am on ubuntu 12.04 installed from repo -- actually upgraded 4.01 to 4.1
-- did not have awsapi installed before.

Here is the progress I have made so far:
a) apt-get install cloudstack-awsapi
This should probably be explained in the above docs to get the awsapi on
7080
b) chgrp cloud /var/log/cloudstack/awsapi; chmod g+w
/var/log/cloudstack/awsapi
Otherwise it was unable to create awsapi.log.  Seems to be an installation
bug.

Currently stuck trying to "cloudstack-aws-api-register" as it is returning
"User registration failed with http error code: 500"

>From the awsapi logs looks to be a problem with cloudbridge database not
available.  I found this
https://issues.apache.org/jira/browse/CLOUDSTACK-1557 which seems to imply
this was fixed.  In the notes it talks about running
cloudstack-setup-databases to create this one.  However shouldn't this have
already been run as part of the cloudstack install?  Is it safe to run
again?

With regards to cloudstack-aws-api-register, the docs say to download it
from a location it specifies.  There appears to be one that is already
installed by cloudstack-awsapi:
# dpkg -S /usr/bin/cloudstack-aws-api-register
cloudstack-awsapi: /usr/bin/cloudstack-aws-api-register
Is the one that is installed no good?

thanks,
Carlos

Networking config question

[Nordgren, Bryce L -FS]

Hi.

I'm trying to get my head around provisioning a cluster in cloudstack 
4.0.2...specifically issues surrounding networking. I have been looking for a 
good tutorial, but have not googled my way into one yet.

My config is very very simple: one management server and one host. I have two 
physical networks: "public" and "private". Cloudstack "public" traffic is the 
only thing on my public network, all other cloudstack traffic is confined to 
the private network. While I intend to grow this setup, I do not envision that 
the essential networking situation will change.

The system is managed via the StackIQ Rocks+Cloud roll.  The eth0 NICs are 
configured as the private network 10.1.4.0/23, having their own superdumb GigE 
switch. The eth1 NICs form the "public" network 192.168.56.0/24 and are plugged 
into the University managed switches. This isn't really "public", but I can get 
to them from the University network. I've been allocated a block of 50 IPs on 
this University-public network. The management server (10.1.4.1) also serves 
DNS for the private network, and serves as a gateway to the public world.

I'm having problems getting all four cloudstack traffic types to coexist on 
these two networks.

The Zone's Guest CIDR is 10.1.4.0/23. The GUI is returning an error when 
launching my config ("The subnet of the pod you are adding conflicts with the 
subnet of the Guest IP Network"). The pod was given 10.1.4.0/23 also, with the 
reserved system IPs of 10.1.4.10-10.1.4.20. Storage traffic, similarly, has 
been dispatched to the private network with IPs of 10.1.4.40-10.1.4.50. It 
hasn't complained about this yet, but it might be waiting.

My question is either: "What did I do wrong, above?" or "What is the preferred 
method of assigning storage, guest, and management traffic to a private network 
and public traffic to a public network (e.g., what numbers go where in the 
provisioning process?)"

Thanks in advance,
Bryce




This electronic message contains information generated by the USDA solely for 
the intended recipients. Any unauthorized interception of this message or the 
use or disclosure of the information it contains may violate the law and 
subject the violator to civil or criminal penalties. If you believe you have 
received this message in error, please notify the sender and delete the email 
immediately.

Re: Customizing the System Capacity Dashboard

[Chip Childers]

On Fri, Jul 26, 2013 at 03:56:13PM +, Boyer, Marc (Marc) wrote:
> Hi,
> 
> Is there an easy way of customizing the information presented in the 
> Dashboard when logging in as an admin user in the ROOT domain?  I'd like to 
> customize it so CPU utilization for each my clusters in my different pods & 
> zones are displayed.
> 
> Thanks

Not easily (i.e.: without code changes).  Sounds like a great feature
request though, and frankly feedback about what's there would be useful
anyway.  I find it meaningless personally, since it doesn't have enough
space for all of the metrics in even a simple install.

Re: Cloudstack AWS

[Chip Childers]

Are you able to use the API via any other mechanisms?  If I'm reading this
right, you have already enabled CloudStack's AWS API compatibility feature,
right?  Can you run commands via boto or equiv CLI for AWS?


On Fri, Jul 26, 2013 at 2:08 PM, Amit Malhotra <
amit.malho...@radialpoint.com> wrote:

> Hello folks,
>
> I'm trying to connect to our company's cloudstack using JetBrain's
> Teamcity's built-in Amazon EC2 support. Teamcity asks me for an Access Key
> ID and a Secret access key which, if I'm not mistaken, is the same thing as
> the apikey (Access Key ID) and the secretkey (Secret Access Key) generated
> by Cloudstack.  As the Amazon support is built-into Teamcity, I redirected
> the connection (with no possibility to change the host name in Teamcity) to
> our cloudstack using a dns redirect on our teamcity machine.
>
> When I try to test the connection from teamcity, the cloudstack logs can
> see that connection I try to make and as far as I can understand (from our
> Network ops team) that the cloudstack is seeing a valid url being sent from
> my side to connect to it. However, I get an error:
> java.lang.RuntimeException: org.apache.commons.codec.DecoderException:
> Illegal hexadecimal charcter n at index 0
> I looked into this exception a bit and it seems to me that it may
> something to do with decoding the keys that I'm using.
>
> Would anybody have any idea on what could be the cause of this, or what
> can I further investigate to figure out why am I being hit with this
> exception?
>
> Thank you for your time & consideration.
>
>
> Amit Malhotra
> ***
> This e-mail and attachments are confidential, legally privileged, may be
> subject to copyright and sent solely for the attention of the addressee(s).
> Any unauthorized use or disclosure is prohibited. Statements and opinions
> expressed in this e-mail may not represent those of Radialpoint.
> ~~ Le contenu du présent
> courriel est confidentiel, privilégié et peut être soumis à des droits
> d'auteur. Il est envoyé à l'intention exclusive de son ou de ses
> destinataires. Il est interdit de l'utiliser ou de le divulguer sans
> autorisation. Les opinions exprimées dans le présent courriel peuvent
> diverger de celles de Radialpoint.
>

Cloudstack AWS

[Amit Malhotra]

Hello folks,

I'm trying to connect to our company's cloudstack using JetBrain's Teamcity's 
built-in Amazon EC2 support. Teamcity asks me for an Access Key ID and a Secret 
access key which, if I'm not mistaken, is the same thing as the apikey (Access 
Key ID) and the secretkey (Secret Access Key) generated by Cloudstack.  As the 
Amazon support is built-into Teamcity, I redirected the connection (with no 
possibility to change the host name in Teamcity) to our cloudstack using a dns 
redirect on our teamcity machine.

When I try to test the connection from teamcity, the cloudstack logs can see 
that connection I try to make and as far as I can understand (from our Network 
ops team) that the cloudstack is seeing a valid url being sent from my side to 
connect to it. However, I get an error: java.lang.RuntimeException: 
org.apache.commons.codec.DecoderException: Illegal hexadecimal charcter n at 
index 0
I looked into this exception a bit and it seems to me that it may something to 
do with decoding the keys that I'm using.

Would anybody have any idea on what could be the cause of this, or what can I 
further investigate to figure out why am I being hit with this exception?

Thank you for your time & consideration.


Amit Malhotra
*** This 
e-mail and attachments are confidential, legally privileged, may be subject to 
copyright and sent solely for the attention of the addressee(s). Any 
unauthorized use or disclosure is prohibited. Statements and opinions expressed 
in this e-mail may not represent those of Radialpoint. 
~~ Le contenu du présent 
courriel est confidentiel, privilégié et peut être soumis à des droits 
d'auteur. Il est envoyé à l'intention exclusive de son ou de ses destinataires. 
Il est interdit de l'utiliser ou de le divulguer sans autorisation. Les 
opinions exprimées dans le présent courriel peuvent diverger de celles de 
Radialpoint.

Re: About WIKI

[David Comerford]

Not sure they're explained anywhere greatly, but basically they are just
the mail settings for sending alerts mails, host down, management server
up, various other errors.

If you have a mail reply server setup then you only need to specify the
alert.smtp.host.
If you require authentication to use said mail server then you need to set
alert.smtp.useAuth to True and fill out the alert.smtp.username and
.password.
The alert.smtp.port is the port. Most of the time that will be 25. The
default 465 is often used for authentication-less relay servers.

Here's some sample values from my database:

mysql> select name,value,description from configuration where name like
'alert.smtp%' \G
*** 1. row ***
   name: alert.smtp.host
  value: mail.smtpserver.com
description: SMTP hostname used for sending out email alerts.
*** 2. row ***
   name: alert.smtp.password
  value: 52l+MXiB/BVgOuq2t1DGSVnlaD604TdW
description: Password for SMTP authentication (applies only if
alert.smtp.useAuth is true).
*** 3. row ***
   name: alert.smtp.port
  value: 25
description: Port the SMTP server is listening on.
*** 4. row ***
   name: alert.smtp.useAuth
  value: true
description: If true, use SMTP authentication when sending emails.
*** 5. row ***
   name: alert.smtp.username
  value: mail-user
description: Username for SMTP authentication (applies only if
alert.smtp.useAuth is true).
5 rows in set (0.00 sec)


Best regards,
David Comerford

Tel: +353 87 1238295
Email: davest...@gmail.com
Website: http://dave.ie
GPG key: http://gpg.dave.ie


On 26 July 2013 17:19, Netsons > Paolo Giustiniani <
p.giustini...@netsons.com> wrote:

> Hello,
>
> I’ve read the wiki at the following page:
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Home 
>
> I would like  more info about the functions in “cloudstack > global
> settings” that are not explained in the wiki.
>
> ** **
>
> For examples:
>
> ** **
>
> alert.smtp.password
>
> Password for SMTP authentication (applies only if alert.smtp.useAuth is
> true).
>
>  
>
> alert.smtp.port
>
> Port the SMTP server is listening on.
>
> 465
>
>  
>
> alert.smtp.useAuth
>
> If true, use SMTP authentication when sending emails.
>
>  
>
> ** **
>
> ** **
>
> Where can I find more info?
>
> ** **
>
> Thank you
>
> ** **
>

ClassCastException for Virtual Routers in Zones using Adv Networking

[Boyer, Marc (Marc)]

Has anyone else seen this using CS 4.1?  I don't see this issue with routers 
that are in zones using basic networking, but I do for Advanced.

[network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null) 
Error while collecting network stats from router: r-31-VM from host: 16
java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to 
com.cloud.agent.api.NetworkUsageAnswer
at 
com.cloud.network.router.VirtualNetworkApplianceManagerImpl$NetworkUsageTask.run(VirtualNetworkApplianceManagerImpl.java:872)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at 
java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)

About WIKI

[Netsons > Paolo Giustiniani]

Hello,

I've read the wiki at the following page:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Home 

I would like  more info about the functions in "cloudstack > global
settings" that are not explained in the wiki.

 

For examples:

 


alert.smtp.password

Password for SMTP authentication (applies only if alert.smtp.useAuth is
true).

 


alert.smtp.port

Port the SMTP server is listening on.

465

 


alert.smtp.useAuth

If true, use SMTP authentication when sending emails.

 



 

 

Where can I find more info?

 

Thank you

 



smime.p7s
Description: S/MIME cryptographic signature

Customizing the System Capacity Dashboard

[Boyer, Marc (Marc)]

Hi,

Is there an easy way of customizing the information presented in the Dashboard 
when logging in as an admin user in the ROOT domain?  I'd like to customize it 
so CPU utilization for each my clusters in my different pods & zones are 
displayed.

Thanks

Re: Manager on FreeBSD

[Chip Childers]

On Fri, Jul 26, 2013 at 6:45 AM, Shanker Balan
wrote:

> On 17-Jul-2013, at 6:50 PM, Ian Duffy  wrote:
>
> > Hi Guys,
> >
> > Just a purely out of interest post here.
> >
> > Has anybody tried running Cloudstack on FreeBSD in a production
> environment?
> >
> > If so did you encounter any issues?
> >
> > Thanks,
> > Ian
>
>
> A few months back I was playing around with CloudByte's ElastiStor which
> is a FreeBSD ZFS based storage solution. The interesting thing is that
> their management interface is built with the Apache CloudStack management
> framework. At the time, the interface was almost identical to stock
> CloudStack. in fact, it was so identical that one might even assume that it
> is really cloudstack thats controlling their storage layer.
>
> In short, they have the "UI" running with their propriety storage adapters
> on FreeBSD 8.x IIRC. Their evaluation builds are available from
> http://www.elastistor.info/builds/.
>
> http://www.cloudbyte.com


Very interesting information...


>
>
> As a side note, having Apache CloudStack manager work on FreeBSD would
> clear a path for creating and distributing production ready "cloudstack
> appliances". These appliances would be fully compliant with the permissive
> ASF guidelines.
>
>
Yup.  It certainly would be a path to that.


> --
> @shankerbalan
>
> M: +91 98860 60539 | O: +91 (80) 67935867
> shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
> ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre,
> Bangalore - 560 055
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is
> operated under license from Shape Blue Ltd. ShapeBlue is a registered
> trademark.
>
>

Re: Manager on FreeBSD

[Shanker Balan]

On 17-Jul-2013, at 6:50 PM, Ian Duffy  wrote:

> Hi Guys,
>
> Just a purely out of interest post here.
>
> Has anybody tried running Cloudstack on FreeBSD in a production environment?
>
> If so did you encounter any issues?
>
> Thanks,
> Ian


A few months back I was playing around with CloudByte's ElastiStor which is a 
FreeBSD ZFS based storage solution. The interesting thing is that their 
management interface is built with the Apache CloudStack management framework. 
At the time, the interface was almost identical to stock CloudStack. in fact, 
it was so identical that one might even assume that it is really cloudstack 
thats controlling their storage layer.

In short, they have the "UI" running with their propriety storage adapters on 
FreeBSD 8.x IIRC. Their evaluation builds are available from 
http://www.elastistor.info/builds/.

http://www.cloudbyte.com

As a side note, having Apache CloudStack manager work on FreeBSD would clear a 
path for creating and distributing production ready "cloudstack appliances". 
These appliances would be fully compliant with the permissive ASF guidelines.

--
@shankerbalan

M: +91 98860 60539 | O: +91 (80) 67935867
shanker.ba...@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue
ShapeBlue Services India LLP, 22nd floor, Unit 2201A, World Trade Centre, 
Bangalore - 560 055

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England & Wales. ShapeBlue Services India LLP is operated under 
license from Shape Blue Ltd. ShapeBlue is a registered trademark.

ESXI support

[Chitra Manjunath]

HI All

IS Cloudstack 4.0.2 support ESXI 5.1 version?

Thanks & Regards
Chitra.M

 CAUTION - Disclaimer *
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are 
not
to copy, disclose, or distribute this e-mail or its contents to any other 
person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has 
taken
every reasonable precaution to minimize this risk, but is not liable for any 
damage
you may sustain as a result of any virus in this e-mail. You should carry out 
your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this 
e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS End of Disclaimer INFOSYS***

Reg: Multiple ips server for cloudstack in Basic zone

[prakash]

Hi,

 Cloudstack is running in basic zone.I have created vm. One nic is setup
in vm as default and public ip is assigned for that Nic. I want more ips
for my vm like ip-alias not another NIC. is it possible to re-configure
virtual router dhcp to serve more than one ip for that vm nic.

 Regards,
 Prakash.M

Re: How to do time synchronization in vm instances

[David Comerford]

No, that's not CS's job.
Hyper tools tools usually have host time sync options but I just use NTP
for simplicity.

Regards,
Dave
On Jul 26, 2013 4:28 AM, "WXR" <1485739...@qq.com> wrote:

> I use kvm as the hypervisor in my cloudstack.
>
> I find that the time in the vm instance is different from its host node
> server.
>
> I want to know how to synchronize the time of vm instances,does cloudstack
> offer some tools like esxi,xenserver,hyper-v to do time synchronization?

答复: cloudstack-management service auto-start?

[Jerry Jiang]

Setup a watchdog script to check the network status, trigger the start
management service when mysql comes back.

Jerry Jiang 

-邮件原件-
发件人: Indra Pramana [mailto:in...@sg.or.id] 
发送时间: 2013年7月26日 星期五 11:53
收件人: users@cloudstack.apache.org; aemne...@gmail.com
主题: Re: cloudstack-management service auto-start?

Hi Ahmad and all,

Good day to you, and thank you for your e-mail. Apologise for the delay in
my response.

This is the logs when I restarted the management server. It seems that the
management server was still not able to connect to the database server when
it tries to start the service. The MySQL database is hosted on a different
server.

Is there a way I can ask the init runlevel / upstart to try starting the
cloudstack-management service at a slightly later time, waiting for the
network connectivity to be restored?

Or do I need to create a cron job shell script which will check the status
of the service, and start it if it's down?

Any other users would like to share their experience on what is the best way
to do this?

===
2013-07-26 11:33:32,394 ERROR [db.Transaction.Transaction] (Timer-1:null)
Unexpected exception:
com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException:*Could
not create connection to database server. Attempted reconnect 3 times.
Giving up.*
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcces
sorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstruc
torAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1014)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:988)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:974)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:919)
at
com.mysql.jdbc.ConnectionImpl.connectWithRetries(ConnectionImpl.java:2299)
at
com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2220)
at com.mysql.jdbc.ConnectionImpl.(ConnectionImpl.java:813)
at com.mysql.jdbc.JDBC4Connection.(JDBC4Connection.java:47)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcces
sorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstruc
torAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at
com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:399)
at
com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:334)
at java.sql.DriverManager.getConnection(DriverManager.java:620)
at java.sql.DriverManager.getConnection(DriverManager.java:200)
at
org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(Driv
erManagerConnectionFactory.java:75)
at
org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnect
ionFactory.java:582)
at
org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPoo
l.java:1188)
at
org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.ja
va:106)
at
com.cloud.utils.db.Transaction.getStandaloneConnectionWithException(Transact
ion.java:208)
at
com.cloud.utils.db.Transaction.getStandaloneConnection(Transaction.java:217)
at
com.cloud.utils.db.DbUtil.getConnectionForGlobalLocks(DbUtil.java:59)
at com.cloud.utils.db.DbUtil.getGlobalLock(DbUtil.java:204)
at com.cloud.utils.db.GlobalLock.lock(GlobalLock.java:154)
at
com.cloud.upgrade.DatabaseIntegrityChecker.check(DatabaseIntegrityChecker.ja
va:232)
at
com.cloud.utils.component.ComponentContext.initComponentsLifeCycle(Component
Context.java:90)
at
com.cloud.servlet.CloudStartupServlet$1.run(CloudStartupServlet.java:50)
at java.util.TimerThread.mainLoop(Timer.java:534)
at java.util.TimerThread.run(Timer.java:484)
Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The
driver has not received any packets from the server.
... 36 more
Caused by: java.net.NoRouteToHostException: No route to host
at java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.ja
va:193)
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlai