Excellent – glad you got it working.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue


dag.sonst...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

On 08/04/2018, 19:46, "Parth Patel" <parthpatel2...@gmail.com> wrote:

    Hi Dag,
    
    Thanks a lot !!!! It worked. Now I can mess around and learn how to
    configure VPC, autoscale and try my shot at ShapeBlue Container Service
    Plugin. Appreciate your help.
    
    Regards,
    Parth Patel
    
    On Fri, 6 Apr 2018 at 18:17 Dag Sonstebo <dag.sonst...@shapeblue.com> wrote:
    
    > Hi Parth,
    >
    > No problem, glad I could help. Let us know how you get on with the dummy
    > interface bridge.
    >
    > With regards to your tagging question – yes this is quite a big and
    > complicated topic. Suffice to summarise it as follows:
    > - Basic zones use a larger L3 network, and guest isolation is done by ACLs
    > – in other words firewall rules which controls which VMs can speak to each
    > other on the same network.
    > - Advanced zones use multiple isolated guest networks which are behind
    > virtual routers, and each isolated network must be secured from
    > eavesdropping from a neighbour network – to do this you need to put in
    > place an isolation mechanism like layer 2 VLAN tags, or a layer 3 SDN
    > solution – which uses a slightly different type of tagging to isolate
    > networks.
    >
    > Regards,
    > Dag Sonstebo
    > Cloud Architect
    > ShapeBlue
    >
    >
    > dag.sonst...@shapeblue.com
    > www.shapeblue.com
    > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
    > @shapeblue
    >
    >
    >
    > On 06/04/2018, 13:34, "Parth Patel" <parthpatel2...@gmail.com> wrote:
    >
    >     Hi Dag,
    >
    >     Thank you for guiding me, i know it's a weird use case and probably
    > would
    >     never be required in a production environment. I will definitely try 
to
    >     make a dummy interface and give it to the guest network target bridge.
    > I
    >     know it would be out of the scope of this email trail for you to
    > explain me
    >     tagged and untagged networking in L2 and L3 networks, but I would
    > search
    >     around the internet and ping this thread if I'm again stuck at some
    >     specific issue after I reach my university's lab. Appreciate your 
help.
    >
    >     Thanks,
    >     Parth Patel
    >
    >     On Fri, 6 Apr 2018 at 17:06 Dag Sonstebo <dag.sonst...@shapeblue.com>
    > wrote:
    >
    >     > Hi Parth,
    >     >
    >     > Take a look through the full email trail – I think we discussed this
    >     > earlier on. In short the answer is no – by definition you can not 
run
    >     > completely untagged isolated networks in an advanced zone – but
    > “tagged”
    >     > means different things for L2 and L3 isolation. The real answer - 
“it
    >     > depends” – an advanced zone always relies on some sort of guest
    > network
    >     > isolation, which in it’s simplest form equates to L2 VLANs. If you
    > were to
    >     > invest time, effort and money into an SDN solution like Nuage or
    > Nicira/NSX
    >     > you could potentially get around it – but complexity and cost goes
    > up. You
    >     > could have a play with something like GRE tunnelling (L3) – but in 
my
    >     > experience this doesn’t scale well, eats a ton of CPU cycles and may
    > not be
    >     > fit for purpose. Again you are looking at a more complex solution.
    >     >
    >     > Regarding the dummy network interface it looks to me like a simple
    > module
    >     > install and configuration – see e.g.
    >     >
    > 
https://www.question-defense.com/2012/11/26/linux-create-fake-ethernet-interface
    >     > . Not my post and I can’t vouch for it’s validity – but the process
    > seems
    >     > straight forward:
    >     >
    >     > [root@kvm1 hooks]# lsmod | grep dummy
    >     > [root@kvm1 hooks]# modprobe dummy
    >     > [root@kvm1 hooks]# lsmod | grep dummy
    >     > dummy                   2714  0
    >     > [root@kvm1 hooks]# ip link set name eth99 dev dummy0
    >     > [root@kvm1 hooks]# ifconfig eth99
    >     > eth99     Link encap:Ethernet  HWaddr 92:BF:A6:30:20:3E
    >     >           BROADCAST NOARP  MTU:1500  Metric:1
    >     >           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
    >     >           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
    >     >           collisions:0 txqueuelen:0
    >     >           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
    >     >
    >     >
    >     > Dag Sonstebo
    >     > Cloud Architect
    >     > ShapeBlue
    >     >
    >     >
    >     > dag.sonst...@shapeblue.com
    >     > www.shapeblue.com
    >     > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
    >     > @shapeblue
    >     >
    >     >
    >     >
    >     > On 06/04/2018, 11:45, "Parth Patel" <parthpatel2...@gmail.com>
    > wrote:
    >     >
    >     >     Hi Dag,
    >     >
    >     >     Thanks for the response. I am currently looking into VLANs and
    > network
    >     >     configuration for my case. But I want to know one thing: are
    > "untagged"
    >     >     VLAN networks sufficient for an advanced zone to function with
    > two
    >     >     networks? I did not state I do not want to use VLANs for
    > networking
    >     > but I
    >     >     wanted to know if ACS advanced zone would function if VLANs are
    >     > untagged?
    >     >     (The network router/switch did not support them). According to 
my
    >     > knowledge
    >     >     I would have to dig much deeper into kernel files to provide a
    > dummy
    >     >     interface as systemctl restart network would not function
    > properly,
    >     > still
    >     >     appreciate the advice. I will look into this more and see what I
    > can do
    >     >     with it.
    >     >
    >     >     Thanks,
    >     >     Parth Patel
    >     >
    >     >     On Fri, 6 Apr 2018 at 13:59 Dag Sonstebo <
    > dag.sonst...@shapeblue.com>
    >     > wrote:
    >     >
    >     >     > Hi Parth,
    >     >     >
    >     >     > Keep in mind you are in unchartered waters – so there may be
    > some
    >     >     > stumbling blocks before you get this to work.
    >     >     >
    >     >     > I suspect what you have to do is change cloudbr1 such that it
    > is
    >     > backed by
    >     >     > a fake or dummy ethernet interface. What seems to happen is
    > the agent
    >     >     > script looks for the network device backing the bridge rather
    > than
    >     > the
    >     >     > bridge itself.
    >     >     > This would mean your setup is like this:
    >     >     >
    >     >     >  Physical eth0 -> cloudbr0 > handles management and public
    >     >     >  Dummy eth1 -> cloudbr1 > handles isolated guest traffic and
    > allows
    >     > for
    >     >     > isolated VLANs internally on the host
    >     >     >
    >     >     > Keep in mind the context here – you have stated you don’t want
    > VLANs
    >     >     > traversing your physical network, hence we are trying to get
    > this
    >     > working
    >     >     > on a single host only. How you configure your IP ranges for
    >     > management and
    >     >     > public is something you need to experiment with and see what
    > works
    >     > for you.
    >     >     >
    >     >     > Regards,
    >     >     > Dag Sonstebo
    >     >     > Cloud Architect
    >     >     > ShapeBlue
    >     >     >
    >     >     > From: Parth Patel <parthpatel2...@gmail.com>
    >     >     > Reply-To: "users@cloudstack.apache.org" <
    > users@cloudstack.apache.org
    >     > >
    >     >     > Date: Friday, 6 April 2018 at 07:30
    >     >     > To: "users@cloudstack.apache.org" <users@cloudstack.apache.org
    > >
    >     >     > Subject: Re: Untagged Networking for Advanced Zone possible?
    >     >     >
    >     >     > Hi Dag,
    >     >     >
    >     >     > When I tried your method and created a NIC-less bridge,
    > following
    >     > are the
    >     >     > contents of my ifcfg-* network files:
    >     >     >
    >     >     > ifcfg-cloudbr0:
    >     >     > TYPE=Bridge
    >     >     > PROXY_METHOD=none
    >     >     > BROWSER_ONLY=no
    >     >     > BOOTPROTO=none
    >     >     > DEFROUTE=yes
    >     >     > IPV4_FAILURE_FATAL=no
    >     >     > NAME=cloudbr0
    >     >     > UUID=25aabe73-8e11-408f-a4ec-c03b26d3aa6e
    >     >     > DEVICE=cloudbr0
    >     >     > ONBOOT=yes
    >     >     > IPADDR=172.16.20.13
    >     >     > PREFIX=16
    >     >     > GATEWAY=172.16.0.1
    >     >     > DNS1=8.8.8.8
    >     >     > DNS2=172.16.0.1
    >     >     > NM_CONTROLLED=no
    >     >     >
    >     >     > ifcfg-cloudbr1:
    >     >     > TYPE=Bridge
    >     >     > IPV4_FAILURE_FATAL=no
    >     >     > NAME=cloudbr1
    >     >     > UUID=25aabe73-8e11-408f-a4ec-c03b26d3aa6e
    >     >     > DEVICE=cloudbr1
    >     >     > ONBOOT=yes
    >     >     > NM_CONTROLLED=no
    >     >     >
    >     >     > ifcfg-eno1:
    >     >     > TYPE=Ethernet
    >     >     > PROXY_METHOD=none
    >     >     > BROWSER_ONLY=no
    >     >     > BOOTPROTO=none
    >     >     > DEFROUTE=yes
    >     >     > IPV4_FAILURE_FATAL=no
    >     >     > NAME=eno1
    >     >     > UUID=25aabe73-8e11-408f-a4ec-c03b26d3aa6e
    >     >     > DEVICE=eno1
    >     >     > ONBOOT=yes
    >     >     > IPADDR=172.16.20.13
    >     >     > PREFIX=16
    >     >     > GATEWAY=172.16.0.1
    >     >     > DNS1=8.8.8.8
    >     >     > DNS2=172.16.0.1
    >     >     > NM_CONTROLLED=no
    >     >     > BRIDGE=cloudbr0
    >     >     >
    >     >     > brctl show output:
    >     >     > [root@srvr3 ~]# brctl show
    >     >     > bridge name bridge id STP enabled interfaces
    >     >     > cloud0 8000.000000000000 no
    >     >     > cloudbr0 8000.3464a92a09f3 no eno1
    >     >     > cloudbr1 8000.000000000000 no
    >     >     > virbr0 8000.5254002dabdb yes virbr0-nic
    >     >     >
    >     >     >
    >     >     >
    >     >     > when adding a host in advanced zone it shows the following
    > error:
    >     > Could
    >     >     > not find network 'cloudbr1'
    >     >     >
    >     >     > 2018-04-04 02:03:11,887 DEBUG [c.c.u.s.SSHCmdHelper]
    >     >     > (qtp510113906-14:ctx-707b53e5 ctx-8d49ccb3) (logid:dff92f23)
    >     > Executing cmd:
    >     >     > /usr/share/cloudstack-common/scripts/util/keystore-cert-import
    >     >     > /etc/cloudstack/agent/agent.properties /etc/cloudstack/agent/
    >     >     > 2018-04-04 02:03:15,686 DEBUG
    > [c.c.h.k.d.LibvirtServerDiscoverer]
    >     >     > (qtp510113906-14:ctx-707b53e5 ctx-8d49ccb3) (logid:dff92f23)
    >     > Succeeded to
    >     >     > import certificate in the keystore for agent on the KVM host:
    >     > 172.16.20.13.
    >     >     > Agent secured and trusted.
    >     >     > 2018-04-04 02:03:15,688 DEBUG [c.c.u.s.SSHCmdHelper]
    >     >     > (qtp510113906-14:ctx-707b53e5 ctx-8d49ccb3) (logid:dff92f23)
    >     > Executing cmd:
    >     >     > cloudstack-setup-agent  -m 172.16.20.13 -z 1 -p 1 -c 1 -g
    >     >     > 1fd67886-c5d9-3464-ac73-46689258b34e -a --pubNic=cloudbr0
    >     > --prvNic=cloudbr0
    >     >     > --guestNic=cloudbr1 --hypervisor=kvm
    >     >     > 2018-04-04 02:03:19,674 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-af4b26a6) (logid:4c5c40d4) Begin
    > cleanup
    >     >     > expired async-jobs
    >     >     > 2018-04-04 02:03:19,683 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-af4b26a6) (logid:4c5c40d4) End
    > cleanup
    >     > expired
    >     >     > async-jobs
    >     >     > 2018-04-04 02:03:20,022 DEBUG
    >     > [c.c.n.r.VirtualNetworkApplianceManagerImpl]
    >     >     > (RouterStatusMonitor-1:ctx-f1d46df0) (logid:a021b44c) Found 0
    >     > routers to
    >     >     > update status.
    >     >     > 2018-04-04 02:03:20,025 DEBUG
    >     > [c.c.n.r.VirtualNetworkApplianceManagerImpl]
    >     >     > (RouterStatusMonitor-1:ctx-f1d46df0) (logid:a021b44c) Found 0
    > VPC
    >     > networks
    >     >     > to update Redundant State.
    >     >     > 2018-04-04 02:03:20,029 DEBUG
    >     > [c.c.n.r.VirtualNetworkApplianceManagerImpl]
    >     >     > (RouterStatusMonitor-1:ctx-f1d46df0) (logid:a021b44c) Found 0
    >     > networks to
    >     >     > update RvR status.
    >     >     > 2018-04-04 02:03:22,518 DEBUG [c.c.c.ConsoleProxyManagerImpl]
    >     >     > (consoleproxy-1:ctx-9d047585) (logid:3b4da034) Skip capacity
    > scan as
    >     > there
    >     >     > is no Primary Storage in 'Up' state
    >     >     > 2018-04-04 02:03:29,677 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-4378508d) (logid:9de3110e) Begin
    > cleanup
    >     >     > expired async-jobs
    >     >     > 2018-04-04 02:03:29,695 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-4378508d) (logid:9de3110e) End
    > cleanup
    >     > expired
    >     >     > async-jobs
    >     >     > 2018-04-04 02:03:35,796 DEBUG [c.c.s.StatsCollector]
    >     >     > (StatsCollector-2:ctx-a6998a7a) (logid:174df0f0) AutoScaling
    > Monitor
    >     > is
    >     >     > running...
    >     >     > 2018-04-04 02:03:35,812 DEBUG [c.c.s.StatsCollector]
    >     >     > (StatsCollector-1:ctx-51d8b17f) (logid:8d7cca2e)
    > HostStatsCollector
    >     > is
    >     >     > running...
    >     >     > 2018-04-04 02:03:35,812 DEBUG [c.c.s.StatsCollector]
    >     >     > (StatsCollector-3:ctx-db3df7da) (logid:c38b9f19)
    > StorageCollector is
    >     >     > running...
    >     >     > 2018-04-04 02:03:39,675 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-26aea785) (logid:48c9a5ba) Begin
    > cleanup
    >     >     > expired async-jobs
    >     >     > 2018-04-04 02:03:39,686 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-26aea785) (logid:48c9a5ba) End
    > cleanup
    >     > expired
    >     >     > async-jobs
    >     >     > 2018-04-04 02:03:49,677 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-ec993f07) (logid:98d10d6c) Begin
    > cleanup
    >     >     > expired async-jobs
    >     >     > 2018-04-04 02:03:49,692 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-ec993f07) (logid:98d10d6c) End
    > cleanup
    >     > expired
    >     >     > async-jobs
    >     >     > 2018-04-04 02:03:50,021 DEBUG
    >     > [c.c.n.r.VirtualNetworkApplianceManagerImpl]
    >     >     > (RouterStatusMonitor-1:ctx-592f1702) (logid:39d0b341) Found 0
    >     > routers to
    >     >     > update status.
    >     >     > 2018-04-04 02:03:50,024 DEBUG
    >     > [c.c.n.r.VirtualNetworkApplianceManagerImpl]
    >     >     > (RouterStatusMonitor-1:ctx-592f1702) (logid:39d0b341) Found 0
    > VPC
    >     > networks
    >     >     > to update Redundant State.
    >     >     > 2018-04-04 02:03:50,027 DEBUG
    >     > [c.c.n.r.VirtualNetworkApplianceManagerImpl]
    >     >     > (RouterStatusMonitor-1:ctx-592f1702) (logid:39d0b341) Found 0
    >     > networks to
    >     >     > update RvR status.
    >     >     > 2018-04-04 02:03:52,519 DEBUG [c.c.c.ConsoleProxyManagerImpl]
    >     >     > (consoleproxy-1:ctx-099c555a) (logid:1e1eb23a) Skip capacity
    > scan as
    >     > there
    >     >     > is no Primary Storage in 'Up' state
    >     >     > 2018-04-04 02:03:59,674 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-33034d0a) (logid:1c504485) Begin
    > cleanup
    >     >     > expired async-jobs
    >     >     > 2018-04-04 02:03:59,684 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-33034d0a) (logid:1c504485) End
    > cleanup
    >     > expired
    >     >     > async-jobs
    >     >     > 2018-04-04 02:04:09,675 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-c5079da9) (logid:8b320bb8) Begin
    > cleanup
    >     >     > expired async-jobs
    >     >     > 2018-04-04 02:04:09,689 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-c5079da9) (logid:8b320bb8) End
    > cleanup
    >     > expired
    >     >     > async-jobs
    >     >     > 2018-04-04 02:04:19,505 DEBUG [c.c.u.s.SSHCmdHelper]
    >     >     > (qtp510113906-14:ctx-707b53e5 ctx-8d49ccb3) (logid:dff92f23)
    > SSH
    >     > command:
    >     >     > cloudstack-setup-agent  -m 172.16.20.13 -z 1 -p 1 -c 1 -g
    >     >     > 1fd67886-c5d9-3464-ac73-46689258b34e -a --pubNic=cloudbr0
    >     > --prvNic=cloudbr0
    >     >     > --guestNic=cloudbr1 --hypervisor=kvm
    >     >     > SSH command output:Starting to configure your system:
    >     >     > Configure SElinux ...         [OK]
    >     >     > Configure Network ...         [OK]
    >     >     > Configure Libvirt ...         [OK]
    >     >     > Configure Firewall ...        [OK]
    >     >     > Configure Nfs ...             [OK]
    >     >     > Configure cloudAgent ...      [OK]
    >     >     > CloudStack Agent setup is done!
    >     >     >
    >     >     >
    >     >     > 2018-04-04 02:04:19,670 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-3953edaa) (logid:223c6612) Begin
    > cleanup
    >     >     > expired async-jobs
    >     >     > 2018-04-04 02:04:19,678 INFO  
[o.a.c.f.j.i.AsyncJobManagerImpl]
    >     >     > (AsyncJobMgr-Heartbeat-1:ctx-3953edaa) (logid:223c6612) End
    > cleanup
    >     > expired
    >     >     > async-jobs
    >     >     > 2018-04-04 02:04:20,020 DEBUG
    >     > [c.c.n.r.VirtualNetworkApplianceManagerImpl]
    >     >     > (RouterStatusMonitor-1:ctx-d51c2a8c) (logid:31404001) Found 0
    >     > routers to
    >     >     > update status.
    >     >     > 2018-04-04 02:04:20,022 DEBUG
    >     > [c.c.n.r.VirtualNetworkApplianceManagerImpl]
    >     >     > (RouterStatusMonitor-1:ctx-d51c2a8c) (logid:31404001) Found 0
    > VPC
    >     > networks
    >     >     > to update Redundant State.
    >     >     > 2018-04-04 02:04:20,023 DEBUG
    >     > [c.c.n.r.VirtualNetworkApplianceManagerImpl]
    >     >     > (RouterStatusMonitor-1:ctx-d51c2a8c) (logid:31404001) Found 0
    >     > networks to
    >     >     > update RvR status.
    >     >     > 2018-04-04 02:04:22,514 DEBUG [c.c.c.ConsoleProxyManagerImpl]
    >     >     > (consoleproxy-1:ctx-03cb5ba3) (logid:b63f8dea) Skip capacity
    > scan as
    >     > there
    >     >     > is no Primary Storage in 'Up' state
    >     >     > 2018-04-04 02:04:22,597 DEBUG
    > [o.a.c.c.p.RootCACustomTrustManager]
    >     >     > (pool-7-thread-1:null) (logid:) A client/agent attempting
    > connection
    >     > from
    >     >     > address=172.16.20.13 has presented these certificate(s):
    >     >     > Certificate [1] :
    >     >     >  Serial: da4b61927e0b90f4
    >     >     >   Not Before:Tue Apr 03 14:03:11 IST 2018
    >     >     >   Not After:Thu Apr 04 02:03:11 IST 2019
    >     >     >   Signature Algorithm:SHA256withRSA
    >     >     >   Version:3
    >     >     >   Subject DN:C=cloudstack, O=cloudstack, OU=cloudstack,
    >     > CN=srvr3.cloud.priv
    >     >     >   Issuer DN:CN=ca.cloudstack.apache.org<
    >     > http://ca.cloudstack.apache.org>
    >     >     >   Alternative Names:[[7, 172.16.20.13], [2, 172.16.20.13]]
    >     >     > Certificate [2] :
    >     >     >  Serial: ca8575145c21dcc5
    >     >     >   Not Before:Tue Apr 03 13:55:06 IST 2018
    >     >     >   Not After:Fri Mar 27 01:55:06 IST 2048
    >     >     >   Signature Algorithm:SHA256withRSA
    >     >     >   Version:3
    >     >     >   Subject DN:CN=ca.cloudstack.apache.org<
    >     > http://ca.cloudstack.apache.org>
    >     >     >   Issuer DN:CN=ca.cloudstack.apache.org<
    >     > http://ca.cloudstack.apache.org>
    >     >     >   Alternative Names:null
    >     >     > 2018-04-04 02:04:22,600 DEBUG
    > [o.a.c.c.p.RootCACustomTrustManager]
    >     >     > (pool-7-thread-1:null) (logid:) Client/agent connection from
    >     >     > ip=172.16.20.13 has been validated and trusted.
    >     >     > 2018-04-04 02:04:23,304 DEBUG [c.c.a.t.Request]
    >     >     > (AgentManager-Handler-2:null) (logid:) Seq 5-0: Scheduling the
    > first
    >     >     > command  { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 1,
    >     >     >
    >     >
    > 
[{"com.cloud.agent.api.StartupRoutingCommand":{"cpuSockets":1,"cpus":4,"speed":2000,"memory":11202912256,"dom0MinMemory":1073741824,"poolSync":false,"supportsClonedVolumes":false,"caps":"hvm,snapshot","pool":"/root","hypervisorType":"KVM","hostDetails":{"Host.OS.Kernel.Version":"3.10.0-693.el7.x86_64","com.cloud.network.Networks.RouterPrivateIpStrategy":"HostLocal","Host.OS.Version":"7.4.1708","Host.OS":"CentOS"},"hostTags":[],"groupDetails":{},"type":"Routing","dataCenter":"1","pod":"1","cluster":"1","guid":"1fd67886-c5d9-3464-ac73-46689258b34e-LibvirtComputingResource","name":"srvr3.cloud.priv","id":5,"version":"4.11.0.0","iqn":"iqn.1994-05.com.redhat:895c24ab79d","publicIpAddress":"172.16.20.13","publicNetmask":"255.255.0.0","publicMacAddress":"34:64:a9:2a:09:f3","privateIpAddress":"172.16.20.13","privateMacAddress":"34:64:a9:2a:09:f3","privateNetmask":"255.255.0.0","storageIpAddress":"172.16.20.13","storageNetmask":"255.255.0.0","storageMacAddress":"34:64:a9:2a:09:f3","resourceName":"LibvirtComputingResource","gatewayIpAddress":"172.16.0.1","wait":0}},{"com.cloud.agent.api.StartupStorageCommand":{"totalSize":0,"poolInfo":{"uuid":"b0c95dc8-bd46-4d3d-a4ee-90cb869d035e","host":"172.16.20.13","localPath":"/var/lib/libvirt/images","hostPath":"/var/lib/libvirt/images","poolType":"Filesystem","capacityBytes":486035005440,"availableBytes":478874988544},"resourceType":"STORAGE_POOL","hostDetails":{},"type":"Storage","dataCenter":"1","pod":"1","guid":"1fd67886-c5d9-3464-ac73-46689258b34e-LibvirtComputingResource","name":"srvr3.cloud.priv","id":5,"version":"4.11.0.0","resourceName":"LibvirtComputingResource","wait":0}}]
    >     >     > }
    >     >     > 2018-04-04 02:04:23,315 DEBUG [c.c.a.t.Request]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Seq 
5-0:
    >     > Processing
    >     >     > the first command  { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags:
    > 1,
    >     >     >
    >     >
    > 
[{"com.cloud.agent.api.StartupRoutingCommand":{"cpuSockets":1,"cpus":4,"speed":2000,"memory":11202912256,"dom0MinMemory":1073741824,"poolSync":false,"supportsClonedVolumes":false,"caps":"hvm,snapshot","pool":"/root","hypervisorType":"KVM","hostDetails":{"Host.OS.Kernel.Version":"3.10.0-693.el7.x86_64","com.cloud.network.Networks.RouterPrivateIpStrategy":"HostLocal","Host.OS.Version":"7.4.1708","Host.OS":"CentOS"},"hostTags":[],"groupDetails":{},"type":"Routing","dataCenter":"1","pod":"1","cluster":"1","guid":"1fd67886-c5d9-3464-ac73-46689258b34e-LibvirtComputingResource","name":"srvr3.cloud.priv","id":5,"version":"4.11.0.0","iqn":"iqn.1994-05.com.redhat:895c24ab79d","publicIpAddress":"172.16.20.13","publicNetmask":"255.255.0.0","publicMacAddress":"34:64:a9:2a:09:f3","privateIpAddress":"172.16.20.13","privateMacAddress":"34:64:a9:2a:09:f3","privateNetmask":"255.255.0.0","storageIpAddress":"172.16.20.13","storageNetmask":"255.255.0.0","storageMacAddress":"34:64:a9:2a:09:f3","resourceName":"LibvirtComputingResource","gatewayIpAddress":"172.16.0.1","wait":0}},{"com.cloud.agent.api.StartupStorageCommand":{"totalSize":0,"poolInfo":{"uuid":"b0c95dc8-bd46-4d3d-a4ee-90cb869d035e","host":"172.16.20.13","localPath":"/var/lib/libvirt/images","hostPath":"/var/lib/libvirt/images","poolType":"Filesystem","capacityBytes":486035005440,"availableBytes":478874988544},"resourceType":"STORAGE_POOL","hostDetails":{},"type":"Storage","dataCenter":"1","pod":"1","guid":"1fd67886-c5d9-3464-ac73-46689258b34e-LibvirtComputingResource","name":"srvr3.cloud.priv","id":5,"version":"4.11.0.0","resourceName":"LibvirtComputingResource","wait":0}}]
    >     >     > }
    >     >     > 2018-04-04 02:04:23,325 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to 
BareMetalDiscoverer
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to NetscalerElement
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to
    > HypervServerDiscoverer
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to
    > BaremetalPxeManagerImpl
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to 
XcpServerDiscoverer
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to NiciraNvp
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to BrocadeVcsElement
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to Ovm3Discoverer
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.h.o.r.Ovm3Discoverer]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    >     >     > createHostVOForConnectedAgent: Host[-0-null]
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to 
LxcServerDiscoverer
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to
    > NetworkUsageManagerImpl
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to
    >     >     > PremiumSecondaryStorageManagerImpl
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to Ovs
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to
    > ConsoleProxyManagerImpl
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to OvmDiscoverer
    >     >     > 2018-04-04 02:04:23,326 DEBUG [c.c.r.ResourceManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Dispatching
    >     > resource
    >     >     > state event CREATE_HOST_VO_FOR_CONNECTED to 
KvmServerDiscoverer
    >     >     > 2018-04-04 02:04:23,486 DEBUG [c.c.r.ResourceState]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Resource state
    >     >     > update: [id = 1; name = srvr3.cloud.priv; old state = 
Creating;
    >     > event =
    >     >     > InternalCreated; new state = Enabled]
    >     >     > 2018-04-04 02:04:23,487 DEBUG [c.c.h.Status]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    >     > Transition:[Resource
    >     >     > state = Enabled, Agent event = AgentConnected, Host id = 1,
    > name =
    >     >     > srvr3.cloud.priv]
    >     >     > 2018-04-04 02:04:23,512 DEBUG
    > [c.c.a.m.ClusteredAgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) create
    >     >     > ClusteredAgentAttache for 1
    >     >     > 2018-04-04 02:04:23,516 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Connect to
    >     >     > listener: XcpServerDiscoverer
    >     >     > 2018-04-04 02:04:23,517 DEBUG [c.c.h.x.d.XcpServerDiscoverer]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Not
    > XenServer
    >     > so
    >     >     > moving on.
    >     >     > 2018-04-04 02:04:23,517 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Connect to
    >     >     > listener: HypervServerDiscoverer
    >     >     > 2018-04-04 02:04:23,517 DEBUG
    > [c.c.h.h.d.HypervServerDiscoverer]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Not
    > Hyper-V
    >     >     > hypervisor, so moving on.
    >     >     > 2018-04-04 02:04:23,517 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Connect to
    >     >     > listener: ClusteredVirtualMachineManagerImpl
    >     >     > 2018-04-04 02:04:23,517 DEBUG 
[c.c.v.VirtualMachineManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) 
Received
    >     > startup
    >     >     > command from hypervisor host. host id: 1
    >     >     > 2018-04-04 02:04:23,517 INFO
    >     > [c.c.v.VirtualMachinePowerStateSyncImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Reset 
VM
    >     > power state
    >     >     > sync for host: 1
    >     >     > 2018-04-04 02:04:23,547 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Connect to
    >     >     > listener: SecurityGroupListener
    >     >     > 2018-04-04 02:04:23,547 INFO  [c.c.n.s.SecurityGroupListener]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Received a
    >     > host
    >     >     > startup notification
    >     >     > 2018-04-04 02:04:23,552 DEBUG [c.c.a.t.Request]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Seq
    >     >     > 1-1865897620614938625: Sending  { Cmd , MgmtId:
    > 55884536686396, via:
    >     >     > 1(srvr3.cloud.priv), Ver: v1, Flags: 100011,
    >     >     >
    >     >
    > 
[{"com.cloud.agent.api.CleanupNetworkRulesCmd":{"interval":1951,"wait":0}}]
    >     >     > }
    >     >     > 2018-04-04 02:04:23,555 INFO  [c.c.n.s.SecurityGroupListener]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Scheduled
    >     > network
    >     >     > rules cleanup, interval=1951
    >     >     > 2018-04-04 02:04:23,556 INFO  [c.c.n.s.SecurityGroupListener]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Received a
    >     > host
    >     >     > startup notification
    >     >     > 2018-04-04 02:04:23,556 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Connect to
    >     >     > listener: NetworkOrchestrator
    >     >     > 2018-04-04 02:04:23,563 DEBUG [o.a.c.e.o.NetworkOrchestrator]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Host's
    >     >     > hypervisorType is: KVM
    >     >     > 2018-04-04 02:04:23,580 DEBUG [o.a.c.e.o.NetworkOrchestrator]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     >     > CheckNetworkCommand to check the Network is setup correctly on
    > Agent
    >     >     > 2018-04-04 02:04:23,600 DEBUG [c.c.a.t.Request]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Seq
    >     >     > 1-1865897620614938626: Sending  { Cmd , MgmtId:
    > 55884536686396, via:
    >     >     > 1(srvr3.cloud.priv), Ver: v1, Flags: 100111,
    >     >     >
    >     >
    > 
[{"com.cloud.agent.api.CheckNetworkCommand":{"networkInfoList":[{"physicalNetworkId":200,"privateNetworkName":"cloudbr0","publicNetworkName":"cloudbr0","guestNetworkName":"cloudbr1"}],"wait":0}}]
    >     >     > }
    >     >     > 2018-04-04 02:04:23,607 DEBUG [c.c.a.t.Request]
    >     >     > (AgentManager-Handler-3:null) (logid:) Seq
    > 1-1865897620614938625:
    >     >     > Processing:  { Ans: , MgmtId: 55884536686396, via: 1, Ver: v1,
    >     > Flags: 10,
    >     >     > [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
    >     >     > 2018-04-04 02:04:23,730 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentManager-Handler-4:null) (logid:) Ping from
    > 1(srvr3.cloud.priv)
    >     >     > 2018-04-04 02:04:23,731 DEBUG
    >     > [c.c.v.VirtualMachinePowerStateSyncImpl]
    >     >     > (AgentManager-Handler-4:null) (logid:) Process host VM state
    > report
    >     > from
    >     >     > ping process. host: 1
    >     >     > 2018-04-04 02:04:23,731 DEBUG
    >     > [c.c.v.VirtualMachinePowerStateSyncImpl]
    >     >     > (AgentManager-Handler-4:null) (logid:) Process VM state 
report.
    >     > host: 1,
    >     >     > number of records in report: 0
    >     >     > 2018-04-04 02:04:23,734 DEBUG
    >     > [c.c.v.VirtualMachinePowerStateSyncImpl]
    >     >     > (AgentManager-Handler-4:null) (logid:) Done with process of VM
    > state
    >     >     > report. host: 1
    >     >     > 2018-04-04 02:04:23,741 INFO  [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentManager-Handler-4:null) (logid:) PingMap for agent: 1
    > will not
    >     > be
    >     >     > updated because agent is no longer in the PingMap
    >     >     > 2018-04-04 02:04:23,745 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentManager-Handler-4:null) (logid:) Not processing
    >     > PingRoutingCommand
    >     >     > for agent id=0; can't find the host in the DB
    >     >     > 2018-04-04 02:04:23,953 DEBUG [c.c.a.t.Request]
    >     >     > (AgentManager-Handler-5:null) (logid:) Seq
    > 1-1865897620614938626:
    >     >     > Processing:  { Ans: , MgmtId: 55884536686396, via: 1, Ver: v1,
    >     > Flags: 110,
    >     >     >
    >     >
    > 
[{"com.cloud.agent.api.CheckNetworkAnswer":{"_reconnect":false,"result":false,"details":"Can
    >     >     > not find network: cloudbr1","wait":0}}] }
    >     >     > 2018-04-04 02:04:23,953 DEBUG [c.c.a.t.Request]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Seq
    >     >     > 1-1865897620614938626: Received:  { Ans: , MgmtId:
    > 55884536686396,
    >     > via:
    >     >     > 1(srvr3.cloud.priv), Ver: v1, Flags: 110, { CheckNetworkAnswer
    > } }
    >     >     > 2018-04-04 02:04:23,953 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Details
    > from
    >     >     > executing class com.cloud.agent.api.CheckNetworkCommand: Can
    > not find
    >     >     > network: cloudbr1
    >     >     > 2018-04-04 02:04:23,954 WARN  [o.a.c.e.o.NetworkOrchestrator]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Unable
    > to
    >     > setup
    >     >     > agent 1 due to Can not find network: cloudbr1
    >     >     > 2018-04-04 02:04:23,956 DEBUG [c.c.a.m.AgentAttache]
    >     >     > (AgentManager-Handler-5:null) (logid:) Seq
    > 1-1865897620614938626: No
    >     > more
    >     >     > commands found
    >     >     > 2018-04-04 02:04:23,957 WARN  [o.a.c.alerts]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > AlertType:: 7
    >     > |
    >     >     > dataCenterId:: 1 | podId:: 1 | clusterId:: null | message::
    > Incorrect
    >     >     > Network setup on agent, Reinitialize agent after network names
    > are
    >     > setup,
    >     >     > details : Can not find network: cloudbr1
    >     >     > 2018-04-04 02:04:23,997 INFO  [c.c.u.e.CSExceptionErrorCode]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Could
    > not find
    >     >     > exception: com.cloud.exception.ConnectionException in error
    > code
    >     > list for
    >     >     > exceptions
    >     >     > 2018-04-04 02:04:23,998 WARN  [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Monitor
    >     >     > NetworkOrchestrator says there is an error in the connect
    > process
    >     > for 1 due
    >     >     > to Incorrect Network setup on agent, Reinitialize agent after
    >     > network names
    >     >     > are setup, details : Can not find network: cloudbr1
    >     >     > 2018-04-04 02:04:23,998 INFO  [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Host 1
    > is
    >     >     > disconnecting with event AgentDisconnected
    >     >     > 2018-04-04 02:04:24,000 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) The 
next
    >     > status of
    >     >     > agent 1is Alert, current status is Connecting
    >     >     > 2018-04-04 02:04:24,001 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Deregistering
    >     > link
    >     >     > for 1 with state Alert
    >     >     > 2018-04-04 02:04:24,001 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Remove
    > Agent
    >     > : 1
    >     >     > 2018-04-04 02:04:24,001 DEBUG [c.c.a.m.ConnectedAgentAttache]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Processing
    >     >     > Disconnect.
    >     >     > 2018-04-04 02:04:24,001 DEBUG [c.c.a.m.AgentAttache]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Seq
    >     >     > 1-1865897620614938625: Sending disconnect to class
    >     >     > com.cloud.network.security.SecurityGroupListener
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener:
    >     > com.cloud.hypervisor.xenserver.discoverer.XcpServerDiscoverer
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener:
    >     > com.cloud.hypervisor.hyperv.discoverer.HypervServerDiscoverer
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.network.security.SecurityGroupListener
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener:
    >     > org.apache.cloudstack.engine.orchestration.NetworkOrchestrator
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.A
    > 
<https://maps.google.com/?q=%3E+2018-04-04+02:04:24,002+DEBUG+%5Bc.c.a.m.A&entry=gmail&source=g>
    > gentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener:
    > com.cloud.storage.secondary.SecondaryStorageListener
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.storage.listener.StoragePoolMonitor
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.deploy.DeploymentPlanningManagerImpl
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.storage.LocalStoragePoolListener
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.network.SshKeysDistriMonitor
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener:
    >     > com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl
    >     >     > 2018-04-04 02:04:24,002 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.consoleproxy.ConsoleProxyListener
    >     >     > 2018-04-04 02:04:24,005 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.network.SshKeysDistriMonitor
    >     >     > 2018-04-04 02:04:24,005 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener:
    >     > com.cloud.network.router.VirtualNetworkApplianceManagerImpl
    >     >     > 2018-04-04 02:04:24,005 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener:
    >     >     >
    > com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
    >     >     > 2018-04-04 02:04:24,005 DEBUG [c.c.n.NetworkUsageManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Disconnected
    >     > called
    >     >     > on 1 with status Alert
    >     >     > 2018-04-04 02:04:24,006 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.storage.download.DownloadListener
    >     >     > 2018-04-04 02:04:24,006 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.capacity.StorageCapacityListener
    >     >     > 2018-04-04 02:04:24,006 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.capacity.ComputeCapacityListener
    >     >     > 2018-04-04 02:04:24,006 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener:
    >     > com.cloud.agent.manager.AgentManagerImpl$BehindOnPingListener
    >     >     > 2018-04-04 02:04:24,006 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener:
    >     > com.cloud.agent.manager.AgentManagerImpl$SetHostParamsListener
    >     >     > 2018-04-04 02:04:24,006 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Sending
    >     > Disconnect
    >     >     > to listener: com.cloud.storage.upload.UploadListener
    >     >     > 2018-04-04 02:04:24,007 DEBUG [c.c.h.Status]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    >     > Transition:[Resource
    >     >     > state = Enabled, Agent event = AgentDisconnected, Host id = 1,
    > name =
    >     >     > srvr3.cloud.priv]
    >     >     > 2018-04-04 02:04:24,028 DEBUG
    > [c.c.a.m.ClusteredAgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646)
    > Notifying
    >     > other
    >     >     > nodes of to disconnect
    >     >     > 2018-04-04 02:04:24,034 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Failed
    > to
    >     > handle
    >     >     > host connection: com.cloud.exception.ConnectionException:
    > Incorrect
    >     > Network
    >     >     > setup on agent, Reinitialize agent after network names are
    > setup,
    >     > details :
    >     >     > Can not find network: cloudbr1
    >     >     > 2018-04-04 02:04:24,046 DEBUG [c.c.a.m.AgentManagerImpl]
    >     >     > (AgentConnectTaskPool-1:ctx-0bf7b058) (logid:f7a4d646) Can not
    > send
    >     > command
    >     >     > com.cloud.agent.api.ReadyCommand due to Host 1 is not up
    >     >     > 2018-04-04 02:04:25,767 DEBUG [c.c.h.d.HostDaoImpl]
    >     > (ClusteredAgentManager
    >     >     > Timer:ctx-f7869282) (logid:9ff5ad9c) Resetting hosts suitable
    > for
    >     > reconnect
    >     >     > 2018-04-04 02:04:25,770 DEBUG [c.c.h.d.HostDaoImp
    > 
<https://maps.google.com/?q=-04-04+02:04:25,770+DEBUG+%5Bc.c.h.d.HostDaoImp&entry=gmail&source=g>
    > l]
    >     > (ClusteredAgentManager
    >     >     > Timer:ctx-f7869282) (logid:9ff5ad9c) Completed resetting hosts
    >     > suitable for
    >     >     > reconnect
    >     >     > 2018-04-04 02:04:25,770 DEBUG [c.c.h.d.HostDaoImpl]
    >     > (ClusteredAgentManager
    >     >     > Timer:ctx-f7869282) (logid:9ff5ad9c) Acquiring hosts for
    > clusters
    >     > already
    >     >     > owned by this management server
    >     >     > 2018-04-04 02:04:25,771 DEBUG [c.c.h.d.HostDaoImpl]
    >     > (ClusteredAgentManager
    >     >     > Timer:ctx-f7869282) (logid:9ff5ad9c) Completed acquiring hosts
    > for
    >     > clusters
    >     >     > already owned by this management server
    >     >     > 2018-04-04 02:04:25,772 DEBUG [c.c.h.d.HostDaoImpl]
    >     > (ClusteredAgentManager
    >     >     > Timer:ctx-f7869282) (logid:9ff5ad9c) Acquiring hosts for
    > clusters
    >     > not owned
    >     >     > by any management server
    >     >     > 2018-04-04 02:04:25,773 DEBUG [c.c.h.d.HostDaoImpl]
    >     > (ClusteredAgentManager
    >     >     > Timer:ctx-f7869282) (logid:9ff5ad9c) Completed acquiring hosts
    > for
    >     > clusters
    >     >     > not owned by any management server
    >     >     > 2018-04-04 02:04:29,219 DEBUG
    > [o.a.c.c.p.RootCACustomTrustManager]
    >     >     > (pool-8-thread-1:null) (logid:) A client/agent attempting
    > connection
    >     > from
    >     >     > address=172.16.20.13 has presented these certificate(s):
    >     >     > Certificate [1] :
    >     >     >
    >     >     >
    >     >     > Please help me understand what am I doing wrong here. I have
    > tried
    >     > several
    >     >     > approaches but none seem to work (like creating the bridge
    > through
    >     >     > virt-manager GUI or typing the IP configuration of targeted
    > guest
    >     > network
    >     >     > in the cloudbr1 file).
    >     >     >
    >     >     > Also, the method you suggested here where L2 network does not
    > leave
    >     > the
    >     >     > host, that would basically mean we do not need to have a
    > physical
    >     > network
    >     >     > in our LAN? like I currently have 192.168.20.0/24<
    >     > http://192.168.20.0/24>
    >     >     > and 172.16.20.0/16<http://172.16.20.0/16> in my physical
    > network,
    >     > but I
    >     >     > could possibly create a isolated guest network of 10.0.2.0/24<
    >     >     > http://10.0.2.0/24> ?
    >     >     >
    >     >     > I am also attaching the management-server logs if it would not
    > be
    >     > stripped
    >     >     > by mailing system. The logs of agent had nothing interesting 
or
    >     > related to
    >     >     > network configuration errors, so not attaching them here.
    >     >     >
    >     >     > Thanks,
    >     >     > Parth Patel
    >     >     >
    >     >     >
    >     >     > dag.sonst...@shapeblue.com
    >     >     > www.shapeblue.com
    >     >     > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
    >     >     > @shapeblue
    >     >     >
    >     >     >
    >     >     >
    >     >     > On Thu, 29 Mar 2018 at 16:18 Parth Patel <
    > parthpatel2...@gmail.com
    >     > <mailto:
    >     >     > parthpatel2...@gmail.com>> wrote:
    >     >     > Thanks Dag. Appreciate it. Will try this out.
    >     >     >
    >     >     > On Thu, 29 Mar 2018 at 16:02 Dag Sonstebo
    >     > <
    > 
https://maps.google.com/?q=Mar+2018+at+16:02+Dag+Sonstebo+&entry=gmail&source=g
    > >
    >     > <dag.sonst...@shapeblue.com
    >     >     > <mailto:dag.sonst...@shapeblue.com>> wrote:
    >     >     > Hi Parth,
    >     >     >
    >     >     > If you want a KVM networking introduction take a look at my
    > blog
    >     > post from
    >     >     > a couple of years back – this is still valid:
    >     >     > http://www.shapeblue.com/networking-kvm-for-cloudstack/
    >     >     >
    >     >     > In short – you don’t set up VLAN tagging for isolated networks
    > on
    >     > the KVM
    >     >     > host – you set up the bridge and then specify your VLAN range
    > when
    >     > you set
    >     >     > up your zone in CloudStack. CloudStack then takes care of
    > creating
    >     > the
    >     >     > isolated VLAN isolated networks on the host. So in short – you
    >     > create your
    >     >     > bridges, then use the bridge names in the advanced zone setup.
    >     >     >
    >     >     > Virtual bridge – yes this is similar to the cloud0 bridge, and
    > yes
    >     > you
    >     >     > create the bridge without a physical interface.
    >     >     >
    >     >     > Regards,
    >     >     > Dag Sonstebo
    >     >     > Cloud Architect
    >     >     > ShapeBlue
    >     >     >
    >     >     >
    >     >     > dag.sonst...@shapeblue.com<mailto:dag.sonst...@shapeblue.com>
    >     >     > www.shapeblue.com<http://www.shapeblue.com>
    >     >     > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
    >     >     > @shapeblue
    >     >     >
    >     >     >
    >     >     >
    >     >     > On 29/03/2018, 11:14, "Parth Patel" <parthpatel2...@gmail.com
    >     > <mailto:
    >     >     > parthpatel2...@gmail.com>> wrote:
    >     >     >
    >     >     >     Hi Dag,
    >     >     >
    >     >     >     Thanks for helping me understand the requirement of
    > advanced
    >     >     > networking.
    >     >     >     Sorry if I have missed something obvious or my question
    > seems
    >     > stupid,
    >     >     > but I
    >     >     >     am just starting to learn. Can you help me out on how to
    > setup
    >     > VLAN
    >     >     >     "tagging" on one machine? I have tried several methods and
    >     > tutorials I
    >     >     >     could find on the internet for VLANs, but none mention
    > "tagging".
    >     >     >
    >     >     >     Also, I do not fully understand private virtual 
bridge.....
    >     > Means I
    >     >     > create
    >     >     >     an interface file for bridge but mention no physical
    > interface
    >     > device?
    >     >     > Is
    >     >     >     it similar to how cloud0 is configured for link local
    > network of
    >     > System
    >     >     >     VMs? I could probably do that, but I don't know much about
    >     > configuring
    >     >     > VLAN
    >     >     >     tagging. I would appreciate if you could give me some
    > guidance or
    >     >     > point me
    >     >     >     where you think some good documentation is given for
    > CentOS/RHEL
    >     > hosts
    >     >     > for
    >     >     >     configuring bridges with VLAN tagging (I have tried but
    > failed to
    >     >     >     understand most of them). I am especially stuck at
    > understanding
    >     > this
    >     >     >     "tagging" of VLANs.
    >     >     >
    >     >     >     Thanks,
    >     >     >     Parth Patel
    >     >     >
    >     >     >     On Thu, 29 Mar 2018 at 15:17 Dag Sonstebo <
    >     > dag.sonst...@shapeblue.com
    >     >     > <mailto:dag.sonst...@shapeblue.com>>
    >     >     >     wrote:
    >     >     >
    >     >     >     > Hi Parth,
    >     >     >     >
    >     >     >     > Yes and no.
    >     >     >     >
    >     >     >     > No – you cannot do advanced zones with *all three* KVM
    > hosts
    >     > and
    >     >     > advanced
    >     >     >     > networking without using VLANs (or another isolation
    >     > mechanism) and
    >     >     > still
    >     >     >     > expect traffic to flow between VMs/VRs on different KVM
    > hosts.
    >     >     >     >
    >     >     >     > Yes – you can probably do this *on a single KVM host* –
    > but
    >     > you will
    >     >     > have
    >     >     >     > to use VLAN tagging internally – this can however be
    > done on a
    >     >     > virtual
    >     >     >     > bridge interface, i.e. the L2 traffic doesn’t ever leave
    > that
    >     > host.
    >     >     >     >
    >     >     >     > Without deep diving into this I think it would look like
    > this:
    >     >     >     >
    >     >     >     > Physical eth0 -> cloudbr0 > handles management and 
public
    >     >     >     > No nic -> private virtual bridge cloudbr1 > handles
    > isolated
    >     > guest
    >     >     > traffic
    >     >     >     > but allows for isolated VLANs internally on the host
    >     >     >     >
    >     >     >     > Regards,
    >     >     >     > Dag Sonstebo
    >     >     >     > Cloud Architect
    >     >     >     > ShapeBlue
    >     >     >     >
    >     >     >     >
    >     >     >     > dag.sonst...@shapeblue.com<mailto:
    > dag.sonst...@shapeblue.com>
    >     >     >     > www.shapeblue.com<http://www.shapeblue.com>
    >     >     >     > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
    >     >     >     > @shapeblue
    >     >     >     >
    >     >     >     >
    >     >     >     >
    >     >     >     > On 29/03/2018, 09:25, "Parth Patel" <
    > parthpatel2...@gmail.com
    >     >     > <mailto:parthpatel2...@gmail.com>> wrote:
    >     >     >     >
    >     >     >     >     Hi Dag,
    >     >     >     >
    >     >     >     >     Thanks for the reply. I am trying to use Shapeblue
    > CCS
    >     >     > (Container as a
    >     >     >     >     Service) with ACS, but for that Isolated networks 
are
    >     > required
    >     >     > which
    >     >     >     > are
    >     >     >     >     only available in Advanced Zone. Further, I want to
    > explore
    >     >     > Cloudstack
    >     >     >     >     further and am also aiming to test and configure
    > other
    >     > advanced
    >     >     >     > features
    >     >     >     >     such as load balancing and auto scaling without
    > netscaler
    >     >     > device. For
    >     >     >     > that
    >     >     >     >     I badly need Advanced Zone networking (especially
    > isolated
    >     >     > networks
    >     >     >     >     offerings). I just want to know if Advanced Zone can
    >     > succesfully
    >     >     >     > function
    >     >     >     >     with two networks, one physcial NIC and no VLAN
    > tagging.
    >     >     >     >
    >     >     >     >     Thanks,
    >     >     >     >     Parth Patel
    >     >     >     >
    >     >     >     >     On Thu, 29 Mar 2018 at 13:48 Dag Sonstebo <
    >     >     > dag.sonst...@shapeblue.com<mailto:dag.sonst...@shapeblue.com>>
    >     >     >     >     wrote:
    >     >     >     >
    >     >     >     >     > Hi Parth,
    >     >     >     >     >
    >     >     >     >     > Not sure if I follow. Generally, your management
    > network
    >     > is
    >     >     > untagged,
    >     >     >     >     > whilst your public and isolated networks tagged.
    > The
    >     >     > underlying idea
    >     >     >     > of
    >     >     >     >     > advanced zones is you must have network isolation
    > between
    >     >     > multiple
    >     >     >     > guest
    >     >     >     >     > networks, otherwise you have no privacy/security.
    > You
    >     > can do
    >     >     > this
    >     >     >     > either at
    >     >     >     >     > L2 with VLAN tagging, which is the simplest, or
    > with L3
    >     > using
    >     >     >     > various SDN
    >     >     >     >     > overlay network solutions (more complicated and
    > comes at
    >     >     > <
    >     >
    > 
https://maps.google.com/?q=ork+solutions+(more+complicated+and+comes+at+&entry=gmail&source=g
    >     > >a
    >     >     > cost).
    >     >     >     >     >
    >     >     >     >     > If you don’t want to tag anything you’re probably
    > better
    >     > off
    >     >     > using
    >     >     >     > basic
    >     >     >     >     > networks, where I believe you could use a single
    > flat
    >     > subnet
    >     >     > (happy
    >     >     >     > to be
    >     >     >     >     > proven wrong).
    >     >     >     >     >
    >     >     >     >     > Regards,
    >     >     >     >     > Dag Sonstebo
    >     >     >     >     > Cloud Architect
    >     >     >     >     > ShapeBlue
    >     >     >     >     >
    >     >     >     >     >
    >     >     >     >     > dag.sonst...@shapeblue.com<mailto:
    >     > dag.sonst...@shapeblue.com>
    >     >     >     >     > www.shapeblue.com<http://www.shapeblue.com>
    >     >     >     >     > 53 Chandos Place, Covent Garden, London  WC2N 
4HSUK
    >     >     >     >     > @shapeblue
    >     >     >     >     >
    >     >     >     >     >
    >     >     >     >     >
    >     >     >     >     > On 29/03/2018, 08:48, "Parth Patel" <
    >     > parthpatel2...@gmail.com
    >     >     > <mailto:parthpatel2...@gmail.com>>
    >     >     >     > wrote:
    >     >     >     >     >
    >     >     >     >     >     Hi all,
    >     >     >     >     >
    >     >     >     >     >     After banging my head with different network
    >     > configuration
    >     >     >     >     > permutations, I
    >     >     >     >     >     don't understand what is the issue with
    > Network Guru
    >     > here
    >     >     > and
    >     >     >     > why it
    >     >     >     >     > can't
    >     >     >     >     >     implement the isolated guest network. I just
    > want to
    >     > know
    >     >     > if
    >     >     >     > Advanced
    >     >     >     >     > Zone
    >     >     >     >     >     can be successfully setup or has someone
    > configured
    >     > an
    >     >     > advanced
    >     >     >     > zone
    >     >     >     >     > using
    >     >     >     >     >     untagged VLAN traffic?
    >     >     >     >     >
    >     >     >     >     >     I have the following configuration of
    > components:
    >     >     >     >     >     - I have 3 (16 GB Ram and 4 Cores) machines
    > each
    >     > with 1
    >     >     > physical
    >     >     >     > NIC.
    >     >     >     >     >     - I have two networks: 192.168.20.0/24<
    >     >     > http://192.168.20.0/24> (using this for isolated
    >     >     >     > guest
    >     >     >     >     >     network) and 172.16.20.0/16<
    > http://172.16.20.0/16>
    >     >     > (management server and NFS servers
    >     >     >     >     > network)
    >     >     >     >     >     - I am using KVM hypervisor and NFS for
    > storage.
    >     >     >     >     >     - Currently, the output of brctl show is (when
    > the
    >     >     > Cloudstack is
    >     >     >     > not
    >     >     >     >     >     running, other wise the interface are
    > populated with
    >     > three
    >     >     > vnets
    >     >     >     > for
    >     >     >     >     > cloud0
    >     >     >     >     >     and 4-5 vnets for cloudbr0):
    >     >     >     >     >     bridge name     bridge id               STP
    > enabled
    >     >     >     >  interfaces
    >     >     >     >     >     cloud0
    

Reply via email to