Re: [ovs-discuss] Prometheus Exporter for OVN
ср, 3 окт. 2018 г. в 2:35, Paul Greenberg : > > Hi Vasiliy, > > Thank you for the reply! I will take the conversation about the modifications > you mentioned into the repo. > > > I'm already have such splitting for libvirt exporter. > > Do you have the code published somewhere? Yes, post link to repo issue. > > What metrics do you consider the most valuable when it comes to OVN (not > OVS)? Are they implemented? > Chassis info missed encap (useful) and options (may be useful). Also pid file and log file path not useful (i don't understand how this use in monitoring), also system run dir. May be to monitor disk space, but i'm confused. -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] Prometheus Exporter for OVN
> > Here is the thinking on this one. The presence of pid file and the validation > that the process listed in the pid file are process checks. If the process is > 0, then it is down and one can monitor for that. Also, if the process ID of a > subsystem (say OVN NB) changed, then it means that service was restarted. I > guess the alert would be if a process is 0 or if the process ID changed, then > alert. > Does it possible to monitor ovn service uptime? If uptime bigger then before - service is restarted. > Per the log files. It happened on a number of occasions that a subsystem > crashed, but its process was still running. One way of detecting something > like that is watch for the log file being stale, i.e. log size does not > increment. There are obviously other ways to monitor that. Also, any spike in > log activity, i.e. sudden large increase in log file size, means something is > happening and it worth looking into it. I think that it is not right way. Sometimes i want to write logs to syslog or journald... > > > also system run dir. May be to monitor disk > space, but i'm confused. > > That's really informational. Kinda know where system dir is. For what this mertic can be used? If i have debian and fedora systems and this dir may changed over distributions -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
[ovs-discuss] need help with ovn
Hi. I need to setup simple test lab with ovn on two hosts. One host is gateway that have external ipv4 address and connected to upstream provider and the second host that have vm with two interfaces (libvirt created tap devices). I need to have one interfaces connected to external network (via gateway host) and autoassign it public ipv4 address via dhcp, and second interface connected to internal network (that can in feature have another vm). How can i do that via ovn commands?Thanks for any hint. -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] need help with ovn
вс, 25 нояб. 2018 г. в 20:42, Numan Siddique : > > > Hi Vasiliy, > > There are many resources which you can look into it. > I would suggest a few > - http://docs.openvswitch.org/en/latest/tutorials/ovn-openstack/ > - Look into man pages of "ovn-*" > - Look into ovn.at test file - > https://github.com/openvswitch/ovs/blob/master/tests/ovn.at - This will give > you the idea on how to use ovn commands > - Few other external links - > - http://blog.spinhirne.com/2016/09/a-primer-on-ovn.html > - https://gist.github.com/russellb/4ab0a9641f12f8ac66fdd6822ee7789e > - > https://developers.redhat.com/blog/2018/09/03/ovn-dynamic-ip-address-management/ > - > https://developers.redhat.com/blog/2018/11/08/how-to-create-an-open-virtual-network-distributed-gateway-router/ > Thanks! I'm find some link to, but i need more like text description about in which cases i need to create logical router, what kinds of ports for which use-cases... But i'm try to read this additional links. -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
[ovs-discuss] Single nic server and ovn
Hi, i have some servers that have only one nic for network. As i understand for ovn i need to add this interface to ovs bridge. But for host access i need some ip address on server and also if ovs or ovn is down or something else with this services i can't connect to server. How to deal with such case? Or only one thing is to create localnet port in ovn? ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] Single nic server and ovn
As i understand in various tutorials i need to add ethernet device to ovs to be able to send traffic or use localnet port ср, 19 дек. 2018 г. в 20:16, Ben Pfaff : > > On Wed, Dec 19, 2018 at 09:56:28AM +0300, Vasiliy Tolstov wrote: > > Hi, i have some servers that have only one nic for network. As i understand > > for ovn i need to add this interface to ovs bridge. > > But for host access i need some ip address on server and also if ovs or ovn > > is down or something else with this services i can't connect to server. > > How to deal with such case? Or only one thing is to create localnet port in > > ovn? > > OVN shouldn't need to take over your NIC. In the most common case it > only deals with tunnels, which get their own bridge and do not need > direct access to the NIC. -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] Single nic server and ovn
ср, 19 дек. 2018 г. в 22:31, Grant Taylor via discuss : > > On 12/18/2018 11:56 PM, Vasiliy Tolstov wrote: > > Hi, i have some servers that have only one nic for network. As i > > understand for ovn i need to add this interface to ovs bridge. > > But for host access i need some ip address on server and also if ovs or > > ovn is down or something else with this services i can't connect to server. > > I have multiple machines with a single interface (or single logical that > is multiple physicals bonded). It works well. > > > How to deal with such case? Or only one thing is to create localnet port > > in ovn? > > I add the interface(s) to OvS and use an internal OvS port to assign my > IP(s) to. > > 5ff87006-3e41-4204-94f5-ad44a8f9d5a8 > Bridge "eth0" > Port "eth0" > Interface "eth0" > type: internal > Port "lab1" > tag: 101 > Interface "lab1" > type: internal > > I have my management IP(s) on the eth0 internal (logical) interface. > > I then use other internal ports for various different things. > > It works great. > > IMHO, OvS is somewhat better, especially when bonding and using VLANs. > OvS handles those more cleanly than needing to create a bond interface > and VLAN sub-interfaces on top of the bond. > > I know about that, but if ovs have panics/crushes or misconfigured i can' get access to my server via ethernet -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
[ovs-discuss] Amazon like networking vpc with ovn
Hi. I'm reading about ovn, openstack networking with ovn. I want to create something like amazon vpc. Create networking global between two locations. With router that can be publicly available, in each location - subnet with addr from global network range. Each subnet connected to global network. So vps in one zone can reach vps in another zone in this subnets via router. Does it possible to do that via ovn? ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] Amazon like networking vpc with ovn
пт, 8 мар. 2019 г. в 19:58, Numan Siddique : > > > > On Fri, Mar 8, 2019 at 12:37 AM Vasiliy Tolstov wrote: >> >> Hi. I'm reading about ovn, openstack networking with ovn. >> I want to create something like amazon vpc. >> Create networking global between two locations. With router that can be >> publicly available, in each location - subnet with addr from global network >> range. >> Each subnet connected to global network. So vps in one zone can reach vps in >> another zone in this subnets via router. >> Does it possible to do that via ovn? > > > Hi Vasiliy, > > If you are able to do the same with OpenStack ML2OVS Neutron (reference > implementation with agents), then I think it should be possible with OVN. > Main problem, i don't know does it possible to do that with ML2OVS neutron =) > I guess you are talking about 2 independent OpenStack (with OVN) deployments > and talking to each other. I'm prefer to have independent ovn setups on each location connected via vxlan tunnels and controlled via cms -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] Maximum Number of Access Control List Entries
чт, 21 мар. 2019 г. в 13:56, Michael Dilmore : > > Hi guys, > > Does anyone know if there is a hard limit on the number of ACL entries > OpenFlow can manage at once? > > I'm dealing with over 100 and this is likely to grow in future. I'm wondering > whether this might cause issues as my security policies become more complex. > As i know openstack uses port groups and attach acl to port group, i think that main drawback in many acl entries to many ports - slow sync when client monitor requested. -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] Amazon like networking vpc with ovn
пт, 29 мар. 2019 г. в 23:50, Han Zhou : > > > > On Sun, Mar 10, 2019 at 1:34 PM Vasiliy Tolstov wrote: > > > > пт, 8 мар. 2019 г. в 19:58, Numan Siddique : > > > > > > > > > > > > On Fri, Mar 8, 2019 at 12:37 AM Vasiliy Tolstov > > > wrote: > > >> > > >> Hi. I'm reading about ovn, openstack networking with ovn. > > >> I want to create something like amazon vpc. > > >> Create networking global between two locations. With router that can be > > >> publicly available, in each location - subnet with addr from global > > >> network range. > > >> Each subnet connected to global network. So vps in one zone can reach > > >> vps in another zone in this subnets via router. > > >> Does it possible to do that via ovn? > > > > > > > > > Hi Vasiliy, > > > > > > If you are able to do the same with OpenStack ML2OVS Neutron (reference > > > implementation with agents), then I think it should be possible with OVN. > > > > > > > Main problem, i don't know does it possible to do that with ML2OVS neutron > > =) > > > > > I guess you are talking about 2 independent OpenStack (with OVN) > > > deployments and talking to each other. > > > > I'm prefer to have independent ovn setups on each location connected > > via vxlan tunnels and controlled via cms > > > > Hi Vasiliy, > > OVN doesn't yet support tunnel interconnection between different OVN setups. > It would be a great feature to support routing between logical routers from > different OVN setups through tunnels between gateways. I think it shouldn't > be too difficult to support this in OVN. > > If you require a L2 network (logical switch) spanning multiple OVN setups, it > might be more tricky. (if so, what's the use case?) > > Thanks, > Han Thank you! I don't need big L2 network, for my use-case tunnel interconnection between different ovn setups is enough. So i need routing between logical routers from different ovn setups though tunnels. Does it possible to do something like this now with current master of ovn? -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] Amazon like networking vpc with ovn
сб, 30 мар. 2019 г. в 00:04, Han Zhou : > > > Thank you! I don't need big L2 network, for my use-case tunnel > > interconnection between different ovn setups is enough. So i need > > routing between logical routers from different ovn setups though > > tunnels. Does it possible to do something like this now with current > > master of ovn? > > > I mean it is possible to implementing the feature in OVN, but it is not > supported yet today. If i create between dc vxlan tunnels via os and create on gateway chassis localnet ports, so each logical router have connection to switch that have localnet port does it can work? -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] Amazon like networking vpc with ovn
сб, 30 мар. 2019 г. в 00:22, Han Zhou : > > > > On Fri, Mar 29, 2019 at 2:08 PM Vasiliy Tolstov wrote: > > > > сб, 30 мар. 2019 г. в 00:04, Han Zhou : > > > > > > > > > Thank you! I don't need big L2 network, for my use-case tunnel > > > > interconnection between different ovn setups is enough. So i need > > > > routing between logical routers from different ovn setups though > > > > tunnels. Does it possible to do something like this now with current > > > > master of ovn? > > > > > > > I mean it is possible to implementing the feature in OVN, but it is not > > > supported yet today. > > > > If i create between dc vxlan tunnels via os and create on gateway > > chassis localnet ports, so each logical router have connection to > > switch that have localnet port does it can work? > > > Do you mean creating tunnels manually between gateways from different DCs? I > think it is possible, but I never tried it. I think as long as you can route > traffic between gateways, it should work. The routing mechanism can be > anything, e.g. regular routing, MPLS, L2 tunnelling, etc. But OVN doesn't > know about the mechanisms - it only understands static routes in logical > routers. The feature I was thinking about is to support this natively by OVN, > so that a tunnel mesh is setup between OVN gateways by ovn-controller running > on the gateway chassises. Maybe it is not that important if you can set it up > manually (or through external CMS system) If that possible via ovn this is more preferable for me =) But i don't know how hard to implement such feature and who can do that =) -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
[ovs-discuss] how to forward all traffic from vm with dst 169.254.169.254 to local compute node
Hi! I need to route all traffic (tcp) from vm to metadata ip address 169.254.169.254 to host server. Ideally i need to know what vm is going to this address. I know that via ovs i can create flow for this stuff, does it possible something like this with ovn? -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] how to forward all traffic from vm with dst 169.254.169.254 to local compute node
чт, 16 мая 2019 г. в 14:57, Daniel Alvarez Sanchez : > > In OpenStack we do this via a DHCP static route [0]. Then we use an > OVN 'localport' in the hypervisor inside a namespace to handle the > requests. > > [0] > https://opendev.org/openstack/networking-ovn/src/branch/stable/stein/networking_ovn/common/ovn_client.py#L1524 > Thank you, why namespace needed? -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
[ovs-discuss] custom compute node services from openvswitch and ovn
Hi! I have fedora 25 box and want to run on it some vms. What services needed to be run on this compute node and what on network controller node? Where i can find services description and it relations? I have ths services: /usr/lib/systemd/system/ovn-controller-vtep.service /usr/lib/systemd/system/ovn-controller.service /usr/lib/systemd/system/ovn-northd.service /usr/lib/systemd/system/openvswitch.service Also note that i want to have on compute node my own agent that control local openvswitch. -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] custom compute node services from openvswitch and ovn
2017-01-19 20:38 GMT+03:00 Ben Pfaff : > A hypervisor in OVN needs to run openvswitch and ovn-controller. > > You should probably start by reading the ovn-architecture manpage. Thanks! -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
[ovs-discuss] openvswitch-ovn in fedora 28
Hi! I'm try to run ovn in fedora 28. I have 3 hosts: gateway=controler 172.16.1.254 compute1 172.16.1.1 compute2 172.16.1.2 What services i need to enable on compute and on controller? Also as i found, i need to enable listening ovn-northd on 172.16.1.254 and connect to it other nodes via port 6641 and 6642. How can i do that in fedora? Also if my controller node have vm that i want to connect to internal ovn network what services i need to run additional on controller node and does it possible? Thanks and sorry, i don't found much info about ovn on fedora. -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
[ovs-discuss] fedora 28 bootloop with ovsdb-server and networking
Hi. I have very bad issue when booting some servers. I have infiniband hardware with IPoIB (ip over infiniband). When sometimes ib network not ready (subnet manager down, link down) networking service failed to load (systemd-networkd), because it can't up ib* device. But ovsdb-server can't start because networking not ready. So in kvm i have messages about Failed to start OpenVswitch database unit Stopped OpenVSwitch database unit Starting OpenvSwitc database unit Failed to start Networking service after that messages looped from the begging (i'm wait more then 30m , but tty console not appeared). What can i do in such case? Why ovsdb-server have hard depency in networking? As i understand it can bring connection up after some times when networking ready....? -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] fedora 28 bootloop with ovsdb-server and networking
вт, 26 июн. 2018 г. в 2:34, Vasiliy Tolstov : > > Hi. I have very bad issue when booting some servers. > I have infiniband hardware with IPoIB (ip over infiniband). > When sometimes ib network not ready (subnet manager down, link down) > networking service failed to load (systemd-networkd), because it can't > up ib* device. But ovsdb-server can't start because networking not > ready. > So in kvm i have messages about > > Failed to start OpenVswitch database unit > Stopped OpenVSwitch database unit > Starting OpenvSwitc database unit > Failed to start Networking service > after that messages looped from the begging (i'm wait more then 30m , > but tty console not appeared). > What can i do in such case? Why ovsdb-server have hard depency in networking? > As i understand it can bring connection up after some times when > networking ready? > Additional notes - network not up because selinux and ipoib issues (already send to linux-rdma list) But issue with network.service and ovsdb-server present - does it possible to not hard requre that network.service is up before ovsdb-server and other ovn components? -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] openvswitch-ovn in fedora 28
вт, 26 июн. 2018 г. в 23:24, Mark Michelson : > > On 06/19/2018 08:42 AM, Vasiliy Tolstov wrote: > > Hi! I'm try to run ovn in fedora 28. > > I have 3 hosts: > > gateway=controler 172.16.1.254 > > compute1 172.16.1.1 > > compute2 172.16.1.2 > > > > What services i need to enable on compute and on controller? > > On the controller, you should start the ovn-northd service in systemd: > `systemctl start ovn-northd` > If there are VMs on your controller node that you want to connect to the > overlay network, then you would also need to run the openvswitch and > ovn-controller services: > `systemctl start openvswitch` > `systemctl start ovn-controller` > Thanks, already do that. > On the compute nodes, you will want to start the openvswitch and > ovn-controller services. > `systemctl start openvswitch` > `systemctl start ovn-controller` > Yes, already have this. > > Also as i found, i need to enable listening ovn-northd on 172.16.1.254 > > and connect to it other nodes via port 6641 and 6642. How can i do > > that in fedora? > > This is done the same way in Fedora as in other distributions. On your > controller, you can set up a basic TCP listener on those ports by running: > > ovn-nbctl set-connection ptcp:6641 > ovn-sbctl set-connection ptcp:6642 > Thanks! > (I recommend using SSL. You can learn more about this topic in the > ovn-nbctl and ovn-nb manpages) > > On your compute nodes, you can point those to your controller's port > 6642, by running > > ovs-vsctl set open_vswitch . external_ids:ovn-remote=:6642 > On this i have qeustion, i found in google that i need also specify external_ids:ovn-nb="tcp:$CENTRAL_IP:6641" external_ids:ovn-encap-type="geneve,vxlan" Does i need this is all compute nodes? > > Also if my controller node have vm that i want to connect to internal > > ovn network what services i need to run additional on controller node > > and does it possible? > > This is a pretty broad topic, but I suggest that you look at the > following areas: > > * On logical switches, look up "localnet" ports. > * Look into the Gateway_Chassis table in the OVN northbound database, > and how to set these up on logical router ports. > > You can get more information in the ovn-nb manpage for both of these > topics. > Thanks for all answers! -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] openvswitch-ovn in fedora 28
Thanks a lot. ср, 27 июн. 2018 г. в 23:09, Numan Siddique : > > I think Mark has provided you the required guidance. > > You could also refer openstack networking-ovn documentation - > https://docs.openstack.org/networking-ovn/latest/install/manual.html > > Thanks > Numan > > > > On Thu, Jun 28, 2018 at 1:26 AM Mark Michelson wrote: >> >> On 06/26/2018 05:57 PM, Vasiliy Tolstov wrote: >> > вт, 26 июн. 2018 г. в 23:24, Mark Michelson : >> >> >> >> On 06/19/2018 08:42 AM, Vasiliy Tolstov wrote: >> >>> Hi! I'm try to run ovn in fedora 28. >> >>> I have 3 hosts: >> >>> gateway=controler 172.16.1.254 >> >>> compute1 172.16.1.1 >> >>> compute2 172.16.1.2 >> >>> >> >>> What services i need to enable on compute and on controller? >> >> >> >> On the controller, you should start the ovn-northd service in systemd: >> >> `systemctl start ovn-northd` >> >> If there are VMs on your controller node that you want to connect to the >> >> overlay network, then you would also need to run the openvswitch and >> >> ovn-controller services: >> >> `systemctl start openvswitch` >> >> `systemctl start ovn-controller` >> >> >> > >> > Thanks, already do that. >> > >> >> On the compute nodes, you will want to start the openvswitch and >> >> ovn-controller services. >> >> `systemctl start openvswitch` >> >> `systemctl start ovn-controller` >> >> >> > >> > Yes, already have this. >> > >> >>> Also as i found, i need to enable listening ovn-northd on 172.16.1.254 >> >>> and connect to it other nodes via port 6641 and 6642. How can i do >> >>> that in fedora? >> >> >> >> This is done the same way in Fedora as in other distributions. On your >> >> controller, you can set up a basic TCP listener on those ports by running: >> >> >> >> ovn-nbctl set-connection ptcp:6641 >> >> ovn-sbctl set-connection ptcp:6642 >> >> >> > >> > Thanks! >> > >> >> (I recommend using SSL. You can learn more about this topic in the >> >> ovn-nbctl and ovn-nb manpages) >> >> >> >> On your compute nodes, you can point those to your controller's port >> >> 6642, by running >> >> >> >> ovs-vsctl set open_vswitch . external_ids:ovn-remote=:6642 >> >> >> > >> > On this i have qeustion, i found in google that i need also specify >> > external_ids:ovn-nb="tcp:$CENTRAL_IP:6641" >> > external_ids:ovn-encap-type="geneve,vxlan" >> > >> > Does i need this is all compute nodes? >> >> You will need external_ids:ovn-encap-type, but you don't need >> external_ids:ovn-nb. I don't know what external_ids:ovn-nb does. >> >> > >> >>> Also if my controller node have vm that i want to connect to internal >> >>> ovn network what services i need to run additional on controller node >> >>> and does it possible? >> >> >> >> This is a pretty broad topic, but I suggest that you look at the >> >> following areas: >> >> >> >> * On logical switches, look up "localnet" ports. >> >> * Look into the Gateway_Chassis table in the OVN northbound database, >> >> and how to set these up on logical router ports. >> >> >> >> You can get more information in the ovn-nb manpage for both of these >> >> topics. >> >> >> > >> > Thanks for all answers! >> > >> >> ___ >> discuss mailing list >> disc...@openvswitch.org >> https://mail.openvswitch.org/mailman/listinfo/ovs-discuss -- Vasiliy Tolstov, e-mail: v.tols...@selfip.ru ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss