Performance tuning advice
Hello, I'm looking for advice on how best to tune Ubuntu Server 8.0.4 for best network performance. I have a custom server application that has up to 50,000 tcp connections open at a time. The amount of data being sent is small -- on the order of a 3-4KB/min. Connections come and go at a rate of 1000/minute. Other considerations: Disk I/O is unimportant. Memory use is intensive. Any thoughts? Thanks, Marty -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam
Re: Performance tuning advice
By latency I'm assuming you mean how long packets stick around in the network stack before they are sent out. Packets are small (500bytes) and need to sent within 10ms. Thank you for the man page pointers. They will help. On Aug 7, 2008, at 3:12 PM, David Miller wrote: There's a lot of kernel tweaks that can be used to fine tune your network stack for this type of workload but you didn't mention how critical latency is to your workload. That will also need to be factored into what settings to use. Pretty much anything in /proc/sys/net/core/ and /proc/sys/net/ipv4/ can be tweaked and the settings can be made permanent using /etc/ sysctl.conf. Look for the Sysctls section in the following man pages for definitions on what each of these settings do. man 7 tcp man 7 udp man 7 socket man 7 ip -- David On Thu, Aug 7, 2008 at 5:47 PM, Martin Hess [EMAIL PROTECTED] wrote: Hello, I'm looking for advice on how best to tune Ubuntu Server 8.0.4 for best network performance. I have a custom server application that has up to 50,000 tcp connections open at a time. The amount of data being sent is small -- on the order of a 3-4KB/min. Connections come and go at a rate of 1000/minute. Other considerations: Disk I/O is unimportant. Memory use is intensive. Any thoughts? Thanks, Marty -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam
oVirt
Given that KVM is the preferred virtualization solution and that we have Virtual Machine Manager to manage a single instance, is there an chance we will be seeing oVirt anytime soon? http://ovirt.org/ From their home page: From running a few virtual machines on a single host to managing thousands of VMs over hundreds of hosts on a network, oVirt is built to make virtualization easy and expand to meet your needs. I need a way to manage many machines Amazon EC2 style and this looks like a great tool. Currently I'm writing lots of code to do the job but I would love to dump it in exchange for something like this. While I'm wishing for the moon I may as well as ask for Cobbler: http://cobbler.et.redhat.com/ It basically make PXE boot setup painless for virtualized installs of KVM etc. Both of these projects are part(?) sponsored by RedHat as an Emerging Technology Project, whatever that means. There brethren are: Augeas - A configuration editing tool and API libvirt - The open source virtualization API Cobbler - OS provisioning and profile management oVirt - Virtualization management across the data center FreeIPA - Identity, policy and audit management Virtual Machine Manager - Virtualization management from the Func - A secure, scriptable remote control framework API I believe these all part of RedHat's Linux Automation for IT https://www.redhat.com/f/pdf/LinuxAutomation_whitepaper.pdf Is someone porting these at this time? Is this on Canonical's roadmap? Should these be on Canonical's roadmap? -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam
Re: Ubuntu Server graphical interface?
Serge has pointed out what should probably be a 5th requirement. * Easy to use No point in having a GUI that is difficult to use. Windows is full of examples of such GUIs and gave GUIs a bad name. Additionally, if the tool makes it possible to manage a set of machines at the expense of managing 1 machine easily then it has failed the ease of use test. Yes. But haveing some enterprise management tool installed, to manage just a bunch of servers might also be if not rificulous, a little overkill. Lots of businesses are small companies who need to only manage a small number of servers. Small companies on low budget where one has to put up stuff in a short time frame, as one server won't serve a workgroup 200 users, but maybe 15. A per server management tool is what often is needed there. Serge Here is the requirements list so far: 1) Optional - must not be required for Ubuntu Server 2) Secure - must not have known security issues, must have good known security architecture 3) Scalable - must be able to administer sets of machines 4) Open Source 5) Easy to use - for 1 or more machines Are there any packages that can meet such requirements? -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam
Re: Ubuntu Server graphical interface?
Jonathan points out that it needs good configuration reporting capabilities: The other requirement that needs to be there is reporting ablity. One of things that Landscape is currently lacking from what I have heard. The ability to manage a large group of computers, report back on the inventory of the machine (hardware, software, users) and create custom reports for the entire enterprise. An example: Give me all of my servers that have X amount of RAM, plus available slots to put more memory in. Also once this tool is created, expand it more importanlty to my clients. So now I can have one piece of management software that I can manage my entire infrastructre across and deploy patches, install software, setup, create and deploy confirautions and report across the entire enterprise. You get that piece of software that is open source and you will find on of the critical holes. Jonathan So here are the general requirements so far: 1) Optional - must not be required for Ubuntu Server 2) Secure - must not have known security issues, must have good known security architecture 3) Scalable - must be able to administer sets of machines 4) Open Source 5) Easy to use (and setup*) - for 1 or more machines * I just added the the setup part. It seems like that is pretty important for a single machine use case. If people have to spend a lot of time just getting it working for a single machine then it isn't going to get much acceptance. And these are the major feature categories: 1) Package management 2) User management 3) Security updates 4) Repository management 5) System monitoring 7) Service management (starting/stopping/monitoring) 8) Service configuring - router - dhcp - web - dns - firewall - ids - snort - ect... 9) Change management - track changes - control changes - rollback changes 10) Configuration reporting - HW - SW - Users - Global custom reports -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam
Re: Ubuntu Server graphical interface?
I find people who think in terms of a few servers will at times find a desktop GUI compelling, but once you move to hundreds or thousands of servers the idea of connecting into a desktop GUI on each machine to administer is beyond ridiculous. I think GUIs are fine but only if they can be used control whole swaths of machines at once i.e. : * upgrade some package on some set of machines * revert to prior package on some set of machines * compare machines for installed package differences * change netfilter policies on some set of machines to refuse or allow a certain type of traffic * start/stop service on some set of machines * change config file on some set of machines * ect... The list of course is pretty much endless but you get the idea. When you have many machines it is pretty much out of the question to connect to each one and administer it individually by hand, either buy GUI or shell. I think any server GUI that is consider should be scalable. It should be able to move beyond the needs of one or 2 servers and be able to handle many servers. Proposal: I propose creating requirements for a server GUI and then see if we can find anything that meets it. So far I think I've seen the following: 1) Optional - must not be required for Ubuntu Server 2) Secure - must not have known security issues, must have good known security architecture 3) Scalable - must be able to administer sets of machines (I know there is not necessarily any consensus on this one and people might reject it as a requirement) 4) ? Shameless plug for #3: * gets xwindows off the servers which is a know security risk and resource hog * potentially can require nothing more than sshd and preshared keys on all the servers On May 3, 2008, at 9:34 AM, Leandro Pereira de Lima e Silva wrote: I'm talking about virt-install, which will open a VNC connection to the machine and only allow connections from localhost. Cheers, Leandro. 2008/5/3 Ante Karamatic [EMAIL PROTECTED]: On Sat, 3 May 2008 12:15:07 -0300 Leandro Pereira de Lima e Silva [EMAIL PROTECTED] wrote: I think that is necessary for creating virtual machines following Ubuntu Server guide, isn't it? If you are talking about virt-manager, then no. virt-manager is a tool you'll use on you workstation and manage virtual machines on a pool of ubuntu servers. -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam -- Leandro Pereira de Lima e Silva -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam
Re: Ubuntu Server graphical interface?
It looks like Landscape (http://www.canonical.com/projects/landscape) does some things, but it is missing an important requirement: * Open source It appears from the way that it is described that you need a support contract with Canonical to use it. I've never used Landscape but it appears that it covers the following areas: 1) Package management 2) User management 3) Security updates 4) Repository management 5) System monitoring 6) Integrates with Canonical support system Obvious major things missing: 7) Service management (starting/stopping/monitoring) 8) Service configuring - router - dhcp - web - dns - firewall - ids - snort - ect... 9) Change management - track changes - control changes - rollback changes 10) ? On May 3, 2008, at 3:45 PM, Leandro Pereira de Lima e Silva wrote: Agreed with you. But... isn't that Canonical Landscape? Cheers, Leandro. Em Sáb, 2008-05-03 às 15:31 -0700, Martin Hess escreveu: I find people who think in terms of a few servers will at times find a desktop GUI compelling, but once you move to hundreds or thousands of servers the idea of connecting into a desktop GUI on each machine to administer is beyond ridiculous. I think GUIs are fine but only if they can be used control whole swaths of machines at once i.e. : * upgrade some package on some set of machines * revert to prior package on some set of machines * compare machines for installed package differences * change netfilter policies on some set of machines to refuse or allow a certain type of traffic * start/stop service on some set of machines * change config file on some set of machines * ect... The list of course is pretty much endless but you get the idea. When you have many machines it is pretty much out of the question to connect to each one and administer it individually by hand, either buy GUI or shell. I think any server GUI that is consider should be scalable. It should be able to move beyond the needs of one or 2 servers and be able to handle many servers. Proposal: I propose creating requirements for a server GUI and then see if we can find anything that meets it. So far I think I've seen the following: 1) Optional - must not be required for Ubuntu Server 2) Secure - must not have known security issues, must have good known security architecture 3) Scalable - must be able to administer sets of machines (I know there is not necessarily any consensus on this one and people might reject it as a requirement) 4) ? Shameless plug for #3: * gets xwindows off the servers which is a know security risk and resource hog * potentially can require nothing more than sshd and preshared keys on all the servers On May 3, 2008, at 9:34 AM, Leandro Pereira de Lima e Silva wrote: I'm talking about virt-install, which will open a VNC connection to the machine and only allow connections from localhost. Cheers, Leandro. 2008/5/3 Ante Karamatic [EMAIL PROTECTED]: On Sat, 3 May 2008 12:15:07 -0300 Leandro Pereira de Lima e Silva [EMAIL PROTECTED] wrote: I think that is necessary for creating virtual machines following Ubuntu Server guide, isn't it? If you are talking about virt-manager, then no. virt-manager is a tool you'll use on you workstation and manage virtual machines on a pool of ubuntu servers. -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam -- Leandro Pereira de Lima e Silva -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam -- ubuntu-server mailing list ubuntu-server@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-server More info: https://wiki.ubuntu.com/ServerTeam
