Re: [Lustre-discuss] lustre + debian
them up. You are now ready to use Lustre Debian style. If deploying this on a cluster, just install your ready made .debs for the kernel and modules. None of this was explained in the README in /usr/share/doc/Lustre so we had to figure it out ourselves. Hopefully the Debian folks have fixed that. Could you please have a look on our Readme.Debian. I've attached the current version of this README. My install (from lenny packages) is conspicuously missing both README.Debian and the 'lmc' tool da6:~# dpkg -l | grep lustre ii liblustre 1.6.4.3-1 ii linux-headers-2.6.18-lustre-1.6.5.1 20080818 ii linux-image-2.6.18-lustre-1.6.5.1 20080818 ii linux-patch-lustre1.6.4.3-1 ii lustre-source 1.6.4.3-1 ii lustre-tests 1.6.4.3-1 ii lustre-utils 1.6.4.3-1 ii openafs-modules-2.6.18-lustre-1.6.5.1 1.4.7.dfsg1-3~bpo40+1+20080818 What am I missing? ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] lustre + debian
On Aug 20, 2008 17:40 -0500, Troy Benjegerdes wrote: them up. You are now ready to use Lustre Debian style. If deploying this on a cluster, just install your ready made .debs for the kernel and modules. None of this was explained in the README in /usr/share/doc/Lustre so we had to figure it out ourselves. Hopefully the Debian folks have fixed that. Could you please have a look on our Readme.Debian. I've attached the current version of this README. My install (from lenny packages) is conspicuously missing both README.Debian and the 'lmc' tool lmc is only for Lustre 1.4 configuration. da6:~# dpkg -l | grep lustre ii liblustre 1.6.4.3-1 ii linux-headers-2.6.18-lustre-1.6.5.1 20080818 ii linux-image-2.6.18-lustre-1.6.5.1 20080818 ii linux-patch-lustre1.6.4.3-1 ii lustre-source 1.6.4.3-1 ii lustre-tests 1.6.4.3-1 ii lustre-utils 1.6.4.3-1 ii openafs-modules-2.6.18-lustre-1.6.5.1 1.4.7.dfsg1-3~bpo40+1+20080818 What am I missing? ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss Cheers, Andreas -- Andreas Dilger Sr. Staff Engineer, Lustre Group Sun Microsystems of Canada, Inc. ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] lustre + debian
I was wondering what kernel works.. it looks like you are using 2.6.18, correct? What needs to happen to get 2.6.25 to work? I'd really like to have lustre and PVFS coexist on the same box. On Fri, Aug 15, 2008 at 02:33:40PM -0700, David Brown wrote: On Fri, Aug 15, 2008 at 9:48 AM, Robert LeBlanc [EMAIL PROTECTED] wrote: You should be able to use official Debian mirrors, that is all that we used, you don't have to build your own packages from scratch either as the packages are already in Lenny. Just apt-get the packages that he built: lustre-utils#Userspace lustre util lustre-dev #Development headers lustre-source #Source for the kernel module lustre-tests#Test suite linux-patch-lustre #Patch for the linux kernel. And the kernel-source and just skip down to where he builds his kernel. Robert Just thought I'd mention the package repository that I maintain as well for debian/ubuntu lustre packages http://www.pdsi-scidac.org/repository/debian http://www.pdsi-scidac.org/repository/ubuntu I rebuild the latest packages from debian and build them for all distributions (except for ubuntu/intrepid and debian/experimental) of debian and ubuntu. If you don't want to build everything on your own using mine is what its there for. Thanks, - David Brown On 8/15/08 10:38 AM, Troy Benjegerdes [EMAIL PROTECTED] wrote: I'm about to try this, and figured it would be worth documenting on the wiki.. http://wiki.lustre.org/index.php?title=Debian_Install so far the only issue is debian.internal.sanger.ac.uk is not visible to us outsiders ;) -- Robert LeBlanc Life Sciences Computer Support Brigham Young University [EMAIL PROTECTED] (801)422-1882 ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss -- -- Troy Benjegerdes'da hozer'[EMAIL PROTECTED] Somone asked me why I work on this free (http://www.gnu.org/philosophy/) software stuff and not get a real job. Charles Shultz had the best answer: Why do musicians compose symphonies and poets write poems? They do it because life wouldn't have any meaning for them if they didn't. That's why I draw cartoons. It's my life. -- Charles Shultz ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] lustre + debian
On Mon, Aug 18, 2008 at 09:21:16AM -0700, David Brown wrote: Lustre developers only support vanilla 2.6.22.x ish (iirc). I don't think they've tried pushing forward the support to newer vanilla kernels. I think its about time for them to push forward their support for newer kernels. I'm sure the lustre package maintainers for debian would appreciate the effort. They do have patch sets for 2.6.23 but I'm unsure how stable they really are. Does anyone know the last time the Lustre kernel patches had some review on the linux kernel mailing list? I know there are some politics and egos involved, but generally the resulting code reviews and flames result in better code. ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] lustre + debian
Troy Benjegerdes wrote: I'm about to try this, and figured it would be worth documenting on the wiki.. http://wiki.lustre.org/index.php?title=Debian_Install so far the only issue is debian.internal.sanger.ac.uk is not visible to us outsiders ;) Oops! That is our internal debian mirror; just substitute your nearest repository. Cheers, Guy -- Dr. Guy Coates, Informatics System Group The Wellcome Trust Sanger Institute, Hinxton, Cambridge, CB10 1HH, UK Tel: +44 (0)1223 834244 x 6925 Fax: +44 (0)1223 496802 -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] lustre + debian
I've just gone through the exercise of recompiling the lenny packages on etch; it worked like a charm. This is the procedure I used. Hope it helps. *Pre-requisites Any debian machine can be used to build the packages. It does not have to be a lustre client or server. *Install build essentials Install the packages required to build debs. (build-essential, module-assistant etc) *Get Source Ensure sources.list contains the following lines: deb http://debian.internal.sanger.ac.uk/debian/ etch main non-free contrib deb-src http://debian.internal.sanger.ac.uk/debian/ lenny main contrib non-free *Download the source with: #aptitude update #apt-get source linux-image-2.6.18-X-686 #apt-get source lustre This will unpack two directories, one with the lustre source and one with the kernel source. *Build lustre userspace Change to the lustre directory. #cd lustre-X.X.X #dpkg-buildpackage -r fakeroot If the build fails with automake errors you will need to install a later automake version. (debian/etch provides several to choose from.) This will build the following packages: lustre-utils#Userspace lustre util lustre-dev #Development headers lustre-source #Source for the kernel module lustre-tests#Test suite linux-patch-lustre #Patch for the linux kernel. Install the lustre-source and linux-patch-lustre packages on the build machine. These packages contain the patches to the kernel source tree that are used in the next step of the build. #dpkg -i linux-patch-lustre_XXX.deb #dpkg -i lustre-source_XXX.deb *Build lustre patched kernel #cd linux-2.6- We need to grab the .config file for the debian kernel. We should be able to generate the config from the source package, but I'm not sure how. The easiest way to get the correct config is to copy /boot/config-X.X.X from a machine already running the debian kernel. #cp /boot/config-2.6.XXX-686 .config Check the kernel config works: (This might generate 1 or 2 minor questions. Just hit m or y.) #make oldconfig We can now build the kernel. #export CONCURRENCY_LEVEL=3 #make-kpkg clean #make-kpkg --rootcmd fakeroot --added-patches=lustre \ --initrd --append-to-version -lustre-1.6.5.1 --revision=mmdd kernel_image (You might be asked about extra scsi statistics options; selecting Y is probably a good idea) You should now have a kernel-image deb. *Build lustre kernel modules The lustre kernel modules can now be built. #module-assistant -u/your/working/directory -k /path/to/the/kernel/linux-2.6-X.X build lustre After the build has finished you should now have a lustre-modules.deb *Install To install lustre on a client or server machine, simply install the packages you have created: linux-image-2.6.XX-lustre-X.X.X._XX.deb lustre-modules-2.6.XX-lustre-X.X.X._XX.deb lustre-utils_X.X.deb liblustre-X-X.deb lustre-dev-X.X.deb The test suite is optional. For configuration of networks and timeout options in /etc/modprobe.d/lustre see the lustre manual. *Extras not currently packaged Lustre uses a special version of e2fsprogs. These allow you to specify the disk raid geometry at filesystem creation time to optimise performance. It also has extra options to support the lfsck lustre filesystem consistency check. Debian upstream have said they will package this in the future. In the meantime, you will have to build it yourself. Note that the modified program is only required on OST and MDS machines. *Get the e2fsprogs source Get the latest sun patch tarball: http://downloads.lustre.org/public/tools/e2fsprogs/latest/ eg e2fsprogs-1.40.11-sun1-patches.tar.gz You will also need the upstream source (in this case e2fsprogs 1.40.11). This can be found http://downloads.lustre.org/public/tools/e2fsprogs/upstream/ *Patch the source tar -xvf e2fsprogs 1.40.11.tar.gz tar -xvf e2fsprogs-1.40.11-sun1-patches.tar.gz Patch the source with quilt. #cd e2fsprogs 1.40.11 #ln -s -f ../patches . #ln -s -f ../patches/series . #quilt push -av *Build the source Note that the ext2fs-dev, libsqlite3-dev, sqlite3 and libdb4.3-dev headers and libraries must be installed before building. (Note that libdb4.4 does not work, but the code will compile OK !?) #./configure --with-lustre=/path/to/lustre/source #make #make install -- Dr. Guy Coates, Informatics System Group The Wellcome Trust Sanger Institute, Hinxton, Cambridge, CB10 1HH, UK Tel: +44 (0)1223 834244 x 6925 Fax: +44 (0)1223 496802 -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] lustre + debian
You should be able to use official Debian mirrors, that is all that we used, you don't have to build your own packages from scratch either as the packages are already in Lenny. Just apt-get the packages that he built: lustre-utils#Userspace lustre util lustre-dev #Development headers lustre-source #Source for the kernel module lustre-tests#Test suite linux-patch-lustre #Patch for the linux kernel. And the kernel-source and just skip down to where he builds his kernel. Robert On 8/15/08 10:38 AM, Troy Benjegerdes [EMAIL PROTECTED] wrote: I'm about to try this, and figured it would be worth documenting on the wiki.. http://wiki.lustre.org/index.php?title=Debian_Install so far the only issue is debian.internal.sanger.ac.uk is not visible to us outsiders ;) -- Robert LeBlanc Life Sciences Computer Support Brigham Young University [EMAIL PROTECTED] (801)422-1882 ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] lustre + debian
On Fri, Aug 15, 2008 at 9:48 AM, Robert LeBlanc [EMAIL PROTECTED] wrote: You should be able to use official Debian mirrors, that is all that we used, you don't have to build your own packages from scratch either as the packages are already in Lenny. Just apt-get the packages that he built: lustre-utils#Userspace lustre util lustre-dev #Development headers lustre-source #Source for the kernel module lustre-tests#Test suite linux-patch-lustre #Patch for the linux kernel. And the kernel-source and just skip down to where he builds his kernel. Robert Just thought I'd mention the package repository that I maintain as well for debian/ubuntu lustre packages http://www.pdsi-scidac.org/repository/debian http://www.pdsi-scidac.org/repository/ubuntu I rebuild the latest packages from debian and build them for all distributions (except for ubuntu/intrepid and debian/experimental) of debian and ubuntu. If you don't want to build everything on your own using mine is what its there for. Thanks, - David Brown On 8/15/08 10:38 AM, Troy Benjegerdes [EMAIL PROTECTED] wrote: I'm about to try this, and figured it would be worth documenting on the wiki.. http://wiki.lustre.org/index.php?title=Debian_Install so far the only issue is debian.internal.sanger.ac.uk is not visible to us outsiders ;) -- Robert LeBlanc Life Sciences Computer Support Brigham Young University [EMAIL PROTECTED] (801)422-1882 ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] lustre + debian
Hello, On Thursday 14 August 2008 18:57:52 Robert LeBlanc wrote: It's easy and then it's not. The Debian way is to download the Lustre kernel packages and the Lustre binary packages. You build a kernel using make-kpkg the --with-patches Lustre option, we found a bug when trying to use the --append_to_kernel option so unless that got fixed, don't use it, Thanks for this informations, I'll have a look on it. them up. You are now ready to use Lustre Debian style. If deploying this on a cluster, just install your ready made .debs for the kernel and modules. None of this was explained in the README in /usr/share/doc/Lustre so we had to figure it out ourselves. Hopefully the Debian folks have fixed that. Could you please have a look on our Readme.Debian. I've attached the current version of this README. Do not use a vanilla kernel from kernel.org, only use the kernel source from the Debian repository as the Lustre kernel packages are tested against them. Vanilla kernels should be supported.. We've only packaged the upstream patches and modified them a bit for the debian kernels. So vanilla kernels should work as usual. Greetings Patrick Winnertz ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
Re: [Lustre-discuss] lustre + debian
On 8/14/08 12:51 PM, Patrick Winnertz [EMAIL PROTECTED] wrote: Hello, On Thursday 14 August 2008 18:57:52 Robert LeBlanc wrote: It's easy and then it's not. The Debian way is to download the Lustre kernel packages and the Lustre binary packages. You build a kernel using make-kpkg the --with-patches Lustre option, we found a bug when trying to use the --append_to_kernel option so unless that got fixed, don't use it, Thanks for this informations, I'll have a look on it. It was that the build script was very strict on what the kernel was named to determine what patches to apply, this was an issue with the script from Lustre. It's been almost a year since I've built Lustre, so this may have changed. them up. You are now ready to use Lustre Debian style. If deploying this on a cluster, just install your ready made .debs for the kernel and modules. None of this was explained in the README in /usr/share/doc/Lustre so we had to figure it out ourselves. Hopefully the Debian folks have fixed that. Could you please have a look on our Readme.Debian. I've attached the current version of this README. The attachment did not make it, I'm downloading the current Lenny Lustre packages to view the file. Do not use a vanilla kernel from kernel.org, only use the kernel source from the Debian repository as the Lustre kernel packages are tested against them. Vanilla kernels should be supported.. We've only packaged the upstream patches and modified them a bit for the debian kernels. So vanilla kernels should work as usual. Yes, all the vanilla patches that Lustre have are in the Debian package, the problem is that Lustre is usually behind Lenny so grabbing the newest kernel from kernel.org fails no matter what distro. What I've found about Debian is that the package team has worked hard to patch Lustre for the current kernel supported by Debian, this is usually a version or two ahead of Lustre. That is why I said not to use a vanilla kernel, your chance of an error free build is greater. -- Robert LeBlanc Life Sciences Computer Support Brigham Young University [EMAIL PROTECTED] (801)422-1882 ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
