Re: Access Linux Files From CMS
On Oct 15, 2009, at 3:30 PM, "Schuh, Richard" mailto:rsc...@visa.com>> wrote: Not the primary purpose; nowhere near it, in fact. For the number and size of files you mentioned, it's probably not worth bothering, but for larger files, you might consider a separate virtual interface for NFS traffic. That would let you tune for that without impacting normal interactive traffic.
Re: Access Linux Files From CMS
Not the primary purpose; nowhere near it, in fact. Regards, Richard Schuh > -Original Message- > From: The IBM z/VM Operating System > [mailto:ib...@listserv.uark.edu] On Behalf Of David Boyes > Sent: Thursday, October 15, 2009 11:52 AM > To: IBMVM@LISTSERV.UARK.EDU > Subject: Re: Access Linux Files From CMS > > Although there are a number of things you can do on the Linux > side to improve the performance. The defaults shipped are > good middle-of-the-road values, but you can do a lot better > if you know the characteristics of the traffic. > > You'll also want to increase the MTU of the connection to the > Linux system if it's primarily used for this purposes. That > will help NFS clients use bigger frames. > > Miguel, is there any external knob in the VM NFS client to > adjust some of the NFS request parameters? I didn't see any > in the docs. > > == db >
Re: Access Linux Files From CMS
Although there are a number of things you can do on the Linux side to improve the performance. The defaults shipped are good middle-of-the-road values, but you can do a lot better if you know the characteristics of the traffic. You'll also want to increase the MTU of the connection to the Linux system if it's primarily used for this purposes. That will help NFS clients use bigger frames. Miguel, is there any external knob in the VM NFS client to adjust some of the NFS request parameters? I didn't see any in the docs. == db
Re: Access Linux Files From CMS
Thanks for the pointer. I'll take a look. Regards, Richard Schuh From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] On Behalf Of Kris Buelens Sent: Thursday, October 15, 2009 11:11 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Access Linux Files From CMS Once you start using BFS and NFS, have a look at my BFSLIST tool from the VM download library. It gives a FILELIST-like interface. 2009/10/15 David Boyes mailto:dbo...@sinenomine.net>> Use the CMS NFS client. Docs in the VM TCP manuals. From: The IBM z/VM Operating System [mailto:IBMVM@LISTSERV.UARK.EDU<mailto:IBMVM@LISTSERV.UARK.EDU>] On Behalf Of Schuh, Richard Sent: Thursday, October 15, 2009 11:29 AM To: IBMVM@LISTSERV.UARK.EDU<mailto:IBMVM@LISTSERV.UARK.EDU> Subject: Access Linux Files From CMS We have a need to be able to access files on a Linux system from CMS in a different LPAR. Never having done this, the specifics of how to do it are a mystery waiting to be solved. What are the steps that need be done in order to accomplish this? Is there a procedure for doing it documented somewhere, a Redbook perhaps? Any pointer to speed us on our way will be appreciated. Regards, Richard Schuh -- Kris Buelens, IBM Belgium, VM customer support
Re: Access Linux Files From CMS
Thanks for the tip. What we are talking about at the current time is 100-200 small files (KB, not GB or even MB) per week, so performance will probably not be a factor. If it is necessary to do any bulk transfers, we will probably use VMFTP. Regards, Richard Schuh > -Original Message- > From: The IBM z/VM Operating System > [mailto:ib...@listserv.uark.edu] On Behalf Of Richard Troth > Sent: Thursday, October 15, 2009 11:01 AM > To: IBMVM@LISTSERV.UARK.EDU > Subject: Re: Access Linux Files From CMS > > Agreed. > And it's not just a BFS or OpenVM thing, it is the nature of > NFS: not best for bulk transfer. > > For bulk transfer, you can use FTP (pleh!) directly to/from > CMS or you can rsync or scp with a Linux guest which plays > PUN/RDR with CMS land. > > -- R; <>< > > > > > > On Thu, Oct 15, 2009 at 12:56, Gentry, Stephen > wrote: > > I'd like to mention a caveat. It's been my experience that NFS and > > BFS aren't the fast thing running. It's ok for small files but for > > big files, like 2 or 3 gig and above, it is painfully slow. > > We looked at off loading some file backup processing from our open > > systems to VM and copying the files from the open system > servers to VM > > took a long time. Even with some tuning, things didn't get > much better. > > We scrapped the idea. > > Steve > > > > > > -Original Message- > > From: The IBM z/VM Operating System > [mailto:ib...@listserv.uark.edu] > > On Behalf Of Richard Troth > > Sent: Thursday, October 15, 2009 12:39 PM > > To: IBMVM@LISTSERV.UARK.EDU > > Subject: Re: Access Linux Files From CMS > > > > Let me second what Dave Jones said: try the CMS NFS client. > If you're > > using CMS to manage Linux guests, it's a really handy tool. For > > example, consider that Linux is running NFS to share a directory > > called "/export/stuff". You could: > > > > openvm mount /../VMBFS:VMSYS:ROOT/ / > > openvm run /bin/mkdir -m 555 -p /import/stuff > > openvm mount /../NFS:linuxhostname/export/stuff /import/stuff > > openvm getbfs /import/stuff/the.file the file a (olddate > > > > Look into the TRANS|NOTRANS option for both 'mount' and 'getbfs'. > > Look into the LIST|NOLIST and other options for 'mount'. > > And of course the REPLACE option for 'getbfs', if needed. > > VM TCP/IP client tools disk required. > > > > The CMS NFS client requires that you have a (non-NFS) byte > filesystem > > mounted as the root. (You do not need the rest of the shell and > > utilities functioning for this example, except for the 'mkdir' > > command. You do NOT need to launch a shell.) The nature of POSIX > > mounts is that there be an empty directory already at the > point where > > you want to mount. (Thus the 'mkdir' command.) > > > > -- Rick; <>< > > > > > > > > > > > > On Thu, Oct 15, 2009 at 11:28, Schuh, Richard > wrote: > >> We have a need to be able to access files on a Linux > system from CMS > > in a > >> different LPAR. Never having done this, the specifics of > how to do it > > are a > >> mystery waiting to be solved. What are the steps that need > be done in > > order > >> to accomplish this? Is there a procedure for doing it documented > > somewhere, > >> a Redbook perhaps? Any pointer to speed us on our way will be > > appreciated. > >> > >> Regards, > >> Richard Schuh > >> > >> > >> > > >
Re: Access Linux Files From CMS
Once you start using BFS and NFS, have a look at my BFSLIST tool from the VM download library. It gives a FILELIST-like interface. 2009/10/15 David Boyes > Use the CMS NFS client. Docs in the VM TCP manuals. > > > > *From:* The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] *On > Behalf Of *Schuh, Richard > *Sent:* Thursday, October 15, 2009 11:29 AM > *To:* IBMVM@LISTSERV.UARK.EDU > *Subject:* Access Linux Files From CMS > > > > We have a need to be able to access files on a Linux system from CMS in a > different LPAR. Never having done this, the specifics of how to do it are a > mystery waiting to be solved. What are the steps that need be done in order > to accomplish this? Is there a procedure for doing it documented somewhere, > a Redbook perhaps? Any pointer to speed us on our way will be appreciated. > > > > Regards, > Richard Schuh > > > > > > > -- Kris Buelens, IBM Belgium, VM customer support
Re: Access Linux Files From CMS
Agreed. And it's not just a BFS or OpenVM thing, it is the nature of NFS: not best for bulk transfer. For bulk transfer, you can use FTP (pleh!) directly to/from CMS or you can rsync or scp with a Linux guest which plays PUN/RDR with CMS land. -- R; <>< On Thu, Oct 15, 2009 at 12:56, Gentry, Stephen wrote: > I'd like to mention a caveat. It's been my experience that NFS and BFS > aren't the fast thing running. It's ok for small files but for big > files, like 2 or 3 gig and above, it is painfully slow. > We looked at off loading some file backup processing from our open > systems to VM and copying the files from the open system servers to VM > took a long time. Even with some tuning, things didn't get much better. > We scrapped the idea. > Steve > > > -Original Message- > From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] On > Behalf Of Richard Troth > Sent: Thursday, October 15, 2009 12:39 PM > To: IBMVM@LISTSERV.UARK.EDU > Subject: Re: Access Linux Files From CMS > > Let me second what Dave Jones said: try the CMS NFS client. If you're > using CMS to manage Linux guests, it's a really handy tool. For > example, consider that Linux is running NFS to share a directory > called "/export/stuff". You could: > > openvm mount /../VMBFS:VMSYS:ROOT/ / > openvm run /bin/mkdir -m 555 -p /import/stuff > openvm mount /../NFS:linuxhostname/export/stuff /import/stuff > openvm getbfs /import/stuff/the.file the file a (olddate > > Look into the TRANS|NOTRANS option for both 'mount' and 'getbfs'. > Look into the LIST|NOLIST and other options for 'mount'. > And of course the REPLACE option for 'getbfs', if needed. > VM TCP/IP client tools disk required. > > The CMS NFS client requires that you have a (non-NFS) byte filesystem > mounted as the root. (You do not need the rest of the shell and > utilities functioning for this example, except for the 'mkdir' > command. You do NOT need to launch a shell.) The nature of POSIX > mounts is that there be an empty directory already at the point where > you want to mount. (Thus the 'mkdir' command.) > > -- Rick; <>< > > > > > > On Thu, Oct 15, 2009 at 11:28, Schuh, Richard wrote: >> We have a need to be able to access files on a Linux system from CMS > in a >> different LPAR. Never having done this, the specifics of how to do it > are a >> mystery waiting to be solved. What are the steps that need be done in > order >> to accomplish this? Is there a procedure for doing it documented > somewhere, >> a Redbook perhaps? Any pointer to speed us on our way will be > appreciated. >> >> Regards, >> Richard Schuh >> >> >> >
Re: Access Linux Files From CMS
I'd like to mention a caveat. It's been my experience that NFS and BFS aren't the fast thing running. It's ok for small files but for big files, like 2 or 3 gig and above, it is painfully slow. We looked at off loading some file backup processing from our open systems to VM and copying the files from the open system servers to VM took a long time. Even with some tuning, things didn't get much better. We scrapped the idea. Steve -Original Message- From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] On Behalf Of Richard Troth Sent: Thursday, October 15, 2009 12:39 PM To: IBMVM@LISTSERV.UARK.EDU Subject: Re: Access Linux Files From CMS Let me second what Dave Jones said: try the CMS NFS client. If you're using CMS to manage Linux guests, it's a really handy tool. For example, consider that Linux is running NFS to share a directory called "/export/stuff". You could: openvm mount /../VMBFS:VMSYS:ROOT/ / openvm run /bin/mkdir -m 555 -p /import/stuff openvm mount /../NFS:linuxhostname/export/stuff /import/stuff openvm getbfs /import/stuff/the.file the file a (olddate Look into the TRANS|NOTRANS option for both 'mount' and 'getbfs'. Look into the LIST|NOLIST and other options for 'mount'. And of course the REPLACE option for 'getbfs', if needed. VM TCP/IP client tools disk required. The CMS NFS client requires that you have a (non-NFS) byte filesystem mounted as the root. (You do not need the rest of the shell and utilities functioning for this example, except for the 'mkdir' command. You do NOT need to launch a shell.) The nature of POSIX mounts is that there be an empty directory already at the point where you want to mount. (Thus the 'mkdir' command.) -- Rick; <>< On Thu, Oct 15, 2009 at 11:28, Schuh, Richard wrote: > We have a need to be able to access files on a Linux system from CMS in a > different LPAR. Never having done this, the specifics of how to do it are a > mystery waiting to be solved. What are the steps that need be done in order > to accomplish this? Is there a procedure for doing it documented somewhere, > a Redbook perhaps? Any pointer to speed us on our way will be appreciated. > > Regards, > Richard Schuh > > >
Re: Access Linux Files From CMS
Use the CMS NFS client. Docs in the VM TCP manuals. From: The IBM z/VM Operating System [mailto:ib...@listserv.uark.edu] On Behalf Of Schuh, Richard Sent: Thursday, October 15, 2009 11:29 AM To: IBMVM@LISTSERV.UARK.EDU Subject: Access Linux Files From CMS We have a need to be able to access files on a Linux system from CMS in a different LPAR. Never having done this, the specifics of how to do it are a mystery waiting to be solved. What are the steps that need be done in order to accomplish this? Is there a procedure for doing it documented somewhere, a Redbook perhaps? Any pointer to speed us on our way will be appreciated. Regards, Richard Schuh
Re: Access Linux Files From CMS
Give it at least a meg. The directories will take some tiny amount of space. Really, there's no reason to NOT install the shell and utilities, though you can get by without them if all you're running now is the CMS NFS client. (You would not have the 'mkdir' command, but you could still 'openvm cre dir' to create the mountpoint directory.) -- R; <>< On Thu, Oct 15, 2009 at 13:01, Schuh, Richard wrote: > Since this is simply to read files, is it necessary to give the BFS filespace > any space, or can it be enrolled with BLKS 0? > > Regards, > Richard Schuh > > > >> -Original Message- >> From: The IBM z/VM Operating System >> [mailto:ib...@listserv.uark.edu] On Behalf Of Richard Troth >> Sent: Thursday, October 15, 2009 9:39 AM >> To: IBMVM@LISTSERV.UARK.EDU >> Subject: Re: Access Linux Files From CMS >> >> Let me second what Dave Jones said: try the CMS NFS client. >> If you're using CMS to manage Linux guests, it's a really >> handy tool. For example, consider that Linux is running NFS >> to share a directory called "/export/stuff". You could: >> >> openvm mount /../VMBFS:VMSYS:ROOT/ / >> openvm run /bin/mkdir -m 555 -p /import/stuff >> openvm mount /../NFS:linuxhostname/export/stuff /import/stuff >> openvm getbfs /import/stuff/the.file the file a (olddate >> >> Look into the TRANS|NOTRANS option for both 'mount' and 'getbfs'. >> Look into the LIST|NOLIST and other options for 'mount'. >> And of course the REPLACE option for 'getbfs', if needed. >> VM TCP/IP client tools disk required. >> >> The CMS NFS client requires that you have a (non-NFS) byte >> filesystem mounted as the root. (You do not need the rest of >> the shell and utilities functioning for this example, except >> for the 'mkdir' >> command. You do NOT need to launch a shell.) The nature of >> POSIX mounts is that there be an empty directory already at >> the point where you want to mount. (Thus the 'mkdir' command.) >> >> -- Rick; <>< >> >> >> >> >> >> On Thu, Oct 15, 2009 at 11:28, Schuh, Richard wrote: >> > We have a need to be able to access files on a Linux system >> from CMS >> > in a different LPAR. Never having done this, the specifics >> of how to >> > do it are a mystery waiting to be solved. What are the >> steps that need >> > be done in order to accomplish this? Is there a procedure >> for doing it >> > documented somewhere, a Redbook perhaps? Any pointer to >> speed us on our way will be appreciated. >> > >> > Regards, >> > Richard Schuh >> > >> > >> > >>
Re: Access Linux Files From CMS
Since this is simply to read files, is it necessary to give the BFS filespace any space, or can it be enrolled with BLKS 0? Regards, Richard Schuh > -Original Message- > From: The IBM z/VM Operating System > [mailto:ib...@listserv.uark.edu] On Behalf Of Richard Troth > Sent: Thursday, October 15, 2009 9:39 AM > To: IBMVM@LISTSERV.UARK.EDU > Subject: Re: Access Linux Files From CMS > > Let me second what Dave Jones said: try the CMS NFS client. > If you're using CMS to manage Linux guests, it's a really > handy tool. For example, consider that Linux is running NFS > to share a directory called "/export/stuff". You could: > > openvm mount /../VMBFS:VMSYS:ROOT/ / > openvm run /bin/mkdir -m 555 -p /import/stuff > openvm mount /../NFS:linuxhostname/export/stuff /import/stuff > openvm getbfs /import/stuff/the.file the file a (olddate > > Look into the TRANS|NOTRANS option for both 'mount' and 'getbfs'. > Look into the LIST|NOLIST and other options for 'mount'. > And of course the REPLACE option for 'getbfs', if needed. > VM TCP/IP client tools disk required. > > The CMS NFS client requires that you have a (non-NFS) byte > filesystem mounted as the root. (You do not need the rest of > the shell and utilities functioning for this example, except > for the 'mkdir' > command. You do NOT need to launch a shell.) The nature of > POSIX mounts is that there be an empty directory already at > the point where you want to mount. (Thus the 'mkdir' command.) > > -- Rick; <>< > > > > > > On Thu, Oct 15, 2009 at 11:28, Schuh, Richard wrote: > > We have a need to be able to access files on a Linux system > from CMS > > in a different LPAR. Never having done this, the specifics > of how to > > do it are a mystery waiting to be solved. What are the > steps that need > > be done in order to accomplish this? Is there a procedure > for doing it > > documented somewhere, a Redbook perhaps? Any pointer to > speed us on our way will be appreciated. > > > > Regards, > > Richard Schuh > > > > > > >
Re: Access Linux Files From CMS
Let me second what Dave Jones said: try the CMS NFS client. If you're using CMS to manage Linux guests, it's a really handy tool. For example, consider that Linux is running NFS to share a directory called "/export/stuff". You could: openvm mount /../VMBFS:VMSYS:ROOT/ / openvm run /bin/mkdir -m 555 -p /import/stuff openvm mount /../NFS:linuxhostname/export/stuff /import/stuff openvm getbfs /import/stuff/the.file the file a (olddate Look into the TRANS|NOTRANS option for both 'mount' and 'getbfs'. Look into the LIST|NOLIST and other options for 'mount'. And of course the REPLACE option for 'getbfs', if needed. VM TCP/IP client tools disk required. The CMS NFS client requires that you have a (non-NFS) byte filesystem mounted as the root. (You do not need the rest of the shell and utilities functioning for this example, except for the 'mkdir' command. You do NOT need to launch a shell.) The nature of POSIX mounts is that there be an empty directory already at the point where you want to mount. (Thus the 'mkdir' command.) -- Rick; <>< On Thu, Oct 15, 2009 at 11:28, Schuh, Richard wrote: > We have a need to be able to access files on a Linux system from CMS in a > different LPAR. Never having done this, the specifics of how to do it are a > mystery waiting to be solved. What are the steps that need be done in order > to accomplish this? Is there a procedure for doing it documented somewhere, > a Redbook perhaps? Any pointer to speed us on our way will be appreciated. > > Regards, > Richard Schuh > > >
Re: Access Linux Files From CMS
It might, I will have to check with the people needing the access and those protecting the Linux data. Write access is not desirable. I presume that this is easily controlled on the Linux side using permissions. Regards, Richard Schuh > -Original Message- > From: The IBM z/VM Operating System > [mailto:ib...@listserv.uark.edu] On Behalf Of Dave Jones > Sent: Thursday, October 15, 2009 8:34 AM > To: IBMVM@LISTSERV.UARK.EDU > Subject: Re: Access Linux Files From CMS > > Hi, Richard. > > I believe the approach I would take would be to start an NFS > server on the Linux side and use CMS's NFS client to access > the Linux files.both read and write access are supported. > > Does that meet your needs? > > Schuh, Richard wrote: > > > > We have a need to be able to access files on a Linux system > from CMS > > in a different LPAR. Never having done this, the specifics > of how to > > do it are a mystery waiting to be solved. What are the > steps that need > > be done in order to accomplish this? Is there a procedure > for doing it > > documented somewhere, a Redbook perhaps? Any pointer to speed us on > > our way will be appreciated. > > > > Regards, > > Richard Schuh > > > > > > > > -- > Dave Jones > V/Soft > www.vsoft-software.com > Houston, TX > 281.578.7544 >
Re: Access Linux Files From CMS
The dasd is not shared. Regards, Richard Schuh > -Original Message- > From: The IBM z/VM Operating System > [mailto:ib...@listserv.uark.edu] On Behalf Of Thomas Kern > Sent: Thursday, October 15, 2009 8:39 AM > To: IBMVM@LISTSERV.UARK.EDU > Subject: Re: Access Linux Files From CMS > > If you have access to the drives from your z/VM LPAR, there > is a package from Sine Nomine called E2CMD (?) that lets you > manipulate EXT2 filesyste= ms. > The current exec (E2SH) needs the disk to be in read/write > mode, but I th= ink that could be fixed so that you could use > the disk in read-only mode. > > /Tom Kern > /301-903-2211 > > > On Thu, 15 Oct 2009 08:28:45 -0700, Schuh, Richard > wrot= > e: > > >We have a need to be able to access files on a Linux system > from CMS in > >= > a > different LPAR. Never having done this, the specifics of how > to do it are= a mystery waiting to be solved. What are the > steps that need be done in ord= er to accomplish this? Is > there a procedure for doing it documented somewher= e, a > Redbook perhaps? Any pointer to speed us on our way will be > appreciated= . > > > > > >Regards, > >Richard Schuh >
Re: Access Linux Files From CMS
Hi, Richard. I believe the approach I would take would be to start an NFS server on the Linux side and use CMS's NFS client to access the Linux files.both read and write access are supported. Does that meet your needs? Schuh, Richard wrote: We have a need to be able to access files on a Linux system from CMS in a different LPAR. Never having done this, the specifics of how to do it are a mystery waiting to be solved. What are the steps that need be done in order to accomplish this? Is there a procedure for doing it documented somewhere, a Redbook perhaps? Any pointer to speed us on our way will be appreciated. Regards, Richard Schuh -- Dave Jones V/Soft www.vsoft-software.com Houston, TX 281.578.7544
Re: Access Linux Files From CMS
If you have access to the drives from your z/VM LPAR, there is a package from Sine Nomine called E2CMD (?) that lets you manipulate EXT2 filesyste ms. The current exec (E2SH) needs the disk to be in read/write mode, but I th ink that could be fixed so that you could use the disk in read-only mode. /Tom Kern /301-903-2211 On Thu, 15 Oct 2009 08:28:45 -0700, Schuh, Richard wrot e: >We have a need to be able to access files on a Linux system from CMS in a different LPAR. Never having done this, the specifics of how to do it are a mystery waiting to be solved. What are the steps that need be done in ord er to accomplish this? Is there a procedure for doing it documented somewher e, a Redbook perhaps? Any pointer to speed us on our way will be appreciated . > > >Regards, >Richard Schuh