[Lustre-discuss] Lustre newbie

2012-06-28 Thread Jason Brooks
Hello, I am totally new to lustre. I have inherited a couple of clusters which have a lustre filesystem mounted on each node via infiniband. one cluster has 56 nodes on it, the other has about 18. There are 6 lustre servers, five of which are ost's and the sixth is the ost. I have a problem

[Lustre-discuss] Lustre with ubuntu 12.04 lts?

2012-08-14 Thread Jason Brooks
question: will the lustre kernel modules load in kernel 3.x? --jason Jason Brooks 971-238-3924 brook...@ohsu.edu<mailto:brook...@ohsu.edu> Oregon Health Sciences University Center for Spoken Language Understanding ___ Lustre-discuss mailing list

[Lustre-discuss] Interoperable issues between 1.8.6 and 2.1

2012-08-22 Thread Jason Brooks
? There's already > 16 terabytes in place... --jason Jason Brooks 971-238-3924 brook...@ohsu.edu<mailto:brook...@ohsu.edu> Oregon Health Sciences University Center for Spoken Language Understanding ___ Lustre-discuss mailing list

Re: [Lustre-discuss] Interoperable issues between 1.8.6 and 2.1

2012-08-22 Thread Jason Brooks
Hello, Thanks for your reply! When you refer to ia64, are you referring to the itanium systems? --jason On Aug 22, 2012, at 6:00 PM, Ken Hornstein wrote: >> I am not finding where it says explicitly that a lustre client running >> 1.8 will successfully be able to read and write to a set o

Re: [Lustre-discuss] 答复: Interoperable issues between 1.8.6 and 2.1

2012-08-23 Thread Jason Brooks
2.1.2 2.1.2 OK > -邮件原件- > 发件人: lustre-discuss-boun...@lists.lustre.org > [mailto:lustre-discuss-boun...@lists.lustre.org] 代表 Ken Hornstein > 发送时间: 2012年8月23日 9:00 > 收件人: Jason Brooks > 抄送: lustre-discuss@lists.lustre.org > 主题: Re: [Lustre-discuss]

[Lustre-discuss] mds backup question

2012-09-19 Thread Jason Brooks
converting bits to ascii data, the amount of space used will increase. The question though is "how much"? It doesn't seem reasonable for the bits to inflate THAT much. --jason Jason Brooks 971-238-3924 brook...@ohsu.edu<mailto:brook...@ohsu.edu> Oregon Health Sciences Univers

Re: [Lustre-discuss] mds backup question

2012-09-19 Thread Jason Brooks
Hello, Now that the getfattr operation is done, here are the specs: the mds filesystem (mounted as type ldiskfs) has 7.7 gigabytes in use. however, the getfattr operation produced an ascii file that is 20 gigabytes in size. is this reasonable? On Sep 19, 2012, at 10:06 AM, Jason Brooks

[Lustre-discuss] lfs_migrate question

2012-10-18 Thread Jason Brooks
Hi, I suffered an oss crash where my oss server had a cpu fault. I have it running again, but I am trying to decommission it. I am migrating the data off of it onto other ost's using the lfs find command with lfs_migrate. It's been nearly 36 hours and about 2 terabytes have been moved. This

[Lustre-discuss] gnu tar usage

2012-10-31 Thread Jason Brooks
Hello, I am using lustre 1.8.6, on a centos 5.5 system. The installed version of tar (gnu, 1.15.1) is out of the centos RPM. The man page claims that use of the —xattrs commandline option will get all of the filesystem's extended attributes. My question: will it get the extended attributes of

Re: [Lustre-discuss] gnu tar usage

2012-11-03 Thread Jason Brooks
Thank you Andreas, I really appreciate you answering my question. --jason On Oct 31, 2012, at 8:23 PM, Dilger, Andreas wrote: > On Oct 31, 2012, at 10:55 AM, Jason Brooks wrote: >> Hello, >> >> I am using lustre 1.8.6, on a centos 5.5 system. >> >>

Re: [Lustre-discuss] Applications of Lustre - streaming?

2012-12-07 Thread Jason Brooks
Hello, The question of hdfs storage via lustre has been in the foreground of my thinking. the hadoop hdfs processes are not aware of block devices: they only know of a filesystem mount point to begin storing data in hdfs. THUS… If we provide a filesystem interface (say a lustre mount point) w

Re: [Lustre-discuss] Applications of Lustre - streaming?

2012-12-07 Thread Jason Brooks
I have used fuse for other filesystems: its great if all you need is access to the data, but the performance is HORRIBLE. --jason From: Jon Yeargers mailto:yearg...@ohsu.edu>> Date: Friday, December 7, 2012 9:42 AM To: Jason Brooks mailto:brook...@ohsu.edu>>, "lustre-discuss

Re: [Lustre-discuss] Applications of Lustre - streaming?

2012-12-07 Thread Jason Brooks
It is the question of how to handle redundancy that stops me from immediately testing this idea of mine. Well, that and time, werewithal, etc... Hadoop is great because it uses the speed and latency of local disks to work with data, and does not require systems be homogeneous. With the data repl

[Lustre-discuss] Restoration of mds is of a different size!

2012-12-18 Thread Jason Brooks
Hello, I am currently using lustre 1.8. I am relatively new with lustre. At the moment, I am trying to move an mds/mgs system from one disk to another. I used the version of tar modified by whamcloud in order to dump and restore the filesytem. I used mkfs.lustre to create a new mds/mgs files

[Lustre-discuss] How smart is Lustre?

2012-12-19 Thread Jason Brooks
Hello, I am building a 2.3.x filesystem right now, and I am looking at setting up some active-active failover abilities to my oss's. I have been looking at Dell's md3xxx arrays, as they have redundant controllers, and allow up to four hosts to connect to each controller. I can see how linux m

Re: [Lustre-discuss] How smart is Lustre?

2012-12-27 Thread Jason Brooks
lled. Simply disable the > multipathing daemon or configure it to ignore the disk arrays and use the > vendor solution. I had no more I/O errors(Which only served to slow down the > boot up process). > > > On Wed, Dec 19, 2012 at 11:36 AM, Jason Brooks wrote: > Hello, > &

[Lustre-discuss] problem with installing lustre and ofed

2012-12-28 Thread Jason Brooks
Hello, I am having trouble installing the server modules for lustre 2.1.4 and use mellanox's OFED distribution so we may use infiniband. Would you folks look at my procedure and results below and let me know what you think? Thanks very much! The mellanox ofed installation builds and install

Re: [Lustre-discuss] problem with installing lustre and ofed

2012-12-28 Thread Jason Brooks
;--- >Jeff Johnson >Co-Founder >Aeon Computing > >jeff.john...@aeoncomputing.com >www.aeoncomputing.com >t: 858-412-3810 x101 f: 858-412-3845 > >4170 Morena Boulevard, Suite D - San Diego, CA 92117 > >/* Follow us on Twitter - @AeonComputing