Each of the 24 servers have to be listening on different ports, which
should be reflected in the server config file. Example:
<Aliases>
Alias tweeks1 tcp://tweeks:3334
Alias tweeks2 tcp://tweeks:3335
</Aliases>
<ServerOptions>
Server tweeks1
DataStorageSpace /orangefs/install/storage/data/3334
MetadataStorageSpace /orangefs/install/storage/meta/3334
LogFile /orangefs/install/orangefs-server-3334.log
</ServerOptions>
<ServerOptions>
Server tweeks2
DataStorageSpace /orangefs/install/storage/data/3335
MetadataStorageSpace /orangefs/install/storage/meta/3335
LogFile /orangefsinstall/orangefs-server-3335.log
</ServerOptions>
You will also have to have 24 handle ranges for metadata and 24 handle
ranges for data, if you want all 24 servers to function as both metadata
and data servers. Example:
<MetaHandleRanges>
Range tweeks1 3-2305843009213693953
Range tweeks2 2305843009213693954-4611686018427387904
</MetaHandleRanges>
<DataHandleRanges>
Range tweeks1 4611686018427387905-6917529027641081855
Range tweeks2 6917529027641081856-9223372036854775806
</DataHandleRanges>
If you use pvfs2-genconfig to generate the initial config file, you can
easily setup these ranges by telling the config script all the nodes you
will be using. You will have to modify the config file to add the
ServerOptions blocks.
Becky
On Thu, Feb 18, 2016 at 5:43 PM, Chen, Hsing Bung <[email protected]> wrote:
>
> I saw this from
>
>
> http://www.orangefs.org/documentation/releases/current/doc/pvfs2-faq/pvfs2-faq.php#SECTION00043000000000000000
> ==========================================================
> 3.3 How can I run multiple PVFS servers on the same node?
>
> If you do decide to run more than one PVFS server on the same node,
> setting things up is as simple as setting up servers on different nodes.
> Each will need its own entry in the list of Aliases and its own
> server-specific configuration file, as described in the Quick Start (
> http://www.pvfs.org/pvfs2/pvfs2-quickstart.html).
>
>
> ======================================================================================
>
>
> I tried to do this.
>
>
>
> I have 24 SSDs on a stoage server. I create xfs on each SSD and bring
> them up and mount at
>
> /mnt/ssd001
>
> /mnt/ssd002
>
>
> ....................
>
> /mnt/ssd024
>
>
>
> Can I create and install 24 Orangefs servers on the same storage server
> (Single host with IB/QDR connection) ?
>
>
> + Configure each orangefs server using one /mnt/ssd00X for data
> and meta
>
> + launch 24 orangefs servers on a single host
>
> + mount 24 IB://host......
>
>
> + expect to see 24 orangefs mount through IB interface
>
>
>
>
> ib://hbcogfs001:3335/orangefs 201326592 11018240 190308352
> 6% /mnt/orangefs001 --> using /mnt/ssd001
>
> ib://hbcogfs001:3335/orangefs 201326592 11018240 190308352
> 6% /mnt/orangefs002 --> using /mnt/ssd002
>
> ................................
>
> ib://hbcogfs001:3335/orangefs 201326592 11018240 190308352
> 6% /mnt/orangefs024 --> using /mnt/ssd024
>
>
>
> Is this setup and configuration possible?
>
> This "3.3" section is from pvfs2-faq. I didn't see the same setup
> information from 2.9.3 release.
>
> Thanks.
>
>
> HB
>
> 2/18/2016
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> _______________________________________________
> Pvfs2-users mailing list
> [email protected]
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>
>
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
