Re: Add a remote disk to LVM

2014-05-07 Thread Mahmood Naderan 
>Hmmm, yes, it is possible, using iSCSI.
OK I will try that. Thanks


 
Regards,
Mahmood



On Wednesday, May 7, 2014 6:38 PM, Lamar Owen  wrote:
On 05/07/2014 01:12 AM, Mahmood Naderan wrote:

> Is it possible to add a network drive to existing LVM? I have created 
> a group and have added three local drives. Now I want to add a remote 
> disk from another node. The remote node has an additional hard drive 
> and is mounted to /arch (remote node)
>
> Is that possible? How? All examples I see are trying to add extra 
> local drives and not remote drives.
>
Hmmm, yes, it is possible, using iSCSI.

In order to do this correctly you would want the machine, that has the 
additional drives, set up to be an iSCSI target, and then use the iSCSI 
initiator on the first machine to attach to the disks; you can then add 
those iSCSI disks to the volume group.  I would use dedicated Gigabit 
Ethernet NICs and point-to-point connections rather than trying to use 
the existing ethernet ports, too.  Oh, and you wouldn't have it mounted 
on the second machine as such.

No, I can't give you a step-by-step, you'll have to do a bit of research 
and you really really need to read up on and understand what iSCSI 
brings to the party.  I have an IA-64 box (SGI Altix) running CentOS 5.9 
(my own hand-rebuild, bootstrapped up from SL CERN 5.4 IA-64) using an 
EMC Clariion array's LUNs over iSCSI, so I have a bit of experience with 
the initiator portion of the equation, but none at all with the target 
portion, but I know that it does exist.

RE: mirror.anl.gov: softwarecollections python2.7 numpy install issue

2014-05-07 Thread peter.chiu 
Hello Elias,

I have not tried the scl command with quotes as you suggested.

In the meantime, by looking into the site:
https://pypi.python.org/simple/pip/,  I managed to down load the pip tar file:

https://pypi.python.org/packages/source/p/pip/pip-1.5.5.tar.gz#md5=7520581ba0687dec1ce85bd15496
 37b

By untarring it, cd and invoke

/opt/rh/python27/root/usr/bin/python2.7 setup.py install

it did generate the pip and pip2 binaries into 

/opt/rh/python27/root/usr/bin.

Using your earlier  suggestions,
/opt/rh/python27/root/usr/bin/pip2.7 install numpy
/opt/rh/python27/root/usr/bin/pip2.7 install scipy
/opt/rh/python27/root/usr/bin/pip2.7 install matplotlib

are completed, though with lots of warnings which I don't understand.

The ssl issue remains, but at least I can move on to install the next package 
data Access library DAL.

Many thanks again.

Regards,
Peter

-Original Message-
From: Elias Persson [mailto:delre...@takeit.se] 
Sent: 07 May 2014 14:39
To: scientific-linux-users@fnal.gov
Subject: Re: mirror.anl.gov: softwarecollections python2.7 numpy install issue

On 2014-05-07 15:18, peter.c...@stfc.ac.uk wrote:
> Thanks, Elias, for your reply.
>
> # scl enable python27 easy_install numpy Unable to open 
> /etc/scl/prefixes/easy_install!
>
> Is it expecting easy_install under /etc/scl/prefixes?
>

No, it's expecting the command to be quoted, which I had missed.

scl enable python27 'easy_install numpy'

You can enable multiple things at once, so with the unquoted cmd it thinks 
easy_install is another thing to be enabled.

Still, that doesn't seem to be related to the problems you're having.
--
Scanned by iCritical.

Re: Add a remote disk to LVM

2014-05-07 Thread Lamar Owen 

On 05/07/2014 01:12 AM, Mahmood Naderan wrote:
Is it possible to add a network drive to existing LVM? I have created 
a group and have added three local drives. Now I want to add a remote 
disk from another node. The remote node has an additional hard drive 
and is mounted to /arch (remote node)


Is that possible? How? All examples I see are trying to add extra 
local drives and not remote drives.



Hmmm, yes, it is possible, using iSCSI.

In order to do this correctly you would want the machine, that has the 
additional drives, set up to be an iSCSI target, and then use the iSCSI 
initiator on the first machine to attach to the disks; you can then add 
those iSCSI disks to the volume group.  I would use dedicated Gigabit 
Ethernet NICs and point-to-point connections rather than trying to use 
the existing ethernet ports, too.  Oh, and you wouldn't have it mounted 
on the second machine as such.


No, I can't give you a step-by-step, you'll have to do a bit of research 
and you really really need to read up on and understand what iSCSI 
brings to the party.  I have an IA-64 box (SGI Altix) running CentOS 5.9 
(my own hand-rebuild, bootstrapped up from SL CERN 5.4 IA-64) using an 
EMC Clariion array's LUNs over iSCSI, so I have a bit of experience with 
the initiator portion of the equation, but none at all with the target 
portion, but I know that it does exist.

Re: mirror.anl.gov: softwarecollections python2.7 numpy install issue

2014-05-07 Thread Elias Persson 

On 2014-05-07 15:18, peter.c...@stfc.ac.uk wrote:

Thanks, Elias, for your reply.

# scl enable python27 easy_install numpy
Unable to open /etc/scl/prefixes/easy_install!

Is it expecting easy_install under /etc/scl/prefixes?



No, it's expecting the command to be quoted, which I had missed.

   scl enable python27 'easy_install numpy'

You can enable multiple things at once, so with the unquoted cmd
it thinks easy_install is another thing to be enabled.

Still, that doesn't seem to be related to the problems you're
having.

RE: mirror.anl.gov: softwarecollections python2.7 numpy install issue

2014-05-07 Thread peter.chiu 
Thanks, Elias, for your reply.

# scl enable python27 easy_install numpy
Unable to open /etc/scl/prefixes/easy_install!

Is it expecting easy_install under /etc/scl/prefixes?

easy_install and easy_install-2.7 are placed under

#ls /opt/rh/python27/root/usr/bin
2to3  pybabel   python2.7 rst2odt smtpd.py
easy_install  pydoc python2.7-config  rst2odt_prepstyles  
sphinx-apidoc
easy_install-2.7  pygettext.py  python2-configrst2pseudoxml   
sphinx-autogen
...


I have also tried:
# scl enable python27 bash
# easy_install pip
Searching for pip
Reading https://pypi.python.org/simple/pip/
Download error on https://pypi.python.org/simple/pip/: [Errno 1] _ssl.c:504: 
error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol -- Some 
packages may not be found!
Reading https://pypi.python.org/simple/pip/
Download error on https://pypi.python.org/simple/pip/: [Errno 1] _ssl.c:504: 
error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol -- Some 
packages may not be found!
Couldn't find index page for 'pip' (maybe misspelled?)
Scanning index of all packages (this may take a while)
Reading https://pypi.python.org/simple/
Download error on https://pypi.python.org/simple/: [Errno 1] _ssl.c:504: 
error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol -- Some 
packages may not be found!
No local packages or download links found for pip
error: Could not find suitable distribution for Requirement.parse('pip')

So still no joy...

Regards,
Peter

-Original Message-
From: Elias Persson [mailto:delre...@takeit.se] 
Sent: 07 May 2014 14:04
To: scientific-linux-users@fnal.gov
Subject: Re: mirror.anl.gov: softwarecollections python2.7 numpy install issue

On 2014-05-07 13:15, peter.c...@stfc.ac.uk wrote:
> Hello,
>
> Having installed the Python2.7 through the repository:
>
> yum-conf-softwarecollections
>
> as suggested in
>
> http://mirror.anl.gov/pub/scientific-linux/6.5/x86_64/external_product
> s/softwarecollections/README
>
> I am then trying to install numpy, pip, scipy, matplotlib etc but they 
> return with these errors:
>
> # /opt/rh/python27/root/usr/bin/easy_install-2.7 numpy
>

Possibly not related to your issues, but the recommended / expected way to use 
the scl stuff is via `scl enable  `.
In your example:

$ scl enable python27 easy_install numpy

or

$ scl enable python27 bash
$ easy_install pip
$ pip install numpy scipy ...
--
Scanned by iCritical.

Re: src.rpm of sl-release-6.5-1

2014-05-07 Thread Arnau Bria 
On Wed, 7 May 2014 07:27:19 -0400
Nico Kadel-Garcia wrote:

> I see it at
> http://ftp1.scientificlinux.org/linux/scientific/6.5/SRPMS/vendor/
thanks a lot!

Arnau

Re: mirror.anl.gov: softwarecollections python2.7 numpy install issue

2014-05-07 Thread Elias Persson 

On 2014-05-07 13:15, peter.c...@stfc.ac.uk wrote:

Hello,

Having installed the Python2.7 through the repository:

yum-conf-softwarecollections

as suggested in

http://mirror.anl.gov/pub/scientific-linux/6.5/x86_64/external_products/softwarecollections/README

I am then trying to install numpy, pip, scipy, matplotlib etc but they
return with these errors:

# /opt/rh/python27/root/usr/bin/easy_install-2.7 numpy



Possibly not related to your issues, but the recommended / expected
way to use the scl stuff is via `scl enable  `.
In your example:

   $ scl enable python27 easy_install numpy

or

   $ scl enable python27 bash
   $ easy_install pip
   $ pip install numpy scipy ...

Re: Add a remote disk to LVM

2014-05-07 Thread David Sommerseth 
On 07/05/14 09:13, Mahmood Naderan wrote:
> No it is not shared via NFS (do we have to first share it?)
> Problem is, there is no free slot for disks in our machine (say N1).
> However another node (say N2 which is running scientific linux
> independently) has free slots. So I added the physical disks to N2. the
> disk has been formatted and it has a mount point on N2.
> 
> Now I want to add N2:/dev/sdb to N1:/dev/tigerfiler1/tigervolume
> Can you please guide step by step?


Not testet, but this is the theory behind it.  I take not responsibility
in potential data loss.


I have no idea how N2:/dev/sdb differs from N1:/dev/sdb.  You need
access to a device file with your new harddrive.  I'm using /dev/sde
here in the example, to cover the LVM basics:

# Make the new drive a LVM physical volume
pvcreate /dev/sde

# Extend the tigerfiler1 volume group with the new drive
vgextend tigerfiler1 /dev/sde

Now you can use

fsadm resize -l /dev/tigerfiler1/tigervolume $NEWSIZE

That's the LVM theory.

What is confusing here is: "So I added the physical disks to N2. the
disk has been formatted and it has a mount point on N2." ... You cannot
use mountpoints for LVM physical volumes.  If you need to do this over a
network, you need to configure iSCSI, which will give you another
/dev/sdX device when properly setup.  This /dev/sdX device can then be
used as an LVM physical volume.

If considering iSCSI (you need tgtd on the iSCSI "server" (target) and
iscsi-utils on the "client" (initiator)), I would strongly recommend
using a separate network interface for the iSCSI traffic - preferably
back-to-back, to not get too bad network performance.

--
kind regards,

David Sommerseth



> 
> 
> *From: *"Mahmood Naderan" 
> *To: *scientific-linux-users@fnal.gov
> *Sent: *Wednesday, May 7, 2014 1:12:41 AM
> *Subject: *Add a remote disk to LVM
> 
> 
> 
> Hello,
> Is it possible to add a network drive to existing LVM? I have
> created a group and have added three local drives. Now I want to add
> a remote disk from another node. The remote node has an additional
> hard drive and is mounted to /arch (remote node)
> 
> Is that possible? How? All examples I see are trying to add extra
> local drives and not remote drives.
> 
> Here are some info
> 
> # vgdisplay
>   --- Volume group ---
>   VG Name   tigerfiler1
>   System ID
>   Formatlvm2
>   Metadata Areas3
>   Metadata Sequence No  2
>   VG Access read/write
>   VG Status resizable
>   MAX LV0
>   Cur LV1
>   Open LV   1
>   Max PV0
>   Cur PV3
>   Act PV3
>   VG Size   2.73 TiB
>   PE Size   4.00 MiB
>   Total PE  715401
>   Alloc PE / Size   715401 / 2.73 TiB
>   Free  PE / Size   0 / 0
>   VG UUID   8Ef8Vj-bDc7-H4ia-D3X4-cDpY-kE9Z-njc8lj
> 
> 
> 
> pvdisplay
>   --- Physical volume ---
>   PV Name   /dev/sdb
>   VG Name   tigerfiler1
>   PV Size   931.51 GiB / not usable 1.71 MiB
>   Allocatable   yes (but full)
>   PE Size   4.00 MiB
>   Total PE  238467
>   Free PE   0
>   Allocated PE  238467
>   PV UUID   FmC77z-9UaR-FhYa-ONHZ-EazF-5Hm2-8zmUuj
> 
>   --- Physical volume ---
>   PV Name   /dev/sdc
>   VG Name   tigerfiler1
>   PV Size   931.51 GiB / not usable 1.71 MiB
>   Allocatable   yes (but full)
>   PE Size   4.00 MiB
>   Total PE  238467
>   Free PE   0
>   Allocated PE  238467
>   PV UUID   1jBQUn-gkkD-37I3-R3nL-KeHA-Hn2A-4zgNcR
> 
>   --- Physical volume ---
>   PV Name   /dev/sdd
>   VG Name   tigerfiler1
>   PV Size   931.51 GiB / not usable 1.71 MiB
>   Allocatable   yes (but full)
>   PE Size   4.00 MiB
>   Total PE  238467
>   Free PE   0
>   Allocated PE  238467
>   PV UUID   mxi8jW-O868-iPse-IfY7-ag3m-R3vZ-gS3Jdx
>  
> 
>  
>  
> Regards,
> Mahmood
> 
> 
> 
>

Re: src.rpm of sl-release-6.5-1

2014-05-07 Thread Nico Kadel-Garcia 
On Wed, May 7, 2014 at 6:49 AM, Arnau Bria  wrote:
> Hello,
>
>> sl-release-6.5-1.x86_64
>
> isn't the source of the above package available?
>
> I only see sl-release-6.5-0.rolling.src.rpm at
> http://ftp1.scientificlinux.org/linux/scientific/6.5/SRPMS/sl6/

I see it at http://ftp1.scientificlinux.org/linux/scientific/6.5/SRPMS/vendor/

Re: local replicas of SL65 repos

2014-05-07 Thread Nico Kadel-Garcia 
On Wed, May 7, 2014 at 6:30 AM, Arnau Bria  wrote:
> On Tue, 6 May 2014 10:23:27 -0400
> Nico Kadel-Garcia wrote:
>
>> Don't use repo sync: use rsync of an upstream server, which can
>> handle sym links and hard links •much• more efficiently.
>>
>> Yum and repo sync are grossly inefficient because of the size of the
>> repo data, compressed tables
>
> Sorry Nico, but I did not understand your answer.
> I use mrepo for replicating SL repos (that uses lftp).
>
> Cheers,
> Arnau

Ahh.  mrepo seems interesting. And *heh*: I remember when rewriting
the CD image merging tools for CentOS and fixing some ".discinfo"
bugs, and sending a copy to our favorite upstream vendor, Funny how
our favorite upstream vendor came out with DVD images very shortly
after that. Looks like mrepo does a lot of that work, I'll have to
remember it. Thanks!

There is a tool called "reposync" for mirroring upstream yum
repositories. It also works with Red Hat's DRM controlled binary
repositories, and with other external repositories that don't allow
filesystem browseability, so I assumed that was what was being
discussed. It does not provide byte-for-byte syncing of the "repodata"
directory of the upstream repository. Instead, the yum client on your
local system is polling that data, and it's pretty inefficient because
*yum* is pretty inefficient.

lftp is better than reposync, I admit. But 'lftp', using HTTP based
access, can't replicate symlinks (which depend on viewability of the
repository). Even FTP based access won't automatically bring over the
hardlinks. And if you're mirroring both the i386 and x86_64
directories, a *lot* of the files are shared between them, and are
hardlinked in the Scientific Linux upstream repositories. They use
"rsync".

And rsync allows for some very useful options, such as using a very
sophisticated "excludes" file, or the ability to tie it to the
"rsnapshot" command which has lockfiles and provides a *staged*
transfer, one that can be activated locally in well defined time
increments rather than changing the contents of  your local mirror
while the transfer is going on.

Good tools, I've used all those others for repository mirroring. What
I've personally rejected, with a vengeance, is spacewalk. and the
upstream commercial version, Red Hat Network. It might have gotten
better, haven't had a chance to play with it in about 8 years.

Re: aufs rpm

2014-05-07 Thread David Sommerseth 
On 07/05/14 13:12, n.chandra sekhar wrote:
> Hi
> 
> I am using scientific Linux 6 of kernel version is
> 2.6.32-358.11.1.e16.x86_64 , so can body suggest where i can i get the
> aufs rpm for this kernel version or if anyone knows please provide the
> downlaod link

Please see the response you already got here:



--
kind regards,

David Sommerseth

mirror.anl.gov: softwarecollections python2.7 numpy install issue

2014-05-07 Thread peter.chiu 
Hello,

Having installed the Python2.7 through the repository:

yum-conf-softwarecollections

as suggested in

http://mirror.anl.gov/pub/scientific-linux/6.5/x86_64/external_products/softwarecollections/README

I am then trying to install numpy, pip, scipy, matplotlib etc but they return 
with these errors:

# /opt/rh/python27/root/usr/bin/easy_install-2.7 numpy
Searching for numpy
Reading https://pypi.python.org/simple/numpy/
Download error on https://pypi.python.org/simple/numpy/: [Errno 1] _ssl.c:504: 
error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol -- Some 
packages may not be found!
Reading https://pypi.python.org/simple/numpy/
Download error on https://pypi.python.org/simple/numpy/: [Errno 1] _ssl.c:504: 
error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol -- Some 
packages may not be found!
Couldn't find index page for 'numpy' (maybe misspelled?)
Scanning index of all packages (this may take a while)
Reading https://pypi.python.org/simple/
Download error on https://pypi.python.org/simple/: [Errno 1] _ssl.c:504: 
error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol -- Some 
packages may not be found!
No local packages or download links found for numpy
error: Could not find suitable distribution for Requirement.parse('numpy')

Similar errors are returned with easy_install rather than easy_install-2.7.

Any idea what is missing here?

Many thanks.

Regards,

Peter Chiu

STFC Rutherford Appleton Laboratory
RAL Space Department
Building R25, Room 2.02
Harwell Oxford
Didcot
OXON
OX11 0QX
UK

-- 
Scanned by iCritical.

aufs rpm

2014-05-07 Thread n . chandra sekhar 
Hi

I am using scientific Linux 6 of kernel version is
2.6.32-358.11.1.e16.x86_64 , so can body suggest where i can i get the aufs
rpm for this kernel version or if anyone knows please provide the downlaod
link

Thanks & Regards

Sekhar Nalluri

src.rpm of sl-release-6.5-1

2014-05-07 Thread Arnau Bria 
Hello,

> sl-release-6.5-1.x86_64

isn't the source of the above package available?

I only see sl-release-6.5-0.rolling.src.rpm at
http://ftp1.scientificlinux.org/linux/scientific/6.5/SRPMS/sl6/

TIA,
Arnau

Re: local replicas of SL65 repos

2014-05-07 Thread Arnau Bria 
On Tue, 6 May 2014 10:23:27 -0400
Nico Kadel-Garcia wrote:

> Don't use repo sync: use rsync of an upstream server, which can
> handle sym links and hard links •much• more efficiently.
> 
> Yum and repo sync are grossly inefficient because of the size of the
> repo data, compressed tables

Sorry Nico, but I did not understand your answer.
I use mrepo for replicating SL repos (that uses lftp).

Cheers,
Arnau

Re: Add a remote disk to LVM

2014-05-07 Thread Mahmood Naderan 
No it is not shared via NFS (do we have to first share it?)
Problem is, there is no free slot for disks in our machine (say N1). However 
another node (say N2 which is running scientific linux independently) has free 
slots. So I added the physical disks to N2. the disk has been formatted and it 
has a mount point on N2.

Now I want to add N2:/dev/sdb to N1:/dev/tigerfiler1/tigervolume
Can you please guide step by step?

 
Regards,
Mahmood
On Wednesday, May 7, 2014 10:00 AM, John Lauro  
wrote:
 
What type of remote disk?   NFS?

A more common case would be to move some directories to /arch and use sym links.
You could create a loopback diskfile somewhere on /arch and add that to LVM.  
It's going to make bootup messy, so you wouldn't want any volumes on it that 
are required for bootup (especially / or /usr or /sbin, and probably not /var) 
...



From: "Mahmood Naderan" 
>To: scientific-linux-users@fnal.gov
>Sent: Wednesday, May 7, 2014 1:12:41 AM
>Subject: Add a remote disk to LVM
>
>
>
>
>
>Hello,
>Is it possible to add a network
 drive to existing LVM? I have created a group and have added three 
local drives. Now I want to add a remote disk from another node. The 
remote node has an additional hard drive and is mounted to /arch (remote
 node)
>
>Is that possible? How? All examples I see are trying to add extra local drives 
>and not remote drives.
>
>Here are some info
>
># vgdisplay
>  --- Volume group ---
>  VG Name   tigerfiler1
>  System ID
> 
 Format    lvm2
>  Metadata Areas    3
>  Metadata Sequence No  2
>  VG Access read/write
>  VG Status resizable
>  MAX LV    0
>  Cur LV    1
>  Open LV   1
>  Max
 PV    0
>  Cur PV    3
>  Act PV    3
>  VG Size   2.73 TiB
>  PE Size   4.00 MiB
>  Total PE  715401
>  Alloc PE / Size   715401 / 2.73 TiB
>  Free  PE / Size   0 / 0
>  VG
 UUID   8Ef8Vj-bDc7-H4ia-D3X4-cDpY-kE9Z-njc8lj
>
>
>
>pvdisplay
>  --- Physical volume ---
>  PV Name   /dev/sdb
>  VG Name   tigerfiler1
>  PV Size   931.51 GiB / not usable 1.71 MiB
>  Allocatable   yes (but full)
>  PE Size   4.00 MiB
> 
 Total PE  238467
>  Free PE   0
>  Allocated PE  238467
>  PV UUID   FmC77z-9UaR-FhYa-ONHZ-EazF-5Hm2-8zmUuj
>
>  --- Physical volume ---
>  PV Name   /dev/sdc
>  VG Name   tigerfiler1
>  PV Size   931.51 GiB / not usable 1.71 MiB
>  Allocatable   yes (but full)
>  PE Size   4.00 MiB
>  Total PE  238467
>  Free PE   0
>  Allocated PE  238467
>  PV UUID   1jBQUn-gkkD-37I3-R3nL-KeHA-Hn2A-4zgNcR
>
>  --- Physical volume ---
>  PV Name   /dev/sdd
>  VG Name   tigerfiler1
>  PV Size   931.51 GiB / not usable 1.71 MiB
>  Allocatable   yes (but full)
>  PE Size   4.00 MiB
>  Total PE  238467
>  Free PE   0
>  Allocated PE  238467
>  PV
 UUID   mxi8jW-O868-iPse-IfY7-ag3m-R3vZ-gS3Jdx
>
> 
>
>
> 
> 
>Regards,
>Mahmood