Re: [Numpy-discussion] the build and installation process

2011-08-26 Thread Ralf Gommers
On Thu, Aug 25, 2011 at 2:23 PM, srean wrote: > Hi, > > I would like to know a bit about how the installation process works. Could > you point me to a resource. In particular I want to know how the site.cfg > configuration works. Is it numpy/scipy specific or is it standard with > distutils. I g

Re: [Numpy-discussion] How to output array with indexes to a text file?

2011-08-26 Thread Brett Olsen
On Thu, Aug 25, 2011 at 2:10 PM, Paul Menzel wrote: > is there an easy way to also save the indexes of an array (columns, rows > or both) when outputting it to a text file. For saving an array to a > file I only found `savetxt()` [1] which does not seem to have such an > option. Adding indexes man

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread josef . pktd
On Fri, Aug 26, 2011 at 2:57 PM, Charles R Harris wrote: > > > On Fri, Aug 26, 2011 at 12:38 PM, Mark Janikas wrote: >> >> Charles!  That looks like it could be a winner!  It looks like you always >> choose the last column of the U matrix and ID the columns that have the same >> values?  It works

Re: [Numpy-discussion] NA mask C-API documentation

2011-08-26 Thread Mark Wiebe
On Fri, Aug 26, 2011 at 11:47 AM, Christopher Jordan-Squire wrote: > Regarding ufuncs and NA's, all the mechanics of handling NA from a > ufunc are in the PyUFunc_FromFuncAndData function, right? So the ufunc > creation docs don't have to be updated to include NA's? > That's correct, any ufunc w

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread Charles R Harris
On Fri, Aug 26, 2011 at 12:38 PM, Mark Janikas wrote: > Charles! That looks like it could be a winner! It looks like you always > choose the last column of the U matrix and ID the columns that have the same > values? It works when I add extra columns as well! BTW, sorry for my lack > of knowl

Re: [Numpy-discussion] NA mask C-API documentation

2011-08-26 Thread Christopher Jordan-Squire
Regarding ufuncs and NA's, all the mechanics of handling NA from a ufunc are in the PyUFunc_FromFuncAndData function, right? So the ufunc creation docs don't have to be updated to include NA's? -Chris JS On Wed, Aug 24, 2011 at 7:08 PM, Mark Wiebe wrote: > I've added C-API documentation to the m

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread Mark Janikas
Charles! That looks like it could be a winner! It looks like you always choose the last column of the U matrix and ID the columns that have the same values? It works when I add extra columns as well! BTW, sorry for my lack of knowledge... but what was the point of the dot multiply at the end

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread josef . pktd
On Fri, Aug 26, 2011 at 1:41 PM, Mark Janikas wrote: > I wonder if my last statement is essentially the only answer... which I > wanted to avoid... > > Should I just use combinations of the columns and try and construct the > corrcoef() (then ID whether NaNs are present), or use the condition nu

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread Charles R Harris
On Fri, Aug 26, 2011 at 11:41 AM, Mark Janikas wrote: > I wonder if my last statement is essentially the only answer... which I > wanted to avoid... > > Should I just use combinations of the columns and try and construct the > corrcoef() (then ID whether NaNs are present), or use the condition nu

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread Fernando Perez
On Fri, Aug 26, 2011 at 7:41 PM, Mark Janikas wrote: > I wonder if my last statement is essentially the only answer... which I > wanted to avoid... > > Should I just use combinations of the columns and try and construct the > corrcoef() (then ID whether NaNs are present), or use the condition nu

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread Mark Janikas
I wonder if my last statement is essentially the only answer... which I wanted to avoid... Should I just use combinations of the columns and try and construct the corrcoef() (then ID whether NaNs are present), or use the condition number to ID the singularity? I just wanted to avoid the whole

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread Mark Janikas
I actually use the VIF when the design matrix can be inverted I do it the quick and dirty way as opposed to the step regression: 1. Calc the correlation coefficient of the matrix (w/o the intercept) 2. Return the diagonal of the inversion of the correlation matrix in step 1. Again, the probl

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread Skipper Seabold
On Fri, Aug 26, 2011 at 1:10 PM, Mark Janikas wrote: > Hello All, > > > > I am trying to identify columns of a matrix that are perfectly collinear. > It is not that difficult to identify when two columns are identical are have > zero variance, but I do not know how to ID when the culprit is of a h

Re: [Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread Mark Janikas
As you will note, since most of the functions work on rows, the matrix in question has been transposed. From: numpy-discussion-boun...@scipy.org [mailto:numpy-discussion-boun...@scipy.org] On Behalf Of Mark Janikas Sent: Friday, August 26, 2011 10:11 AM To: 'Discussion of Numerical Python' Subje

[Numpy-discussion] Identifying Colinear Columns of a Matrix

2011-08-26 Thread Mark Janikas
Hello All, I am trying to identify columns of a matrix that are perfectly collinear. It is not that difficult to identify when two columns are identical are have zero variance, but I do not know how to ID when the culprit is of a higher order. i.e. columns 1 + 2 + 3 = column 4. NUM.corrcoef(m

Re: [Numpy-discussion] saving groups of numpy arrays to disk

2011-08-26 Thread Robert Kern
On Fri, Aug 26, 2011 at 07:04, Derek Homeier wrote: > On 25.08.2011, at 8:42PM, Chris.Barker wrote: > >> On 8/24/11 9:22 AM, Anthony Scopatz wrote: >>>    You can use Python pickling, if you do *not* have a requirement for: >> >> I can't recall why, but it seem pickling of numpy arrays has been >>

Re: [Numpy-discussion] saving groups of numpy arrays to disk

2011-08-26 Thread Chris.Barker
On 8/26/11 5:04 AM, Derek Homeier wrote: > Hmm, the pure Python version might be, but, I've used cPickle for a long time > and never noted any stability problems. well, here is the NEP: https://github.com/numpy/numpy/blob/master/doc/neps/npy-format.txt It addresses the why's and hows of the for

[Numpy-discussion] array_equal and array_equiv comparison functions for structured arrays

2011-08-26 Thread Derek Homeier
Hi, as the subject says, the array_* comparison functions currently do not operate on structured/record arrays. Pull request https://github.com/numpy/numpy/pull/146 implements these comparisons. There are two commits, differing in their interpretation whether two arrays with different field na

Re: [Numpy-discussion] saving groups of numpy arrays to disk

2011-08-26 Thread Derek Homeier
On 25.08.2011, at 8:42PM, Chris.Barker wrote: > On 8/24/11 9:22 AM, Anthony Scopatz wrote: >>You can use Python pickling, if you do *not* have a requirement for: > > I can't recall why, but it seem pickling of numpy arrays has been > fragile and not very performant. > Hmm, the pure Python v

Re: [Numpy-discussion] saving groups of numpy arrays to disk

2011-08-26 Thread Paul Anton Letnes
On 25. aug. 2011, at 23.49, David Warde-Farley wrote: > On 2011-08-25, at 2:42 PM, Chris.Barker wrote: > >> On 8/24/11 9:22 AM, Anthony Scopatz wrote: >>> You can use Python pickling, if you do *not* have a requirement for: >> >> I can't recall why, but it seem pickling of numpy arrays has be