Re: [Numpy-discussion] In-place operations

2006-09-13 Thread Francesc Altet 
El dt 12 de 09 del 2006 a les 13:28 -0600, en/na Travis Oliphant va
escriure:
> >[BTW, numpy.empty seems twice as slower in my machine. Why?
> >  
> >
> Timer("a=numpy.empty(1,dtype=numpy.complex128)", "import
> 
> 
> >numpy").repeat(3,1)
> >[0.37033700942993164, 0.31780219078063965, 0.31607294082641602]
> >]
> >  
> >
> Now, you are creating an empty array with 1 elements in it. 

Ups, my bad. So, here are the correct times for array creation:

>>> Timer("a=numpy.empty(10,dtype=numpy.complex128)", "import
numpy").repeat(3,1)
[0.083303928375244141, 0.080381870269775391, 0.077172040939331055]
>>> Timer("a=numpy.empty(100,dtype=numpy.complex128)", "import
numpy").repeat(3,1)
[0.086454868316650391, 0.084085941314697266, 0.083555936813354492]
>>> Timer("a=numpy.empty(1000,dtype=numpy.complex128)", "import
numpy").repeat(3,1)
[0.084996223449707031, 0.082299947738647461, 0.081347942352294922]
>>> Timer("a=numpy.empty(1,dtype=numpy.complex128)", "import
numpy").repeat(3,1)
[0.31068897247314453, 0.30376386642456055, 0.30176281929016113]
>>> Timer("a=numpy.empty(10,dtype=numpy.complex128)", "import
numpy").repeat(3,1)
[0.42552995681762695, 0.36864185333251953, 0.36870002746582031]
>>> Timer("a=numpy.empty(100,dtype=numpy.complex128)", "import
numpy").repeat(3,1)
[0.48045611381530762, 0.41251182556152344, 0.40645909309387207]

So, it seems that there are a certain time dependency with size

array of 10 elements   -->  7.7 us
array of 100 elements  -->  8.4 us
array of 1000 elements -->  8.1 us
array of 1 elements--> 30.2 us
array of 10 elements   --> 36.9 us
array of 100 elements  --> 40.6 us

Well, it seems that malloc actually takes more time when asking for more
space. However, this can't be the reason why Pierre is seeing that:

a = numpy.exp(a)  [1]

is slower than

numpy.exp(a,out=a)  [2]

as I'd say that this increment in time is negligible compared with
processing times of those big arrays. In fact, here are my times:

>>> Timer("a = numpy.exp(a)", "import numpy;a =
numpy.random.rand(2048,2048) + 1j *
numpy.random.rand(2048,2048)").repeat(3,1)
[2.5527338981628418, 2.5427830219268799, 2.5074479579925537]
>>> Timer("numpy.exp(a,out=a)", "import numpy;a =
numpy.random.rand(2048,2048) + 1j *
numpy.random.rand(2048,2048)").repeat(3,1)
[2.5298278331756592, 2.5082788467407227, 2.580025482178]

So, both times are comparable.

Perhaps what Pierre is seeing is that he is approaching the limits of
memory in his system and because [1] takes more memory than [2] (two
objects in memory instead of one) perhaps the former is causing the OS
to start swapping. However a quick look with top at the processes, says
that both [1] and [2] takes similar amounts of memory (~ 170 MB peak)
and, as arrays take 64 MB each, in both cases the used memory seems
higher than the required at first sight. Mmmm, the only explanation is
that the exp() ufunc does require temporaries, although this is a bit
strange as exp() works element wise. I recognize that I'm a bit lost
here...


-- 
>0,0<   Francesc Altet http://www.carabos.com/
V   V   Cárabos Coop. V.   Enjoy Data
 "-"



-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] In-place operations

2006-09-13 Thread Johannes Loehnert 
Hi,

one word in advance, instead of optimizing it is advisable to seek for a way 
to refactorize the algorithm using smaller arrays, since this kind of 
optimization almost certainly reduces readability. If you do it, comment 
well. ;-)

If you have very large arrays and want to do some arithmetics on it, say

B = 2*B + C

you can use inplace operators to avoid memory overhead:

B *= 2
B += C

Another trick which works in most situations is to do the outermost loop in 
python:

for i in xrange(len(B)):
B[i] = 2*B[i] + C[i]

This reduces the temporary array size to 1/len(B) while still being fast (if 
the other dimensions are large enough). For very large 1d arrays, you could 
split them into chunks of a certain size.

However, you have to be careful that your calculation does not access 
already-calculated elements of B. Consider the following example:

In [2]: B=arange(10)

In [3]: B+B[::-1]
Out[3]: array([9, 9, 9, 9, 9, 9, 9, 9, 9, 9])

In [4]: B += B[::-1]

In [5]: B
Out[5]: array([ 9,  9,  9,  9,  9, 14, 15, 16, 17, 18])


Johannes

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

[Numpy-discussion] PHAlxcRMA

2006-09-13 Thread Paxton Pereda 



Hi
 
QUIT OVE t RPA e YIN a G FOR YOU e R P o HAR z MAC j Y
 
S u AV k E u p p to 50  w % wi v th http://www.prlawoec.com-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

[Numpy-discussion] numpy-1.0b5 can't find ATLAS

2006-09-13 Thread Hanno Klemm 

Hello,

when I try to build numpy-1.0b5 it doesn't find my ATLAS libraries. 

I had to build hem from scratch (version 3.7.17) and the compile went
well. I have installed them under 

/scratch/python2.4/atlas 

furthermore, I have blas and lapack installed under 

/scatch/python2.4/lib

I adjusted the environment variables as:

BLAS=/scratch/python2.4/lib/libfblas.a
LAPACK=/scratch/python2.4/lib/libflapack.a
ATLAS=/scratch/python2.4/atlas

and my site.cfg looks like

[atlas]
library_dirs = /scratch/python2.4/atlas/lib
atlas_libs = lapack, blas, cblas, atlas
include_dirs = /scratch/python2.4/atlas/include

python setup.py config then finds the blas and lapack libraries under
/scratch/python2.4/lib but does not find the atlas libraries.

What am I doing wrong here?

Hanno

P.S.: The output of python setup.py config reads:

atlas_threads_info:
Setting PTATLAS=ATLAS
  libraries lapack,blas,cblas,atlas not found in /scratch/python2.4/atlas
  libraries lapack_atlas not found in /scratch/python2.4/atlas
  libraries lapack,blas,cblas,atlas not found in
/scratch/python2.4/atlas/include/atlas
  libraries lapack_atlas not found in
/scratch/python2.4/atlas/include/atlas
  libraries lapack,blas,cblas,atlas not found in
/scratch/python2.4/atlas/include
  libraries lapack_atlas not found in /scratch/python2.4/atlas/include
  libraries lapack,blas,cblas,atlas not found in
/scratch/python2.4/atlas/lib
  libraries lapack_atlas not found in /scratch/python2.4/atlas/lib
  libraries lapack,blas,cblas,atlas not found in /scratch/python2.4/lib
  libraries lapack_atlas not found in /scratch/python2.4/lib
  libraries lapack,blas,cblas,atlas not found in /usr/local/lib
  libraries lapack_atlas not found in /usr/local/lib
  libraries lapack,blas,cblas,atlas not found in /usr/lib
  libraries lapack_atlas not found in /usr/lib
numpy.distutils.system_info.atlas_threads_info
  NOT AVAILABLE

atlas_info:
  libraries lapack,blas,cblas,atlas not found in /scratch/python2.4/atlas
  libraries lapack_atlas not found in /scratch/python2.4/atlas
  libraries lapack,blas,cblas,atlas not found in
/scratch/python2.4/atlas/include/atlas
  libraries lapack_atlas not found in
/scratch/python2.4/atlas/include/atlas
  libraries lapack,blas,cblas,atlas not found in
/scratch/python2.4/atlas/include
  libraries lapack_atlas not found in /scratch/python2.4/atlas/include
  libraries lapack,blas,cblas,atlas not found in
/scratch/python2.4/atlas/lib
  libraries lapack_atlas not found in /scratch/python2.4/atlas/lib
  libraries lapack,blas,cblas,atlas not found in /scratch/python2.4/lib
  libraries lapack_atlas not found in /scratch/python2.4/lib
  libraries lapack,blas,cblas,atlas not found in /usr/local/lib
  libraries lapack_atlas not found in /usr/local/lib
  libraries lapack,blas,cblas,atlas not found in /usr/lib
  libraries lapack_atlas not found in /usr/lib
numpy.distutils.system_info.atlas_info
  NOT AVAILABLE

/scratch/src/numpy-1.0b5/numpy/distutils/system_info.py:1205: UserWarning:
Atlas (http://math-atlas.sourceforge.net/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [atlas]) or by setting
the ATLAS environment variable.
  warnings.warn(AtlasNotFoundError.__doc__)
lapack_info:
  FOUND:
libraries = ['lapack']
library_dirs = ['/scratch/python2.4/lib']
language = f77

  FOUND:
libraries = ['lapack', 'fblas']
library_dirs = ['/scratch/python2.4/lib']
define_macros = [('NO_ATLAS_INFO', 1)]
language = f77

running config


-- 
Hanno Klemm
[EMAIL PROTECTED]



-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

[Numpy-discussion] Avoiding array-scalar arithmetic?

2006-09-13 Thread Ryan Gutenkunst 
Hi all,

I'm migrating an application from Numeric to numpy, and I've run into a 
significant application slowdown related to arithmetic on array-scalars.

The inner loop of the application is integrating a nonlinear set of 
differential equations using odeint, with the rhs a 
dynamically-generated (only once) python function. In that function I 
copy the entries of the current x array to a bunch of local variables, 
do a bunch of arithmetic, and assign the results to a dx_dt array.

The arithmetic is approximately 3x slower using numpy than Numeric, 
because numpy returns array-scalars while Numeric returns normal 
scalars. (Simple example below.)

I can wrap all my arrays accesses with float() casts, but that 
introduces a noticable overhead (~50% for problems of interest).

I'm guessing speeding up the scalar-array math would be difficult, if 
not impossible. (Maybe I'm wrong?)

I notice that numpy_array.item() will give me the first element as a 
normal scalar. Would it be possible for numpy_array.item(N) to return 
the Nth element of the array as a normal scalar?

Thanks a bunch,
Ryan

The effect can be isolated as (running in python 2.4 on a 32-bit Athlon):
In [1]: import Numeric, numpy

In [2]: a_old, a_new = Numeric.array([1.0, 2.0]), numpy.array([1.0, 2.0])

In [3]: b_old, b_new = a_old[0], a_new[0]

In [4]: %time for ii in xrange(100):c = b_old + 1.0
CPU times: user 0.40 s, sys: 0.00 s, total: 0.40 s
Wall time: 0.40

In [5]: %time for ii in xrange(100):c = b_new + 1.0
CPU times: user 1.20 s, sys: 0.00 s, total: 1.20 s
Wall time: 1.22

In [6]: Numeric.__version__, numpy.__version__
Out[6]: ('24.2', '1.0b5')

-- 
Ryan Gutenkunst   |
Cornell LASSP |   "It is not the mountain
   |we conquer but ourselves."
Clark 535 / (607)227-7914 |-- Sir Edmund Hillary
AIM: JepettoRNG   |
  http://www.physics.cornell.edu/~rgutenkunst/

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] Avoiding array-scalar arithmetic?

2006-09-13 Thread Travis Oliphant 
Ryan Gutenkunst wrote:
> Hi all,
>
> I'm migrating an application from Numeric to numpy, and I've run into a 
> significant application slowdown related to arithmetic on array-scalars.
>
>   
Yeah,  that is a common thing.   There are two factors:  1) array 
indexing and 2) array scalar math.

I don't think array scalar math has to be slower in principle then 
Python code.   I think it's ability to handle interaction with multiple 
scalars that is operating more slowly right now.  It could be sped up.

The array indexing code is slower (in fact Numeric's indexing code is 
slower then just using lists also). 
> I'm guessing speeding up the scalar-array math would be difficult, if 
> not impossible. (Maybe I'm wrong?)
>   
I think scalar-array math could be sped up quite a bit.  I haven't done 
much in that area at all.   Right now a lot of setup code is handled 
generically instead of type-specifically like it could be.

> I notice that numpy_array.item() will give me the first element as a 
> normal scalar. Would it be possible for numpy_array.item(N) to return 
> the Nth element of the array as a normal scalar?
>   
Now this is an interesting idea.  It would allow you to by-pass the 
slow-indexing as well as the array scalar computation should you desire 
it.  I like it and am going to add it unless there are convincing 
objections.

-Travis


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

[Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend

2006-09-13 Thread Travis Oliphant 
I'd like to make the first release-candidate of NumPy 1.0 this weekend.

Any additions wanting to make the first official release candidate 
should be checked in by then.

-Travis


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend

2006-09-13 Thread Albert Strasheim 
Hello all

I just ran NumPy and SciPy through Valgrind, and everything looks clean on
that the NumPy side.

Some other things that could be fixed for RC1:

- GCC 4.1.1 warning in ufuncobject.c:

numpy/core/src/ufuncobject.c: In function âPyUFunc_RegisterLoopForTypeâ:
numpy/core/src/ufuncobject.c:3215: warning: "cmp" may be used uninitialized
in this function

- Time to kill the dft package?

/usr/lib/python2.4/site-packages/numpy/dft/__init__.py:2: UserWarning: The
dft subpackage will be removed by 1.0 final -- it is now called fft
  warnings.warn("The dft subpackage will be removed by 1.0 final -- it is
now called fft")

- Test failure

==
ERROR: check_instance_methods
(numpy.core.tests.test_defmatrix.test_matrix_return)
--
Traceback (most recent call last):
  File
"/usr/lib/python2.4/site-packages/numpy/core/tests/test_defmatrix.py", line
166, in check_instance_methods
b = f(*args)
ValueError: setitem must have at least one argument

Although not strictly NumPy issues, the following crops up when you run the
SciPy test suite through Valgrind:

Valgrind warnings when running
scipy.integrate.tests.test_integrate.test_odeint
http://projects.scipy.org/scipy/scipy/ticket/246

Valgrind warnings when running Cephes tests
http://projects.scipy.org/scipy/scipy/ticket/247

Memory leak in fitpack
http://projects.scipy.org/scipy/scipy/ticket/248

I think I've figured out #248. #246 should be relatively easy to fix. #247
is... interesting.

Regards,

Albert

> -Original Message-
> From: [EMAIL PROTECTED] [mailto:numpy-
> [EMAIL PROTECTED] On Behalf Of Travis Oliphant
> Sent: 13 September 2006 22:18
> To: numpy-discussion
> Subject: [Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend
> 
> I'd like to make the first release-candidate of NumPy 1.0 this weekend.
> 
> Any additions wanting to make the first official release candidate
> should be checked in by then.
> 
> -Travis


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend

2006-09-13 Thread Sebastian Haase 
Hi!
I would like to hear about three tickets I submitted some time ago:

Ticket  #230  a**2 not executed as a*a if a.dtype = int32
  is this easy to fix ?

Ticket #229   numpy.random.poisson(0) should return 0
  I hope there is agreement that the edge-case of 0 should/could be handled 
without raising an exception.  I submitted a patch  (please test first!)
  any comments on this one.

Ticket #188   dtype should have nicer str representation
  Is this one now officially dead ? 
  "http://aspn.activestate.com/ASPN/Mail/Message/3207949

Thanks,
Sebastian Haase

  
On Wednesday 13 September 2006 13:18, Travis Oliphant wrote:
> I'd like to make the first release-candidate of NumPy 1.0 this weekend.
>
> Any additions wanting to make the first official release candidate
> should be checked in by then.
>
> -Travis
>
>
> -
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job
> easier Download IBM WebSphere Application Server v.1.0.1 based on Apache
> Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> ___
> Numpy-discussion mailing list
> Numpy-discussion@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/numpy-discussion

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend

2006-09-13 Thread Travis Oliphant 
Sebastian Haase wrote:
> Hi!
> I would like to hear about three tickets I submitted some time ago:
>
> Ticket  #230  a**2 not executed as a*a if a.dtype = int32
>   is this easy to fix ?
>
>   
Fixed.  Now, all arrays with a**2 are executed as a*a (float arrays are 
still
executed as square(a) (is this needed)?

> Ticket #229   numpy.random.poisson(0) should return 0
>   I hope there is agreement that the edge-case of 0 should/could be handled 
> without raising an exception.  I submitted a patch  (please test first!)
>   any comments on this one.
>   

Fixed.  This seems reasonable to me.

> Ticket #188   dtype should have nicer str representation
>   Is this one now officially dead ? 
>   "but str() should rather  return   'int32 (little endian)'
>   
It's not necessarily dead, the problem is complexity of implementation 
and more clarity about how all dtypes are supposed to be printed, not 
just this particular example.   A patch would be very helpful here.  If 
desired it could be implemented in _internal.py and called from there in 
arrayobject.c

But, to get you thinking...  How should the following be printed

dtype('c4')

dtype('a4,i8,3f4')

dtype('3f4')


-Travis


 

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

[Numpy-discussion] iscomplex on strings

2006-09-13 Thread Matthew Brett 
Hi,

I was surprised by this - but maybe I shouldn't have been:

In [7]:iscomplex('a')
Out[7]:True

In [8]:iscomplex(u'a')
Out[8]:True

Best,

Matthew

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] Problem with concatenate and object arrays

2006-09-13 Thread Matthew Brett 
Hi,

> For example, if you do array([a,b,c]).shape(), the answer is normally
> (3,) unless a b and c happen to all be lists of the same length, at
> which point your array could have a much more complicated shape... but
> as the person who wrote "array([a,b,c])" it's tempting to assume that
> the result has shape (3,), only to discover subtle bugs much later.

Very much agree with this.

> If we were writing an array-creation function from scratch, would
> there be any reason to include object-array creation in the same
> function as uniform array creation? It seems like a bad idea to me.
>
> If not, the problem is just compatibility with Numeric. Why not simply
> write a wrapper function in python that does Numeric-style guesswork,
> and put it in the compatibility modules? How much code will actually
> break?

Can I encourage any more comments?  This suggestion seems very
sensible to me, and I guess this is our very last chance to change
this. The current behavior does seem to violate least surprise - at
least to my eye.

Best,

Matthew

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] Problem with concatenate and object arrays

2006-09-13 Thread Charles R Harris 
On 9/13/06, Matthew Brett <[EMAIL PROTECTED]> wrote:
Hi,> For example, if you do array([a,b,c]).shape(), the answer is normally> (3,) unless a b and c happen to all be lists of the same length, at> which point your array could have a much more complicated shape... but
> as the person who wrote "array([a,b,c])" it's tempting to assume that> the result has shape (3,), only to discover subtle bugs much later.Very much agree with this.> If we were writing an array-creation function from scratch, would
> there be any reason to include object-array creation in the same> function as uniform array creation? It seems like a bad idea to me.>> If not, the problem is just compatibility with Numeric. Why not simply
> write a wrapper function in python that does Numeric-style guesswork,> and put it in the compatibility modules? How much code will actually> break?Can I encourage any more comments?  This suggestion seems very
sensible to me, and I guess this is our very last chance to changethis. The current behavior does seem to violate least surprise - atleast to my eye.I've been thinking about how to write a new constructor for objects. Because array has been at the base of numpy for many years I think it is too late to change it now, but perhaps a new and more predictable constructor for objects may eventually displace it. The main problem in constructing arrays of objects is more information needs to be supplied because the user's intention can't be reliably deduced from the current syntax. That said, I have no idea how widespread the use of object arrays is and so don't know how much it really matters. I don't use them much myself.
Chuck
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend

2006-09-13 Thread Charles R Harris 
On 9/13/06, Travis Oliphant <[EMAIL PROTECTED]> wrote:
I'd like to make the first release-candidate of NumPy 1.0 this weekend.Any additions wanting to make the first official release candidateshould be checked in by then.There are a few cleanups and added functionality I have in mind but nothing that would affect the release. Do you plan to keep the 
1.0 release as is with only added fixes and then make a 1.1 release not too long after that contains additions, or are you thinking that modifications that don't affect the API should all go into 1.0.x or some such?
Chuck
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] In-place operations

2006-09-13 Thread Charles R Harris 
On 9/13/06, Francesc Altet <[EMAIL PROTECTED]> wrote:
El dt 12 de 09 del 2006 a les 13:28 -0600, en/na Travis Oliphant vaescriure:> >[BTW, numpy.empty seems twice as slower in my machine. Why?> >> >> Timer("a=numpy.empty
(1,dtype=numpy.complex128)", "import> > > >numpy").repeat(3,1)> >[0.37033700942993164, 0.31780219078063965, 0.31607294082641602]
> >]> >> >> Now, you are creating an empty array with 1 elements in it.Ups, my bad. So, here are the correct times for array creation:>>> Timer("a=numpy.empty
(10,dtype=numpy.complex128)", "importnumpy").repeat(3,1)[0.083303928375244141, 0.080381870269775391, 0.077172040939331055]>>> Timer("a=numpy.empty(100,dtype=numpy.complex128)", "import
numpy").repeat(3,1)[0.086454868316650391, 0.084085941314697266, 0.083555936813354492]>>> Timer("a=numpy.empty(1000,dtype=numpy.complex128)", "importnumpy").repeat(3,1)
[0.084996223449707031, 0.082299947738647461, 0.081347942352294922]>>> Timer("a=numpy.empty(1,dtype=numpy.complex128)", "importnumpy").repeat(3,1)[0.31068897247314453, 0.30376386642456055
, 0.30176281929016113]>>> Timer("a=numpy.empty(10,dtype=numpy.complex128)", "importnumpy").repeat(3,1)[0.42552995681762695, 0.36864185333251953, 0.36870002746582031]>>> Timer("a=
numpy.empty(100,dtype=numpy.complex128)", "importnumpy").repeat(3,1)[0.48045611381530762, 0.41251182556152344, 0.40645909309387207]So, it seems that there are a certain time dependency with size
array of 10 elements   -->  7.7 usarray of 100 elements  -->  8.4 usarray of 1000 elements -->  8.1 usarray of 1 elements--> 30.2 usarray of 10 elements   --> 
36.9 usarray of 100 elements  --> 40.6 usThe transition looks a bit like a cache effect, although I don't see why the cache should enter in. But all the allocations look pretty fast to me.
Chuck 
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend

2006-09-13 Thread Sebastian Haase 
Travis Oliphant wrote:

>> Ticket #188   dtype should have nicer str representation
>>   Is this one now officially dead ? 
>>   ">but str() should rather  return   'int32 (little endian)'
>>   
> It's not necessarily dead, the problem is complexity of implementation 
> and more clarity about how all dtypes are supposed to be printed, not 
> just this particular example.   A patch would be very helpful here.  If 
> desired it could be implemented in _internal.py and called from there in 
> arrayobject.c
> 
> But, to get you thinking...  How should the following be printed
> 
> dtype('c4')
> 
> dtype('a4,i8,3f4')
> 
> dtype('3f4')
> 
> 
> -Travis


I would argue that if the simple cases were addressed first those would 
cover 90% (if not 99% for most people) of the cases occurring in 
people's daily use.
For complex types (like 'a4,i8,3f4') I actually think the current text 
is compact and good.
(Lateron one could think about
'c4' --> '4 chars'
'3f4' --> '3 float32s'

but already I don't know: is there any difference between 'c4' and 
'4c1'?  What is the difference between 'c4' and 'a4' !?
)


My main focus is on the fact that you might read 'http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] [Numpy-tickets] [NumPy] #235: r_, c_, hstack, vstack, column_stack should be made more consistent

2006-09-13 Thread Sebastian Haase 
Travis,
what is the "new string directives as the first element of the item 
tuple" !?

I always liked the idea of having a "shortest possible" way for creating 
  (or concatenating)
rows with "r_"
*and*
columns with "c_"
!

Why did the "c_" have to be removed !?

Thanks,
Sebastan


NumPy wrote:
> #235: r_, c_, hstack, vstack, column_stack should be made more consistent
> -+--
>  Reporter:  baxissimo|Owner:  somebody
>  Type:  enhancement  |   Status:  closed  
>  Priority:  normal   |Milestone:  
> Component:  numpy.lib|  Version:  devel   
>  Severity:  normal   |   Resolution:  fixed   
>  Keywords:   |  
> -+--
> Changes (by oliphant):
> 
>   * status:  new => closed
>   * resolution:  => fixed
> 
> Comment:
> 
>  r_ is the only current quick-creator.  You can now get the functionality
>  of all others using string directives as the first element of the item
>  tuple.
> 
>  Column stack was fixed.
> 

-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend

2006-09-13 Thread Travis Oliphant 
Charles R Harris wrote:
>
>
> On 9/13/06, *Travis Oliphant* <[EMAIL PROTECTED] 
> > wrote:
>
> I'd like to make the first release-candidate of NumPy 1.0 this
> weekend.
>
> Any additions wanting to make the first official release candidate
> should be checked in by then.
>
>
> There are a few cleanups and added functionality I have in mind but 
> nothing that would affect the release. Do you plan to keep the 1.0 
> release as is with only added fixes and then make a 1.1 release not 
> too long after that contains additions, or are you thinking that 
> modifications that don't affect the API should all go into 1.0.x or 
> some such?
The plan is for 1.0.x to contain modifications that don't affect the API 
(good additions should be O.K.).  We want extensions compiled against 
1.0.x to work for a long time.  The 1.1 release won't be for at least  a 
year and probably longer.

1.0.1 would be a maintenance release of the 1.0 release.

-Travis


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend

2006-09-13 Thread Travis Oliphant 
Sebastian Haase wrote:
> Travis Oliphant wrote:
>
>   
>> It's not necessarily dead, the problem is complexity of implementation 
>> and more clarity about how all dtypes are supposed to be printed, not 
>> just this particular example.   A patch would be very helpful here.  If 
>> desired it could be implemented in _internal.py and called from there in 
>> arrayobject.c
>>
>> But, to get you thinking...  How should the following be printed
>>
>> dtype('c4')
>>
>> dtype('a4,i8,3f4')
>>
>> dtype('3f4')
>>
>>
>> -Travis
>> 
>
>
> I would argue that if the simple cases were addressed first those would 
> cover 90% (if not 99% for most people) of the cases occurring in 
> people's daily use.
> For complex types (like 'a4,i8,3f4') I actually think the current text 
> is compact and good.
> (Lateron one could think about
> 'c4' --> '4 chars'
> '3f4' --> '3 float32s'
>
> but already I don't know: is there any difference between 'c4' and 
> '4c1'?  What is the difference between 'c4' and 'a4' !?
> )
>
>
> My main focus is on the fact that you might read ' "less" than 4-bytes int, which is very confusing !
>   
I can agree it's confusing at first, but it's the same syntax the struct 
module uses which is the Python precedent for this.
> As far as a patch is concerned: is _internal.py already being called now 
> from arrayobject.c for the str() and repr() methods ? And is there so 
>   
Yes, you can easily make a call to _internal.py from arrayobject.c (it's 
how some things are actually implemented). 

If you just provide a Python function to call for dtype.__str__ then 
that would suffice.
> far any difference in str() and repr() ?
> I assume that repr() has to stay exactly the way it is right now - right !?
>
>   
Yeah, the repr() probably needs to stay the same

-Travis


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] [Numpy-tickets] [NumPy] #235: r_, c_, hstack, vstack, column_stack should be made more consistent

2006-09-13 Thread Travis Oliphant 
Sebastian Haase wrote:
> Travis,
> what is the "new string directives as the first element of the item 
> tuple" !?
>   

These have been there for a while, but I recently added a couple of 
capabilities.

> I always liked the idea of having a "shortest possible" way for creating 
>   (or concatenating)
> rows with "r_"
> *and*
> columns with "c_"
> !
>
> Why did the "c_" have to be removed !?
>   

It wasn't removed, I thought to deprecate it.  Owing to your response 
and the fact that others seem to use c_ quite a bit, I've kept it as a 
short hand for

r_['1,2,0', ...]

This means that arrays will be concatenated along the 1st axis after 
being up-graded to (at-least) 2-dimensional arrays with 1's placed at 
the end of the new shape.

Thus,

c_[[1,2,3],[4,5,6]

produces

array([[1, 4],
   [2, 5],
   [3, 6]])

This is a bit different if you were using c_ when you should have been 
using r_.

-Travis



-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion

Re: [Numpy-discussion] NumPy 1.0 release-candidate 1.0 this weekend

2006-09-13 Thread Nils Wagner 
Travis Oliphant wrote:
> I'd like to make the first release-candidate of NumPy 1.0 this weekend.
>
> Any additions wanting to make the first official release candidate 
> should be checked in by then.
>
> -Travis
>
>
> -
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> ___
> Numpy-discussion mailing list
> Numpy-discussion@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/numpy-discussion
>   
Is it possible to circumvent the error messages if one uses Python2.4 ?

ImportError: ctypes is not available.

Nils

 


-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
Numpy-discussion mailing list
Numpy-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/numpy-discussion