[Numpy-discussion] ANN: Scipy 0.15.0 release

2015-01-11 Thread Pauli Virtanen
notes are available at https://sourceforge.net/projects/scipy/files/scipy/0.15.0/ Best regards, Pauli Virtanen == SciPy 0.15.0 Release Notes == SciPy 0.15.0 is the culmination of 6 months of hard work. It contains several new features, numerous bug

[Numpy-discussion] ANN: Scipy 0.15.1

2015-01-18 Thread Pauli Virtanen
it is available again in Scipy 0.15.1, using it is deprecated and it may be removed again in a future Scipy release. Source tarballs, binaries, and full release notes are available at https://sourceforge.net/projects/scipy/files/scipy/0.15.1/ Best regards, Pauli Virtanen ==

Re: [Numpy-discussion] Matrix Class

2015-02-11 Thread Pauli Virtanen
11.02.2015, 21:57, Alan G Isaac kirjoitti: [clip] > I think gains could be in lazy evaluation structures (e.g., > a KroneckerProduct object that never actually produces the product > unless forced to.) This sounds like an abstract linear operator interface. Several attempts have been made to this

Re: [Numpy-discussion] GSoC'15 - mentors & ideas

2015-02-25 Thread Pauli Virtanen
25.02.2015, 07:11, Nathaniel Smith kirjoitti: > Not sure if this is a full GSoC but it would be good to get the benchmarks > into the numpy repository, so we can start asking people who submit > optimizations to submit new benchmarks as part of the PR (just like other > changes require tests). Thi

Re: [Numpy-discussion] GSoC'15 - mentors & ideas

2015-02-25 Thread Pauli Virtanen
25.02.2015, 19:59, Pauli Virtanen kirjoitti: > 25.02.2015, 07:11, Nathaniel Smith kirjoitti: >> Not sure if this is a full GSoC but it would be good to get the benchmarks >> into the numpy repository, so we can start asking people who submit >> optimizations to submit new benc

Re: [Numpy-discussion] numpy pickling problem - python 2 vs. python 3

2015-03-06 Thread Pauli Virtanen
Arnd Baecker web.de> writes: [clip] > Still I would have thought that this should be working out-of-the box, > i.e. without the pickle.loads trick? Pickle files should be considered incompatible between Python 2 and Python 3. Python 3 interprets all bytes objects saved by Python 2 as str and att

Re: [Numpy-discussion] numpy pickling problem - python 2 vs. python 3

2015-03-06 Thread Pauli Virtanen
06.03.2015, 20:00, Benjamin Root kirjoitti: > A slightly different way to look at this is one of sharing data. If I am > working on a system with 3.4 and I want to share data with others who may > be using a mix of 2.7 and 3.3 systems, this problem makes npz format much > less attractive. pickle i

Re: [Numpy-discussion] numpy pickling problem - python 2 vs. python 3

2015-03-06 Thread Pauli Virtanen
06.03.2015, 22:43, Eric Firing kirjoitti: > On 2015/03/06 10:23 AM, Pauli Virtanen wrote: >> 06.03.2015, 20:00, Benjamin Root kirjoitti: >>> A slightly different way to look at this is one of sharing data. If I am >>> working on a system with 3.4 and I want to share data

Re: [Numpy-discussion] numpy pickling problem - python 2 vs. python 3

2015-03-06 Thread Pauli Virtanen
06.03.2015, 22:23, Pauli Virtanen kirjoitti: > 06.03.2015, 20:00, Benjamin Root kirjoitti: >> A slightly different way to look at this is one of sharing data. If I am >> working on a system with 3.4 and I want to share data with others who may >> be using a mix of 2.7 and 3.3

Re: [Numpy-discussion] numpy pickling problem - python 2 vs. python 3

2015-03-07 Thread Pauli Virtanen
07.03.2015, 01:29, Julian Taylor kirjoitti: > On 07.03.2015 00:20, Pauli Virtanen wrote: >> 06.03.2015, 22:43, Eric Firing kirjoitti: >>> On 2015/03/06 10:23 AM, Pauli Virtanen wrote: >>>> 06.03.2015, 20:00, Benjamin Root kirjoitti: >>>>> A slightly di

Re: [Numpy-discussion] Advanced indexing: "fancy" vs. orthogonal

2015-04-03 Thread Pauli Virtanen
03.04.2015, 04:09, josef.p...@gmail.com kirjoitti: [clip] > I think numpy indexing is not too difficult and follows a consistent > pattern, and I completely avoid mixing slices and index arrays with > ndim > 2. > > I think it should be DOA, except as a discussion topic for numpy 3000. If you chan

Re: [Numpy-discussion] Numpy compilation error

2015-04-12 Thread Pauli Virtanen
12.04.2015, 17:15, Peter Kerpedjiev kirjoitti: [clip] > numpy/random/mtrand/distributions.c:892:1: internal compiler error: > Illegal instruction An internal compiler error means your compiler (in this case, gcc) is broken. The easiest solution is to use a newer version of the compiler, assuming t

Re: [Numpy-discussion] Verify your sourceforge windows installer downloads

2015-05-28 Thread Pauli Virtanen
28.05.2015, 20:05, David Cournapeau kirjoitti: [clip] >> In any case I've always been surprised that NumPy is distributed >> through SourceForge, which has been sketchy for years now. Could it >> simply be hosted on PyPI? >> > > They don't accept arbitrary binaries like SF does, and some of our >

Re: [Numpy-discussion] Verify your sourceforge windows installer downloads

2015-05-28 Thread Pauli Virtanen
28.05.2015, 20:35, Sturla Molden kirjoitti: > Pauli Virtanen wrote: > >> Is it possible to host them on github? I think there's an option to add >> release notes and (apparently) to upload binaries if you go to the >> "Releases" section --- there's

Re: [Numpy-discussion] Verify your sourceforge windows installer downloads

2015-05-28 Thread Pauli Virtanen
28.05.2015, 21:52, Julian Taylor kirjoitti: > there is no guarantee that github will not do this stuff in future too, > also PyPI or self hosting do not necessarily help as those resources can > be compromised. > The main thing that should be learned this and the many similar > incidents in the pas

Re: [Numpy-discussion] Homu

2015-06-15 Thread Pauli Virtanen
15.06.2015, 12:00, Nathaniel Smith kirjoitti: [clip] > http://homu.io/ One thing to consider is the disadvantage from security POV: this gives full write access to the Numpy repository to that someone who is running the bot. I don't see information on who this person (or these persons) is and ho

Re: [Numpy-discussion] Numpy, BLAS, and CBLAS questions

2015-07-13 Thread Pauli Virtanen
13.07.2015, 19:44, Eric Martin kirjoitti: > It seems to me that a potentially better route than "add code to Numpy to > support BLAS library" for each library is to make Numpy easy to configure > to compile with an arbitrary BLAS library (like what I've been doing). Does this work: export ATLAS=N

Re: [Numpy-discussion] Numpy, BLAS, and CBLAS questions

2015-07-13 Thread Pauli Virtanen
13.07.2015, 20:08, Nathaniel Smith kirjoitti: [clip] > Keep in mind that any solution needs to support weird systems too, > including Windows. I'm not sure we can assume that all BLAS libraries are > ABI compatible either. Debian/Ubuntu make sure that this is true for the > ones they ship, but not

Re: [Numpy-discussion] Development workflow (not git tutorial)

2015-08-14 Thread Pauli Virtanen
14.08.2015, 20:45, Allan Haldane kirjoitti: [clip] > Related to this, does anyone know how to debug numpy in gdb with proper > symbols/source lines, like I can do with other C extensions? I've tried > modifying numpy distutils to try to add the right compiler/linker flags, > without success. runte

Re: [Numpy-discussion] Development workflow (not git tutorial)

2015-08-14 Thread Pauli Virtanen
15.08.2015, 01:44, Chris Barker kirjoitti: [clip] > numpy doesn't use namespace packages, so develop mode works there. The develop mode is mainly useful with a virtualenv. Otherwise, you install work-in-progress development version into your ~/.local which then breaks everything else. In addition

Re: [Numpy-discussion] py2/py3 pickling

2015-08-24 Thread Pauli Virtanen
24.08.2015, 01:02, Chris Laumann kirjoitti: [clip] > Is there documentation about the limits and workarounds for py2/py3 > pickle/np.save/load compatibility? I haven't found anything except > developer bug tracking discussions (eg. #4879 in github numpy). Not sure if it's written down somewhere b

Re: [Numpy-discussion] py2/py3 pickling

2015-08-25 Thread Pauli Virtanen
25.08.2015, 01:15, Chris Laumann kirjoitti: > Would it be possible then (in relatively short order) to create > a py2 -> py3 numpy pickle converter? You probably need to modify the pickle stream directly, replacing *STRING opcodes with *BYTES opcodes when it comes to objects that are needed for c

Re: [Numpy-discussion] Notes from the numpy dev meeting at scipy 2015

2015-08-26 Thread Pauli Virtanen
26.08.2015, 14:14, Francesc Alted kirjoitti: [clip] > 2015-08-25 12:03 GMT+02:00 Nathaniel Smith : >> Let's focus on evolving numpy as far as we can without major >> break-the-world changes (no "numpy 2.0", at least in the foreseeable >> future). >> >> And, as a target for that evolution, l

Re: [Numpy-discussion] Cython-based OpenMP-accelerated quartic polynomial solver

2015-09-30 Thread Pauli Virtanen
html However, since it's piecewise, there's purposefully support only for real-valued roots. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org https://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Compilation problems npy_float64

2015-11-05 Thread Pauli Virtanen
py/commit/832baa20f0b5 so you may have better luck with the dev version. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org https://mail.scipy.org/mailman/listinfo/numpy-discussion

[Numpy-discussion] Downstream integration testing

2016-01-31 Thread Pauli Virtanen
d take some understanding of the downstream package, but this would at least ensure we are aware of stuff breaking. Provided it's covered by downstream test suite, of course. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion

Re: [Numpy-discussion] Downstream integration testing

2016-01-31 Thread Pauli Virtanen
31.01.2016, 14:41, Daπid kirjoitti: > On 31 Jan 2016 13:08, "Pauli Virtanen" wrote: >> For example, automated test rig that does the following: >> >> - run tests of a given downstream project version, against >> previous numpy version, record output &g

Re: [Numpy-discussion] Numpy 1.11.0b2 released

2016-02-02 Thread Pauli Virtanen
'm necessarily volunteering to maintain the setup, though, but if it seems useful, move it under numpy org. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org https://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Numpy 1.11.0b2 released

2016-02-04 Thread Pauli Virtanen
added value this is compared to travis matrix, eg. https://travis-ci.org/pv/testrig/ Of course, if the suggestion is that the results are generated on somewhere else than on travis, then that's a different matter. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org https://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Numpy 1.11.0b2 released

2016-02-05 Thread Pauli Virtanen
05.02.2016, 19:55, Nathaniel Smith kirjoitti: > On Feb 5, 2016 8:28 AM, "Chris Barker - NOAA Federal" > wrote: >> >>> An extra ~2 hours of tests / 6-way parallelism is not that big a deal >>> in the grand scheme of things (and I guess it's probably less than >>> that if we can take advantage of ex

Re: [Numpy-discussion] NumPy 1.11.0b3 released.

2016-02-10 Thread Pauli Virtanen
10.02.2016, 04:09, Charles R Harris kirjoitti: > I'm pleased to announce the release of NumPy 1.11.0b3. This beta contains [clip] > Please test, hopefully this will be that last beta needed. FWIW, https://travis-ci.org/pv/testrig/builds/108384173 ___ N

Re: [Numpy-discussion] Numpy 1.11.0rc1 released.

2016-02-23 Thread Pauli Virtanen
23.02.2016, 03:47, Charles R Harris kirjoitti: > I'm delighted to announce the release of Numpy 1.11.0rc1. Hopefully the > issues discovered in 1.11.0b3 have been dealt with and this release can go > on to become the official release. Source files and documentation can be > found on Sourceforge > <

Re: [Numpy-discussion] Numpy 1.11.0rc1 released.

2016-02-23 Thread Pauli Virtanen
ntation in the 2GB address space available? If dt==float64, that requires 250MB contiguous. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org https://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] GSoC?

2016-03-04 Thread Pauli Virtanen
Thu, 11 Feb 2016 00:02:52 +0100, Ralf Gommers kirjoitti: [clip] > OK first version: > https://github.com/scipy/scipy/wiki/GSoC-2016-project-ideas I kept some > of the ideas from last year, but removed all potential mentors as the > same people may not be available this year - please re-add yourselv

Re: [Numpy-discussion] ATLAS build errors

2016-03-27 Thread Pauli Virtanen
dify the build to avoid > them? Maybe the ATLAS binaries supplied were compiled with g77 instead of gfortran. If so, they should not be used with gfortran --- need to recompile. Also, in the past ATLAS binaries shipped by distributions had severe bugs. However, 3.8.x may be a new enough version.

Re: [Numpy-discussion] Why does asarray() create an intermediate memoryview?

2016-03-27 Thread Pauli Virtanen
base refcounting. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org https://mail.scipy.org/mailman/listinfo/numpy-discussion

[Numpy-discussion] Benchmark regression feeds

2016-06-24 Thread Pauli Virtanen
Hi, In case someone is interested in getting notifications of performance regressions in the Numpy and Scipy benchmarks, this is available as Atom feeds at: https://pv.github.io/numpy-bench/regressions.xml https://pv.github.io/scipy-bench/regressions.xml -- Pauli Virtanen

Re: [Numpy-discussion] deterministic, reproducible matmul / __matmult_

2016-07-11 Thread Pauli Virtanen
emory alignment --- not in dot products, but in other computations. Out of curiosity, what is the application where this is necessary? Maybe there is a numerically stable formulation? -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@

Re: [Numpy-discussion] StackOverflow documentation

2016-07-21 Thread Pauli Virtanen
urse, working on that requires a somewhat different level of committment than editing what's essentially Stackexchange-provided wiki (where content gets relicensed with attribution clauses where you have to reference stackexchange and not the original author dire

Re: [Numpy-discussion] test_closing_fid (in test_io.py) on PyPy

2016-08-05 Thread Pauli Virtanen
Fri, 05 Aug 2016 10:06:02 +0300, Matti Picus kirjoitti: [clip] > I can submit a pull request to skip on pypy, or should this be solved in > a more substantial way? Should also be safe to just skip it on Pypy, it's testing that the wrong way to use np.load also works on CPython.

Re: [Numpy-discussion] New iterator API (nditer): Overlap detection in NumPy

2016-09-07 Thread Pauli Virtanen
also that copies break assumptions also there. It might be possible to turn it on by default for operands with COPY or UPDATEIFCOPY flags --- but I'm not sure if that's helpful (now you'd need to set the flags to all input operands). -- Pauli Virtanen

[Numpy-discussion] New iterator APIs (nditer / MapIter): Overlap detection in NumPy

2016-09-11 Thread Pauli Virtanen
Hi, In the end some further API additions turn out to appear needed: * NPY_ITER_COPY_IF_OVERLAP, NPY_ITER_OVERLAP_NOT_SAME flags for NpyIter_New. * New API function PyArray_MapIterArrayCopyIfOverlap, as ufunc.at needs to check overlaps for index arrays before constructing iterators, and t

Re: [Numpy-discussion] New iterator APIs (nditer / MapIter): Overlap detection in NumPy

2016-09-12 Thread Pauli Virtanen
Mon, 12 Sep 2016 11:31:07 +0200, Sebastian Berg kirjoitti: >> * NPY_ITER_COPY_IF_OVERLAP, NPY_ITER_OVERLAP_NOT_SAME >>   flags for NpyIter_New. >> >> * New API function PyArray_MapIterArrayCopyIfOverlap, >>   as ufunc.at needs to check overlaps for index arrays before >>   constructing iterators,

Re: [Numpy-discussion] automatically avoiding temporary arrays

2016-10-03 Thread Pauli Virtanen
Mon, 03 Oct 2016 15:07:28 -0400, Benjamin Root kirjoitti: > With regards to arguments about holding onto large arrays, I would like > to emphasize that my original suggestion mentioned weakref'ed numpy > arrays. > Essentially, the idea is to claw back only the raw memory blocks during > that limbo

Re: [Numpy-discussion] Ensuring one can operate on array-like argument in place

2016-11-13 Thread Pauli Virtanen
Sat, 12 Nov 2016 17:00:07 +, Pavlyk, Oleksandr kirjoitti: [clip] > if x_arr is not x: >in_place = 1 # a copy was made, so we can work in place. > > The logic is of the last line turns out to be incorrect, because the > input x can be a class with an array interface. Please see:

Re: [Numpy-discussion] Dealing with roundoff error

2010-03-27 Thread Pauli Virtanen
t? 0.1 does not have a terminating representation in base-2: 0.1_10 = 0.0001100110011001100110011.._2 -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Py3k: making a py3k compat header available in installed numpy for scipy

2010-03-29 Thread Pauli Virtanen
ma, 2010-03-29 kello 19:13 +0900, David Cournapeau kirjoitti: > I have worked on porting scipy to py3k, and it is mostly working. One > thing which would be useful is to install something similar to > npy_3kcompat.h in numpy, so that every scipy extension could share the > compat header. Is the cur

Re: [Numpy-discussion] Py3k: making a py3k compat header available in installed numpy for scipy

2010-03-29 Thread Pauli Virtanen
2010/3/30 David Cournapeau > Pauli Virtanen wrote: [clip] > > At least, I don't see what I would like to change there. The only thing > > I wouldn't perhaps like to have in the long run are the PyString and > > possibly PyInt redefinition macros. > > I wou

Re: [Numpy-discussion] Making a 2to3 distutils command ?

2010-03-30 Thread Pauli Virtanen
2010/3/30 David Cournapeau : > Currently, when building numpy with python 3, the 2to3 conversion > happens before calling any distutils command. Was there a reason for > doing it as it is done now ? This allowed 2to3 to also port the various setup*.py files and numpy.distutils, and implementing it

Re: [Numpy-discussion] Making a 2to3 distutils command ?

2010-03-30 Thread Pauli Virtanen
ti, 2010-03-30 kello 07:18 -0600, Ryan May kirjoitti: > Out of curiosity, is there something wrong with the support for 2to3 > that already exists within distutils? (Other than it just being > distutils) > > http://bruynooghe.blogspot.com/2010/03/using-lib2to3-in-setuppy.html That AFAIK converts

[Numpy-discussion] Ufunc memory access optimizations (Was: ufuncs on funny strides ...)

2010-04-01 Thread Pauli Virtanen
these lines, though mostly addressing the reduction: http://github.com/pv/numpy-work/tree/ticket/1143-speedup-reduce http://projects.scipy.org/numpy/ticket/1143 Not production quality so far, and the non-C-output order would definitely help also here.) -- Pauli Virtanen __

Re: [Numpy-discussion] Proposal for new ufunc functionality

2010-04-10 Thread Pauli Virtanen
ld be stuffed to the main namespace, or under numpy.rec. Another addition to ufuncs that should be though about is specifying the Python-side interface to generalized ufuncs. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Is this a small bug in numpydoc?

2010-04-14 Thread Pauli Virtanen
ea. > > But I didn't write numpydoc and I'm tired, so I don't want to commit > this without a second pair of eyes... Yeah, it's a bug, I think. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] My GSoC Proposal to Implement a Subset of NumPy for PyPy

2010-04-18 Thread Pauli Virtanen
s of Numpy, the code could be immediately usable in real world, being less of a proof-of-concept subset. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Disabling Extended Precision in NumPy (like -ffloat-store)

2010-04-21 Thread Pauli Virtanen
Probably the only way to ensure this is to recompile Numpy (and possibly, also Python) with the -ffloat-store option turned on. When compiling Numpy, you should be able to insert the flag via OPT="-ffloat-store" python setup.py build -- Pauli Virtanen ___

[Numpy-discussion] Adding an ndarray.dot method

2010-04-29 Thread Pauli Virtanen
Wed, 28 Apr 2010 14:12:07 -0400, Alan G Isaac wrote: [clip] > Here is a related ticket that proposes a more explicit alternative: > adding a ``dot`` method to ndarray. > http://projects.scipy.org/numpy/ticket/1456 I kind of like this idea. Simple, obvious, and leads to clear code: a.dot(b

Re: [Numpy-discussion] Datetime overflow error, attn Stefan.

2010-05-09 Thread Pauli Virtanen
Sat, 08 May 2010 18:44:59 -0600, Charles R Harris wrote: [clip] > Because window's longs are always 32 bit, I think this is a good > indication that somewhere a long is being used instead of an intp. The test itself used 32-bit integers. Fix'd. Pauli _

Re: [Numpy-discussion] pareto docstring

2010-05-11 Thread Pauli Virtanen
ame, e.g. `pareto1` to signal it's the first kind, and deprecate the old function altogether. A third option would be just to silently fix the bug. In any case the change should be mentioned noticeably in the release notes. -- Pauli Virtanen ___ N

Re: [Numpy-discussion] savetxt not working with python3.1

2010-05-17 Thread Pauli Virtanen
Mon, 17 May 2010 13:22:18 -0400, Skipper Seabold wrote: [clip] > What version of Numpy? Can you file a bug ticket with a failing > example? I couldn't replicated with r8417 on Python 3. It was fixed in r8411. -- Pauli Virtanen ___ NumPy

Re: [Numpy-discussion] dtype and array creation

2010-05-20 Thread Pauli Virtanen
type=str) array(['1234'], dtype='|S4') When I looked at this the last time, it wasn't completely obvious how to make this to do something more sensible. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Build failure at rev8246

2010-05-21 Thread Pauli Virtanen
new files. Try building from a clean checkout. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Extending documentation to c code

2010-05-25 Thread Pauli Virtanen
ficult, as projects aimed doing that in Python exist, for instance http://code.google.com/p/pycparser/ -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Extending documentation to c code

2010-05-26 Thread Pauli Virtanen
c by > default, Anyway, we can probably nevertheless just agree on a readable plain-text/ rst format, and then just use doxygen to generate the docs, as a band-aid. http://github.com/pv/numpycdoc -- Pauli Virtanen ___ NumPy-Discussion mailing list

Re: [Numpy-discussion] Introduction to Scott, Jason, and (possibly) others from Enthought

2010-05-26 Thread Pauli Virtanen
he heavy lifting could then be good for reuse and be more easy to maintain, but I think how and where they would be exposed hasn't been discussed so far... -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http

Re: [Numpy-discussion] Reading and writing binary data to/from file objects

2010-05-26 Thread Pauli Virtanen
ke, 2010-05-26 kello 14:07 +0200, Christoph Bersch kirjoitti: > f = open(fname2, 'w') [clip] > Am I doing something substantially wrong or is this a bug? You are opening files in text mode. Use mode 'wb' instead. -- Pauli Virtanen ___

Re: [Numpy-discussion] Extending documentation to c code

2010-05-26 Thread Pauli Virtanen
Wed, 26 May 2010 07:15:08 -0600, Charles R Harris wrote: > On Wed, May 26, 2010 at 2:59 AM, Pauli Virtanen wrote: > >> Wed, 26 May 2010 06:57:27 +0900, David Cournapeau wrote: [clip: >> doxygen] >> > It is yet another format to use inside C sources (I don't think

Re: [Numpy-discussion] NotImplemented returns

2010-05-27 Thread Pauli Virtanen
bug. The function should raise a ValueError instead. NotImplemented is meant only for use as a placeholder singleton in implementation of rich comparison operations etc., and we shouldn't introduce any new meanings IMHO. -- Pauli Virtanen ___

Re: [Numpy-discussion] Introduction to Scott, Jason, and (possibly) others from Enthought

2010-05-28 Thread Pauli Virtanen
3 changes did not require breaking ABI (on Py2). -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Finding Star Images on a Photo (Video chip) Plate?

2010-05-29 Thread Pauli Virtanen
r place). The correct places where this stuff should be is http://docs.scipy.org/ http://scipy.org/Additional_Documentation -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Technicalities of the SVN -> GIT transition

2010-06-01 Thread Pauli Virtanen
real emails. Since email are "private", I don't want to just > "scrape" them without asking permission first. I don't know how we > should proceed here. I don't think correcting the email addresses in the SVN history is very use

Re: [Numpy-discussion] Technicalities of the SVN -> GIT transition

2010-06-05 Thread Pauli Virtanen
easiest combo to work with later? I think the Github user name is not really needed here, as what goes into the history is the Git ID: name + email address. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Technicalities of the SVN -> GIT transition

2010-06-05 Thread Pauli Virtanen
Fri, 04 Jun 2010 15:19:27 -0700, Dan Roberts wrote: > Sorry to interrupt, but do you have a usable, up to date cloneable git > repository somewhere? I noticed that you had a repository on github, but > it's about a month out of date. I understand if what you're working on > isn't ready to be clone

Re: [Numpy-discussion] numpy.savez does /not/ compress!?

2010-06-08 Thread Pauli Virtanen
name, so it probably wouldn't break anyone's code. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Problems with get_info installing scipy

2010-06-08 Thread Pauli Virtanen
have an older version of numpy installed somewhere that overrides the new one. Check "import numpy; print numpy.__file__" to see which one is imported. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] NumPy re-factoring project

2010-06-10 Thread Pauli Virtanen
hich cannot probably be shared between different openmp threads. So one would have to do some extra work to parallelize these parts manually. But probably if multithreading is desired, openmp sounds like the way to go... -- Pauli Virtanen ___ NumPy

Re: [Numpy-discussion] NumPy re-factoring project

2010-06-11 Thread Pauli Virtanen
to implement specialized loops for each operation, currently we do one function indirection per iteration which probably costs something. But again, it may be that the operations are already bounded by memory speed, and this would not improve p

Re: [Numpy-discussion] NumPy re-factoring project

2010-06-11 Thread Pauli Virtanen
fore proceeding. I'd say that we should simply do this, as nobody should depend on this assumption. I think I there was some code ready to implement this shuffling. I'll try to dig it out and implement the shuffling. -- Pauli Virtanen ___ Num

Re: [Numpy-discussion] NumPy re-factoring project

2010-06-11 Thread Pauli Virtanen
that the outer iterator overhead is small compared to the duration of the inner loop. This must then be compared to the memory access overhead involved in the dtype** array. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Tensor contraction

2010-06-12 Thread Pauli Virtanen
shape of indices) + (dimensions after the index dimensions) 2) if the index dimensions are not all next to each other, then the shape of the result array is (broadcast shape of indices) + (non-index dimensions) Might be a bit surprising, but at this po

Re: [Numpy-discussion] Tensor contraction

2010-06-12 Thread Pauli Virtanen
Sat, 12 Jun 2010 16:30:14 -0400, Alan Bromborsky wrote: > If I have a single numpy array, for example with 3 indices T_{ijk} and I > want to sum over two them in the sense of tensor contraction - > > T_{k} = \sum_{i=0}^{n-1} T_{iik}. Is there an easy way to do this with > numpy? HTH, (not really

Re: [Numpy-discussion] NumPy re-factoring project

2010-06-13 Thread Pauli Virtanen
his would be useful for temporary arrays, although then one would have to be careful not ever to return memory allocated by this back to the caller. > have two C functions, the first determining the amount of allocation, > the second doing the computation. That sounds like a PITA, think

Re: [Numpy-discussion] PyArray_Scalar() and Unicode

2010-06-13 Thread Pauli Virtanen
be parseable by DecodeUTF16. Conversion to real UCS-2 from UCS-4 would be a lossy procedure, since not all code points can be represented with 2 bytes. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scip

Re: [Numpy-discussion] Technicalities of the SVN -> GIT transition

2010-06-15 Thread Pauli Virtanen
That's a mirror of a mirror, the master SVN mirror is here: http://projects.scipy.org/git/numpy/ -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

[Numpy-discussion] Ufunc memory access optimization

2010-06-15 Thread Pauli Virtanen
pe, 2010-06-11 kello 10:52 +0200, Hans Meine kirjoitti: > On Friday 11 June 2010 10:38:28 Pauli Virtanen wrote: [clip] > > I think I there was some code ready to implement this shuffling. I'll try > > to dig it out and implement the shuffling. > > That would be gre

Re: [Numpy-discussion] Ufunc memory access optimization

2010-06-15 Thread Pauli Virtanen
p itself can access the memory with a single stride. This may cause some speed loss in some expressions. Perhaps there should be a subtle bias towards C-order? But I'm not sure this is worth the bother. -- Pauli Virtanen ___ NumPy-Discussion

Re: [Numpy-discussion] Ufunc memory access optimization

2010-06-15 Thread Pauli Virtanen
. Yes, I do not think any of us is expecting it to be simple. I don't think we can aim for the optimal solution, since it is ill-defined, but only for one that is "good enough in practice". -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] checking for array type in C extension

2010-06-18 Thread Pauli Virtanen
pe, 2010-06-18 kello 12:49 +0200, Berthold Hoellmann kirjoitti: [clip] > tst.inttestfunc(np.array((1,2),dtype=np.int)) > tst.inttestfunc(np.array((1,2),dtype=np.int8)) > tst.inttestfunc(np.array((1,2),dtype=np.int16)) > tst.inttestfunc(np.array((1,2),dtype=np.int32)) > tst.inttestfunc(np.array((1,2

Re: [Numpy-discussion] checking for array type in C extension

2010-06-18 Thread Pauli Virtanen
tation needs clarification, as numpy.int is not actually the platform-size integer, but the Python-size integer. The platform-size integer corresponding to C "int" is IIRC numpy.intc, which should result to the same sizes as NPY_INT. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Multiplying numpy floats and python lists

2010-06-20 Thread Pauli Virtanen
x27;t understand how this can be: the float64 scalar type is not supposed to have a non-NULL in the nb_index slot. Indeed, a np.float64.__index__ method does not exist, and the following indeed does not work: [1, 2, 3][np.float64(2.2)] Strange. -- Pauli Virtanen ___

[Numpy-discussion] needs_info status in Trac

2010-06-20 Thread Pauli Virtanen
status to our Trac systems, primarily for tickets in this state. Please make best use of it (or have your say if you think it's not useful, in which case we can back it out). -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scip

Re: [Numpy-discussion] Possible to use numexpr with user made ufuncs/scipy ufuncs?

2010-06-26 Thread Pauli Virtanen
uld it be possible to add generic support for user-supplied ufuncs into numexpr? This would maybe be more of a convenience feature than a speed improvement, although perhaps some speed could be gained by evaluating ufuncs per-block. -- Pauli Virtanen

Re: [Numpy-discussion] Possible to use numexpr with user made ufuncs/scipy ufuncs?

2010-06-26 Thread Pauli Virtanen
ranslated to numexpr bytecode that would make a Python function call to obtain "iv(0, x)" for each block of data required, assuming "iv" is a vectorized function. It's of course possible to precompute the value of "iv(0, x)", but this is extra hassle and re

Re: [Numpy-discussion] numpy.random.poisson docs missing "Returns"

2010-06-27 Thread Pauli Virtanen
The only chance would be to search for docstrings that haven't been edited after a certain date. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] arr.copy(order='F') doesn't agree with docstring: what is intended behavior?

2010-06-27 Thread Pauli Virtanen
oblem is probably that the function is using PyArg_ParseTuple instead of PyArg_ParseTupleAndKeywords > Who do I contact about getting a trac account? Go to http://projects.scipy.org/numpy/ and select "Register". -- Pauli Virtanen ___

Re: [Numpy-discussion] Possible to use numexpr with user made ufuncs/scipy ufuncs?

2010-06-28 Thread Pauli Virtanen
, speedups (at least with MKL) could come from using faster implementations of sin/cos/exp etc. basic functions. Using SIMD to maximum effect would then require an amount of cleverness in re-writing the evaluation algorithms, which sounds like a major amount of work. --

Re: [Numpy-discussion] numpy.load raising IOError but EOFError expected

2010-06-28 Thread Pauli Virtanen
ke, 2010-06-23 kello 12:46 +0200, Ruben Salvador kirjoitti: [clip] > how can I detect the EOF to stop reading r = f.read(1) if not r: break # EOF else: f.seek(-1, 1) -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discuss

Re: [Numpy-discussion] numpy.load raising IOError but EOFError expected

2010-06-28 Thread Pauli Virtanen
since it tries to unpickle, if it doesn't see the .npy magic header. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] sum up to a specific value

2010-07-01 Thread Pauli Virtanen
Thu, 01 Jul 2010 06:17:50 -0300, Renato Fabbri wrote: > i need to find which elements of an array sums up to an specific value > > any idea of how to do this? Sounds like the knapsack problem http://en.wikipedia.org/wiki/Knapsack_problem ___ NumPy-Dis

Re: [Numpy-discussion] sum up to a specific value

2010-07-01 Thread Pauli Virtanen
Some search words you might want to try on Google: http://www.google.com/search?q=subset%20sum%20dynamic%20programming Generic advice only this time, sorry; I don't have pre-made code for solving this at hand, but hopefully the above links give some pointers for

Re: [Numpy-discussion] memory leak using numpy and cvxopt

2010-07-02 Thread Pauli Virtanen
cvxopt import matrix N = 2000 X = [0]*N Y = matrix(0.0, (N, N)) while True: Y[:N, :1] = X -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

<    1   2   3   4   5   6   7   8   9   10   >