Re: [Numpy-discussion] How to start at line # x when using numpy.memmap

2011-08-19 Thread Brent Pedersen
On Fri, Aug 19, 2011 at 7:29 AM, Jeremy Conlin jlcon...@gmail.com wrote: On Fri, Aug 19, 2011 at 7:19 AM, Pauli Virtanen p...@iki.fi wrote: Fri, 19 Aug 2011 07:00:31 -0600, Jeremy Conlin wrote: I would like to use numpy's memmap on some data files I have. The first 12 or so lines of the files

Re: [Numpy-discussion] How to start at line # x when using numpy.memmap

2011-08-19 Thread Brent Pedersen
On Fri, Aug 19, 2011 at 9:09 AM, Jeremy Conlin jlcon...@gmail.com wrote: On Fri, Aug 19, 2011 at 8:01 AM, Brent Pedersen bpede...@gmail.com wrote: On Fri, Aug 19, 2011 at 7:29 AM, Jeremy Conlin jlcon...@gmail.com wrote: On Fri, Aug 19, 2011 at 7:19 AM, Pauli Virtanen p...@iki.fi wrote: Fri, 19

Re: [Numpy-discussion] Memmap with multiprocessing

2011-04-27 Thread Brent Pedersen
On Wed, Apr 27, 2011 at 4:07 PM, Christoph Gohlke cgoh...@uci.edu wrote: I don't think this was working correctly in numpy 1.4 either. The underlying problem seems to be that instance attributes of ndarray subtypes get lost during pickling: import pickle import numpy as np class

[Numpy-discussion] moving window product

2011-03-21 Thread Brent Pedersen
hi, is there a way to take the product along a 1-d array in a moving window? -- similar to convolve, with product in place of sum? currently, i'm column_stacking the array with offsets of itself into window_size columns and then taking the product at axis 1. like:: w =

Re: [Numpy-discussion] moving window product

2011-03-21 Thread Brent Pedersen
On Mon, Mar 21, 2011 at 11:19 AM, Keith Goodman kwgood...@gmail.com wrote: On Mon, Mar 21, 2011 at 10:10 AM, Brent Pedersen bpede...@gmail.com wrote: hi, is there a way to take the product along a 1-d array in a moving window? -- similar to convolve, with product in place of sum? currently

Re: [Numpy-discussion] moving window product

2011-03-21 Thread Brent Pedersen
On Mon, Mar 21, 2011 at 11:57 AM, Keith Goodman kwgood...@gmail.com wrote: On Mon, Mar 21, 2011 at 10:34 AM, Brent Pedersen bpede...@gmail.com wrote: On Mon, Mar 21, 2011 at 11:19 AM, Keith Goodman kwgood...@gmail.com wrote: On Mon, Mar 21, 2011 at 10:10 AM, Brent Pedersen bpede...@gmail.com

Re: [Numpy-discussion] 2D binning

2010-06-01 Thread Brent Pedersen
On Tue, Jun 1, 2010 at 1:51 PM, Wes McKinney wesmck...@gmail.com wrote: On Tue, Jun 1, 2010 at 4:49 PM, Zachary Pincus zachary.pin...@yale.edu wrote: Hi Can anyone think of a clever (non-lopping) solution to the following? A have a list of latitudes, a list of longitudes, and list of data

Re: [Numpy-discussion] [Patch] Fix memmap pickling

2010-05-26 Thread Brent Pedersen
On Mon, May 24, 2010 at 3:37 PM, Gael Varoquaux gael.varoqu...@normalesup.org wrote: On Mon, May 24, 2010 at 03:33:09PM -0700, Brent Pedersen wrote: On Mon, May 24, 2010 at 3:25 PM, Gael Varoquaux gael.varoqu...@normalesup.org wrote: Memmapped arrays don't pickle right. I know that to get

Re: [Numpy-discussion] [Patch] Fix memmap pickling

2010-05-24 Thread Brent Pedersen
On Mon, May 24, 2010 at 3:25 PM, Gael Varoquaux gael.varoqu...@normalesup.org wrote: Memmapped arrays don't pickle right. I know that to get them to really pickle and restore identically, we would need some effort. However, in the current status, pickling and restoring a memmapped array leads

Re: [Numpy-discussion] faster code

2010-05-16 Thread Brent Pedersen
On Sun, May 16, 2010 at 12:14 PM, Davide Lasagna lasagnadav...@gmail.com wrote: Hi all, What is the fastest and lowest memory consumption way to compute this? y = np.arange(2**24) bases = y[1:] + y[:-1] Actually it is already quite fast, but i'm not sure whether it is occupying some

Re: [Numpy-discussion] patch to pickle np.memmap

2010-04-20 Thread Brent Pedersen
On Tue, Apr 13, 2010 at 8:59 PM, Brent Pedersen bpede...@gmail.com wrote: On Tue, Apr 13, 2010 at 8:52 PM, Brent Pedersen bpede...@gmail.com wrote: hi, i posted a patch to allow pickling of np.memmap objects. http://projects.scipy.org/numpy/ticket/1452 currently, it always returns 'r

[Numpy-discussion] patch to pickle np.memmap

2010-04-13 Thread Brent Pedersen
hi, i posted a patch to allow pickling of np.memmap objects. http://projects.scipy.org/numpy/ticket/1452 currently, it always returns 'r' for the mode. is that the best thing to do there? any other changes? -brent ___ NumPy-Discussion mailing list

Re: [Numpy-discussion] patch to pickle np.memmap

2010-04-13 Thread Brent Pedersen
On Tue, Apr 13, 2010 at 8:52 PM, Brent Pedersen bpede...@gmail.com wrote: hi, i posted a patch to allow pickling of np.memmap objects. http://projects.scipy.org/numpy/ticket/1452 currently, it always returns 'r' for the mode. is that the best thing to do there? any other changes? -brent

Re: [Numpy-discussion] Name of the file associated with a memmap

2010-04-12 Thread Brent Pedersen
On Mon, Apr 12, 2010 at 1:59 PM, Robert Kern robert.k...@gmail.com wrote: On Mon, Apr 12, 2010 at 15:52, Charles R Harris charlesr.har...@gmail.com wrote: On Mon, Apr 12, 2010 at 2:37 PM, Charles R Harris charlesr.har...@gmail.com wrote: On Mon, Apr 12, 2010 at 1:55 PM, Brent Pedersen bpede

Re: [Numpy-discussion] Name of the file associated with a memmap

2010-04-12 Thread Brent Pedersen
On Mon, Apr 12, 2010 at 2:46 PM, Robert Kern robert.k...@gmail.com wrote: On Mon, Apr 12, 2010 at 16:43, Gael Varoquaux gael.varoqu...@normalesup.org wrote: On Mon, Apr 12, 2010 at 04:39:23PM -0500, Robert Kern wrote: where should i write the docs? in the file itself or through the doc

Re: [Numpy-discussion] Name of the file associated with a memmap

2010-04-12 Thread Brent Pedersen
On Mon, Apr 12, 2010 at 3:08 PM, Robert Kern robert.k...@gmail.com wrote: On Mon, Apr 12, 2010 at 17:00, Brent Pedersen bpede...@gmail.com wrote: On Mon, Apr 12, 2010 at 2:46 PM, Robert Kern robert.k...@gmail.com wrote: On Mon, Apr 12, 2010 at 16:43, Gael Varoquaux gael.varoqu

Re: [Numpy-discussion] Name of the file associated with a memmap

2010-04-12 Thread Brent Pedersen
On Mon, Apr 12, 2010 at 3:31 PM, Brent Pedersen bpede...@gmail.com wrote: On Mon, Apr 12, 2010 at 3:08 PM, Robert Kern robert.k...@gmail.com wrote: On Mon, Apr 12, 2010 at 17:00, Brent Pedersen bpede...@gmail.com wrote: On Mon, Apr 12, 2010 at 2:46 PM, Robert Kern robert.k...@gmail.com wrote

Re: [Numpy-discussion] Utility function to find array items are in ascending order

2010-02-09 Thread Brent Pedersen
On Tue, Feb 9, 2010 at 7:42 AM, Vishal Rana ranavis...@gmail.com wrote: Hi, Is there any utility function to find if values in the array are in ascending or descending order. Example: arr = [1, 2, 4, 6] should return true arr2 = [1, 0, 2, -2] should return false Thanks Vishal

[Numpy-discussion] documenting optional out parameter

2009-10-25 Thread Brent Pedersen
hi, i've seen this section: http://docs.scipy.org/numpy/Questions+Answers/#the-out-argument should _all_ functions with an optional out parameter have exactly that text? so if i find a docstring with reasonable, but different doc for out, should it be changed to that? and if a docstring of a

Re: [Numpy-discussion] vectorizing

2009-06-05 Thread Brent Pedersen
On Fri, Jun 5, 2009 at 1:05 PM, Keith Goodmankwgood...@gmail.com wrote: On Fri, Jun 5, 2009 at 1:01 PM, Keith Goodman kwgood...@gmail.com wrote: On Fri, Jun 5, 2009 at 12:53 PM,  josef.p...@gmail.com wrote: On Fri, Jun 5, 2009 at 2:07 PM, Brian Blais bbl...@bryant.edu wrote: Hello, I have a

Re: [Numpy-discussion] vectorizing

2009-06-05 Thread Brent Pedersen
On Fri, Jun 5, 2009 at 1:27 PM, Keith Goodmankwgood...@gmail.com wrote: On Fri, Jun 5, 2009 at 1:22 PM, Brent Pedersen bpede...@gmail.com wrote: On Fri, Jun 5, 2009 at 1:05 PM, Keith Goodmankwgood...@gmail.com wrote: On Fri, Jun 5, 2009 at 1:01 PM, Keith Goodman kwgood...@gmail.com wrote

Re: [Numpy-discussion] vectorizing

2009-06-05 Thread Brent Pedersen
On Fri, Jun 5, 2009 at 2:01 PM, Keith Goodmankwgood...@gmail.com wrote: On Fri, Jun 5, 2009 at 1:22 PM, Brent Pedersen bpede...@gmail.com wrote: On Fri, Jun 5, 2009 at 1:05 PM, Keith Goodmankwgood...@gmail.com wrote: On Fri, Jun 5, 2009 at 1:01 PM, Keith Goodman kwgood...@gmail.com wrote

Re: [Numpy-discussion] loadtxt slow

2009-03-01 Thread Brent Pedersen
On Sun, Mar 1, 2009 at 11:29 AM, Michael Gilbert michael.s.gilb...@gmail.com wrote: On Sun, 1 Mar 2009 16:12:14 -0500 Gideon Simpson wrote: So I have some data sets of about 16 floating point numbers stored in text files.  I find that loadtxt is rather slow.  Is this to be expected?  

Re: [Numpy-discussion] loadtxt issues

2009-02-10 Thread Brent Pedersen
On Tue, Feb 10, 2009 at 9:40 PM, A B python6...@gmail.com wrote: Hi, How do I write a loadtxt command to read in the following file and store each data point as the appropriate data type: 12|h|34.5|44.5 14552|bbb|34.5|42.5 Do the strings have to be read in separately from the numbers?

Re: [Numpy-discussion] Comparison of arrays

2009-02-09 Thread Brent Pedersen
On Mon, Feb 9, 2009 at 6:02 AM, Neil neilcrigh...@gmail.com wrote: I have two integer arrays of different shape, e.g. a array([ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10]) b array([ 3, 4, 5, 6, 7, 8, 9, 10]) How can I extract the values that belong to the array a

[Numpy-discussion] genfromtxt view with object dtype

2009-02-04 Thread Brent Pedersen
hi, i am using genfromtxt, with a dtype like this: [('seqid', '|S24'), ('source', '|S16'), ('type', '|S16'), ('start', 'i4'), ('end', 'i4'), ('score', 'f8'), ('strand', '|S1'), ('phase', 'i4'), ('attrs', '|O4')] where i'm having problems with the attrs column which i'd like to be a dict. i can

Re: [Numpy-discussion] Renaming a field of an object array

2009-02-04 Thread Brent Pedersen
On Wed, Feb 4, 2009 at 2:50 PM, Pierre GM pgmdevl...@gmail.com wrote: All, I'm a tad puzzled by the following behavior (I'm trying to correct a bug in genfromtxt): I'm creating an empty structured ndarray, using np.object as dtype. a = np.empty(1,dtype=[('',np.object)]) array([(None,)],

Re: [Numpy-discussion] genfromtxt view with object dtype

2009-02-04 Thread Brent Pedersen
observed...). Let me know how it goes. P. that fixes it. thanks again pierre! -b On Feb 4, 2009, at 4:03 PM, Brent Pedersen wrote: On Wed, Feb 4, 2009 at 9:36 AM, Pierre GM pgmdevl...@gmail.com wrote: On Feb 4, 2009, at 12:09 PM, Brent Pedersen wrote: hi, i am using genfromtxt

[Numpy-discussion] genfromtxt

2009-01-21 Thread Brent Pedersen
hi, i'm using the new genfromtxt stuff in numpy svn, looks great pierre any who contributed. is there a way to have the header commented and still be able to have it recognized as the header? e.g. #gender age weight M 21 72.10 F 35 58.33 M 33 21.99 if i use np.loadtxt or

Re: [Numpy-discussion] genfromtxt

2009-01-21 Thread Brent Pedersen
On Wed, Jan 21, 2009 at 9:39 PM, Pierre GM pgmdevl...@gmail.com wrote: Brent, Mind trying r6330 and let me know if it works for you ? Make sure that you use names=True to detect a header. P. yes, works perfectly. thanks! -brent ___ Numpy-discussion

Re: [Numpy-discussion] numpy array change notifier?

2008-10-27 Thread Brent Pedersen
On Mon, Oct 27, 2008 at 1:56 PM, Robert Kern [EMAIL PROTECTED] wrote: On Mon, Oct 27, 2008 at 15:54, Erik Tollerud [EMAIL PROTECTED] wrote: Is there any straightforward way of notifying on change of a numpy array that leaves the numpy arrays still efficient? Not currently, no. -- Robert

Re: [Numpy-discussion] array gymnastics

2008-09-11 Thread Brent Pedersen
On Thu, Sep 11, 2008 at 6:03 PM, Alan Jackson [EMAIL PROTECTED] wrote: There has got to be a simple way to do this, but I'm just not seeing it. a = array([[1,2,3,4,5,6], [7,8,9,10,11,12]]) b = array([21,22,23,24,25,26]) What I want to end up with is : c = array([[1,7,21],

Re: [Numpy-discussion] a good polygon class?

2008-08-19 Thread Brent Pedersen
hi, http://pypi.python.org/pypi/Shapely supports the array interface, and has all the geos geometry operations: http://gispython.org/shapely/manual.html#contains On Tue, Aug 19, 2008 at 8:31 AM, mark [EMAIL PROTECTED] wrote: Hello List - I am looking for a good polygon class. My main