Re: [Numpy-discussion] np.savez not multi-processing safe, alternatives?

2009-03-30 Thread Pauli Virtanen
Mon, 30 Mar 2009 09:03:56 -0400, Wes McKinney wrote: > I have a process that stores a number of sets of 3 arrays output which > can either be stored as a few .npy files or an .npz file with the same > keys in each file (let's say, writing roughly 10,000 npz files, all > containing the same keys 'a'

[Numpy-discussion] np.savez not multi-processing safe, alternatives?

2009-03-30 Thread Wes McKinney
I have a process that stores a number of sets of 3 arrays output which can either be stored as a few .npy files or an .npz file with the same keys in each file (let's say, writing roughly 10,000 npz files, all containing the same keys 'a', 'b', 'c'). If I run multiple processes on the same machine