Do note that SharedArrays will only work with bitstype arrays, not with,
for example, an array of Strings.
Assuming that you are parsing these files and generating an large amount of
small strings, I would suspect that the time being taken is in serializing
and deserializing these large amount of
Hi Amit,
Well in my case I'm parsing a bunch of files, store results in dictionaries
which are merged back into one big array of dictionaries. Since each file
can be parsed independently pmap seems to be good and clean fit. But
because size of each Dictionary is quite big merging the data back
Hi There,
I just want to confirm this is a desired behavior of map/pmap functions.
What I am noticing is that in case of using pmap functions need to return data
(copy of input data), whereas map works fine with referenced values. I'd love
to have similiare behaviuor in pmap since it is much
pmap always copies since the functions are executed in a different worker
process. Do you want to collect the results of pmap execution in a
dictionary? What is the actual problem you are trying to solve?
On Fri, May 30, 2014 at 12:53 AM, Kuba Roth kuba.r...@gmail.com wrote:
Hi There,
I just
