Today I ran:
seq 1000000 | parallel --pipe --tee wc ::: {1..13000}This feeds 6.8 MB to 13000 wc's running in parallel (+ 26000 helper processes) giving a total of 39000 parallel processes. It took 15 GB RAM and did not feel very fast. But it worked correctly. It also required 'ulimit -u 40000; ulimit -n 100000'. Have you used GNU Parallel to push your system to the limit? What is your record? /Ole
