On Thu, May 11, 2017 at 5:39 PM, Jason Paul Joines <[email protected]> wrote:
> GNU Parallel Users,
>
>
> I am using GNU Parallel version 20170422 on Scientific Linux
> release 6.6. When using rsync log file format options with parallel,
> the logs are filled with errors because each log file format option gets
> interpreted as a file to transfer that does not exist.
You are writing to the same file in parallel. That will not work.
> I get the same behavior if I enclose the options in single
> quotes instead of double quotes, put the log-file-format option before
> the log-file option, or pass the the transfer list into a BASH script
> that contains: parallel -j 8 rsync -aHAX --delete --log-file-format='%o
> %f %L %l %b %i %t' --log-file ../testlog {} ../ddir/ ::: $@
>
> Any ideas how to get parallel and rsync log-file-format options
> to cooperate?
Try this:
parallel -j 8 rsync -aHAX --delete --log-file-format='%o %f %L %l %b
%i %t' --log-file ../testlog{#} {} ../ddir/ ::: $@
This will create a new file for each job. Or this:
parallel -j 8 rsync -aHAX --delete --log-file-format="'%o %f %L %l %b
%i %t'" --log-file /dev/stdout {} ../ddir/ ::: * > ../logfile
/Ole
