linux:parallel_rsync
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionLast revisionBoth sides next revision | ||
parallel_rsync [2012/12/06 18:08] – dodger | linux:parallel_rsync [2019/07/29 12:11] – [Code] dodger | ||
---|---|---|---|
Line 1: | Line 1: | ||
+ | ====== [SCRIPT] psync (parallel rsync) ====== | ||
+ | |||
====== Description ====== | ====== Description ====== | ||
This set of scripts will parallelize the transfer of a huge directory tree keeping in mind a maximum number of simultaneous transfers. | This set of scripts will parallelize the transfer of a huge directory tree keeping in mind a maximum number of simultaneous transfers. | ||
Line 4: | Line 6: | ||
====== Instructions ====== | ====== Instructions ====== | ||
I suggest you tu launch psync with the following line: | I suggest you tu launch psync with the following line: | ||
- | < | + | < |
./psync.sh / | ./psync.sh / | ||
</ | </ | ||
Line 29: | Line 31: | ||
==== Code ==== | ==== Code ==== | ||
- | <code> | + | <file bash psync.sh> |
#!/bin/bash | #!/bin/bash | ||
[ ! $1 ] && echo " | [ ! $1 ] && echo " | ||
Line 56: | Line 58: | ||
local let MAXPARALEL=20 | local let MAXPARALEL=20 | ||
- | LAUCHRSYNC=" | + | LAUCHRSYNC=" |
local let y=0 | local let y=0 | ||
for FOLDER in $(find ${TARGET} -mindepth ${MAXDEPTH} -maxdepth ${MAXDEPTH} -type d) ; do | for FOLDER in $(find ${TARGET} -mindepth ${MAXDEPTH} -maxdepth ${MAXDEPTH} -type d) ; do | ||
Line 84: | Line 86: | ||
sync_this ${TARGET} | sync_this ${TARGET} | ||
- | </code> | + | </file> |
==== Script Variables ==== | ==== Script Variables ==== | ||
Line 102: | Line 104: | ||
==== Code ==== | ==== Code ==== | ||
- | <code> | + | <file bash launch_rsync.sh> |
#!/bin/bash | #!/bin/bash | ||
# launch_rsync.sh | # launch_rsync.sh | ||
Line 129: | Line 131: | ||
echo "$RES : ${TARGET}" | echo "$RES : ${TARGET}" | ||
fi | fi | ||
- | </code> | + | </file> |
==== Variables ==== | ==== Variables ==== | ||
^ Variable ^ Description ^ | ^ Variable ^ Description ^ |
linux/parallel_rsync.txt · Last modified: 2022/02/11 11:36 by 127.0.0.1