MPSCP File Copy Utility
Table of Contents
IntroductionConfiguration Flags
Usage Examples
Introduction
MPSCP (Multiple Point Secure CoPy) is a new technology to the DoD High Performance Computing Modernization Program (HPCMP) providing an improvement in securely copying large files between systems. MPSCP has the same look and feel of the commonly used rcp and scp utilities, but provides a means to copy large files using multiple IP sockets between the source and destination systems. This results in an increase in the amount of bandwidth being used, and can result in a significant reduction in copy time. To work, MPSCP must be installed on both the source and destination systems. It is now available on all DOD HPCMP compute resources and has been configured for your use as part of the DoD HPCMP Baseline Configuration Initiative.
If you are having trouble using MPSCP on DoD HPCMP resources, please contact the CCAC and we will be happy to assist you.
Configuration Flags
- -b
- Set the blocksize for reads and writes in each data stream. The default is 1048576 and the maximum is 33554432.
- -p
- Preserve the access times, modification times and permissions from the original file.
- -r
- Recursively copy entire directories.
- -v
- Run in verbose mode, causing debugging messages to be printed. This can be helpful to resolve authentication and connection problems you may run into.
- -w
- Set the number of parallel copies (or IP sockets) to perform during this execution. The default is 1 and the maximum is 64.
Usage Examples
Copy a file from the current machine to a remote host using 4 sockets:
mpscp -w 4 ${WORKDIR}/output.job remote_host1:~/
Copy a directory from a remote host to MJM using 2 sockets:
mpscp -w 2 -r remote_host:~/project123 \ mjm-l1.arl.hpc.mil:/usr/var/tmp/project123