File-transfer

How to upload/data to/from ml nodes.

Using SCP command

• Prerequisite
  • Check the following link to get help on how to find my terminal
    • https://training.pages.sigma2.no/tutorials/unix-for-hpc/episodes/intro.html
  •  A UNIX terminal or the command line interface of Windows 10 or newer. For older windows versions use:
    • https://gitforwindows.org/
• Procedure. The example below sends the file called "afile.txt" from your laptop/desktop to ml1 node. As the home areas are shared, when you upload it to ml1, it is accessible from all ml nodes
  • You need to replace "<USERNAME>" with your UiO user name. There are two methods shown below and one or both methods might work for you depending on the versions of ssh on your computer

  • scp -J <USERNAME>@login.uio.no afile.txt <USERNAME>@ml1.hpc.uio.no:

  • OR

  • scp 'ProxyJump <USERNAME>@login.uio.no' afile.txt <USERNAME>@ml1.hpc.uio.no:

  • The above command would ask for the UiO password up to two time and if you provide the correct password the file would be transferred and would be placed in your home area.
• To download a file from ML nodes, you need to issue the opposite of the above command still from your laptop/desktop
• Procedure, to download a file called from-ml-node.txt from the home directory of any of the ml nodes,  to your laptop/desktop
• You need to replace "<USERNAME>" with your UiO user name. There are two methods shown below and one or both methods might work for you depending on the versions of ssh on your computer

• scp -J <USERNAME>@login.uio.no <USERNAME>@ml1.hpc.uio.no:from-ml-node.txt  .

• OR

• scp 'ProxyJump <USERNAME>@login.uio.no' <USERNAME>@ml1.hpc.uio.no:from-ml-node.txt  .

  • Please note the DOT at the end
  • The above command would ask for the UiO password up to two time and if you provide the correct password the file would be transferred to the current location (the folder you are on)

Folders or many files at once

Please use an archive to to create a an archive before transferring. Check the Archiving files section in the following document.

https://training.pages.sigma2.no/tutorials/hpc-intro/episodes/15-transferring-files.html