This page explains how to copy files for your analysis to and from Hydra.

(warning) Files should always be copied directly to the /pool/data or /scratch directories, not to your home directory (/home) because of space limitations. See here for more about data storage on Hydra.

These quick start instructions show how to configure FileZilla for file transfers, and a short introduction to scprsync or sftp.

Using FileZilla

  1. "FileZilla Client" is available for Mac, Windows and Linux systems.
    Mac screenshots are shown here, but use on other systems is similar.
  2. Open the FileZilla application.
  3. In the Quickconnect toolbar at the top of the window enter:
    1. Host: hydra-login01.si.edu or hydra-login02.si.edu
    2. Username: your Hydra username
    3. Password: your Hydra password
    4. Port: 22 


  4. Press the "Quickconnect" button to start the connection.

    (warning) If you get a warning about Saving passwords, choose "Do not save Passwords" and then the OK button.


    (warning) If you get a warning about Unknown host key, click the "Always trust..." checkbox and then the OK button.


  5. The files listed on the left side of the window are on your local computer, those on the right are on Hydra.
    1. Use the file tree on the left to navigate to the directory with your files to upload
    2. For the destination on Hydra, enter the path of your destination in the "Remote site:" text box
    3. Drag files from the left to a directory on the right side to upload them

Using SCP

The command scp is available on any Linux or Mac machine. To access it from a Mac, start a terminal to get a Unix prompt.

Use the command cd to go to where the files you want to copy are.

scp myfile remuser@hydra-login01.si.edu:/path/to/dest/ 

where:

scp myfile1 myfile2 remuser@hydra-login01.si.edu:/path/to/dest/ 
scp myfile* remuser@hydra-login01.si.edu:/path/to/dest/ 

The command scp always copy the file(s), the option '-p' (like in scp -p) will preserve the date information of the file(s) copied.

And

scp remuser@hydra-login01.si.edu:/path/to/location/myfile .


scp 'remuser@hydra-login01.si.edu:/path/to/location/myfile*' .

To learn more about scp, read the manual page (man scp).

Using RSYNC

The command rsync is available on any Linux or Mac machine. To access it from a Mac, start a terminal to get a Unix prompt. 

It synchronizes files between two hosts (machines), so it will not copy files that exists already and are up-to-date: it will copy a file if the one on the remote location is older.

Use the command cd to go to where the files you want top copy are.

rsync myfile remuser@hydra-login01.si.edu:/path/to/dest/
rsync myfile1 myfile2 remuser@hydra-login01.si.edu:/path/to/dest/
rsync myfile* remuser@hydra-login01.si.edu:/path/to/dest/

And

rsync remuser@hydra-login01.si.edu:/path/to/location/myfile .
rsync 'remuser@hydra-login01.si.edu:/path/to/location/myfile*' .

The difference with scp, is tharsync will only copy what is new,

rsync * remuser@hydra-login01.si.edu:/path/to/dest/

to synchronize the content of the current working directory.

Use the option '-n' (like in rsync -n) to check what rsync will do (it will list what will be copied, but not do it).

Three more useful options are:

that can be combined as rsync -azv

To learn more about rsync, read the manual page (man rsync).

Using SFTP or LFTP

You can also use the command sftp or lftp to copy files, it is also available on any/most Linux or Mac machine.

To access it from a Mac, start a terminal to get a Unix prompt.

Use the command cd to go to where the files you want top copy are.

sftp remuser@hydra-login01.si.edu
sftp> cd /path/to/dest/
sftp> put myfile
sftp> get myresults
sftp> exit

The main sftp commands are cdlcdput and get:

To learn more about sftp or lftp, read the manual page (man sftp, man lftp).


Last updated   MK/PF/SGK.