HPC Storage - File Systems
Talon 3.0 has a variety of different file systems. It is crucial that you understand the proper usage of these filesystems for best performance and stewardship of computational resources. Misuse of the filesystems could mean the termination of your jobs or loss of you data.
Summary of File Systems
Details of File Systems
Home directory: When you login your home directory (aka $HOME) is set to your EUID as such /home/euid123. This ext4 filesystem is local only to talon3 login and all home directories are made available to each compute node, via NFS mount. Quotas are set in /home, use the "quota" command to check your quota. Home directories are for storing, input, output, codes, scripts, ... and should never be used for runtime temporary/scratch files, as this causes undue traffic and slows the operation of this filesystem. For more on file permissions see the online UNIX manuals (aka man page) on chown, chgrp, chmod.
Scratch2 directory: For storage the HPC Team has deployed an updated high-speed parallel filesystem affectionately named scratch2. It is running Lustre on a DDN SFA7700X storage appliance. This filesystem has 1.4PB total available and can sustain speeds of up to 10GB/s over FDR Infiniband. Each compute node has the file system mounted as /storage/scratch2. The Scratch2 filesystem should be used when running your jobs. Files in this filesystem are subject to being removed after each run, so please copy any data you wish to save back to your home directory. Additionally each PI research group can request a shared file space where memebers of the same PI group can access. If your research group requires a shared access directory, send a ticket to firstname.lastname@example.org