Welcome the Smithsonian Institution High Performance Computing Wiki.
This Wiki holds information for the use of HPC resources at the Smithsonian.
Central to the SI HPC resources is the Smithsonian Institution High Performance Cluster (SI/HPC), named Hydra.
- High performance computing is administered by the Office of Research Computing within ODT and in collaboration with OCIO.
- OCIO's Herndon Data Center in Herndon, VA houses the high performance computing cluster, Hydra.
- The documentation is organized as follows:
- The complete documentation can be downloaded as a PDF document (200+ pages).
What's New
- Nov 22, 2024
- MATLAB runtime R2024a and R2024b are now available,
- load the
matlab/R2024bormatlab/2024amodule to access them.
- Nov 7, 2024
- The command dos2unix is accessible without the need to load any module and the man page is available (man dos2unix).
- We have added a workflow manager ("WFM") special queue, please consult the relevant documentation.
- Oct 28, 2024
- A new web-based SSH terminal (WeTTY) for accessing Hydra through a browser (e.g., https://telework.si.edu).
This new interface uses improved website technology for a better user experience: faster display of text to the screen; better support for pasting text into the browser, etc. compared to the web-based SSH interface we have been offering until now (shell-in-a-box).
Both the new and old systems are currently available, either on the Hydra landing page (https://hydra.si.edu) or via the "Hydra" option at https://telework.si.edu.
The new system is labeled "New Web SSH terminal (WeTTY)".If you're a user of the web-based SSH terminal, please try out the new system and let us know if you encounter any issues.
We will remove the old interface by December 1st if no major issues are identified.
- A new web-based SSH terminal (WeTTY) for accessing Hydra through a browser (e.g., https://telework.si.edu).
- Oct 26, 2024
- We have added a page explaining the automatic emails sent to users.
- Sep 16, 2024
We have installed the following:
- gnuplot on all the compute nodes (v5.2p4), not just the login nodes;
- the latest version of awscli (v 2.17.43):
- to access it load the tools/awscli module,
- version 2.15.27 is available via the tools/awscli/2.15.27 module;
- newest version of the compilers:
- gnu 14.2.0 via the gcc/14.2.0 module,
- the default version remains 8.5.0;
- Nvidia 24.3 and 24.5, via the nvidia/24.3 or nvidia/24.5 modules,
- the default version remains 23.9;
- Intel 2024.1 and 2024.2, via the intel/2024.1 and intel/2024.2 modules,
- the default version remains 2024.0.
- gnu 14.2.0 via the gcc/14.2.0 module,
- The various MPI flavors (vendor's, OpenMPI and MVAPICH) are available for each compiler version, including several versions whenever possible.
- refer to the module list, or use:
- module whatis gcc/14.2/
- module whatis nvidia/24/
- module whatis intel/24/
- refer to the module list, or use:
- The Nvidia compilers come with two different versions of cuda: 11.8 and 12.x.
- The Intel compilers come with Intel's distribution of python and conda.
If you have any questions or encounter any problems, email:
SI-HPC-Admin@si.edu for Sys-Admin related issues, SI-HPC@si.edu for non-SAO users who need help, hpc@cfa.harvard.edu for SAO users who need help. - Past news with more details can be found at the What's New page.
Quick Links
*: these pages are only accessible from trusted machines: within SI or SAO networks, or using VPN.
Reminder
- References to
Hydra(publications, proposals, etc.) should mention the cluster as:
Smithsonian Institution High Performance Computing Cluster. Smithsonian Institution. https://doi.org/10.25572/SIHPC.
- or as an acknowledgment:
"(Some of) [Tt]he computations in this paper were conducted on the Smithsonian High Performance Cluster (SI/HPC), Smithsonian Institution. https://doi.org/10.25572/SIHPC".
Last updated SGK/MPK.
