In a nutshell#
Sherlock features over 1,300 compute nodes, 41,500+ CPU cores and 500+ GPUs, for a total computing power of more than 3.4 Petaflops. That would rank it in the Top500 list of the most powerful supercomputers in the world.
The cluster currently extends across 2 Infiniband fabrics (EDR, HDR). A 6.1 PB parallel, distributed filesystem, delivering over 200 GB/s of I/O bandwidth, provides scratch storage for more than 5,900 users, and 900 PI groups.
The Sherlock cluster has been initiated in January 2014 with a base of freely available computing resources (about 2,000 CPU cores) and the accompanying networking and storage infrastructure (about 1 PB of shared storage).
Since then, it's been constantly expanding, spawning multiple cluster generations, with numerous contributions from many research groups on campus.
For more information about Sherlock's ongoing evolution and expansion, please see Cluster generations.
|login nodes||12|| |
|data transfer nodes||3||dedicated bandwidth for large data transfers|
Access to computing resources
Computing resources marked with below are freely available to every Sherlock user. Resources marked with are only accessible to Sherlock owners and their research teams.
|compute nodes ||154||4,032||- 56x 20 (Intel E5-2640v4), 128 GB RAM, EDR IB |
- 28x 24 (Intel 5118), 191 GB RAM, EDR IB
- 70x 32 (AMD 7502), 256 GB RAM, HDR IB
|development nodes ||2||40||- 2x 20 (Intel E5-2640v4), 128 GB RAM, EDR IB |
|large memory nodes ||5||408||- 1x 32 (Intel E5-2697Av4), 512 GB RAM, EDR IB |
- 1x 56 (Intel E5-4650v4), 3072 GB RAM, EDR IB
- 1x 64 (AMD 7502), 4096 GB RAM, HDR IB
- 2x 128 (AMD 7742), 1024 GB RAM, HDR IB
|GPU nodes ||26||748||- 1x 20 (Intel E5-2640v4), 256 GB RAM, EDR IB |
3x Tesla P40
- 1x 20 (Intel E5-2640v4), 256 GB RAM, EDR IB
4x Tesla P100 PCIe
- 3x 20 (Intel E5-2640v4), 256 GB RAM, EDR IB
4x Tesla V100_SXM2
- 1x 24 (Intel 5118), 191 GB RAM, EDR IB
4x Tesla V100_SXM2
- 2x 24 (Intel 5118), 191 GB RAM, EDR IB
4x Tesla V100 PCIe
- 16x 32 (AMD 7502P), 256 GB RAM, HDR IB
4x Geforce RTX_2080Ti
- 2x 32 (AMD 7502P), 256 GB RAM, HDR IB
4x Tesla V100S PCIe
|privately-owned nodes ||1,203||36,284||36 different node configurations, including GPU and bigmem nodes|
For more information about storage options on Sherlock, please refer to the Storage section of the documentation.
Sherlock is architected around shared storage components, meaning that users can find the same files and directories from all of the Sherlock nodes.
- Highly-available NFS filesystem for user and group home directories (with hourly snapshots and off-site replication)
- High-performance Lustre scratch filesystem (6.1 PB parallel, distributed filesystem, delivering over 200 GB/s of I/O bandwidth)
- Direct access to SRCC's Oak long-term research data storage system (42.1 PB)