The SDSU Division of Technology and Security (DTS) manages a 240 TFLOP (approx.) cluster and parallel file system. Funding for this resource came from an NSF MRI program award: “MRI: Acquisition of a High-Performance Cluster to Enable Advanced Bioscience and Engineering Research,” NSF 15-504, MRI Award 1726946. This cluster instrument includes a substantial general compute pool, 3TB high memory, and NVIDIA GPU nodes to support CPU, high memory and GPU intensive computing. The parallel file system includes 1.2 PB of high-speed storage space for data-intensive compute jobs within the cluster. The cluster leverages three networks consisting of 100Gbps Infiniband (Cluster data application processing), 10 Gbps Ethernet (science data transfers) and 1Gbps (cluster management).
In 2018, the state of South Dakota implemented a high-speed fiber-optic network, which brought 100Gbps of high-speed broadband connectivity to support research activities within state, regional (Great Plains Network Research Platform) and the national research networks (Internet 2). In the fourth quarter of 2017, the SDSU Division of Technology and Security (DTS) upgraded its local area network infrastructure to support 100 GBPS of data transmission capacity within its core network router system. This work also included an upgrade of the sub-core switching to 40Gbps and all network building switching to a minimum of 10Gbps of connectivity.
In 2014, the South Dakota State University (SDSU) Division of Technology and Security (DTS) were awarded an NFS CC* Cyberinfrastructure Program grant: “CC*IIE Networking Infrastructure: Building a Science DMZ and Enhancing Science Data Movement to Support Data-Intensive Computational Research at South Dakota State University,” NSF 14-521, CC*IIE Project Reference: 1440622. The project goals revolve around a theme of enhancing cross-institutional research collaboration with the deployment of a high-speed frictionless (Science DMZ) network. Upgrade work in 2018 involved the implementation of a robust data management sharing service (Globus) and a new 100 Gbps Flash I/O Network Appliance (FIONA) data transfer node, an integral element for the inclusion of SDSU in the Great Plains Network (GPN) Research Platform.
SDSU DTS manages a Global Parallel File System (GPFS) and various Hitachi Data System storage area network systems that provide enterprise-class storage for single instance servers and cluster systems. Raw data, metadata, and the products of research are archived and made publicly available within SDSU’s OpenPrairie; a product contracted between SDSU and the Bepress corporation (Digital Commons). The SDSU DTS manages a 2.5PB cold storage data (magnetic tape) repository for science data archival purposes. This system is located several blocks away from the SDSU Data Center in a separate building.
Data Center Support Services
The SDSU DTS (Division of Technology and Security) houses all servers, storage, and central networking equipment for the Brookings, SD campus within the Morrill Hall building, rooms 112 and 114. The room is configured in a hot-and-cold aisle layout with all cabling overhead in existing trays. The raised flooring panels are rated for 1000 PSI concentrated load. The GDP panel supplies all power within the Data Center and is rated at 1000 amps. Also, the GDP panel is equipped with a TVSS rated at160 kA. UPS-1 and UPS-2 are both rated at 160 kVA (144 kW). Generator 1 and Generator 2 are both rated at 150 kW. Two DX CRAC cooling units have 22 tons and 16 tons of cooling capacity (38 tons of cooling total). Also, the room cooling includes, three chilled water CRAC units having 8 tons of cooling capacity each (24 tons of cooling total).
DTS Research Networking / Computing Support Staff
SDSU DTS permanent staff support for HPC includes a Manager, two Science Domain Specialists, Cyberinfrastructure Engineering Specialist, and a Systems Administrator. Graduate Student workers are also employed to help support research computing desktop, single server, cluster application support, and programming.