Resources
Research Computing and Data (RCD) offers many resources to support students, faculty and staff at Clemson University. These include our high-performance research computing cluster, Palmetto 2, our Indigo Data Lake, data transfer tools and GitLab. These resources play a vital role in research ascension and position Clemson University well in the high-performance computing space.
Palmetto 2 Cluster
Clemson’s Palmetto Cluster empowers the University research community with vital resources for innovation. Our advanced knowledge infrastructure integrates world-class provisions in high-performance computing, high-performance networks, data visualization, storage architectures and middleware. All Clemson researchers can use and receive training on the Palmetto Cluster for free.
Learn More About Palmetto 2Indigo Data Lake
The Indigo Data Lake is the new research data storage solution provided by the Research Computing and Data (RCD) group. Indigo is designed to provide high-performance and high-capacity data storage solutions for a wide variety of applications. With multiple access methods, it is easier than ever to connect, store, and retrieve your research data. These benefits can be shared with other users by adding collaborators to your space. The hardware behind Indigo is powered by VAST Data.
Learn More About Indigo Data Lake
Data Transfer
There are many ways to move data in and out of Palmetto for your research. Selecting the correct method is important, since using the wrong method might impact the performance of shared resources for other users.
Methods
Globus and SFTP via the data transfer nodes (DTNs) are the recommended methods to transfer data between filesystems, as well as into and out of the cluster. The DTNs contain the fastest connections to all storage systems and are dedicated resources for transferring data.
Below are the supported methods to transfer data into Palmetto.
| Method | Maximum Transfer Size |
|---|---|
| Globus | All Transfers |
| STFP (Data Transfer Nodes) | All Transfers |
| STFP (login nodes) | Small files (< 100 MB total) |
| Open OnDemand | Very small files (< 50 MB total) |
For more information about Globus, SFTP, Open OnDemand or Rclone, visit the RCD Documentation page to learn more.
GitLab
Clemson Research Computing and Data maintains a GitLab instance at git.rcd.clemson.edu. Users with an approved GitLab Group Allocation on ColdFront and those with Palmetto access are authorized to use GitLab.
GitLab group provides enhanced features for organizing projects and repositories under a common namespace, simplifying permission management and collaboration on larger, team-based initiatives. PI's can create GitLab groups by requesting a GitLab Group Allocation on ColdFront.
