Data Sharing

Collaborate with external users by using high-performance data storage and sharing tools.

Capabilities

Research conducted with supercomputing resources both within and outside ALCF systems often produces large, high-fidelity, cutting-edge scientific datasets and visualizations. Unique within the DOE, the ALCF offers large-scale data sharing, storage, and management efforts for users and the broader research community. These tools are available to members of the research community who do not leverage ALCF systems. 

Applications

In recent years, several teams of researchers have leveraged ALCF’s data sharing platforms in their research. Some examples include:

  • Developing a protocol for creating and sharing FAIR data and AI models within a unified computational framework
  • Utilizing Globus to enable rapid data analysis to allow APS users to use near real-time feedback from beam lines
  • OpenCosmo, a project designed to make large cosmological simulation datasets widely available and enable flexible data access and analysis.

Systems

The ALCF Community Data Co-Op (ACDC) provides facility users with a platform for data access and sharing to support data-driven research, discovery, and analysis. Through ACDC, users have access to Eagle, a large-scale data-sharing platform. Eagle is one of DOE’s most advanced data resources, providing scientists across the nation with a high-performance platform for storing and sharing massive datasets. Eagle supports sharing data with collaborators outside of the ALCF user community via Globus. 

Globus is a data management and compute platform that was developed at Argonne and the University of Chicago. It provides an automated backbone for securely moving data, running computations, and linking processes across facilities and research teams, allowing users to focus on their research. Globus reduces the friction of data sharing by enabling scientists (including both ALCF users and external researchers) to share their data with collaborators throughout the scientific community. 

Access

ALCF users and external researchers can use Globus to share their data. You can learn more about Globus at https://www.globus.org or in our user documentation.