The ALCF Inference Service provides researchers with access to a wide range of AI models running on dedicated ALCF systems. By offering AI inference as a shared resource, the service enables researchers to analyze data, test new ideas, and incorporate AI into scientific workflows without deploying or managing models themselves.
Researchers can use the service for a variety of tasks, including:
- Analyzing large datasets from simulations, experiments, and observational studies
- Extracting insights from scientific publications and other documents
- Generating and refining code
- Building AI-enabled applications and workflows
- Supporting retrieval-augmented and agentic systems
- Accelerating hypothesis generation and data interpretation
Systems and Models
The ALCF Inference Service runs on dedicated systems, including Sophia, an NVIDIA DGX A100 cluster, and Metis, a SambaNova platform optimized for high-throughput inference workloads. Additional NVIDIA-based systems, including Minerva and Tara, will expand support for the service in the future.
Users have access to a collection of open-source models, including Google’s Gemma series, Meta’s LLaMA models, and OpenAI’s GPT-OSS family, as well as domain-specific foundation models, computer vision models, and in-house models developed at Argonne, such as AuroraGPT.
