Mira/Cetus/Vesta

Mira

Mira, an IBM Blue Gene/Q supercomputer at the Argonne Leadership Computing Facility, is equipped with 786,432 cores, 768 terabytes of memory and has a peak performance of 10 petaflops. Mira’s 49,152 compute nodes have a PowerPC A2 1600 MHz processor containing 16 cores, each with 4 hardware threads, running at 1.6 GHz, and 16 gigabytes of DDR3 memory. A 17th core is available for the communication library. 

IBM’s 5D torus interconnect configuration, with 2GB/s chip-to-chip links, connects the nodes, enabling highly efficient computation by reducing the average number of hops and latency between compute nodes. The Blue Gene/Q system also features a quad floating point unit (FPU) that can be used to execute scalar floating point instructions, four-wide SIMD instructions, or two-wide complex arithmetic SIMD instructions. This quad FPU provides higher single thread performance for some applications.

Mira users will have access to a GPFS file system with 24 PB of capacity and 240 GB/second bandwidth. Users will also have access to the HPSS data archive and Cooley, the ALCF's analysis and visualization cluster.  All of these resources are available through high performance networks including ESnet’s recently upgraded 100 gigabit per second links.

Mira System Configuration

  • Architecture: IBM BG/Q
  • Processor: 16 1600 MHz PowerPC A2 cores
  • Cabinets: 48
  • Nodes: 49,152
  • Cores/node: 16
  • Total cores: 786,432 cores
  • Memory/node: 16 GB RAM per node
  • Memory/core: 1 GB
  • Interconnect: 5D Torus Proprietary Network
  • Speed: 10 PF
  • Square Footage: 1,632 sq feet

Cetus

Cetus shares the same software environment and file systems as Mira. The primary role of Cetus is to run small jobs in order to debug problems that occurred on Mira.

Cetus System Configuration

  • Architecture: IBM BG/Q
  • Processor: 16 1600 MHz PowerPC A2 cores
  • Cabinets: 4
  • Nodes: 4,096
  • Cores/node: 16
  • Total cores: 65,536 cores
  • Memory/node: 16 GB RAM per node
  • Memory/core: 1 GB
  • Interconnect: 5D Torus Proprietary Network

Vesta

Vesta is the ALCF’s test and development platform, serving as a launching pad for researchers planning to use Mira. Vesta has the same architecture as Mira, but on a much smaller scale (two computer racks compared to Mira’s 48 racks). This system enables researchers to debug and scale up codes for the Blue Gene/Q architecture in preparation for Mira.

Vesta is also a resource for users applying for a Director’s Discretionary allocation and researchers preparing proposals for INCITE and ALCC.  By allocating time on Vesta for testing and development, Mira is kept clear for capability jobs.

Vesta System Configuration

  • Architecture: IBM BG/Q
  • Processor: 16 1600 MHz PowerPC A2 cores
  • Cabinets: 2
  • Nodes: 2,048
  • Cores/node: 16
  • Total cores: 32,768 cores
  • Memory/node: 16 GB RAM per node
  • Memory/core: 1 GB
  • Interconnect: 5D Torus Proprietary Network