Skip to content

STAR-CCM+

STAR-CCM+ is a complete multi-disciplinary platform for the simulation of products and designs operating under real-world conditions.

STAR-CCM+ is available as a module on Apocrita.

Usage

To run the default version of STAR-CCM+, simply load the starccm module:

module load starccm

For usage documentation, run starccm+ -help

Example jobs

When running jobs, replace SIM-FILE in the examples below with the name of your simulation file.

Serial job

Here is an example job running on 4 cores and 16G of memory on a single node:

#!/bin/bash
#SBATCH --ntasks=4        # (or -n 4) Request 4 cores
#SBATCH --mem-per-cpu=4G  # Request 4GB RAM per core (16GB total)
#SBATCH --time=1:0:0      # (or -t 1:0:0) Request 1 hour runtime

module load starccm

starccm+ -batchsystem slurm \
  -batch SIM-FILE

Parallel job

Here is an example job running on 96 cores across 2 ddy nodes with MPI:

#!/bin/bash
#SBATCH --partition=parallel  # (or -p parallel) Request the parallel partition
#SBATCH --nodes=2             # (or -N 2) Request 2 nodes
#SBATCH --ntasks=96           # (or -n 96) Request 96 cores
#SBATCH --time=240:0:0        # (or -t 240:0:0) Request 240 hours runtime
#SBATCH --exclusive           # Request all CPUs per node
#SBATCH --mem=0               # Request all available memory per node

module load starccm

starccm+ -batchsystem slurm \
  -mpi intel \
  -batch SIM-FILE

GPU job

Do not use NVIDIA MPS

STAR-CCM+ integrates the NVIDIA Multi-Process Service (MPS) but this should not be used on Apocrita as it interferes with correct GPU allocation and prevents other users on the same node from using their assigned GPU(s). Please ensure you add -gpgpu auto:nomps to all GPU jobs to ensure that MPS is disabled (see below example).

Here is an example job running on 8 cores and 1 GPU:

#!/bin/bash
#SBATCH --partition=gpushort  # (or -p gpushort) Request the gpushort partition
#SBATCH --ntasks=8            # (or -n 8) Request 8 cores
#SBATCH --time=1:0:0          # (or -t 1:0:0) Request 1 hour runtime
#SBATCH --mem-per-cpu=11G     # Request 11GB RAM per core (88GB total)
#SBATCH --gres=gpu:1          # Request 1 GPU of any type

module load starccm

starccm+ -batchsystem slurm \
  -mpi intel \
  -batch SIM-FILE \
  -gpgpu auto:nomps