Storage Systems

gpfs.png

Apocrita has over a petabyte of IBM Spectrum Scale (formerly called GPFS) storage. This is a high-performance clustered file system which provides concurrent high-speed file access to your data.

It is widely used in HPC both commercially and in academia. The storage system is connected to the QMUL Enterprise backup solution (TSM) to provide a high level of data resilience.

Home Directories

All users have a home directory mounted under /data/home (e.g. /data/home/abc123). This is networked storage, is accessible from all nodes in the cluster and is backed up nightly. This space is deliberately small and limited to 50GB per user (10GB for taught students).

Scratch

Scratch space is used for temporary storage of files.

Lab/Project storage space

Users may have project or lab storage allocated to them, the location of this storage is specific to your group. Each research project or lab can have 1TB of free shared space for this. If you do not have this set up for your group, or you do not have access to it, please email its-research-support@qmul.ac.uk.

If you or your group requires more than this, Additional Storage space can be purchased.

In addition to data storage for users, Apocrita also stores some widely used public datasets.

Local disk space on nodes - $TMPDIR

There is temporary space available on the nodes that can be used when you submit a job to the cluster. The size of this storage per node type is listed on the individual node types page.

As this storage is physically located on the nodes, it cannot be shared between them, but it might provide better performance for I/O intensive tasks than networked storage. Examples are on the Using $TMPDIR page.

Additional Storage

Additional backed-up storage is available for purchase at £150 per 1TB per annum. This can be arranged by submitting an email to its-research-support@qmul.ac.uk and including an Agresso budget code.

If you have a requirement for a significantly larger storage space please contact our Research Consultants and they will help you find the right solution.