Scratch

Scratch data is short-term data you are currently working on and will not need once results have been created, or data that is large and easily recreated or copied from its original source.

Standard Scratch

Temporary Storage is available under /data/scratch/abc123, however this is not backed up. Each user has 300GB of standard scratch space and it is NOT deleted automatically. Since this data is not actively curated, it tends to fill up with old files, defeating the purpose of short term data storage.

Important Note

Standard scratch storage is being phased out in favour of autoScratch described below.

autoScratch - Auto Deleting Scratch Space

/data/autoScratch stores files that you only wish to keep for a limited period.

This is one very large shared area without individual per user quotas, so you can use space so long as nobody else is using it at the same time.

This space is available to all cluster nodes and we intend to keep this storage as fast as possible.

There are two directories for every user, each has a different policy described below.

Important Note

autoScratch data is not backed up and any important data should be moved to other locations as quickly as possible. Data stored here will be automatically deleted. An email is sent to you shortly before this occurs.

Weekly

autoScratch weekly is held in /data/autoScratch/weekly/abc123 and deleted 14 days after the last modification time.

If you have any files which have not been modified for 10 days, you will receive a daily email listing the files due for deletion, until the files are automatically deleted, modified or moved to your home directory or group share. Only the first 100 files are shown in the email, with the remainder listed in /data/autoScratch/weekly/$USER/autoScratch-Expiring

Monthly

autoScratch monthly is held in /data/autoScratch/monthly/username and deleted 90 days after the last modification time.

If you have any files which have not been modified for 80 days, you will receive a daily email listing the files due for deletion, until the files are automatically deleted, modified or moved to your home directory or group share. Only the first 100 files are shown in the email, with the remainder listed in /data/autoScratch/monthly/$USER/autoScratch-Expiring

Note

Please do not abuse this service by modifying timestamps of your files to make this a permanent location as it is unfair to other users. Moving files from weekly to monthly is preferred.