Posted in 2024

How to get more memory for my Slurm job

The amount of memory specified on the Levante configuration page for different node types refers to the total physical memory installed in a node. Since some memory is reserved for the needs of the operating system and the memory-based local file system (e.g. /tmp, /usr), the amount of memory actually available for job execution is less than the total physical memory of a node.

The table below provides numbers for the preset amounts of physical memory (RealMemory), memory reserved for the system (MemSpecLimit) and memory available for job execution (which is the difference between RealMemory and MemSpecLimit) for three Levante node variants:

Read more ...

Slurm-managed cronjobs

To execute recurring batch jobs at specified dates, times, or intervals, you can use the Slurm scrontab tool. It provides a reliable alternative to the traditionally used cron utility to automate periodic tasks on Levante.

To define the recurring jobs, Slurm uses a configuration file, so-called crontab, which is handled using the scrontab command. The scrontab command with the -e option invokes an editing session, so you can create or modify a crontab:

Read more ...

HSM module cleanup April 2024

On 30 April 2024 many modules of old slk and slk_helpers version will be removed from Levante.

modules which will be removed:

Read more ...

Changelog slk_helpers v1.12.10

Update from slk_helpers v1.10.2 to 1.12.10

see here for changes from slk_helpers v1.9.7 to v1.10.2

Read more ...

HSM: check storage location of files

From time to time connection issues between StrongLink and one of the tape libraries occur. If the retrieval of a file fails repeatedly in such a situation, then it is useful to be able to check whether the file is stored on a tape in the affected library. For this purpose we provide the commands slk_helpers resource_tape and slk_helpers tape_library.

Example:

Read more ...

How to keep disk usage under control

Below, we provide some tips how to monitor your disk usage on Levante and find large files and directories in case you are nearing or exceeding your disk storage quota.

You can check your disk quota on Levante with the lfsquota.sh wrapper script stored in the /sw/bin directory. To display disk usage and limits for the personal directories assigned to your user account (i.e. /home and /scratch), use:

Read more ...