Skip to content

Computing nodes

Computing nodes can only be accessed with the job manager (SLURM) ssh to nodes is only possible when you have jobs on nodes

to know the state of all nodes, use the check-cluster command

Spirit cluster (2025/04/01)

Number of core is without HyperThreading ( This is real core )

  • 2 nodes type :
  • zen4 : 64 cores 256GB 4GB/core (2 AMD EPYC 7452 32-Core)
    • 240GB max allocatable for job and 3840M ( not 4096 ) per core
    • there is also 4 nodes with 96 cores and 256GB (2 AMD EPYC 7552 48-Core)
  • zen16 : 32 cores 512GB 16GB/core (2 AMD EPYC 7302 16-Core)
    • 496GB max allocatable for job and 15872M ( not 16384) per core
  • 22 Computing nodes
  • 14 zen4
  • 6 zen16
  • 1 zen16/jupyter (shared)
  • 1 jupyter

Spiritx cluster (2025/04/01)

Number of core is without HyperThreading ( This is real core )

  • 2 nodes type :
  • zen4 :
    • 64 cores 256GB 4GB/core (2 AMD EPYC 7452 32-Core)
    • 240GB max allocatable for job and 3840M ( not 4096 ) per core
    • there is also 4 nodes with 96 cores and 256GB (2 AMD EPYC 7552 48-Core)
  • zen16 : 32 cores 512GB 16GB/core (2 AMD EPYC 7302 16-Core)
    • 496GB max allocatable for job and 15872M ( not 16384) per core
    • there is also 2 nodes with 64 cores and 1024GB with 15872M per core
  • 22 Computing nodes
  • 13 zen4
  • 7 zen16
  • 2 jupyter

check-cluster sample

user@spirit:~/> check-cluster 
NODE         STATE  FREE-CPU     FREE-MEM    LOAD  PARTITION       GRES          REASON 
spirit64-01   mix     12/64    161/240 Gb   50.63  zen4*           (null)                
spirit64-02   mix     1/64      69/240 Gb   50.82  zen4*           (null)                
spirit64-03   mix     5/64     100/240 Gb   49.06  zen4*           (null)                
spirit64-04   mix     13/64     90/240 Gb   24.02  zen4*           (null)                
spirit64-05   mix     10/64     40/240 Gb    0.00  zen4*           (null)                
spirit64-06   mix     62/64    233/240 Gb    2.45  zen4*           (null)                
spirit64-07   mix     53/64    199/240 Gb   27.06  zen4*           (null)                
spirit64-08   mix     63/64    237/240 Gb    1.33  zen4*           (null)                
spirit64-09   mix     36/96     90/240 Gb   60.02  zen4*           (null)                
spirit64-10   mix     51/96    140/240 Gb   29.95  zen4*           (null)                
spirit64-11   idle    96/96    240/240 Gb    0.01  zen4*           (null)                
spirit64-12   idle    96/96    240/240 Gb    0.01  zen4*           (null)                
spirit64-13   idle    64/64    240/240 Gb    0.00  zen4*           (null)                
spirit64-14   idle    64/64    240/240 Gb    0.00  zen4*           (null)                
spirit32-01   mix     11/32    279/496 Gb    6.97  zen16           (null)                
spirit32-02   mix     23/32    368/496 Gb    0.82  zen16           (null)                
spirit32-03   idle    48/48    496/496 Gb    0.00  zen16           (null)                
spirit32-04   alloc   0/48     376/496 Gb   48.01  zen16           (null)                
spirit32-05   mix     23/32    368/496 Gb    0.91  zen16           (null)                
spirit32-06   mix     8/32     376/496 Gb   24.10  zen16           (null)                
spirit32-07   mix     8/32     376/496 Gb   24.05  zen16           (null)                
spirit32-07   mix     8/32     376/496 Gb   24.05  jupyter         (null)                
spirit32-08   idle    32/32    496/496 Gb    0.01  jupyter         (null)                

active jobs : 42 , pending jobs: 3
active cpu  : 557 of 1344 (41%)
active nodes: 23 of 23 (100%)
limit for internal user are :

  • MaxTRESPerUser=cpu=96,mem=262544 MAXJOBS=64 MaxSubmitJobs=1000

limit for external user are :

  • MaxTRESPerUser=cpu=32,mem=131272 MAXJOBS=32 MaxSubmitJobs=500