Skip to content

Computing nodes

Computing nodes can only be accessed with the job manager (SLURM) ssh to nodes is only possible when you have jobs on nodes

to know the state of all nodes, use the check-cluster command

Spirit cluster (2023/04/01)

Number of core is without HyperThreading ( This is real core )

  • 2 nodes type :
  • zen4 : 64 cores 256GB 4GB/core (2 AMD EPYC 7452 32-Core)
    • 240GB max allocatable for job and 3840M ( not 4096 ) per core
    • there is also 4 nodes with 96 cores and 256GB (2 AMD EPYC 7552 48-Core)
  • zen16 : 32 cores 512GB 16GB/core (2 AMD EPYC 7302 16-Core)
    • 496GB max allocatable for job and 15872M ( not 16384) per core
  • 20 Computing nodes
  • 12 zen4
  • 8 zen16

Spiritx cluster (2023/01/20)

  • 2 nodes type :
  • zen4 :
    • 64 cores 256GB 4GB/core (2 AMD EPYC 7452 32-Core)
    • 240GB max allocatable for job and 3840M ( not 4096 ) per core
    • there is also 4 nodes with 96 cores and 256GB (2 AMD EPYC 7552 48-Core)
  • zen16 : 32 cores 512GB 16GB/core (2 AMD EPYC 7302 16-Core)
    • 496GB max allocatable for job and 15872M ( not 16384) per core
  • 14 Computing nodes
  • 10 zen4
  • 4 zen16

check-cluster sample

user@spirit:~/> check-cluster 
NODE         STATE  FREE-CPU     FREE-MEM    LOAD  PARTITION       GRES          REASON 
spirit64-01   mix     12/64     97/240 Gb   52.01  zen4*           (null)                
spirit64-02   alloc   0/64       3/240 Gb   49.51  zen4*           (null)                
spirit64-03   mix     24/64     94/240 Gb   20.14  zen4*           (null)                
spirit64-04   mix     1/64       9/240 Gb   38.57  zen4*           (null)                
spirit64-05   mix     27/64    122/240 Gb   36.95  zen4*           (null)                
spirit64-06   mix     55/64    208/240 Gb    1.02  zen4*           (null)                
spirit64-07   mix     14/64    103/240 Gb   50.00  zen4*           (null)                
spirit64-08   mix     25/64     94/240 Gb   39.02  zen4*           (null)                
spirit64-09   mix     31/96     12/240 Gb   62.29  zen4*           (null)                
spirit64-10   mix     38/96     25/240 Gb   26.22  zen4*           (null)                
spirit64-11   mix     64/96    120/240 Gb   32.09  zen4*           (null)                
spirit64-12   mix     60/96    129/240 Gb   34.08  zen4*           (null)                
spirit32-01   mix     14/32    280/496 Gb    4.31  zen16           (null)                
spirit32-02   mix     27/32    432/496 Gb    1.00  zen16           (null)                
spirit32-03   mix     13/48    436/496 Gb   35.00  zen16           (null)                
spirit32-04   alloc   0/48     368/496 Gb   47.49  zen16           (null)                
spirit32-05   idle    32/32    496/496 Gb    0.00  zen16           (null)                
spirit32-06   idle    32/32    496/496 Gb    0.02  zen16           (null)                
spirit32-07   idle    32/32    496/496 Gb    0.00  jupyter         (null)                
spirit32-08   idle    32/32    496/496 Gb    0.04  jupyter         (null)                

active jobs : 85 , pending jobs: 2
active cpu  : 651 of 1184 (55%)
active nodes: 20 of 20 (100%)
limit for internal user are :

  • MaxTRESPerUser=cpu=96,mem=262544 MAXJOBS=64 MaxSubmitJobs=1000

limit for external user are :

  • MaxTRESPerUser=cpu=32,mem=131272 MAXJOBS=32 MaxSubmitJobs=500