Calculation resources
Description of the available calculation resources
EXPLOR Material
| Partition | Node-id | Material | CPU | GPU | # of nodes | # of cores / node | # of total cores | Available memory / node | Default memory / core | Network | Total Tflops | Node-id |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| std | cna[02...64], cnb[01..64] | DELL C6320 | Intel Xeon E5-2683v42.1 GHz, AVX2 | n/a | 84 | 32 | 2688 | 120GB | 3.75GB | Omnipath100GB/s | 32.2 | cna[02...64], cnb[01..64] |
| std | cnc[01-11,13-48] | DELL C6420 | Intel Xeon Gold 61302.1 GHz, AVX512 | n/a | 42 | 32 | 1344 | 180GB | 5.625GB | Omnipath100GB/s | 16.6 | cnc[01-11,13-48] |
| std | cnd[01-04,06-12] | DELL C6220 | Intel Xeon E5-2640v22.0 GHz, AVX | n/a | 11 | 16 | 192 | 60GB | 3.75GB | Infiniband40GB/s | 0.8 | cnd[01-04,06-12] |
| std | cne[01-16] | DELL R630 | Intel Xeon E5-2637v43.5 GHz, AVX2 | n/a | 16 | 8 | 128 | 120GB | 15.0GB | Ethernet10GB/s | 0.4 | cne[01-16] |
| std | cni[25-28] | Dell C6420 | Intel Xeon Gold 62302.1 GHz, AVX512 | n/a | 4 | 40 | 160 | 180GB | 4.5GB | Infiniband100GB/s | 3.0 | cni[25-28] |
| std | cnl[01] | Dell R6615 | AMD EPYC 92542.9 GHz, AVX2 | n/a | 1 | 24 | 24 | 240GB | 10.0GB | Infiniband100GB/s | 0.6 | cnl[01] |
| gpu | gpb[01-06] | DELL C4130 | Intel Xeon E5-2683v42.1 GHz, AVX | NVIDIA TeslaP100 | 64xGPU/nœud | 32 | 192 | 120GB | 3.75GB | Omnipath100GB/s | 65.1 | gpb[01-04,06] |
| gpu | gpc[01-04] | DELL T630 | Intel Xeon E5-2683v42.1 GHz, AVX | GEFORCE GTX1080 Ti | 42xGPU/nœud | 32 | 128 | 64GB | 2.0GB | Omnipath100GB/s | 46.6 | gpc[01-04] |
Hosted Material
The mesocentre is also intended to house material.Contact us explor-contact@univ-lorraine.fr for any further information about hosting material.
| Partition | Node-id | Material | CPU | GPU | # of nodes | # of cores / node | # of total cores | Available memory / node | Default memory / core | Network | Total Tflops (DP) | Partition |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| mysky | cnc[53-64] | DELL C6420 | Intel Xeon Gold 61302.1 Ghz, AVX512 | n/a | 9 | 32 | 288 | 180GB | 5.6GB | Omnipath100GB/s | 4.2 | mysky |
| myhf | cnf[02-06] | DELL C6420 | Intel Xeon Gold 51223.6 Ghz, AVX512 | n/a | 5 | 8 | 40 | 96GB | 12.0GB | Omnipath100GB/s | 0.2 | myhf |
| mycas | cng[01-05,07-09,11-12] | DELL C6820 | Intel Xeon Gold 62302.1 GHz, AVX512 | n/a | 8 | 40 | 320 | 180GB | 4.50GB | Omnipath100GB/s | 6.7 | mycas |
| mylhf | cnh[01-02] | DELL R640 | Intel Xeon Gold 52223.8 Ghz, AVX512 | n/a | 2 | 8 | 16 | 758GB | 94.8GB | Omnipath100GB/s | 0.1 | mylhf |
| mylemta | cni[01-16] | Dell C6420 | Intel Xeon Gold 62302.1 GHz, AVX512 | n/a | 16 | 40 | 640 | 180GB | 4.50GB | Infiniband100GB/s | 12.1 | mylemta |
| mystdcas | cni[17-24,29-32] | Dell C6420 | Intel Xeon Gold 62302.10GHz, AVX512 | n/a | 12 | 40 | 480 | 180GB | 4.50GB | Infiniband100GB/s | 9.1 | mystdcas |
| mystdepyc | cnj[01-64] | DELL 6425 | AMD EPYC 74132.65 GHz, AVX2 | n/a | 64 | 48 | 3072 | 246GB | 5.1GB | Infiniband100GB/s | 123.5 | mystdepyc |
| myhfcas | cnk[01-08] | Dell R640 | Intel Xeon Gold 52223.8 Ghz, AVX512 | n/a | 8 | 8 | 64 | 180GB | 22.5GB | Infiniband100GB/s | 0.2 | myhfcas |
| mylpct | cnl[02-04] | Dell R6615 | AMD EPYC 92542.9 GHz, AVX512 | n/a | 3 | 24 | 72 | 240GB | 10.0GB | Infiniband100GB/s | 1.9 | mylpct |
| mygeo | cnl[05-18] | Dell R6615 | AMD EPYC 9354P3.2 GHz, AVX512 | n/a | 14 | 32 | 448 | 512GB | 16.0GB | Infiniband100GB/s | 11.4 | mygeo |
| myt4 | gpd[01-03] | DELL R740 | Intel Xeon Gold 6126CPU @ 2.6 GHz, AVX512 | TESLA T4 | 33xGPU/nœud | 24 | 96 | 86GB | 3.6GB | Infiniband100GB/s | 25.0 | myt4 |
| myrtx6000 | gpe[01-02] | Dell R740 | Intel Xeon Gold 62302.1 GHz, AVX512 | RTX6000 | 22xGPU/nœud | 40 | 80 | 182GB | 4.55GB | Infiniband100GB/s | 31.0 | myrtx6000 |
| mylpctgpu | gpf[01] | Dell R760xa | Intel Xeon Gold 52182.3 GHz, AVX512 | L40 | 14xGPU/nœud | 32 | 32 | 120GB | 3.75GB | 90.9 | mylpctgpu |
Details of GPU nodes
| Node | Partition | CPU | GPU | Memory/node (GB) | Memory/GPU-card (GB) | Cuda Ver. |
|---|---|---|---|---|---|---|
| gpb01 | gpu | 32 | 4 | 118 | 16.0 | 12.2 |
| gpb02 | gpu | 32 | 4 | 118 | 16.0 | 12.2 |
| gpb03 | gpu | 32 | 4 | 118 | 16.0 | 12.2 |
| gpb04 | gpu | 32 | 4 | 118 | 16.0 | 12.2 |
| gpb05 | gpu | 32 | 4 | 118 | 16.0 | 12.2 |
| gpb06 | gpu | 32 | 4 | 118 | 16.0 | 12.2 |
| gpc01 | gpu | 32 | 2 | 54 | 11.0 | 12.2 |
| gpc02 | gpu | 32 | 2 | 54 | 11.0 | 12.2 |
| gpc03 | gpu | 32 | 2 | 54 | 11.0 | 10.1 |
| gpc04 | gpu | 32 | 2 | 54 | 11.0 | 10.1 |
| gpd01 | gpu | 24 | 3 | 86 | 15.0 | 12.2 |
| gpd02 | gpu | 24 | 3 | 86 | 15.0 | 12.2 |
| gpd03 | gpu | 24 | 3 | 86 | 15.0 | 12.2 |
| gpe01 | gpu | 40 | 2 | 182 | 22.5 | 12.2 |
| gpe02 | gpu | 40 | 2 | 182 | 22.5 | 12.2 |
| gpf01 | gpu | 32 | 4 | 118 | 44.9 | 12.4 |
Global Computing Power
Total Power: 480 TFlops
| # Number of Nodes | # Number of Cores | CPU Power (TFlops) | GPU Power (TFlops) |
|---|---|---|---|
| 315 | 10496 | 220 | 260 |
Intel Skylake Processors (6th generation):
The "skylake" nodes cnc[01-64] and cnf[02-06] include 56 nodes connected on a low-latency 100GB network. Each node has two Skylake processors Intel Xeon Gold 6130 Processor (each processor has 16 cores clocked at 2.10 GHz, i.e., 32 cores per node) and 192 GB of RAM. This configuration is suitable for massively parallel applications.
The only real difference between Skylake (6th generation) and Broadwell (5th generation) processors is that Skylake implements more efficient computation instructions. Therefore Skylake can perform more operations per second (flops) than Broadwell — provided programs are recompiled with the proper options to enable use of the new registers (AVX512).
Intel Broadwell Processors (5th generation):
The "standard" nodes cn(a/b)[01-64] include 83 nodes connected on a low-latency 100GB network. Each node has two Broadwell processors Intel Xeon E5-2683 v4 (each processor has 16 cores clocked at 2.10 GHz, i.e., 32 cores per node) and 128 GB of RAM. This configuration is suitable for massively parallel applications.
The "high-frequency" nodes cne[01-16] include 16 nodes connected on a 10GB Ethernet network. Each node has two Intel Xeon E5-2637 v4 processors (each with 4 cores clocked at 3.5 GHz) and 128 GB of RAM. These nodes are suited for serial or lightly parallelized applications.
The GPU nodes gpb[01-06] include 6 nodes connected on a low-latency 100GB network. Each node has two Broadwell processors Intel Xeon E5-2683 v4 (each with 16 cores at 2.10 GHz, i.e., 32 cores per node), 128 GB RAM and 4 NVIDIA Tesla P100 cards.
The GPU "GTX" nodes gpc[01-04] include 4 nodes connected on a low-latency 100GB network. Each node has two Broadwell processors Intel Xeon E5-2683 v4 (each with 16 cores at 2.10 GHz, i.e., 32 cores per node), 128 GB RAM and 2 GEFORCE GTX 1080 Ti cards.
Intel Ivy Bridge Processors (3rd generation):
The cndi[01-12] nodes include 11 nodes connected on a low-latency 40Gb Infiniband network. Each node has two Intel Xeon E5-2640 v2 2.0 GHz processors (each with 8 cores at 2.0 GHz) and 64 GB of RAM. These nodes are suitable for parallel applications.
The general allocation in the std partition now includes nodes from exclusive partitions (myXXX). If you do not select any special nodes, your JOB may be preempted due to job priority on MyXXX nodes. To avoid this, consider selecting appropriate nodes while excluding private nodes. For instructions, please check items 4.3 and 5.
Job duration and resource limits
The following resource and time limits apply at the mesocenter for each submitted job:
| Max # of Nodes / job | Maximum Duration / job (days) |
|---|---|
| 1 | 16 |
| 2 | 16 |
| 4 | 8 |
| 8 | 4 |
| 16 | 4 |
| 32 | 2 |
The maximum number of active jobs is determined by the total number of CPUs allocated, which is limited to 2048 per user. Jobs submitted beyond this limit will be placed in a queue and processed once earlier jobs have finished.
Job submission will be refused if the maximum duration is not specified or if the requested resources exceed the limits above.