@ejolson,
Cloud computing focuses on throughput, while HPC computing focuses on latency. Not many people appreciate the differences this brings to the table for both hardware and software design.
Containers can introduce some latency, due to added network processing steps and kernel overhead compared to running directly on the host machine. No bueno for an HPCguy. Singularity might have some sort of trick, but I am highly doubtful. That said, I will likely take a look at some point, just to see if they've found a way to overcome the hurdles.
Quote from outside source, aka the web:
Some workloads, like those involving physics, floating math, or sorting, can experience higher variance in latency within containers compared to
bare metal or even VMs.
Cloud computing focuses on throughput, while HPC computing focuses on latency. Not many people appreciate the differences this brings to the table for both hardware and software design.
Containers can introduce some latency, due to added network processing steps and kernel overhead compared to running directly on the host machine. No bueno for an HPCguy. Singularity might have some sort of trick, but I am highly doubtful. That said, I will likely take a look at some point, just to see if they've found a way to overcome the hurdles.
Quote from outside source, aka the web:
Some workloads, like those involving physics, floating math, or sorting, can experience higher variance in latency within containers compared to
bare metal or even VMs.
Statistics: Posted by HPCguy — Fri Apr 25, 2025 11:38 pm