Latency really doesn't matter for super-computers? Dude.. Latency is one of the greatest obstacles in "super computers", what are you trying to say?In some things latency really don't matter (research, BOINC, super-computers) as they are all about compute power
No doubt, Nvidia has had a large multi-year lead here, as AMD was finally getting their stuff in order with Ryzen/Epyc and moving from GCN to RDNA architecture in their GPU's.I have seen thousands of servers in datacenters, never seen an AMD card...plenty of Tesla cards though
The current top 2 "super computers" in the world (Summit and Sierra) utilize IBM Power9 CPU paired with Nvidia Volta GV100 GPU's.
The next two coming online in the next <18 months, the worlds first Exascale systems, will be powered by both AMD CPU and GPU. Nice win for AMD there.