NVIDIA Hopper H100 & L4 Ada GPUs Achieve Record-Breaking Performance In MLPerf AI Benchmarks

erek

[H]F Junkie
Joined
Dec 19, 2005
Messages
12,709
Impressive performance

"On the NVIDIA A30 GPU, which is a more affordable GPU, Deci delivered accelerated throughput and a 0.4% increase in F1 accuracy compared to an FP32 baseline.

By using Deci, teams that previously needed to run on an NVIDIA A100 GPU can now migrate their workloads to the NVIDIA A30 GPU and achieve 3x better performance than they previously had for roughly a third of the compute price. This means dramatically better performance for significantly less inference cloud cost."

-Hopper-H100-L4-Ada-GPUs-Performance-Benchmarks-_6.png


Source: https://wccftech.com/nvidia-hopper-...breaking-performance-in-mlperf-ai-benchmarks/
 
Last edited:
Back
Top