erek
[H]F Junkie
- Joined
- Dec 19, 2005
- Messages
- 12,709
Impressive performance
"On the NVIDIA A30 GPU, which is a more affordable GPU, Deci delivered accelerated throughput and a 0.4% increase in F1 accuracy compared to an FP32 baseline.
By using Deci, teams that previously needed to run on an NVIDIA A100 GPU can now migrate their workloads to the NVIDIA A30 GPU and achieve 3x better performance than they previously had for roughly a third of the compute price. This means dramatically better performance for significantly less inference cloud cost."
Source: https://wccftech.com/nvidia-hopper-...breaking-performance-in-mlperf-ai-benchmarks/
"On the NVIDIA A30 GPU, which is a more affordable GPU, Deci delivered accelerated throughput and a 0.4% increase in F1 accuracy compared to an FP32 baseline.
By using Deci, teams that previously needed to run on an NVIDIA A100 GPU can now migrate their workloads to the NVIDIA A30 GPU and achieve 3x better performance than they previously had for roughly a third of the compute price. This means dramatically better performance for significantly less inference cloud cost."

Source: https://wccftech.com/nvidia-hopper-...breaking-performance-in-mlperf-ai-benchmarks/
Last edited: