• Some users have recently had their accounts hijacked. It seems that the now defunct EVGA forums might have compromised your password there and seems many are using the same PW here. We would suggest you UPDATE YOUR PASSWORD and TURN ON 2FA for your account here to further secure it. None of the compromised accounts had 2FA turned on.
    Once you have enabled 2FA, your account will be updated soon to show a badge, letting other members know that you use 2FA to protect your account. This should be beneficial for everyone that uses FSFT.

RTX 6000 Blackwell vs. 3x 5090?

uOpt

2[H]4U
Joined
Mar 29, 2006
Messages
2,901
What happens when you compare LLM inference running on a Blackwell RTX6000 versus 3x RTX 5090 in one machine?

Would it be faster due to more GPU units? Or slower due to communication overhead? Or is it "it depends"?

Of course power consumption of the trio would suck (no pun intended).
 
Personally I would go RTX 6000 Pro Max-Q.

You are memory bandwidth and latency bound so crossing the PCIe bus will not speed things up.

Also you can actually fit the RTX 6000 in a normal case, 3x 5090 will need a mining type rig and extension cables.
 
Back
Top