Recent content by mjlitola

To me there is not an affordable hardware for LLM. If you go with the old route of buying 10x A100 for $1500 a pop and a tall server blade, then you are easily looking at $30.000, which is out of my price range and you would still only get 480-640GB of VRAM.

OMG, that is loud. I was thinking of placing 50 mm sound insulation on top of a server rack and rack case that runs a similar setup of fans. That must be 80dB, so 40dB sound insulation brings it down to 40dB, but 40 dB is still like somebody talking all the time with their normal speaking voice...

Massive amounts of savings in comparison w/ RTX A6000, when the latter costs ab. $8000 a pop and upgraded RTX 4090s you can buy for $3000 in Ebay. You can get over 2,5x VRAM with the same price. Deepseek R1 671B runs about 4 tokens/s on one RTX A6000 and 500GB DDR5 ram machine, whereas w/ 3 x...

I do not know the large S&P 500 business scene, but as a small business owner myself, I would argue that consolidation of most cores to one 1U -rack is very important to small and medium size companies. The rent of 1U -rack at the city centre (inside the bedrock and backed up daily to the cloud...

I floated an idea that Intel might lower the prices of its most energy hungry part, because some buyer's (small buyers) do not calculate the total cost of ownership--only the investment price of the parts. The problem with Intel is the pricier mobo (4 socket Supermicro X11QPH+-P) and the fact...

It seems that the prior DELL Canada leak of Epyc 7543 price was bogus, so I had to drop it from the list. The interesting thing right now is that the used Xeon prices have started moving. However, the variance of price of single processor, i.e. Xeon Platinum 8280, might vary 1000s of euros at...

It seems that AMD is leaving the low end for Intel. It is suprising, but you can do pretty well with just the low end. In Finland we had Nokia, which was running a pretty tight ship producing low end mobiles. Finland is a very small country, but for a long time 15 years or so, Nokia's weight on...

Where Intel can currently give grief to AMD Zen2 -based system is at the low end 4p system. Alibaba.com has 16c Xeon Gold 5218 at 350 euros. The 4-socket motherboard is quite expensive (1268 eur VAT 0%) and 4-socket boot-up times are horrendous (ab. 15 minutes according to servethehome.com), but...

6510 by MOS Technology 286 by Intel 486dx2 by Intel Pentium E2140 by Intel i7-3960x by Intel T9600 by Intel Core M-5Y31 by Intel

In article https://www.servethehome.com/intel-is-serving-major-xeon-discounts-to-combat-amd-epyc/ Patrick Kennedy claims that Intel is matching the price of Xeon to correspond AMD Epyc prices and this comes well below a thousand parts ordered. I agree with you that life cycle costs of a...

It is true that server market price elasticity of demand is fairly inelastic (according to 2015 paper server market price elasticity is -0.51 http://www.qyjohn.net/wp-content/uploads/2015/10/price-elasticity-enterprise.pdf ); it means that any price increase of 1 percent, the effect of demand is...

I would think that AMD's chip shortage is not as bad as people are saying. If we estimate that an average Xeon price is ab. USD 1000 (in the server market it was USD 538 in 2015), then Intel sells ab. 5 million Xeon chip per year (with USD 5,91 Billion server sales...

I have been intently following the prices of both Intel Xeon and AMD Epyc processors in the eve of Zen3 launch of Feb 15th. Xeon has an ability to have a maximum of 4P in one Supermicro X12 or X11 motherboard (they are said to be quite hard to boot and quite expensive Supermicro X11QPH+ costs...

There seems to be just a small price adjustment in Ebay.de in zen1 -parts, whereas Alibaba keeps on trucking with the same prices for 7502 and 7h12 originating probably from big server farms. The total power draw of chinese server market was 161 TWh in 2018, if one estimates 50% CPU and 50% GPU...

They probably can't get anymore speed inside the CCR, so the new DDR5 -lanes, which utilize the current IO-structure has to have 3-5 times per clock cycle to read the data from L3-caches and transfer the data thru IO-lanes to the DDR5. However there might be a physical limitation of how much...