I read it as: No one really cares for your opinion, so unless you want to talk actual facts only when there's a tangible benefit to doing so, shut up and be happy.the meaning of this though bragh?...Imean I'm probbably drunk and and stupid but...
Follow along with the video below to see how to install our site as a web app on your home screen.
Note: This feature may not be available in some browsers.
I read it as: No one really cares for your opinion, so unless you want to talk actual facts only when there's a tangible benefit to doing so, shut up and be happy.the meaning of this though bragh?...Imean I'm probbably drunk and and stupid but...
That is worthy of recognition.I made a post that has more than 1 page
winning
I very much disagree with Sam Altman. I'm sure large scale Data Centers are more efficient at AI than someone's computer at home, but that's retarded. That's like saying buying a new car is more efficient than driving an old car. It simply isn't true.And that a complete different subject, Altman point is so simple and true it is an strawman I think, no one disagree with it, the solution to the AI ram shortage isobviously not every AI consumer building is own way less efficiant AI infrastructure that sleep doing nothing when they do not work, yours of Ai consummer should consume 100 to 10,000 time less AI, so many time less than it can run on an RTX A1000, well of course, if we diminish IA use by a factor of 1,000 that would help.
so you 100% agree, not only they are more efficiant when they run, but they do run more hours by days.I very much disagree with Sam Altman. I'm sure large scale Data Centers are more efficient at AI than someone's computer at home, but that's retarded.
Yes, as long that the datacenter usage rate is near 100% that a bit irrelevant and you do not need to buy a lot of memory or sram specialized ASIC ai chips for those others things.My computer does other things when AI isn't one of them, and so far it isn't.
How did Anthropic sold for about 17 billions of AI service at a 9.9 billions compute&infracstructure&electricity cost to deliver those service if that the case ?Sam Altman's computers are converting electricity into shareholder confidence and nothing more. The demand for AI is not enough to justify the electricity, let alone the DRAM usage in Data Centers.
Less and less, AI is not that much trained on premade content-data anymore (on why it is getting better), they give an AI an objective and it trains by trying to do the task, scoring euresthic by doing a lot of trying and error, which way gave the best results, cheapest way to do it and so on, nobody debate you still need real computer to run ram, all Sam Altman user are using its product from a computer with ram, it is about buying a bunch of Spark to have 1TB of ram at home to run your own model being a way that will make the global ram shortage situation better or worse than using a more efficiant and shared with other cloud.You still need real people who make real content to train the AI on. Which means you still need real computers that have ram. Training AI on AI is akin to incest. It works for a while until it doesn't.
You mistake cloud AI with commercial solution provider ai like chatgpt, if I run Deepseek 4.1 on my computer and make it available for you over the web, you are using cloud AI now and you will have the exact same result as if you ran Deepseek on your own computer at home, when you rent microsoft-AWS-google cloud infracstructure to run AI, they have no idea what you are doing, which model you are running and so on.Cloud AI has real limits. Go ahead and see which AI allows you to make fun of Israel, because a lot of them won't. Some cloud AI isn't letting people use them to make game decomps. LLM's are the only way to go if you want true freedom when using AI.
No, because all they do is try to make AI less retarded. ChatGPT isn't even the top dog in AI anymore. Sam Altman has spent so much resources to not even have the best AI.so you 100% agree, not only they are more efficiant when they run, but they do run more hours by days.
That sentence...Sam Altman said nothing at all, no one actually disagree with the very simple statement he made,
His problem is that people are using LLM's over cloud based AI like ChatGPT, which has made DRAM even more expensive even for Sam.but as you said it is a bit of a strawmen, outside very uninformed or people that did not though much, no one actually believe that evreyone building his own AI infracstructure to run all their wanted ai workload on 2027 themslve, would help ram become cheaper.
100% doing what though? They don't make enough money to pay even a fraction of the debt they owe.Yes, as long that the datacenter usage rate is near 100% that a bit irrelevant and you do not need to buy a lot of memory or sram specialized ASIC ai chips for those others things.
Anthropic owes $900 Billion. $17 Billion is a drop in the bucket.How did Anthropic sold for about 17 billions of AI service at a 9.9 billions compute&infracstructure&electricity cost to deliver those service if that the case ?
Or they're training AI? It's a huge waste of resources.The demand in AI not being enough to justifiy the electricity seem a bit strange, almost all the electricity used is now inference, which is simply the expression of the demand for AI.
Which is exactly why they won't let us have it. Look at 3d printers trying to be locked down they won't allow us to have stuff that might bypass their controlAltman is a rent seeker bozo, but to address his point about % utilization, I was just saying that it would be nice to pool our resources together with some sharing of compute with some peer to peer credit system. That way we can us the trillion+ param local models (in a distributed way if possible) without needing to use their stuff where they can control the pricing and can tell us what we can or can't do (like reverse engineer games).
Got it now. Agreed, Sam is an idiot that needs to stop talking.
In the same vain, looks over at 64GB "rotting" on the shelf. Pifffftt!Pets my 64GB DDR5 playing youtube videos and source games LOL.
You missing the point. AI as a whole is not need nor wanted. It is a huge drain on resources. Not to mention people are forcefully made supplement the cost through higher water, electricity, noise and so on form these DC. Also the cost of all electronics have been steadily rising in price with seemingly so end in sight on how high it will go. Fuck Sam Altman and his AI bullshit.
That is the part that really really really scares me. If they can have an AI that builds them stuff, wipes there ass, fixes them when they are sick and collects food for them ECT they have motivation to actively kill us off so they don't have to share the land with 8 Billion people. COVID was probably a test run to figure out the optimal way to spread somethingWait till the elites, start using robots everyday. Then they have no need for humans. Do the math on that.
That is the part that really really really scares me. If they can have an AI that builds them stuff, wipes there ass, fixes them when they are sick and collects food for them ECT they have motivation to actively kill us off so they don't have to share the land with 8 Billion people. COVID was probably a test run to figure out the optimal way to spread something
This is so far away from his comments, all Sam altman clients need to own a computer to pay openAI to use its product.If he doesn't understand why people want their own computers,
I am not sure what not wanted would mean here, it is the fastest adoption of a new tech by regular people all over the world of all time, the revealed preference is hard to deny. The most bottom up has well, pushed by regular people into the world more than anything we seen before.You missing the point. AI as a whole is not need nor wanted.
Playing devil's advocate for the big AI corpo overlords doesn't mean it's right regardless. The greater good is a BS philosophy used as a blanket to cover the continuous sins of those committing them & require more from others who refuse to go along with it.This is so far away from his comments, all Sam altman clients need to own a computer to pay openAI to use its product.
This is all a click-bait for profit cycle (of course), and everyone want to not understand what going on for the fun of being mad here.
What he said was:
An example of this is people...
A lot of people want local inference.
And somehow, they assume that the problem is solved now.
Because, we are going to have open-source models.
We're going to be able to run them on our computers.
And so we're not going to need all the stuff in the data center.
But from a global allocation perspective, actually, it's quite terrible to have everybody have a bunch of the world's limited supply of DRAM sitting in their own computer.
And, being used—Mm-hmm. 5% of the time.
You want maximum utilization in the cloud if you're trying to deal with this very supply constrained environment.
i.e. It is about people thinking that having 512gb-12 TB of ram to run lage local model with big context using it only 500 hours a year at full capacity, instead of people sharing that ram with each other for when they need it is a not a good global allocation.
Nothing to do with everyone wanting to or having both a phone and a Macbook
I doubt that it is more efficient.The current situation is that there are a lot of people duplicating small models to run locally. If you took that same amount of collective memory and instead used it to hold one gigantic model that many people could access, that would be a more efficient system and give better results. Does that idea go against every historical precedence of human nature? Of course. But it doesn’t mean it’s not accurate.
Playing devil's advocate for the big AI corpo overlords doesn't mean it's right regardless. The greater good is a BS philosophy used as a blanket to cover the continuous sins of those committing them & require more from others who refuse to go along with it.
Ram wise compute speed can affect it, if a task take 1 hours instead of 6 hours to do, you need 1/6 of the ram on perfect timing (it will never be that much being saved, but you get the point), Rubin GB200 system is so much more efficient than blackwell who was so much more efficient than Hopper and so on, the level of custom kernel-effort that go to optimise token per watt into those giant datacenter, the superiority of the dedicated hardware for it, make that almost impossible.AI inference is not scalable, like the web was. You can host a thousand web sites on a single PC in a datacenter, but AI inference will have the same compute and RAM cost no matter the scale. So it's not like the bigger the data center the more efficient it runs, it might even be less power efficient to run in a datacenter than on a simple PC.
always hard to talk about closed door model efficacy, but GPT 6 luna is so cheap to use (very similar per token price than a small Qwen model) and more token efficient, that people that could use a small model at home can choose that (or their routing system picking it) and will be way cheaper, cloud or at home does not need to change anything on the nature of the model used (you can use Qwen3 30b on the cloud or at home), that a bit 2 different subject.The small models people are able to run at home are perfectly suitable for most home use cases.
Four to five billion people don't need access. Supposing everyone does, then it only needs to reach the same point where it's good enough on a local machine for the average user.Its more about physical reality of what possible versus anything moral, it is not really just some greater good that everyone that built local AI capacity that they do not use fully most of the time to rent it (i.e. share it) with others if they can, until something change in ram supply or how AI work it is the only way to give access to capable AI to 4-5 billions people.
People can of course have different axis and think AI should not be commonly used at all, but those people do not want everyone to build a MacUltra 256/512GB or more capacity either anyway.
I don't care that it's not, though.people sharing that ram with each other for when they need it is a not a good global allocation.
It's not really that everyone is "sitting" on ram though. It's that they are sitting on untapped, and already purchased resources that they themselves could use. It's more the reality that no one has offered a product that fully allows on-prem installation of the same resources in an easy way. Just because it's in the cloud doesn't make it more efficient. Because of the amount of ram and GPUs being used it's harder to support AI in the cloud not less. Inference will use every bit of ram that you can give it and each random query takes up its own bit of memory which can cause growth in utilization. Compare that with say a server for home use. The number of queries are drastically reduced, plus they are usually similar because they're the same queries over and over. A GPU with 16 - 24 GB of RAM can serve a household. That's not out of the question at all. Before the AI boom all of us could easily assemble a computer that could handle AI quite easily for a pretty reasonable cost.The over dramatic responses here are only eclipsed by the over dramatic article.
Individuals wanting their own stuff to use and stuff being efficiently optimized for usage are two separate things.
The current situation is that there are a lot of people duplicating small models to run locally. If you took that same amount of collective memory and instead used it to hold one gigantic model that many people could access, that would be a more efficient system and give better results. Does that idea go against every historical precedence of human nature? Of course. But it doesn’t mean it’s not accurate.