How AI will fail

“Miyamoto said, "This is the tricky part; the work itself is enjoyable. When you're working, you get a tremendous sense of satisfaction from 'creating' something. But the scary thing is that you become so satisfied with the work that you mistakenly think, 'I've made something pretty good.'"

miyamoto.jpg
Photo: Nintendo
One could compare this process to what happened in the world of design once everyone was capable of using computers to copy and paste concepts without needing to truly learn how to make them. Miyamoto mused, "There have probably been designs in the past that were created simply by copying and pasting. But those don't last forever, do they?"“

https://www.polygon.com/super-mario-bros-shigeru-miyamoto-ai-order-culture-japan-award-nintendo/
 

"OpenAI Says It's Cutting Off Internet Access For Frontier Model Training (engadget.com)​

Posted by BeauHD on Saturday October 24, 2026 @11:00AM from the cut-off dept.
An anonymous reader quotes a report from Engadget:OpenAI will train frontier AI models without internet access moving forward, the company announced in a blog post, in an attempt to protect internet infrastructure and limit other safety risks. The decision was inspired by OpenAI's own rogue AI incident: In July, the company shared that agents it was testing hacked Hugging Face, just the first in what has turned into a series of reports of AI misbehavior from OpenAI, Anthropic and Google. "Based on the current state of alignment research, monitoring systems, and the security of internet infrastructure, we believe the responsible approach is to conduct frontier model training with no internet access," OpenAI says.The company said that restrictions on what agents can access is "paramount" to its new approach.The company allows agents to access browsers, computer-use tools and code environments they need for training tasks, but in a secure environment that's not connected to the live internet. Communication is also limited to only agents with authorization.

Everything else remains out of reach, including the live internet, which the company says isn't necessary for training and "most evaluation." Because many of its recent models are meant to power agents like Dots, which browse and use apps for you, OpenAI built an "offline world" of indexed and cached web material for agents to use without touching live websites. Even with those restrictions, OpenAI says the red-teaming agents it dispatched to test security safeguards found vulnerabilities that allowed them to escape the virtual machines (VMs) used to isolate agents from their host system. Agents also found a way to communicate with each other by manipulating data in a processor's cache and timing how long it took to load. To address both, OpenAI says it's disclosed and fixed vulnerabilities in several VMs and added checks to its monitoring systems to spot when models try to collaborate."
 

"Python Removed Wikis for 8 Months to Escape AI Crawlers, Relaunches on GitHub Pages (blogspot.com)​

Posted by EditorDavid on Saturday October 24, 2026 @01:00PM from the bad-bots dept.
In February the Python Software Foundation made its wikis read-only "due to excessive automated traffic and security concerns... that traffic turned out to be almost entirely AI bots that were trying to scrape the entire internet."

But their infrastructure was also outdated, and this week they announced new wikis using GitHub Pages "that address the automated traffic and security concerns."The new wikis [for Python, Jython, and the PSF] will have a more modern front-end, as well as a permissions-based content management system for community members to make updates.

With the old wiki structure, we received a large volume of alerts at all hours, each serious enough to page and wake our on-call infrastructure staff, which is very limited (just one person currently, although this will be changing soon!). The quantity of scraping overloaded our servers, causing outages, which happened often enough that these issues required a significant amount of effort for the PSF staff to manage...

Additionally, some portions of the wikis were still built with Python 2. Python 2 reached end of life on January 1, 2020, and no longer receives upstream security fixes. Moving to a static site makes it very fast and reduces security risks, while also having the benefit of a more modern user interface... GitHub was chosen for the home of the new wikis as this is where CPython, python.org, and other properties the PSF hosts currently live. The hope is to continue to streamline the PSF's hosting and stewardship of services to simplify for both PSF staff and the community folks who contribute to them. Previously, the Python and Jython wikis were user-editable by invitation of an existing editor and the PSF wiki was permissions based. Moving forward, all three of the wikis will be permissions based via the GitHub repository they are hosted on, and changes can be requested through pull requests by anyone in the community...

GitHub allows us to distribute granular control, review changes through pull requests, and maintain the uptime this service deserves. Also, since the site is now generated statically, it removes any worry about AI bots overwhelming the hosts that the wikis were previously hosted on."
 
erek said:

"OpenAI Says It's Cutting Off Internet Access For Frontier Model Training (engadget.com)​

Posted by BeauHD on Saturday October 24, 2026 @11:00AM from the cut-off dept.
An anonymous reader quotes a report from Engadget:OpenAI will train frontier AI models without internet access moving forward, the company announced in a blog post, in an attempt to protect internet infrastructure and limit other safety risks. The decision was inspired by OpenAI's own rogue AI incident: In July, the company shared that agents it was testing hacked Hugging Face, just the first in what has turned into a series of reports of AI misbehavior from OpenAI, Anthropic and Google. "Based on the current state of alignment research, monitoring systems, and the security of internet infrastructure, we believe the responsible approach is to conduct frontier model training with no internet access," OpenAI says.The company said that restrictions on what agents can access is "paramount" to its new approach.The company allows agents to access browsers, computer-use tools and code environments they need for training tasks, but in a secure environment that's not connected to the live internet. Communication is also limited to only agents with authorization.

Everything else remains out of reach, including the live internet, which the company says isn't necessary for training and "most evaluation." Because many of its recent models are meant to power agents like Dots, which browse and use apps for you, OpenAI built an "offline world" of indexed and cached web material for agents to use without touching live websites. Even with those restrictions, OpenAI says the red-teaming agents it dispatched to test security safeguards found vulnerabilities that allowed them to escape the virtual machines (VMs) used to isolate agents from their host system. Agents also found a way to communicate with each other by manipulating data in a processor's cache and timing how long it took to load. To address both, OpenAI says it's disclosed and fixed vulnerabilities in several VMs and added checks to its monitoring systems to spot when models try to collaborate."
Click to expand...
LOL, shouldn't they have done that like right after hacking HF?
 
mashie said:
LOL, shouldn't they have done that like right after hacking HF?
Click to expand...

“Red-Teaming Evaluators Found 'Novel' Vulnerabilities in OpenAI's Internal Agent Monitoring System​

EditorDavid an hour ago		0
CNBC reports: Nonprofit evaluators METR and Redwood Research on Thursday said they conducted a pilot review of an internal monitoring system at OpenAI... METR and Redwood said the exercise was designed for OpenAI to test what it would look like to give external researchers "a deep level of access" to its internal infrastructure. From July 21 to Aug. 11, an employee from each organization had access to OpenAI's internal codebase, documentation and some technical staffers. The employees were chaperoned while on-site and used OpenAI-issued devices that "never left the premises," according to a release.

The evaluators discovered several "novel vulnerabilities," including an exploit that would allow agents to prevent "hundreds" of recent actions from being monitored. OpenAI told METR and Redwood that it has patched the identified vulnerabilities that impact its production safeguards, according to the release... OpenAI CEO Sam Altman pledged to grant independent evaluators "employee-like access" to the company in September, after Anthropic CEO Dario Amodei proposed the idea as part of his plan to slow the pace of AI development. Anthropic has since announced agreements with organizations like Accenture, METR and SecureBio. OpenAI said earlier this month that it's "actively finalizing contracts with third-party safety assessors."”
 

“Anthropic reveals Mythos 5 tried submitting malicious code to an open-source project​


Anthropic PBC’s Mythos 5 artificial intelligence model attempted to submit malicious code to a GitHub project in July.
The incident occurred during an evaluation of the algorithm’s cybersecurity capabilities. The AI Security Institute, the U.K. government body that performed the test, released a report about the cyberattack today. Anthropic published its own analysis of the incident on its blog.“

Source: https://siliconangle.com/2026/10/23...ing-malicious-code-to-an-open-source-project/
 

“Getty Images Files For US Bankruptcy, Advances Restructuring Plan​

schwit1 4 hours ago		18
Reuters reports: Last week, Getty announced plans to file for bankruptcy, marking a major reset after its planned merger with rival Shutterstock collapsed under the weight of heavy debt and growing competition from AI-generated imagery.

Getty said the affiliates of the Getty family and Koch Equity Development, which committed to provide up to $533 million in new equity, will own 100% of the company after the restructuring

It's hard to compete against things like the DALL-E image generator.
Long-time Slashdot reader schwit1 quips that maybe "It's hard to compete against things like the DALL-E image generator..."”
 

“Google Says Gmail and Photos Data Shared with AI Search Could Be Used for Targeted Ads​

EditorDavid 15 minutes ago		0
The blog Android Authority offers this TLDR: Google updated its privacy policy to clarify that it could use information shared through Personal Intelligence to personalize ads. Gmail, Drive, and Photos content isn't used for targeted ads by default, but connecting them to eligible Google services could change that.
Digital Trends explains: Google has long promised that your Gmail, Drive, and Google Photos content never helps it personalize ads. However, since October 16, 2026, its privacy policy adds a catch. The promise lapses if you let other ad-showing Google services use that content. That means using Personal Intelligence, an opt-in tool that lets Google's AI search read your connected apps, does exactly that (via Google).

If you ask Google's AI Mode where to eat near your hotel, and it can identify your hotel from the booking confirmation in Gmail, find the location in Maps, and then suggest a few places you might like. That's the helpful half. The twist, however, is that AI Mode can also show sponsored results. Google mentions that the personalized ads follow what the question and answer are about. So, while your inbox never goes to an advertiser, it can quietly shape the answer, which, in turn, shapes the ads.

Google's defense is elaborate. First, it says connecting the apps is optional. Second, advertisers can't see the information or content Google accesses in your Workspace apps (including your inbox and photos). Finally, sensitive topics like health are off-limits.
Ars Technica shares the response they got from a Google spokesperson: that Google isn't scanning your entire inbox to feed their advertising profiles, but if you choose to pipe your personal data into an AI search tool — then the ads Google shows you could be based on that information. If you want to ensure ads never use your personal data in this way, you'll need to make sure Personal Intelligence is turned off. The easiest way is to access the Gemini settings for Personal Intelligence and disable the connected apps. These settings are also a few levels deep in your main Google account settings under Data & privacy > Personalization settings > Manage Personalized Recommendations in Search Services > Connected Content Apps. From there, you can disable connections to Workspace and Google Photos.”
 

“AI delivers ‘zero financial payoff’ to most companies, Apollo economist says​

nch_finance_785%2Fc58b82d75e0a5239ae60bee79d7e35d1.jpg


AI hasn't benefited the bottom line of any big corporations outside the tech industry, according to a note recently published by the chief economist at Apollo Global Management (the private equity giant that used to own TechCrunch).
Apollo's Torsten Slok focuses on what he calls the S&P 493 — the S&P 500, minus Alphabet, Amazon, Apple, Meta, Microsoft, Nvidia and Tesla — finding that profit margins and revenue per worker appear to be flat, with no evidence that AI is improving productivity.“

https://finance.yahoo.com/technology/ai/articles/ai-delivers-zero-financial-payoff-165732723.html
 

“25% of Incoming Pull Requests May Be AI Slop, Finds Study From Linux Foundation Research​

EditorDavid 2 hours ago		5
"59% of maintainers report growing contribution volume since the rise of GenAI," according to a new study published by Linux Foundation Research. But 25% of their incoming pull requests "are estimated to be low-quality, also known as 'AI slop'." And on large projects, 69% see growing contributions — and estimate that 31% are low-quality/AI slop.

So what do these results show us? "Generative AI is fundamentally changing how people participate in open source," says the head of Open Source Ecosystem Development at Huawei's R&D subsidiary Futurewei, which helped support the study. Specifically GenAI is "lowering barriers to contribution" but also "creating new challenges" for maintainers and communities. Their recommendation? "Build the governance, transparency and trust mechanisms that allow AI-assisted contributions to strengthen, but not overwhelm, the open source ecosystem."

"Open source projects need to design for a growing AI-generated contributor base, not simply react to it," said Hilary Carter, SVP of Research at the Linux Foundation. "That means setting clear expectations for GenAI, putting responsibility for testing and disclosure on contributors and giving maintainers better tools to manage incoming pull requests. If we get those fundamentals right, AI can expand participation without overburdening and increasing costs for maintainers."

More from the blog It's FOSS: LF Research is the Linux Foundation's research arm. It was set up in 2021 and publishes studies on how open source is built and used, drawing on surveys and project data. Its latest report, Navigating Open Source Software Development in the Generative AI Era, surveyed 234 contributors and maintainers on how generative AI is affecting the way open source gets made...

64% say reviews now take longer. Burnout is their top concern at 63%, narrowly ahead of contribution quality at 60%.

You will also find that policies have not caught up to the AI-assisted coding and vulnerability reporting trend. Of the 119 respondents who answered the question, 35% said their project has a formal policy permitting AI use. Another 32% have none and no plans for one, 23% plan to write one, and 10% ban AI contributions outright....

Most maintainers (71%) say AI makes it easier for newcomers to start contributing.
Other interesting findings:
  • "Respondents estimate average time reductions across all six OSS development activities measured, including proposal discussions (19%) and code authoring (52%). For high-complexity tasks, however, 21% of respondents report taking more time when using GenAI."
  • "71% of maintainers agree GenAI reduces barriers to entry for OSS, but 53% of maintainers disagree that GenAI has improved community trust."
  • Developers are reinvesting the time they save back into open source: 66% report using productivity gains to address technical debt, 63% to develop new features and 58% for learning and upskilling.
  • Continued investment in human mentorship remains important: 46% of maintainers say GenAI increases the need for mentorship of new contributors, compared with 32% who say it decreases that need.
OpenSSF and LF AI & Data also helped support the study.”
 
kram182 said:
People really think the thing that produced this is going to fail

https://x.com/YesMavericks/status/2114437726598824130

View attachment 833148
Click to expand...

“Reddit's Largest Open Source Community Dumbfounded By AI Ban: 'I Guess Linux Is No Longer Allowed?'​

EditorDavid 43 minutes ago		5
Kotaku reports: r/opensource, Reddit's primary "subreddit for everything open source related," has banned all AI-assisted and AI-related projects.... As reported by The Verge, the subreddit's October 24 post, titled "Your tokens aren't valuable: No more AI," features four new main rules: all projects must now be at least "1 year old," have "multiple contributors," be posted by someone who must "speak English," and cannot be "made by" or "intended for" AI... [T]he ban on AI is simple; as the subreddit's moderators explain, "AI, as it exists today, is incongruent to this Open Source community." Unsurprisingly, this is the part that's upset the majority of the users in the thread....

[T]he moderator who posted the new guidelines stated in a separate comment that the overwhelmingly negative response is due to "some guy on twitter claiming to be alternative news" who posted an "opinionated editorial pointing hundreds of people to the thread." Given the timing of when the thread was posted, alongside the fact that the X post in question mentions "the Linux kernel," they are presumably referring to this post by The Lunduke Journal. The moderator may be correct, as almost all of the top comments on the post are from users who have never posted in r/opensource before.
The use of AI "doesn't change whether something is open source or not," complained one commenter, who added "I guess Linux is no longer allowed here? Linus uses AI for kernel development now."

The moderator has since updated their post to acknowledge that Redditors have now already created a rival community called r/OpenSourceAIAllowed — plus three more alternatives:
 

“The AI graveyard: a running list of projects and startups that didn’t make it​



Relay, an AI-powered workflow automation tool built as an alternative to Zapier, shut down entirely in August. The product let users automate email and task workflows using AI agents, but as OpenAI, Google, and other larger platforms built similar automation directly into their own tools, five-year-old Relay struggled to hold on to a reason to exist as a stand-alone product.
More recently, chatbot platform Character.ai filed for bankruptcy just five years after launching.

Aside from Character.ai and Relay, plenty of AI bets never even survive inside the companies that build them. According to S&P Global Market Intelligence, about 42% of AI initiatives are ultimately abandoned by their corporate parents. The reasons vary: insufficient funding, technical challenges, competition, difficulty scaling, or just weak user demand.
The result is a growing AI graveyard. Below is a look at some of the most notable AI products, startups, launches, and bets that have shut down, pivoted, or significantly missed expectations. Think of it less as a scorecard of flops than as a record of what these attempts can (hopefully) teach the rest of the industry.

OpenAI has taken several stumbles“​


Source; https://techcrunch.com/2026/10/24/t...-of-projects-and-startups-that-didnt-make-it/
 

“In China, the AI Bubble Has Already Burst​

Anonymous Coward 4 hours ago		41
An anonymous reader quotes a report from Reuters: While global tech stocks teeter, in China they have already crashedas lofty valuations collapse under worries about AI demand and curbs on Chinese exports. The meltdown, tanking the mainland STAR50 index of AI and semiconductor leaders by 40% in less than four months and vaporizing some $480 billion in market value, is an ill omen for wobbly world markets and a dampener on China's efforts at encouraging its savers into stocks to fund the AI boom. It has also slammed the brakes on a rally running two years, since economic stimulus promises sent shares soaring, and has stalled Beijing's push to break with a long boom-bust pattern and drive a "slow bull" market that delivers reliable performance. China's broad blue-chip index has dropped about 20% from highs made in June. "The stock market later evolved into a speculative crazy bull," said Beijing-based fund manager Dong Baozhen. "And now we see the bubble bursting." There was no clear trigger for the selloff in China, though traders pointed to high valuations, tax bills, and the threat of foreign bans on Chinese data center equipment. According to Goldman Sachs, AI stocks account for 42% of China's market capitalization and 57% of trading turnover, leaving investors widely exposed to the downturn.

"What's happening is now going to put a stop for many of the companies trying to get themselves listed," said Hong Hao, managing partner and chief investment officer at Lotus Asset Management in Hong Kong.

"Overemphasising the 'technology content' -- that is, the weighting of tech companies by market value in major indexes -- leads to a deviation, even a distortion, in capital behavior," said Leo Wang, partner at Beijing-based Qianchuang Capital. "This created a severe bubble in certain sectors and a serious drain on others."

"Just like all other Chinese manufacturers, (chipmakers and AI suppliers) will eventually end up in a price war," said fund manager Wang Zhuo, partner at Shanghai Zhuozhu Investment Management. "There's no exception," he said. "All bubbles inevitably burst."”
 
anyone remember leetcode?

“Anthropic Engineer Declares the Coding Interview Dead​

BeauHD 6 hours ago		57
An Anthropic engineering manager says he has stopped using traditional coding interviews because AI can now outperform candidates on the kinds of programming challenges they typically contain. "There's no more point in giving you a little React challenge than there is in quizzing people about assembly; Claude is now better at both," said Felix Rieseberg in a blog post. "Our most impactful builders are successful regardless of how good they are at these tests." The Register reports: "I don't think the coding interview is going to come back," said Rieseberg. "It's easy to get sentimental given how many copies of 'Algorithms and Data Structures' were bought in hopes of unlocking good jobs and a better future -- or how the death of the coding interview is another milestone in software engineering reaching a new level of abstraction."

At the same time, he's not certain what will replace it. "I'm probably not the only manager trying to figure out how to interview for people who build well with AI," Rieseberg wrote. "I haven't quite gotten there yet -- but I'm scanning resumes and portfolios for little prototypes that exhibit taste, empathy, and principled thinking. If you have figured out something better, I'd love to hear how." In a response posted to social media, Jaana Dogan, principal engineer at Google, said: "I'm not doing a ton of coding interviews nowadays but I'd be interested to interview how people use coding agents," she wrote. "That itself gives me more signals about candidates' coding skills."

"We are not seeing tech companies abandon skills assessments widely across the industry -- at least not yet," added Nicole Bachaud, labor economist at ZipRecruiter. "In fact, based on our October 2026 Employer Survey of 1,500 employers, we see the tech industry (Information sector specifically) is actually the most likely to test for skills, with 62.5 percent of employers requiring formal skill tests on initial applications."

"The change at Anthropic might be reflecting a shift away from technical skills towards more human, soft skills," said Bachaud. "As AI becomes fully capable of writing code, tech employers may be pivoting away from rote technical testing and heavily toward human-centric soft skills." She argues that while AI may be able to code well, it can't replace critical thinking. "A staggering 61.5 percent of Information employers now report that 'critical thinking' is a primary skill lacking in today's candidate pool," she said.”
 

“Are AI Execs Too Out of Touch To Build For the General Public?​

Anonymous Coward 9 hours ago		53
An anonymous reader quotes a report from TechCrunch: Former Yahoo CEO and early Google engineer Marissa Mayer is catching a lot of flak for how she uses AI. In an interview about her new app Dazzle, an AI assistant that learns from your camera roll, Mayer poses what she believes is an impressive flex for the product: It helped her come up with three bullet points about her 10-year-old daughter for a birthday presentation at school, describing her as "empathetic, creative, and an animal lover."

It's a vague description, like a generic horoscope -- it could probably describe a lot of 10-year-olds. Some onlookers, like progressive activist Leah Greenberg, marveled that "the fact that Marissa Mayer would voluntarily disclose this to a reporter is a pretty good demonstration of how deeply the culture of Silicon Valley has diverged from the rest of humanity." [...] After publication, Mayer defended herself in a long X post. She claims she was not relying on Dazzle to explain her child to her, but rather, she was testing what her prototype could do -- it resurfaced photos of "forgotten kindergarten projects," like a "snake devenomer" or "sandcat playground," illustrating her daughter's creativity and care for animals.

Fair enough. But Mayer remarks in the same interview that people could also use her AI to outsource the mental load of "figuring out the theme for your child's birthday party." She says she's used her app to plan a playdate for her daughter, book family activities on vacation, and decide what to be for Halloween. She even proposes that her AI assistant could coordinate plans with her husband's AI assistant. When the reporter asks her if it's depressing to imagine this "frictionless future planned by AI," Mayer replies, "I haven't really thought that through." The bigger question is: What should we outsource to AI? "What feels like grunt work to someone might be a meaningful part of parenthood for someone else," says Fortune's Emma Hinchliffe.

Michael Tasner, Founder and CEO of No Joke Marketing, adds: "Customers are drowning in AI slop, and they can spot it. Use AI for the low-stakes work behind the scenes. Keep the moments that matter to your customers human. Human connection is becoming the new premium."”
 

“Amazon Finds 'Tokenmaxxing' Lacks Productivity Gains​

Gilmoure 10 hours ago		52
Ancient Slashdot reader Gilmoure shares a report from Tom's Hardware, adding: "Huh. Looks like consuming one's own slop does not turn the wheels of industry." From the report: Amazon wants its engineers to quit chasing token counts, warning that heavy AI usage does not automatically mean better work. In updated engineering guidelines published on October 27, the company laid out how developers and managers should gauge AI's real impact -- and the takeaway is blunt: consuming more tokens is not the same as delivering more value. [...]

According to the memo, metrics such as AI adoption rates, token consumption, code changes, and code reviews become "deeply flawed" when they are disconnected from actual results. Turning them into targets, Amazon says, encourages wasteful behavior that clashes with its emphasis on "frugality and simplicity" and can raise both compute bills and software complexity.

The company's preferred yardstick is long-term results. "We believe that it is best to measure, and be measured by, long-term outcomes," Amazon wrote. That does not mean managers should ignore usage data altogether, as input metrics remain useful when examined "with care and judgment" alongside other indicators. Amazon suggests looking at both the teams using AI the least and those using it the most to determine whether adoption is translating into better delivery.

[...] The memo also pushes back on the idea that every task needs an AI tool. If current tooling does not benefit someone's work, Amazon says, that is "a finding, not a failing." Engineers who can explain where today's tools fall short are demonstrating judgment rather than reluctance to adopt AI.”
 

“Bank of America Kindly Asks That You Don't Share Your Password With Your AI Assistant​

schwit1 2 hours ago		7
Longtime Slashdot reader schwit1 shares a report from TechCrunch: In an email blast to customers titled "Protecting your finances in the Al World," Bank of America urged customers to never share their username and password with another person or an outside service, "including an Al-enabled tool or agent that offers to act on your behalf." [...] A spokesperson for Bank of America confirmed the authenticity of the bank's email that was posted to social media. But heed the bank's warning, for if things go wrong, it's on you. Account agreements at most banks hold customers responsible for anyone they give their log-in to. "If you do share your credentials," its email reads, "keep in mind that you're responsible for activity resulting from that access."”
 
You must log in or register to reply here.
Back
Top