AMD's new Ryzen AI

[erek]

AMD Ryzen AI

"As part of its overall AI strategic direction, AMD is providing early access to the Ryzen AI software to Windows developers. This will enable AI researchers and developers to run AI workloads on select Ryzen 7040 Series processors with Ryzen AI using the open-source AI framework Vitis AI Execution Provider (EP), which is up streamed in ONNX Runtime with support for Microsoft Olive. This package offers superior CPU support and is set to seamlessly and progressively boost AMD XDNA AI Engine acceleration with virtually no usability impact. Developers are encouraged to visit GitHub to begin.

"We believe that dedicated AI processing engines are essential to bring to life a future of amazing AI experiences on Windows 11," said Pavan Davuluri, CVP Windows Silicon and Systems Integration, Microsoft Corp. "The Ryzen 7040 Series processors with AMD Ryzen AI are a great way to experience Windows Studio Effects now and, in the future, for developers to run AI workloads on the ONNX Runtime today."

AI is expected to drive innovation in the Windows ecosystem for years to come, for both customers and developers alike. AMD Ryzen 7040 Series processors with AMD Ryzen AI are the vanguard of a new generation of silicon that offers outstanding performance, incredible power efficiency, and unique experiences not available on other x86 processors today. The new developer tools AMD has made available will enable programmers to more easily add or integrate AI functionality, making artificial intelligence-powered applications more widely available to the general public. These features will be available in more than 80 AMD Ryzen AI- powered laptops, making them the best choice for anyone looking for a powerful, modern notebook."

Source: https://www.techpowerup.com/309044/...dows-11-with-new-developer-tools-for-ryzen-ai

 

[erek]

AMD Ryzen AI

"As part of its overall AI strategic direction, AMD is providing early access to the Ryzen AI software to Windows developers. This will enable AI researchers and developers to run AI workloads on select Ryzen 7040 Series processors with Ryzen AI using the open-source AI framework Vitis AI Execution Provider (EP), which is up streamed in ONNX Runtime with support for Microsoft Olive. This package offers superior CPU support and is set to seamlessly and progressively boost AMD XDNA AI Engine acceleration with virtually no usability impact. Developers are encouraged to visit GitHub to begin.

"We believe that dedicated AI processing engines are essential to bring to life a future of amazing AI experiences on Windows 11," said Pavan Davuluri, CVP Windows Silicon and Systems Integration, Microsoft Corp. "The Ryzen 7040 Series processors with AMD Ryzen AI are a great way to experience Windows Studio Effects now and, in the future, for developers to run AI workloads on the ONNX Runtime today."

AI is expected to drive innovation in the Windows ecosystem for years to come, for both customers and developers alike. AMD Ryzen 7040 Series processors with AMD Ryzen AI are the vanguard of a new generation of silicon that offers outstanding performance, incredible power efficiency, and unique experiences not available on other x86 processors today. The new developer tools AMD has made available will enable programmers to more easily add or integrate AI functionality, making artificial intelligence-powered applications more widely available to the general public. These features will be available in more than 80 AMD Ryzen AI- powered laptops, making them the best choice for anyone looking for a powerful, modern notebook."

View attachment 572141
Source: https://www.techpowerup.com/309044/...dows-11-with-new-developer-tools-for-ryzen-ai

Microsoft Introduces Windows 11 Co-Pilot, the First Centralized AI Assistant on a PC Platform​

PRESS RELEASE by T0@st Today, 12:32 Discuss (12 Comments)
Panos Panay, Chief Product Officer, Windows and Devices: "The team and I are pumped to be back at Build with the developer community this year. Over the last year, Windows has continued to see incredible growth fueled by Windows 11 adoption. In fact, one of the most exciting areas driving that growth for Windows has been developers themselves, with a 24% YoY increase in monthly devices used for development."

"AI is the defining technology of our time and developers are at the forefront of this transformation. With the right tools we can empower developers and our shared customers to shape the future and leave their mark on the world. We are just starting to see the incredible impact AI is having across industries and in our own daily lives. Today, the team and I are excited to share the next steps we are taking on our journey with Windows 11, to meet this new age of AI."

 

[erek]

AMD Ryzen AI

"As part of its overall AI strategic direction, AMD is providing early access to the Ryzen AI software to Windows developers. This will enable AI researchers and developers to run AI workloads on select Ryzen 7040 Series processors with Ryzen AI using the open-source AI framework Vitis AI Execution Provider (EP), which is up streamed in ONNX Runtime with support for Microsoft Olive. This package offers superior CPU support and is set to seamlessly and progressively boost AMD XDNA AI Engine acceleration with virtually no usability impact. Developers are encouraged to visit GitHub to begin.

"We believe that dedicated AI processing engines are essential to bring to life a future of amazing AI experiences on Windows 11," said Pavan Davuluri, CVP Windows Silicon and Systems Integration, Microsoft Corp. "The Ryzen 7040 Series processors with AMD Ryzen AI are a great way to experience Windows Studio Effects now and, in the future, for developers to run AI workloads on the ONNX Runtime today."

AI is expected to drive innovation in the Windows ecosystem for years to come, for both customers and developers alike. AMD Ryzen 7040 Series processors with AMD Ryzen AI are the vanguard of a new generation of silicon that offers outstanding performance, incredible power efficiency, and unique experiences not available on other x86 processors today. The new developer tools AMD has made available will enable programmers to more easily add or integrate AI functionality, making artificial intelligence-powered applications more widely available to the general public. These features will be available in more than 80 AMD Ryzen AI- powered laptops, making them the best choice for anyone looking for a powerful, modern notebook."

View attachment 572141
Source: https://www.techpowerup.com/309044/...dows-11-with-new-developer-tools-for-ryzen-ai

Demo at computex
https://www.tomshardware.com/news/amd-demoes-ryzen-ai-at-computex-2023

 

[tangoseal]

Oh wonderful, I can't make a nuclear weapon in my garage without being arrested and tossed under the prison but I can make zero oversight AI that can dominate and destroy humanity with no limitations or ethical regulations.

You know the same AI that is going to remove over 300 million jobs by 2030. According to experts and all probably double that according to some.

 

[Twisted Kidney]

Oh wonderful, I can't make a nuclear weapon in my garage without being arrested and tossed under the prison but I can make zero oversight AI that can dominate and destroy humanity with no limitations or ethical regulations.

If you had enough money to lobby you could make sure all those yucky rules only affect people that can't afford to lobby.

 

[sharknice]

Oh wonderful, I can't make a nuclear weapon in my garage without being arrested and tossed under the prison but I can make zero oversight AI that can dominate and destroy humanity with no limitations or ethical regulations.

You know the same AI that is going to remove over 300 million jobs by 2030. According to experts and all probably double that according to some.

A couple hundred years ago 99% of people were farmers. Now it's like 1% and life today is a million times better.

Same shit with AI.

 

[rgMekanic]

A couple hundred years ago 99% of people were farmers. Now it's like 1% and life today is a million times better.

Same shit with AI.

you will own nothing, and you will be happy.

 

[LukeTbk]

Now it's like 1% and life today is a million times better.

During those transition, it can still hurt many and social unrest can be quite intense:
https://www.pbs.org/wgbh/americanexperience/features/theminewars-labor-wars-us/

And while history rhyme a lot, it is always possible for a deflationary possibly jobs destructing tech to not play like it did before, the ability for workers to capture part of the added profits from the saving-add production can be different from eras to eras and obviously a good enough AI could render virtually all human work optional, versus being a tool to be used by humans. In the past, the humans displaced did other work elevating the total production of good and service, this could end up different than those previous times.

It can be surprising like automatic teller machine augmented the number of bank teller and their hours because they transition to sellers instead of simple transaction executive and got more lucrative for the banks, instead of an expense.

 

[Red Falcon]

Now it's like 1% and life today is a million times better.

That was true until 2020, and the pendulum is quickly swinging back the other way.
Life is getting much harder on a global scale, and is far more difficult and less worthwhile than it was in just 2019.

you will own nothing, and you will be happy.

That's the goal by 2030, as we quickly move from Cyberpunk 2020 to Cyberpunk RED (2040s), just a decade ahead of schedule.

 

[KazeoHin]

A couple hundred years ago 99% of people were farmers. Now it's like 1% and life today is a million times better.

Same shit with AI.

Agreed. you know how many people lost their jobs due to the industrial revolution? tons. TODAY'S jobs will be taken by AI, yes. but tomorrow's jobs will be created by AI. If you have this mindset of "KEEP EVERY JOB EVER" than we would all be hunter-gatherers living in huts: Things like the printing press, steam power and the assembly line made a LOT of talented, hard-working people completely irrelevant and unemployable. boo fucking hoo: progress.

 

[cpufrost]

Agreed. you know how many people lost their jobs due to the industrial revolution? tons. TODAY'S jobs will be taken by AI, yes. but tomorrow's jobs will be created by AI. If you have this mindset of "KEEP EVERY JOB EVER" than we would all be hunter-gatherers living in huts: Things like the printing press, steam power and the assembly line made a LOT of talented, hard-working people completely irrelevant and unemployable. boo fucking hoo: progress.

You can't stop progress!

 

[erek]

You can't stop progress!

Truth, this. ^

 

[erek]

AMD Ryzen AI

"As part of its overall AI strategic direction, AMD is providing early access to the Ryzen AI software to Windows developers. This will enable AI researchers and developers to run AI workloads on select Ryzen 7040 Series processors with Ryzen AI using the open-source AI framework Vitis AI Execution Provider (EP), which is up streamed in ONNX Runtime with support for Microsoft Olive. This package offers superior CPU support and is set to seamlessly and progressively boost AMD XDNA AI Engine acceleration with virtually no usability impact. Developers are encouraged to visit GitHub to begin.

"We believe that dedicated AI processing engines are essential to bring to life a future of amazing AI experiences on Windows 11," said Pavan Davuluri, CVP Windows Silicon and Systems Integration, Microsoft Corp. "The Ryzen 7040 Series processors with AMD Ryzen AI are a great way to experience Windows Studio Effects now and, in the future, for developers to run AI workloads on the ONNX Runtime today."

AI is expected to drive innovation in the Windows ecosystem for years to come, for both customers and developers alike. AMD Ryzen 7040 Series processors with AMD Ryzen AI are the vanguard of a new generation of silicon that offers outstanding performance, incredible power efficiency, and unique experiences not available on other x86 processors today. The new developer tools AMD has made available will enable programmers to more easily add or integrate AI functionality, making artificial intelligence-powered applications more widely available to the general public. These features will be available in more than 80 AMD Ryzen AI- powered laptops, making them the best choice for anyone looking for a powerful, modern notebook."

View attachment 572141
Source: https://www.techpowerup.com/309044/...dows-11-with-new-developer-tools-for-ryzen-ai

AMD Has Open-Source Ryzen AI Demo Code - But Only For Windows https://www.phoronix.com/news/AMD-Ryzen-AI-Open-Source-Demo

 

[uOpt]

Who needs this as Windows only when most AI acceleration farms run Linux?

 

[Deleted member 162929]

Who needs this as Windows only when most AI acceleration farms run Linux?

Microsoft

 

[Lakados]

Who needs this as Windows only when most AI acceleration farms run Linux?

Given it’s for consumer devices…
This AI as AMD is calling it is their collection of application specific accelerators similar to the fixed function ones found in the Apple Mx silicon.

So it is not the research type AI where you are loading and researching models just the practical use of some existing ones.

 

[Deleted member 162929]

Plus it's obvious from WIndows 11 that Microsoft is in a very 'let's stuff everything, and then the kitchen sink, and then some more' into Windows ATM, with WSL and all that

 

[Lakados]

Plus it's obvious from WIndows 11 that Microsoft is in a very 'let's stuff everything, and then the kitchen sink, and then some more' into Windows ATM, with WSL and all that

Well for business stuff Microsoft is getting their butt whooped by Apple right now because of the Mx lineup of Apple Silicon.
Zoom calls (and other similar platforms) from an Apple Silicon Mac look and sound better than the Intel and AMD equivalents, the Nvidia GPU-equipped laptops look and sound best thanks to their "AI" audio and video enhancement filters, but battery life there isn't exactly stellar...
Apple Neural Engine (what Apple calls their "AI") which contains all their fixed function accelerators is what is handing them the lead in the mobile space, and it's obvious that Microsoft would want Intel and AMD to deliver their equivalents because I assure you, that the big OEMs (Dell, HP, and Lenovo) are very tired of looking like the budget alternatives when compared to the MacBook Air and Pro options.

 

[LukeTbk]

Plus it's obvious from WIndows 11 that Microsoft is in a very 'let's stuff everything, and then the kitchen sink, and then some more' into Windows ATM, with WSL and all that

Could be misreading the 11 part of the sentence but WSL 1 and 2 has been supported in Windows 10 home and up since 2020 I think

Who needs this as Windows only when most AI acceleration farms run Linux?

It is a bit surprising but , I would imagine it will be expended but it seem to target the oem Laptop market for things like conference call ai a la Nvidia broadcast (framing, eyes contact, backgrounds, sound noise cleaning, video quality, etc...), for that kind of stuff I could imagine in the x86 market I can imagine windows laptop being a bigger market than Linux one.

 

[Lakados]

Could be misreading the 11 part of the sentence but WSL 1 and 2 has been supported in Windows 10 home and up since 2020 I think

It is a bit surprising but , I would imagine it will be expended but it seem to target the oem Laptop market for things like conference call ai a la Nvidia broadcast (framing, eyes contact, backgrounds, sound noise cleaning, video quality, etc...), for that kind of stuff I could imagine in the x86 market I can imagine windows laptop being a bigger market than Linux one.

There are also benefits to image editing, photo touch ups, spell check, streaming video, real time translation, OCL text recognition, lots of services we use daily on our cellphones and take for granted but the PC market lack’s completely with out 3’rd party web enabled services or expensive add in components.

 

[LukeTbk]

There are also benefits to image editing, photo touch ups, spell check, streaming video, real time translation, OCL text recognition, lots of services we use daily on our cellphones and take for granted but the PC market lack’s completely with out 3’rd party web enabled services or expensive add in components.

On mobile, stuff that can take away compute on the device or make it really efficient (going to a server for some of those), but for Laptop I imagine you need software side to happen, like Windows did for the 2 examples of streaming in the message you quoted in Windows Studio Effects (that was already using neural processing unit on the ARM windows machine).

On AMD github they give image recognition, so they can sorts your picture by category:

https://github.com/amd/RyzenAI-cloud-to-client-demo/blob/main/images/demo_msft_build.png?raw=true

Looking at the API it can also be used for training (they give Microsoft Olive as an example), it seem to be able to run a very general AI made by Facebook that nvidia-arm-androind-qualcoom-huawei-apache-intel-apple-microsoft-etc... use:
https://en.wikipedia.org/wiki/Open_Neural_Network_Exchange

i.e. Linux support should be there soon if not at launch (as ONNX , Microsoft Olive, etc... have good Linux support), it is probably part of the collaboration to focus on Windows for the annoucement.