Key information
Modified PlayStation 5 consoles are now capable of executing artificial intelligence programs. By leveraging a new project, the hardware utilizes its graphics processing unit and system memory to perform these computational tasks with increased efficiency.
A Reddit user identified as u/AdIllustrious7246 refined a previous system iteration that relied solely on the console's processor. That earlier version faced significant stability issues, including frequent crashes, due to a 6 GB memory limitation. The updated implementation utilizes PS5_Vulkan software to grant unrestricted access to the GPU.
This modification allows the system to access up to 11.4 GB of RAM, resulting in substantial performance gains. Complex AI models now operate at 20 tokens per second, while lighter alternatives like Llama 3.2 3B achieve speeds exceeding 120 tokens per second.
The project developer provided real-time monitoring of power consumption, system effort, and thermal output. Furthermore, users can interact with the AI remotely via a web browser on a PC or mobile device, provided both are connected to the same local network.
