logo
Kurashizu Blogwhere ideas flow
  • Home
  • News
  • Blog
  • About
  • Home
  • News
  • Blog
  • About

© 2026 Kurashizu. All rights reserved.

Admin·New Post·Service Status
Powered by Cloudflare·30.10.26
← Back to news

Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

Original article
github.com|352 points|84 comments|by Anon84|Oct 16, 2026

PS5LM: Native GGUF Model Execution on Jailbroken PlayStation 5

Developer

PS5LM transforms a jailbroken PS5 into a powerful, private home AI server. By leveraging llama.cpp, this project allows the console to run any GGUF-formatted model natively on its hardware, starting with the Qwen 3.8 series.

🚀 Core Functionality

The application utilizes the console's RDNA 2 GPU via the llama.cpp Vulkan backend. It allocates approximately 11.4 GB11.4\text{ GB}11.4 GB of shared memory to handle both the model weights and the KV cache.

Key Features

  • Universal Compatibility: Supports every quantization method and architecture recognized by llama.cpp.
  • Industry Standard APIs:
    • OpenAI compatible: /v1/chat/completions
    • Anthropic compatible: /v1/messages (fully supports Claude Code)
  • Web Interface: A built-in chat page accessible via any browser.
  • Connectivity: Simply point your client to http://console:8081. Any loaded model will respond to requests.
  • TV Integration: All requests are streamed directly to the TV screen, showing the requesting device, the prompt, and the real-time response.
  • Local Control: Use the □\square□ button for demos and △\triangle△ to trigger the keyboard for couch-based interaction.
  • Telemetry Dashboard: A dedicated "Console" page tracks CPU/GPU load\text{CPU/GPU load}CPU/GPU load, power consumption\text{power consumption}power consumption, and temperature\text{temperature}temperature over 2-minute or 1-hour intervals.

🧠 Decision Models & Ollaya Integration

PS5LM introduces Decision Models (e.g., d1, Clef, OpenJev), powered by the logic of Ollaya. Unlike standard LLMs, these models perform a single forward pass to provide typed decisions with calibrated probabilities rather than generating text.

What is a Decision Model? While Ollama runs LLMs on PCs, Ollaya runs decision models. PS5LM brings this to the console, allowing for near-instantaneous "Yes/No" or categorical answers.

Example API Request

curl http://console:8081/v1/systemone -H 'Content-Type: application/json' -d '{
  "state": "I was charged twice this month. Refund me or I cancel.",
  "questions": {
    "intent": {
      "type": "choice", 
      "instructions": "What does the customer want?", 
      "criteria": {"refund": null, "information": null, "cancel": null}
    },
    "angry": {
      "type": "noul", 
      "instructions": "Is the customer angry?"
    }
  }
}'

📊 Performance Benchmarks

The following data was captured on a PS5 Slim:

ModelQuantizationSizePerformanceNotes
Qwen 3.5 0.8BQ4_K_M0.5 GB0.5\text{ GB}0.5 GB207 t/s207\text{ t/s}207 t/sExtremely fast
Qwen 3.5 9BQ4_K_M5.3 GB5.3\text{ GB}5.3 GB55 t/s55\text{ t/s}55 t/sBalanced
Qwen 3.8 27BUD-Q2_K_XL9.2 GB9.2\text{ GB}9.2 GB≈20 t/s\approx 20\text{ t/s}≈20 t/s64k64\text{k}64k context
d1 Omni 600MDecision1.1 GB1.1\text{ GB}1.1 GB3 q / 0.3s3\text{ q / } 0.3\text{s}3 q / 0.3s720p720\text{p}720p image support

🛠️ Technical Architecture

The system flow can be visualized as follows:

The Tech Stack

  • Language: C++
  • UI Framework: ps5-homebrew-ui
  • Backend: llama.cpp with ggml-vulkan
  • Drivers: PS5_Vulkan's RADV (built on Linux)

📦 Installation & Requirements

Prerequisites

Your PS5 must be jailbroken and running firmware between 7.00 and 13.60.

Required Payloads:

  • kstuff-lite (Kernel patches for homebrew)
  • etaHEN (Homebrew support)
  • ShadowMountPlus (Adds PS5LM to the home screen via /data/homebrew)

Recommended Payloads:

  • elfldr (Port 9021: for power/temp/space monitoring)
  • ftpsrv (Port 2121: for easy file transfers)

Setup Steps

  1. Download ps5lm-app-vX.Y.Z.zip from the latest release and extract it.
  2. Manually move models via FTP →\rightarrow→ Use the built-in Suggested list to download directly from Hugging Face.
  3. Alternatively, place .gguf files in /data/PS5LM/models or on a USB drive.
  4. Once the Home screen displays "Ready", access the interface at http://console:8081.

🎮 Controller Mapping

ButtonLocationAction
L1 / R1GlobalCycle through: Home →\rightarrow→ Models →\rightarrow→ API →\rightarrow→ Console →\rightarrow→ Settings
CrossHomeSwitch active model
Square / TriangleHomeSend demo request / Open keyboard
D-pad / CrossModelsNavigate, load, unload, or download models
L2 / R2 / SquareModelsModify search terms / Check memory fit
Cross / SquareDownloadsPause, resume, or cancel (double press) / clear
L2 / R2ConsoleToggle between 2-minute and 1-hour telemetry
D-pad / CrossSettingsNavigate and toggle configuration options
Square / TriangleDiagnosticsView app/server logs or filter for errors

🛠️ For Developers & Tinkers

If you want to dive deeper into the code, explore the following:

  • Building: See the Building guide.
  • Porting: Check Porting and Research docs.
  • CLI: Integration with opencode, Codex, or Claude Code is detailed in docs/CLI.md.

Special Thanks:

  • abhi245y: Created the original native GPU app (PS5LM Plus).
  • Mihawk-99: For PS5_Vulkan and RADV.
  • PS5CEMU-HAR: For the Mesa driver patches.
  • BlackBearReloaded: For the ps5-homebrew-ui.