AI Running a Local LLM with Image Input Support (AMD GPU / CPU Compatible)
The purpose
Running a local vision-capable LLM (Chat AI) using llama.cpp.
In this article, we will use Qwen2.5-VL...
LLM
AI AI Running LLMs Locally (with AMD GPU/CPU Support)
The purpose
Running a local LLM (Chat AI) using llama.cpp.
In this article, we will use Gemma, Google's model des...
AI Running an LLM Locally with AMD GPU (DirectML) – Experimental Setup
The purpose
I'll try running an LLM using an AMD GPU.
I'll be using DirectML and its sample code.
I'll modi...