Final Unicourse'tan Çalış, Yüksek Notu Garantile!
Vizesine Unicourse'tan Çalış, Yüksek Notu Garantile!
I built two open-source tools to fix AMD GPU local LLM setup (ROCmFix) and benchmark Vulkan vs HIP performance (InferBench)
-
Running local LLMs on consumer AMD GPUs often comes with two pain points: configuring backend overrides
(HSA_OVERRIDE_GFX_VERSION)and figuring out whether Vulkan or HIP/ROCm gives better token throughput on your setup.I created two open-source tools to solve this:
1. ROCmFix
Repo: github.com/xanpavle/rocmfixZero-dependency Python script runnable via single-line terminal command.
Detects GPU PCI IDs directly (Windows Registry / Linux lspci) to map the correct HSA_OVERRIDE_GFX_VERSION.
Automatically updates shell profiles (PowerShell, CMD, Bash, Zsh, Fish) and includes an undo command and driver diagnostic runner (rocmfix doctor).
2. InferBench
Repo: github.com/xanpavle/inferbenchAutomated benchmarking tool for local LLM servers (Ollama, LM Studio).
Rigorously compares Vulkan vs HIP/ROCm performance with warm-up passes, median of N runs, and cold-start VRAM unloading between test cycles.
Both projects are MIT-licensed. Check them out and let me know your benchmarking results!
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Kayıt Ol Giriş