Final Unicourse'tan Çalış, Yüksek Notu Garantile!
Vizesine Unicourse'tan Çalış, Yüksek Notu Garantile!
Fikrini Gerçeğe Dönüştür
Projeni dünyaya göstermek için sahne hazır. Red Bull Basement başvuruları açık.
Başvurunu YapLow to midrange systems (8-32 GB) vs. free cloud tiers
-
I'm a noob to local LLMs. I want to use an LLM to create Python and Bash functions from well-defined specs written by me. I've used Claude's Sonnet for this mostly.
I'm a light user of LLMs and almost never hit the request limit on Claude.
It seems like cloud LLMs are in a price war right now and last-gen capabilities are bottoming out in cost? Is that correct?
I pay about $0.12 per kWh, probably going up as more AI data centers get built.
Hardware I have:
- <16GB VRAM - AMD BC-250 APU - "16 GB total with approximately 12 GiB assigned to GPU UMA and 4 GiB left for the OS" (hardware unlocking changes by the day)
- 8GB RAM - 11th gen Intel laptop with Xe graphics
- 8GB RAM - Pixel 7a
- 32 GB DDR3 - 2nd gen intel - doubt this does anything
Hardware I'm eventually selling:
- 8GB VRAM RTX 3070 + 32 GB DDR5 + 1TB NVMe SSD - AMD Ryzen 5 7600X CPU - putting this here in case it's substantially better than the BC-250
Among this hardware, I should look for a model that fits on the BC-250?
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Kayıt Ol Giriş
