Running 27B LLM at 80 tokens/sec on dual GPUs shows accessible inference scaling
Hacker News·0mo·iMil
iMil benchmarked Qwen 3.6 27B on RTX 5080 + RTX 3090, hitting 80 tokens/sec throughput. For makers building AI features on modest hardware, this suggests you don't need enterprise clusters—stacking older and newer GPUs can hit meaningful inference speeds without proportional cost.
Original story
Read the original on Hacker NewsRelated stories
AI
HYVE Ether OS goes on pre-sale: a $499 sovereign AI operating system you actually ownVibe Software Solutions·1mo·Anthony S. Owens


Devtools
Code Terraform: write Python to literally reshape a planetHacker News Show HN·1mo·investorsHeaven