Hacker Newsnew | past | comments | ask | show | jobs | submit | fromlogin
Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU (github.com/xaskasdf)
391 points by xaskasdf 3 days ago | past | 101 comments

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: