> Running deepseek 6B on the Private LLM app on the iPhone 13 basically set my phone on fire

Hey, I’m the author of Private LLM. I hope you’re joking about the phone catching fire. Btw, there’s no DeepSeek 6B model, you’re likely talking about the DeepSeek Distill 7B model.

Yes thank you for the correct correction

The last model I tried to run was Dolphin 3B but even Zephyr1.6B kills the phone pretty fast even with a full battery

Even Dolphin completely killed my phone so yeah I can’t really use the Private LLM app for anything heavier than the default 1.6B

Yeah, I agree. Really hard to fit anything larger on the 4GB of RAM on the iPhone 13 of which, only about (depending on what iOS version you're on) 2.1-2.5GB is usable by apps.