TechDebtDevin 6 days ago

VRAM Required = Number of Parameters (in billions) × Number of Bytes per Parameter × Overhead[0].

[0]: https://twm.me/posts/calculate-vram-requirements-local-llms/

2
manmal 6 days ago

Don’t forget to add a lot of extra space if you want a usable context size.

TechDebtDevin 6 days ago

Wouldn't that be your overhead var

wetwater 6 days ago

Thats neat! thanks