cherioo 3 hours ago

What hardware are you able to run this on?

3
torginus 15 minutes ago

Sorry for the random question, I wonder if you know, what's the status of running LLMs non-NVIDIA GPUs nowadays? Are they viable?

naming_the_user 1 hour ago

Works well for me on an MBP with 36GB ram with no swapping (just).

I've been asking it to perform relatively complex integrals and it either manages them (with step by step instructions) or is very close with small errors that can be rectified by following the steps manually.

simonw 2 hours ago

M2 MacBook Pro with 64GB of RAM.