pkkkzip 6 hours ago

what sort of hardware do i need to run qwen 1.5 and QwQ ?

2
doctoboggan 1 hour ago

Its running with a decent token/second (as fast or faster than I can read...) on my M1 Max MBP with 64GB of memory

greenavocado 3 hours ago

Probably H100s to be safe. I use deepinfra.