Hugging Face VRAM Calculator in Chrome with OffiDocs
Ad
DESCRIPTION
The best VRAM Calculator for Hugging Face models
It can be pretty hard to figure out what hardware you need to run LLMs and other AI models.
Now, you can easily see the requirements to inference or fine-tune a model. If it doesn't fit, you will even get suggestions on how to still get it working (i.e. quantization or QLoRA).
This tool is an extension to the Hugging Face website. This is still a Beta version so please leave feedback if you can think of improvements.
Hugging Face VRAM Calculator web extension integrated with the OffiDocs Chromium online
