Hugging Face VRAM Calculator in Chrome with OffiDocs
Hugging Face VRAM Calculator Chrome web store extension
DESCRIPTION:
Run the Chrome online web store extension Hugging Face VRAM Calculator using OffiDocs Chromium online.
The best VRAM Calculator for Hugging Face models
It can be pretty hard to figure out what hardware you need to run LLMs and other AI models.
Now, you can easily see the requirements to inference or fine-tune a model. If it doesn't fit, you will even get suggestions on how to still get it working (i.e. quantization or QLoRA).
This tool is an extension to the Hugging Face website. This is still a Beta version so please leave feedback if you can think of improvements.
Hugging Face VRAM Calculator web extension integrated with the OffiDocs Chromium online