GGUFs are here. Tutorials to run locally.
#1
by alanzhuly - opened
GGUFs are available: https://huggingface.co/NexaAI/Qwen3-VL-2B-Thinking-GGUF
Note currently only NexaSDK supports this model
Quickstart
- Download NexaSDK with one click
- one line of code to run in your terminal:
nexa infer NexaAI/Qwen3-VL-2B-Thinking-GGUF
The Nexa SDK is so convenient.