mac mini / vMLX error

#2
by tangotangobai - opened

create session

Process exited before becoming ready: ValueError: Model type mage_vl not supported. Error: No module named 'mlx_vlm.speculative.drafters.mage_vl'

Is the error reported when using vMLX to load the model due to vMLX not supporting it?

MLX Community org

Not vMLX β€” your mlx-vlm is just older than the model.

mage_vl was merged into mlx-vlm on 2026-07-29 (PR #1745), and the newest PyPI release (0.6.8) went out 2026-07-27 β€” two days earlier. So pip install mlx-vlm doesn't include it yet. Until 0.6.9 ships:

pip install -U git+https://github.com/Blaizzy/mlx-vlm

The speculative.drafters part of the message is a red herring. The loader tries mlx_vlm.models.<type> first and mlx_vlm.speculative.drafters.<type> second, then reports only the last error β€” so the failure that actually matters is the first one, mlx_vlm.models.mage_vl not being there. Mage-VL has no speculative drafter and doesn't need one.

One caveat: if vMLX bundles or pins its own copy of mlx-vlm rather than using your environment's, updating it there is what counts β€” or wait for 0.6.9 and a vMLX bump.

Sign up or log in to comment