Models

Intel/GLM-4.7-int4-mixed-AutoRound

Text Generation • 2B • Updated 4 days ago • 129 • 19

Intel/Qwen3-Next-80B-A3B-Instruct-int4-mixed-AutoRound

Text Generation • Updated Sep 18, 2025 • 18.7k • 23

Intel/Qwen2-0.5B-Instuct-int4-inc

Text Generation • 0.6B • Updated Jun 6, 2024 • 6 • 1

Intel/Qwen2-1.5B-Instuct-int4-inc

Text Generation • 2B • Updated Jun 6, 2024 • 6 • 3

Intel/Qwen2.5-0.5B-Instruct-int4-inc

Updated Oct 10, 2024 • 2

Intel/Qwen2.5-1.5B-Instruct-int4-inc

Updated Oct 10, 2024 • 2

Intel/Qwen3-8B-int4-AutoRound

2B • Updated May 26, 2025 • 29 • 1

Intel/GLM-4.6-int4-mixed-AutoRound

Text Generation • 2B • Updated 6 days ago • 9 • 1

Intel/neural-chat-7b-v3-1-int4-inc

Text Generation • 7B • Updated Aug 26, 2024 • 13 • 2

Intel/neural-chat-7b-v3-3-int4-inc

Text Generation • 7B • Updated Aug 26, 2024 • 8 • 2

Intel/falcon-7b-int4-inc

Text Generation • 7B • Updated Aug 26, 2024 • 5

Intel/Phi-3-mini-4k-instruct-int4-inc

Updated Jul 4, 2024 • 4

Intel/Baichuan2-13B-Chat-int4-inc

Updated Jul 4, 2024 • 1

Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc

Updated Jul 4, 2024 • 1

Intel/opt-1.3b-int4-inc-recipe

Updated Nov 6, 2024 • 1

Intel/Phi-3-mini-128k-instruct-int4-inc-recipe

Updated Nov 8, 2024 • 1

Intel/Qwen2-7B-int4-inc

Text Generation • 2B • Updated Oct 24, 2024 • 18 • 6

fbaldassarri/modello-italia-9b-autoround-w4g128-cpu

Text Generation • 9B • Updated Jun 22, 2024 • 7

fbaldassarri/modello-italia-9b-autoround-w4g128-gpu

Text Generation • 9B • Updated Jun 22, 2024 • 4

OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc

11B • Updated Apr 30, 2025 • 14 • 1

OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc

6B • Updated Apr 30, 2025 • 10 • 1

OPEA/Qwen2.5-14B-Instruct-int4-sym-inc

3B • Updated Apr 30, 2025 • 11

OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc

3B • Updated Jun 5, 2025 • 18 • 1

OPEA/Phi-3.5-vision-instruct-int4-sym-inc

Updated Apr 30, 2025 • 17

OPEA/Qwen2.5-7B-Instruct-int4-sym-inc

2B • Updated Apr 30, 2025 • 13 • 1

OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc

3B • Updated Jun 5, 2025 • 79 • 2

OPEA/llava-v1.5-7b-int4-sym-inc

1B • Updated Jul 18, 2025 • 15 • 1

OPEA/cogvlm2-llama3-chat-19B-int4-sym-inc

20B • Updated Jul 18, 2025 • 17

OPEA/Qwen2.5-72B-Instruct-int4-sym-inc

12B • Updated Apr 30, 2025 • 36 • 1

OPEA/Qwen2-7B-int4-sym-inc

8B • Updated Apr 30, 2025 • 6