Ben Tso

Benasd's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/Qwen3.6-27B-GGUF about 2 months ago

Can we run Q4 on llama cpp with some compact optimization config without offloading into CPU (which makes it slow) in 16 GB VRAM?

3

#14 opened about 2 months ago by

Mapraw

New activity in AesSedai/Qwen3.6-35B-A3B-GGUF 2 months ago

Q6_K?

15

#1 opened 2 months ago by

qenme

New activity in Sehyo/Qwen3.5-397B-A17B-NVFP4 4 months ago

Fix for large images

1

#9 opened 4 months ago by

ordisbold

New activity in apolo13x/Qwen3.5-35B-A3B-NVFP4 4 months ago

Can you provide the script used to quantize this model?

#2 opened 4 months ago by

Benasd

New activity in QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ 8 months ago

How the model was quantized and which library was used

👍 2

9

#4 opened 8 months ago by

Benasd

New activity in Qwen/Qwen3-30B-A3B-GPTQ-Int4 about 1 year ago

AWQ version

2

#1 opened about 1 year ago by

Benasd

New activity in Qwen/Qwen3-30B-A3B about 1 year ago

【Evaluation】Best practice for evaluating Qwen3 !!

🔥👍 7

1

#2 opened about 1 year ago by

wangxingjun778

New activity in Benasd/Qwen2.5-VL-72B-Instruct-AWQ about 1 year ago

How do you run this model?

1

#1 opened over 1 year ago by

for1096

New activity in Benasd/Qwen2.5-VL-72B-Instruct-AWQ-fix about 1 year ago

Quantization Dataset & How-to

4

#1 opened about 1 year ago by

mwebr

New activity in google/gemma-3-27b-it over 1 year ago

Benchmarks on model card and report don't add up

4

#9 opened over 1 year ago by

patrickvonplaten

New activity in Qwen/Qwen2.5-VL-72B-Instruct-AWQ over 1 year ago

Update preprocessor_config.json

👍 1

5

#7 opened over 1 year ago by

Benasd

New activity in Benasd/Qwen2.5-VL-72B-Instruct-AWQ over 1 year ago

Tranformers removed 2.5 VL Image Proccessor

1

#3 opened over 1 year ago by

bikevit2008

failed with 4 gpu

3

#2 opened over 1 year ago by

asarray

How do you run this model?

1

#1 opened over 1 year ago by

for1096