Please support int8

#25
by k3soft - opened

Currently, int8 is the mainstream option faster and better, capable of replacing fp8. I hope an int8 version of the model will be added

k3soft changed discussion status to closed

Sign up or log in to comment