Memory issues
#9 opened 4 days ago
by
Tortoise17
How to run awq model with audio output?
1
#8 opened 20 days ago
by
morlz
Use this model with vLLM on L40 or 4090 (SM89)
#7 opened 23 days ago
by
Mephisto1484
Strange warning on first completion w/ vLLM 0.11.0
#6 opened about 1 month ago
by
whoisjeremylam
GPTQ 4-bit version?
โ
1
#5 opened about 2 months ago
by
thomasip
wrong ouput
4
#4 opened about 2 months ago
by
KlausRust
How can I load this model
๐
2
2
#3 opened 2 months ago
by
godcat950081
Can I request a higher quantization, such as 3-bit or 2-bit awq?
1
#2 opened 2 months ago
by
win10
how to run it?
5
#1 opened 2 months ago
by
SlavikF