The model startup using vllm failed.
1
#5 opened 3 days ago
by
beausoft
can this model be Quantized?
3
#4 opened 17 days ago
by
tinging
Sadly, Amperes are not supported😢
🚀
😔
3
#3 opened 29 days ago
by
Saaiet
Did someone get it running on 4 NVIDIA RTX PRO 6000 Blackwell (96 GB) GPUs?
👍
3
#2 opened 30 days ago
by
FabianHeller
Aww Man!
20
#1 opened about 1 month ago
by
mtcl