neuralmagic
's Collections
DeepSeek-R1-Distill Quantized
updated
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation
•
8B
•
Updated
•
308
•
5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation
•
71B
•
Updated
•
2.46k
•
10
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation
•
33B
•
Updated
•
1.74k
•
9
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Text Generation
•
71B
•
Updated
•
285
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation
•
15B
•
Updated
•
1.08k
•
3
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation
•
8B
•
Updated
•
1.22k
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation
•
2B
•
Updated
•
3.89k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation
•
2B
•
Updated
•
31
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation
•
15B
•
Updated
•
3.28k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
4.47k
•
5
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation
•
2B
•
Updated
•
461
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
171k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation
•
3B
•
Updated
•
266
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation
•
2B
•
Updated
•
456
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation
•
0.6B
•
Updated
•
8
•
1
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation
•
11B
•
Updated
•
455
•
5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation
•
6B
•
Updated
•
488
•
5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation
•
33B
•
Updated
•
6.17k
•
13