-
-
-
-
-
-
Inference Providers
Active filters:
gptq
tencent/HY-MT1.5-1.8B-GPTQ-Int4
Translation
•
2B
•
Updated
•
316
•
9
tencent/HY-MT1.5-7B-GPTQ-Int4
Translation
•
8B
•
Updated
•
241
•
5
TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ
7B
•
Updated
•
193
•
61
tiiuae/Falcon-H1-7B-Instruct-GPTQ-Int8
Text Generation
•
8B
•
Updated
•
36
•
2
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
22
•
121
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
21
•
1
TheBloke/WizardLM-33B-V1-0-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
33B
•
Updated
•
40
•
93
Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4
Text Generation
•
14B
•
Updated
•
1.19k
•
49
Intel/Qwen2-0.5B-Instuct-int4-inc
Text Generation
•
0.6B
•
Updated
•
5
•
1
Intel/Qwen2-1.5B-Instuct-int4-inc
Text Generation
•
2B
•
Updated
•
4
•
3
jart25/Qwen3-Next-80B-A3B-Instruct-Int4-GPTQ
Updated
•
943
•
3
Text Generation
•
16B
•
Updated
•
82
•
2
TevunahAi/Nemotron-3-Nano-30B-A3B-GPTQ
Text Generation
•
6B
•
Updated
•
1.12k
•
2
QuantTrio/GLM-4.7-GPTQ-Int4-Int8Mix
Text Generation
•
390B
•
Updated
•
129
•
4
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
24
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
38
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
32
•
40
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
25
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
22
•
2
Text Generation
•
Updated
•
24
•
45
Text Generation
•
7B
•
Updated
•
163
•
31
Text Generation
•
Updated
•
2.49k
•
21
Text Generation
•
Updated
•
1.17k
•
41
Text Generation
•
13B
•
Updated
•
47
•
38
TheBloke/galpaca-30B-GPTQ
Text Generation
•
Updated
•
22
•
48
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
19
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
15
TheBloke/vicuna-7B-v0-GPTQ
Text Generation
•
7B
•
Updated
•
16
•
15
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
14
•
3
TheBloke/gpt4-alpaca-lora-30B-GPTQ
Text Generation
•
33B
•
Updated
•
17
•
20