RedHatAI
/

Llama-3.1-8B-Instruct-speculator.eagle3

Text Generation

Model card Files Files and versions

ekurtic commited on Oct 8

Commit

7752ad3

·

verified ·

1 Parent(s): db3e335

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -15,7 +15,7 @@
       {
         "accept_tolerance": 0.0,
         "proposal_type": "greedy",
-        "speculative_tokens": 5,
         "verifier_accept_k": 1
       }
     ],

       {
         "accept_tolerance": 0.0,
         "proposal_type": "greedy",
+        "speculative_tokens": 3,
         "verifier_accept_k": 1
       }
     ],