Lawrence-cj commited on
Commit
ed42b2b
·
verified ·
1 Parent(s): 3c638a0

Upload files with `sana-upload`.

Browse files
Files changed (1) hide show
  1. transformer/config.json +1 -1
transformer/config.json CHANGED
@@ -25,5 +25,5 @@
25
  ],
26
  "qk_norm": "rms_norm_across_heads",
27
  "rope_max_seq_len": 1024,
28
- "sample_size": 64
29
  }
 
25
  ],
26
  "qk_norm": "rms_norm_across_heads",
27
  "rope_max_seq_len": 1024,
28
+ "sample_size": 30
29
  }