custom quantization
#5133
Replies: 1 comment
-
|
Sure, just modify the quantize example, you can change quantization for layers or individual tensors. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Can I use this project to customize the quantification of each layer of llama?
Beta Was this translation helpful? Give feedback.
All reactions