Skip to content

Commit 27b5049

Browse files
committed
feat: expend max new token
1 parent 5427cca commit 27b5049

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

HakaseCore/llm/llama3.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -71,7 +71,7 @@ def generate_text(self, instruction: str) -> str:
7171
do_sample=True,
7272
temperature=0.4,
7373
top_p=0.9,
74-
max_new_tokens=100,
74+
max_new_tokens=10000,
7575
eos_token_id=[
7676
self.tokenizer.eos_token_id,
7777
self.tokenizer.convert_tokens_to_ids("<|eot_id|>"),

0 commit comments

Comments
 (0)