Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to the latest tokenizers with StringPack/Unpack from opset #1562

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

pavel-esir
Copy link
Contributor

No description provided.

@pavel-esir pavel-esir added the category: tokenizers Tokenizer class or submodule update label Jan 16, 2025
@ilya-lavrenov ilya-lavrenov added this to the 2025.0 milestone Jan 16, 2025
@ilya-lavrenov ilya-lavrenov self-assigned this Jan 16, 2025
@ilya-lavrenov ilya-lavrenov marked this pull request as draft January 17, 2025 08:16
auto-merge was automatically disabled January 17, 2025 08:16

Pull request was converted to draft

@pavel-esir pavel-esir force-pushed the update_tok_with_str_ops branch from 4dafdda to e4879c8 Compare January 17, 2025 09:02
@pavel-esir pavel-esir force-pushed the update_tok_with_str_ops branch from e4879c8 to 41b9237 Compare January 17, 2025 09:12
@pavel-esir pavel-esir changed the base branch from master to releases/2025/0 January 17, 2025 09:12
@pavel-esir
Copy link
Contributor Author

rebuild

@pavel-esir pavel-esir force-pushed the update_tok_with_str_ops branch from dc130f5 to 2aa54dd Compare January 17, 2025 12:10
@pavel-esir pavel-esir changed the base branch from releases/2025/0 to master January 17, 2025 12:10
@pavel-esir pavel-esir force-pushed the update_tok_with_str_ops branch from 2aa54dd to 02bd379 Compare January 17, 2025 12:21
@ilya-lavrenov ilya-lavrenov marked this pull request as ready for review January 17, 2025 17:57
@pavel-esir pavel-esir force-pushed the update_tok_with_str_ops branch from 02bd379 to 77f748a Compare January 17, 2025 18:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: tokenizers Tokenizer class or submodule update
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants