Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Port] Add Qwen2VL & check not empty rendered chat template #1590

Open
wants to merge 17 commits into
base: releases/2025/0
Choose a base branch
from
Open

[Port] Add Qwen2VL & check not empty rendered chat template #1590

wants to merge 17 commits into from
+755 −10

Conversation

yatarkan
Copy link
Contributor

No description provided.

yatarkan added 17 commits January 17, 2025 18:04
@yatarkan
Add qwen2_vl to vlm model type enum
a81cb99
@yatarkan
Add qwen2vl specific params to processor config
53736aa
@yatarkan
Add image preprocessing for qwen2vl to vision encoder
a165924
@yatarkan
Add string tokens for qwen2vl to vlm config
bde693b
@yatarkan
Add inputs embedder for qwen2vl with utility methods, move getting po…
d7282d9 
…sition ids to class method
@yatarkan
Reuse get_position_ids class method in vlm pipeline
c1e456e
@yatarkan
Add updating of 3D position ids tensor in lm_encoding
4070f30
@yatarkan
Calculate rope delta in inputs embedder, return it with position ids
2a5e8e3
@yatarkan
Add optional rope delta to lm encoding
f492879
@yatarkan
Propagate rope delta in vlm pipeline
c28bbe0
@yatarkan
Add job for testing qwen2vl in vlm workflow
36e097f
@yatarkan
Add printing of vision embeddings merger compiled model properties
700af43
@yatarkan
Add qwen2vl to supported models
6d9ebd3
@yatarkan
Remove unused default values
263486c
@yatarkan
Fix function signature
103cdbd
@yatarkan
Add check for not empty rendered chat template
0eb2119
@yatarkan
Add test for exception on empty rendered chat template
0f4e0d9
@yatarkan yatarkan added this to the 2025.0 milestone Jan 17, 2025
@github-actions github-actions bot added category: visual language Visual language pipeline category: LLM LLM pipeline (stateful, static) category: GHA CI based on Github actions category: tokenizers Tokenizer class or submodule update no-match-files labels Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ilya-lavrenov ilya-lavrenov Awaiting requested review from ilya-lavrenov

@Wovchena Wovchena Awaiting requested review from Wovchena

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
category: GHA CI based on Github actions category: LLM LLM pipeline (stateful, static) category: tokenizers Tokenizer class or submodule update category: visual language Visual language pipeline no-match-files
Projects
None yet
Milestone
2025.0
Development

Successfully merging this pull request may close these issues.
1 participant
@yatarkan