-
Notifications
You must be signed in to change notification settings - Fork 200
Pull requests: openvinotoolkit/openvino.genai
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Update to the latest tokenizers with StringPack/Unpack from opset
#1591
opened Jan 17, 2025 by
pavel-esir
Loading…
[Port] Add Qwen2VL & check not empty rendered chat template
category: GHA
CI based on Github actions
category: LLM
LLM pipeline (stateful, static)
category: tokenizers
Tokenizer class or submodule update
category: visual language
Visual language pipeline
no-match-files
[RTTI] Fix passes rtti definitions
category: LLM
LLM pipeline (stateful, static)
category: LoRA
Low rank adapters
category: whisper
Whisper pipeline
prioretize config model type under path-based task determination
category: llm_bench
Label for tool/llm_bench folder
Test Continuous batching
category: LLM
LLM pipeline (stateful, static)
category: tokenizers
Tokenizer class or submodule update
add_special_tokens
properly
category: continuous batching
Add indentation for llm_bench json report dumping
category: llm_bench
Label for tool/llm_bench folder
#1584
opened Jan 17, 2025 by
nikita-savelyevv
Loading…
Change openvino.runtime imports to openvino for 2025.0
category: llm_bench
Label for tool/llm_bench folder
GHA: Use 2025.0.0 RC1
category: GHA
CI based on Github actions
category: tokenizers
Tokenizer class or submodule update
no-match-files
Update to the latest tokenizers with StringPack/Unpack from opset
category: tokenizers
Tokenizer class or submodule update
do_not_merge
do_not_review
Pass pad_token_id as model compilation parameters
category: LLM
LLM pipeline (stateful, static)
#1556
opened Jan 15, 2025 by
AsyaPronina
Loading…
Cb by default int8 respect ir
category: continuous batching
Continuous batching
category: LLM
LLM pipeline (stateful, static)
category: speculative decoding
Speculative decoding
do_not_merge
no-match-files
Cb by default int8
category: continuous batching
Continuous batching
category: LLM
LLM pipeline (stateful, static)
do_not_merge
no-match-files
#1549
opened Jan 15, 2025 by
ilya-lavrenov
Loading…
[CB] Split token streaming and generation to different threads for all CB based pipelines
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: prompt lookup
category: samples
GenAI samples
category: speculative decoding
Speculative decoding
category: tokenizers
Tokenizer class or submodule update
Debug qwen
category: LLM
LLM pipeline (stateful, static)
category: NPU
category: samples
GenAI samples
do_not_review
#1537
opened Jan 13, 2025 by
AsyaPronina
•
Draft
Automatically apply chat template in non-chat scenarios
category: GenAI C++ API
Changes in GenAI C++ public headers
category: GHA
CI based on Github actions
category: LLM
LLM pipeline (stateful, static)
category: samples
GenAI samples
category: tokenizers
Tokenizer class or submodule update
category: visual language
Visual language pipeline
no-match-files
[Tokenizers] add max_lengh parametrisation to encode
category: GenAI C++ API
Changes in GenAI C++ public headers
category: Python API
Python API for GenAI
category: tokenizers
Tokenizer class or submodule update
enhancement
New feature or request
Phi 3.5 vision instruct
category: visual language
Visual language pipeline
no-match-files
#1516
opened Jan 9, 2025 by
Wovchena
Loading…
Add MSVC Support For UTF-8 in Chat Sample
category: samples
GenAI samples
#1483
opened Jan 6, 2025 by
sammysun0711
Loading…
Add a choice of how to end streaming from callback: STOP or CANCEL
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: LLM
LLM pipeline (stateful, static)
category: prompt lookup
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: speculative decoding
Speculative decoding
category: visual language
Visual language pipeline
no-match-files
Concurrency in stable-diffusion image generation
category: cmake / build
Cmake scripts
category: GenAI C++ API
Changes in GenAI C++ public headers
category: samples
GenAI samples
category: text to image
Text 2 image pipeline
no-match-files
Previous Next
ProTip!
Adding no:label will show everything without a label.