Skip to content
Windows (VS 2019, Python 3.11)

[CB] Split token streaming and generation to different threads for all CB based pipelines #5760

Sign in to view logs

[CB] Split token streaming and generation to different threads for all CB based pipelines

[CB] Split token streaming and generation to different threads for all CB based pipelines #5760

Annotations

1 error

Download OpenVINO package

Download OpenVINO package
succeeded Jan 17, 2025 in 2s