Skip to content

NPUW: LLMInferRequest - not copy kvcache for last generated token #5493

NPUW: LLMInferRequest - not copy kvcache for last generated token

NPUW: LLMInferRequest - not copy kvcache for last generated token #5493

Python API tests (3.10, openvinogithubactions.azurecr.io/ov_test/debian_10_py310:pr-28380)  /  Python API tests

succeeded Jan 16, 2025 in 3m 12s