Skip to content

NPUW: LLMInferRequest - not copy kvcache for last generated token #42516

NPUW: LLMInferRequest - not copy kvcache for last generated token

NPUW: LLMInferRequest - not copy kvcache for last generated token #42516

Annotations

1 warning

Pytorch Layer Tests  /  PyTorch Layer Tests

succeeded Jan 16, 2025 in 2m 36s