KV cache management and memory optimization in continuous audio streams