@arxivlens.bsky.social

8 months ago

MemShare: Memory Efficient Inference for Large Reasoning Models through
KV Cache Reuse
Hong Xu, Kaiwen Chen et al.
Paper
Details
#MemEfficientInference #KVCacheReuse #LargeReasoningModels