Skip to content

vllm.distributed.kv_transfer.kv_lookup_buffer ΒΆ

Modules:

Name Description
base

This file contains a new class KVLookupBufferBase that allows developers to
mooncake_store

This file contains a new class MooncakeStore that allows developers to
simple_buffer

Implements a distributed key-value (KV) cache transfer mechanism.