PD-Multiplexing

A new paradigm for serving LLMs with SLO guarantees