GAUSS: A Workload-Aware Analytical and Monte-Carlo Simulator for LLM Inference Serving
Large language model (LLM) inference has become an operational workload that fleets must provision, monitor, and bill against latency service-level objectives (SLOs).
arXiv - cs.AI2 min read