TensorTonic
Problems

Simulate Disaggregated Prefill and Decode Serving

Simulate Disaggregated Prefill and Decode Serving, and return selected prefill and decode replica indices, TTFT, and completion time for every request.