TensorTonic
Problems

Compute TTFT, TPOT, ITL, and Token Throughput

Compute TTFT, TPOT, inter-token latency, and token throughput from request arrival and token timestamp data.