TensorTonic
Problems

Analyze Prefill and Decode with the Roofline Model

Analyze the prefill and decode phases of transformer inference using the roofline performance model.