TensorTonic
Problems

Implement Sparse MoE Top-k Expert Routing

Select the top k highest-scoring experts per token and compute routing weights as a softmax over only those selected logits.