TensorTonic
Problems

Derivatives of Common Activation Functions

Compute the analytical derivative of four activation functions: Sigmoid, Tanh, ReLU, and Swish.