Inputs $\to$ fully connected layer $\to$ ReLU $\to$ fully connected layer $\to$ Softmax loss + $L_2$ regularization