L1

L2

Dropout

input needs to be multiplied with the keep prob (1-p)