CDSSM overfitting

ARC-II doing well

tanh (blue) vs ReLU (orange)

Dropout effect

• Green - 0% dropout. Overfitting
• Gray - 10% dropout. Best learning
• Orange - 20% dropout.
• Blue - 30% dropout. Underfitting