Problem description: Using ReLU: <img width="1522" height="1051" alt="Image" src="https://github.com/user-attachments/assets/70bffaa4-4ddc-407f-8533-ffcd539b21e0" /> Using Tanh: <img width="1543" height="1074" alt="Image" src="https://github.com/user-attachments/assets/b11d1818-5d99-41a6-b6a2-3eb599067a65" /> The appearence of spikes is controlled by activation function.
Problem description:
Using ReLU:
Using Tanh:
The appearence of spikes is controlled by activation function.