PyTorch: Visualizing Non-linearity

<PyTorch: Visualizing Non-linearity> 

 

Date: 2023.05.11           

 

* The PyTorch series will mainly touch on the problem I faced. For actual code, check out my github repository.

 

[Dataset]

There’s not much to explain since the dataset and model itself is quite simple and intuitive. I’ll begin with the dataset.

 

[&ldquo;circles&rdquo; dataset]

[Extract 1000 Sample Data]

[Power of Non-linearity]

From our previous linear model, I added extra nodes per hidden layer, one extra hidden layer itself, and used ReLU as the activation function. Let’s compare the results between a linear model and non-linear model.

[Linear Model (no ReLU)]

[Nonlinear Model (ReLU)]