Goals
- We can explain the importance of good features for neural network models.
- We have started to get a sense of how a nonlinearity can be useful for feature extraction.
Warm-Up: ReLU features
We’ll play with this model briefly:
- ReLU Regression Interactive
(name:
u05n00-relu.ipynb; show preview, open in Colab)
For more, try out Figure 3.3a in the Understanding Deep Learning interactive figures
Feature Extractors
- Image Classification: Losses and Feature Extraction
(name:
u05n1-img-classifier-feature-extractor.ipynb; show preview, open in Colab)