Principles
Principles of the course/book:
- Teach the whole game (i.e. start with complete high-level approach, then dig down into abstractions)
- Teach through example
- Simplify
- Remove barriers
Mindset
- Aim to solve your own problems
- Focus on your hobbies / passions
- Start small
- Encourage your playfulness / curiosity
ML
Supervised ML paradigm:
Be aware!
What is the single most important and challenging issue when training? Reducing overfitting
What is the most important method for training models more quickly, accurately and with less data? Using pre-trained models / transfer learning
What is the single biggest source of failure when organisations decide to use AI? Poor understanding of importance of test / validation sets
Interpreting a neural network
How to interpret a (trained) neural network:
Left: reconstructed weights; Right: parts of training images with largest activations
Image Recognizers for Non-Image Tasks
How to use an image recogniser for a non-image task? Find a way of transforming the data into an image, such that the human eye can spot classes.
Documentation
How to get FastAI documentation within a Jupyter notebook? Call
doc(object)