Backprop is incredibly cool

• Intuitive generalization of single-unit gradient descent
• Explicit credit/blame, aka internal reinforcement
• Simple to understand
• Works well a lot of the time
• Function regression is a huge problem, old field
• Not invented until 1983
• Before that NNs were dead