Data & Decision Boundary
Network Architecture
Too high = overshoots. Too low = learns slowly.
More neurons = more complex boundaries.
The 'squish function' that gives the network its power.