Objective: locate deep learning, understand what it changes and avoid the "neural network for everything" reflex. Duration: 35 minutes.
Artificial intelligence covers the techniques that let a machine perform a task associated with intelligence. Machine learning is a part of AI in which rules are adjusted from data. Deep learning is a part of machine learning that learns with networks made of several stages of transformation.
AI ⊃ Machine Learning ⊃ Deep LearningThe word deep describes the number of representation steps, not depth of thought. An image can successively become: pixels → edges → textures → parts → object.
Classical methods often require a human to build the useful variables. A deep network can learn part of that representation directly from raw data. This property is particularly useful for images, audio, text and complex signals.
| Situation | First reasonable candidate |
|---|---|
| Small table of 3,000 rows | tree, boosting, regression |
| Millions of labeled images | CNN or Vision Transformer |
| Text with a pretrained model | fine-tuned Transformer |
| Exact and stable business rule | classical programming |
Deep networks often demand more data, more compute and more experimentation. They are sensitive to the protocol, initialization and learning rate. A larger model is neither automatically more accurate nor automatically more useful.
Pick three cases: a churn table, chest X-rays and an exact tax rule. For each, propose the simplest solution, a baseline, the expected proof and a stopping criterion. Deliverable: a one-page table. Success: no solution is chosen only because it is "modern".
Reading: deep learning is not an automatic choice. The nature of the data, the amount of supervision, the compute budget and the operating cost determine the solution. The main trap is picking the most complex architecture before establishing a measurable baseline.