What I learned today

  A Comprehensive Theory of Deep Learning Table of Contents Preface Motivation The Need for Theory Scope and Audience 1. Introduction: Demystifying Deep Learning The Evolution of Machine Learning Perceived Mysteries and Myths Framing the Theoretical Challenge 2. The Geometric Field Perspective Neural Networks as High-Dimensional Dynamical Fields Attractors, Phase Transitions, and Topological Structures Semantic Clouds and Representation Manifolds 3. Generalization: From Soft Biases to Universality Inductive Biases: Hard vs. Soft PAC-Bayes, Compression, and Classical Bounds Double Descent, Benign Overfitting, and Their Interpretation Universality and Mode Connectivity 4. Representation Learning and Semantic Structure Adaptive Bases and Feature Construction Semantic Cloud Geometry: Modularity, Entanglement, Disentanglement The Role of Finsler Manifolds and Lattice Resonance Analogies, Transfer, and Compositionalit...

Table of Contents   A Field Guide to the Hard Limits of Cognition PART I — Defining the Problem Space 1. Introduction: Intelligence Has a Ceiling  – Why endless growth is a myth  – The transition from expansion to saturation  – What “useful intelligence” really means 2. Cognitive Growth: Illusion of Infinite Ascent  – History of the exponential climb  – AI scaling laws and the cognitive boom  – When more IQ stops mattering 3. From Capability to Constraint: Mapping the Ceiling  – The structural difference between hard problems and unsolved ones  – When intelligence hits physics and math PART II — The Structural Barriers 4. Computational Complexity: The P ≠ NP Wall  – Definitions, implications, and mythologies  – Why intelligence cannot “shortcut” the intractable  – Real-world cases: routing, scheduling, cryptography 5. Chaos and the Lyapunov Horizon  – Non-linear systems and prediction decay  – Weather, ecosystems, and financial turbulence  – Prediction limit...

Human Superpower: Language and Social Skills – Structured Table of Contents I. Evolutionary Baseline (Pre-70,000 BP) Anatomically Modern, Cognitively Archaic : Limited vocal capacity; reliance on manual gestures and iconic signals. Small, kin-based forager bands; loose traditions, slow technology turnover. Climate & Demographic Stress : Population bottlenecks; refugia shaping cultural continuity and social learning. II. Emergence of Full Recursion and Symbolic Culture (70,000–45,000 BP) Recursive Thought & Flexible Speech : Archaeological evidence for planning, coastal foraging, and symbolic objects (beads, ochre). Manual gesture remains crucial in mixed communication systems. Socially Learned Technology : Coastal gathering, nets, primitive boats; slow but steady innovation. Population Expansion & Behavioral Modernity : Broader networks, more complex group coordination. Language becomes the main channel for group identity and r...