Discussion of exponential progress in AI and computation, including Moore’s Law and the Bitter Lesson by Rich Sutton. This was part of the AI paper club on our Discord. Join here:

Bitter Lesson:
Slides for this video:
References sheet:
Lex + AI Podcast Discord:

0:00 – Overview
0:37 – Bitter Lesson by Rich Sutton
6:55 – Contentions and opposing views
9:10 – Is evolution a part of search, learning, or something else?
10:51 – Bitter Lesson argument summary
11:42 – Moore’s Law
13:37 – Global compute capacity
15:43 – Massively parallel computation
16:41 – GPUs and ASICs
17:17 – Quantum computing and neuromorphic computing
19:25 – Neuralink and brain-computer interfaces
21:28 – Deep learning efficiency
22:57 – Open questions for exponential improvement of AI
28:22 – Conclusion

– Subscribe to this YouTube channel
– Twitter:
– LinkedIn:
– Facebook:
– Instagram:
– Medium:



Leave a reply

Think-Feel-Connect and NeverHateOnlyLove.com are registered trademarks of LOPROD®, all rights reserved. All our material, digital, written, audiovisual is property of our private network and its respective members, all rights are reserved. If you use our website in any form, it means you have accepted our Terms and Conditions. Questions? Contact us.

Think-Feel-Connect y NeverHateOnlyLove.com son marcas registradas de LOPROD®, todos los derechos reservados. Todo nuestro material, digital, escrito, audiovisual es propiedad de nuestra red privada y sus respectivos miembros, todos los derechos están reservados. Si utiliza nuestro sitio web en cualquier forma, significa que ha aceptado nuestros Términos y condiciones. ¿Preguntas? Contáctanos.

Log in with your credentials

Forgot your details?