Transformer neural networks are taking over AI right now, and quite possibly their most famous use is in ChatGPT. In this talk, we'll see exactly how Transformers work in an easy to follow step-by-step way. We'll then review the history of neural networks to better understand how Transformers were invented and to give us a perspective on what the next steps might be for Neural Networks in general.