Why Do Transformers Look Like This?

CodeEmporium Guide 9 days ago

Description

Why do Transformers look like this? There is a story behind that.

ABOUT ME
โญ• Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
๐Ÿ“š Medium Blog: https://medium.com/@dataemporium
๐Ÿ’ป Github: https://github.com/ajhalthor
๐Ÿ‘” LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/

RESOURCES
[1 ๐Ÿ“š] Transformer Paper: https://arxiv.org/pdf/1706.03762
[2 ๐Ÿ“š] LSTM blog: https://karpathy.github.io/2015/05/21/rnn-effectiveness/
[3 ๐Ÿ“š] Transformer Architecture Image deep dive: https://github.com/ajhalthor/Transformer-Neural-Network/blob/main/Transformer_Architecture_complete.png

PLAYLISTS FROM MY CHANNEL
โญ• Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8
Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc
โญ• Transformers from Scratch: https://www.youtube.com/playlist?list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
โญ• ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
โญ• Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
โญ• The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
โญ• Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
โญ• Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD


MATH COURSES (7 day free trial)
๐Ÿ“• Mathematics for Machine Learning: https://imp.i384100.net/MathML
๐Ÿ“• Calculus: https://imp.i384100.net/Calculus
๐Ÿ“• Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
๐Ÿ“• Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
๐Ÿ“• Linear Algebra: https://imp.i384100.net/LinearAlgebra
๐Ÿ“• Probability: https://imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
๐Ÿ“• โญ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
๐Ÿ“• Python for Everybody: https://imp.i384100.net/python
๐Ÿ“• MLOps Course: https://imp.i384100.net/MLOps
๐Ÿ“• Natural Language Processing (NLP): https://imp.i384100.net/NLP
๐Ÿ“• Machine Learning in Production: https://imp.i384100.net/MLProduction
๐Ÿ“• Data Science Specialization: https://imp.i384100.net/DataScience
๐Ÿ“• Tensorflow: https://imp.i384100.net/Tensorflow