What are attention mechanisms, transformers and the technological basis of GPT?

He has been working with image and document processing for over 20 years, working for companies such as Nuance, ABBYY, Banctec and Recognition. In 2017, he joined Natural Language Processing…

Master in Computer Science from the Federal University of Goiás - UFG. Graduated in Computer Engineering from the Federal University of Goiás - UFG. He was a member of the Pequi Mecânico robotics research group for 5 years. During his master's degree, he was a member of the I4Soft research group, applying Artificial Intelligence to Software Engineering problems. He is currently a PhD student in Computer Science at the Federal University of Goiás - UFG, a member of the Deep Learning Brasil research group. He has experience with mobile robots, machine learning, evolutionary computing, game development and artificial intelligence applied t…