DSWoK — Data Science Well of Knowledge
Search
Search
Dark mode
Light mode
Explorer
#attention
2 notes
· co-occurs with
3 tags
· last updated
Jul 31, 2026
Co-tags
#
nlp
2
#
architecture
2
#
transformer
2
Notes tagged
#attention
01
Attention
The original Transformer paper. Neural sequence attention predates it: Bahdanau et al., 2014 introduced soft alignment for machine translation.
Jul 31, 2026
Deep Learning
02
Transformer
The first Transformer was introduced in the Attention Is All You Need paper, soon after that BERT was published.
Jul 31, 2026
NLP