SPICE of Efficient Transformers: A Survey by
Tay et al
TL-DR:
Surveying the
X
in
X
-formers
The SPICE for this is disseminated via two formats.
Static SPICE
(PDF with URLs to the papers)
Interactive SPICE below. (Click on the links and the representative Image appears. Click on 'Fullscreen')

Fullscreen

Matrix Rain with Blue Neon Text "Those who ride the tiger can never dismount."