Collected work
Efficient transformers
A visual companion to Efficient Transformers: A Survey by Tay et al.
SPICE of Efficient Transformers: A Survey by Tay et al
TL-DR:
Surveying the X in X-formers
The SPICE for this is disseminated via two formats.
Static SPICE (PDF with URLs to the papers)
Interactive SPICE below. (Click on the links and the representative Image appears. Click on 'Fullscreen')
Migrated from vinayprabhu.com. Original wording is retained on this collection page. Download the source archive