i-net Clear Reports
| Goal | Recommended First Paper | |------|--------------------------| | | “Rethinking Attention with Performers” (Choromanski et al. , 2021) | | Learn the causal sparse pattern | “SCAT: Sparse Causal Attention Transformer” (Zaheer et al. , 2022) | | See a concrete hybrid | “Linear‑Sparse Transformers: Merging Performers with SCAT” (Liu et al. , 2023) |
"Performer scat" likely refers to scat singing, a vocal improvisation technique used by musicians, particularly in jazz and experimental music. Scat singing involves creating melodic lines with the voice, often using nonsensical syllables, vocalizations, or even sounds that mimic instrumental playing. perverformer scat