A curated, community-maintained collection of residual connection, normalization and depth-parametrization designs. Each card gives a simplified update rule in shared notation:
xl is the residual stream entering layer l, Fl is the attention or MLP branch, and Hl is a multi-stream state.
Formulas are schematic; check the paper for the exact form.