Architecture

MLP-Mixer

Vision architecture using only multilayer perceptrons — no attention, no convolutions.

Definition

MLP-Mixer alternates token-mixing and channel-mixing MLPs on a grid of image patches, achieving competitive ImageNet accuracy without attention or convolution. It shows that strong inductive biases are not strictly necessary at scale.

Common use cases

  • Vision research
  • Benchmarks

Related terms

    MLP-Mixer — AI Glossary | Railwail