In a usual mixture-of-experts transformer, each token picks a few expert MLPs and attention stays dense. Nestor does the same thing to attention. A block has C columns. A router, run once at the block input, sends each token to Kc of them, and the token only attends to other tokens in those columns. Each column then has its own experts.