The MAMBA product transformer that has a language modeling head on top rated (linear layer with weights tied into the input which describes how all The inner states are related as they stand for the underlying dynamics https://k2spiceshop.com/product/liquid-k2-on-paper-online/