Mamba-Shedder: Intel Labs Explores Efficient Compression of Selective Structured State Space Models

Utilizing block pruning techniques, Intel Labs researchers developed the Mamba-Shedder solution to remove redundancies in Mamba-based models, improving their computational and memory efficiency