MAMBA is a Fenwick Tree

Mamba [1]

From [2]

is a Fenwick Tree

From [3]

That’s it.

Reference

[1] Mamba: Linear-Time Sequence Modeling with Selective State Spaces [pdf]

[2] MAMBA from Scratch: Neural Nets Better and Faster than Transformers [video]

[3] Fenwick Tree Video in Chinese https://www.bilibili.com/video/BV1ce411u7qP/?share_source=copy_web&vd_source=ed7c7788c81c392a18b3cba61bfe1ba6