Understanding and Mitigating Bottlenecks of State Space Models through the Lens of Recency and Over-smoothing
Paper
•
2501.00658
•
Published
•
7
•
2
Peihao Wang
peihaowang
AI & ML interests
Geometric Learning, Generative Models, Neural Rendering, Large Language Models
Recent Activity
authored
a paper
4 days ago
Rethinking Addressing in Language Models via Contexualized Equivariant
Positional Encoding
commented
a paper
8 days ago
Understanding and Mitigating Bottlenecks of State Space Models through
the Lens of Recency and Over-smoothing
Organizations
peihaowang's activity
commented
a
paper
8 days ago