Accelerating Language Model Inference with Mixture of Attentions
•
24
Haitham Bou Ammar
hba123
AI & ML interests
LLMs, VLMs, Robotics, Reinforcement Learning, Bayesian Optimisation
Recent Activity
reacted
to
their
post
with 🚀
3 days ago
I have some New Year presents for you, #MachineLearning and #AI community! We just opened our code for new state-of-the-art results that beat EAGLE-2 and Medusa #LLM inference.
We also shared the model check pt on @huggingface! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding
upvoted
an
article
4 days ago
Accelerating Language Model Inference with Mixture of Attentions
posted
an
update
4 days ago
I have some New Year presents for you, #MachineLearning and #AI community! We just opened our code for new state-of-the-art results that beat EAGLE-2 and Medusa #LLM inference.
We also shared the model check pt on @huggingface! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding
Articles
Organizations
None yet
hba123's activity
reacted to
their
post with 🚀
3 days ago
Post
1775
I have some New Year presents for you, #MachineLearning and #AI community! We just opened our code for new state-of-the-art results that beat EAGLE-2 and Medusa #LLM inference.
We also shared the model check pt on @huggingface ! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding
We also shared the model check pt on @huggingface ! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding
upvoted
an
article
4 days ago
Article
Accelerating Language Model Inference with Mixture of Attentions
By
•
•
24
posted
an
update
4 days ago
Post
1775
I have some New Year presents for you, #MachineLearning and #AI community! We just opened our code for new state-of-the-art results that beat EAGLE-2 and Medusa #LLM inference.
We also shared the model check pt on @huggingface ! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding
We also shared the model check pt on @huggingface ! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding
published
an
article
4 days ago
Article
Accelerating Language Model Inference with Mixture of Attentions
By
•
•
24
liked
a
model
4 days ago
authored
2
papers
12 days ago
reacted to
their
post with 🚀
15 days ago
Post
1791
Blindly applying algorithms without understanding the math behind them is not a good idea frmpv. So, I am on a quest to fix this!
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
posted
an
update
18 days ago
Post
1791
Blindly applying algorithms without understanding the math behind them is not a good idea frmpv. So, I am on a quest to fix this!
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
commented
a
paper
18 days ago
upvoted
an
article
18 days ago
Article
Deriving DPO's Loss
By
•
•
26
commented
a
paper
about 1 month ago
upvoted
a
paper
2 months ago
commented
a
paper
2 months ago
authored
2
papers
4 months ago
upvoted
a
paper
5 months ago
commented
a
paper
5 months ago
upvoted
a
paper
5 months ago
upvoted
a
paper
6 months ago