Skip to content
View roymiles's full-sized avatar
🚲
🚲
46 followers · 34 following

Achievements

Achievement: Pair ExtraordinaireAchievement: Pull Sharkx2Achievement: StarstruckAchievement: Arctic Code Vault Contributor

Achievements

Achievement: Pair ExtraordinaireAchievement: Pull Sharkx2Achievement: StarstruckAchievement: Arctic Code Vault Contributor

Block or report roymiles

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
roymiles/README.md

I'm into model distillation, efficient fine-tuning, and building practical ML systems that scale. I also enjoy open-source, side projects, and making research code actually usable.

Pinned Loading

  1. huggingface/peft huggingface/peft Public

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    Python 21.2k 2.3k

  2. VkD VkD Public

    [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections

    Python 58 2

  3. ITRD ITRD Public

    [BMVC 2022] Information Theoretic Representation Distillation

    Python 19 1

  4. Simple-Recipe-Distillation Simple-Recipe-Distillation Public

    [AAAI 2024] Understanding the Role of the Projector in Knowledge Distillation

    Jupyter Notebook 20 1

  5. VeLoRA VeLoRA Public

    [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections

    Python 22 3

  6. diffusion-stitching diffusion-stitching Public

    Stitching Noisy Diffusion Thoughts for Better Reasoning

    Python 8