Skip to content
View Prasannajaga's full-sized avatar
🎯
Focusing
🎯
Focusing
16 followers · 32 following

Achievements

Achievement: QuickdrawAchievement: YOLOAchievement: Pull Sharkx2

Achievements

Achievement: QuickdrawAchievement: YOLOAchievement: Pull Sharkx2

Block or report Prasannajaga

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Prasannajaga/README.md

Hi 👋, I'm Prasanna

LLM inference | Cyclist

profile views

My love for programming started after I dropped out. now, Im doing self-research on LLMs, RL, and evals. after going through a couple of exploration with LLMs, I found my sweet spot in inference infrastructure.

Give me your GPUs. I promise they'll never be idle again.

Blogs

I write blogs, a lot of blogs, you can find a few that Im really proud of here:

Pinned Loading

  1. llm-d llm-d Public

    Forked from llm-d/llm-d

    Achieve state of the art inference performance with modern accelerators on Kubernetes

    Shell

  2. Calinix Calinix Public

    custom EPP layer which supports cache aware load balancer for prefill + decode disaggregation

    Rust

  3. guidellm guidellm Public

    Forked from vllm-project/guidellm

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    Python

  4. cracker-sdk cracker-sdk Public

    manage your VM orechestration easily with cracker-sdk

    Python

  5. catch-me-if-u-can catch-me-if-u-can Public

    Catch me if you can

    Python

  6. shu-bamma/marlin-cli shu-bamma/marlin-cli Public

    Find moments in your videos — agent-first CLI for Marlin-2B (dense captioning + temporal grounding). Local on Apple Silicon (MLX) / NVIDIA (vLLM), or NemoStation hosted.

    Python 10 2