feat: one-sided target probability acceptance for MTP drafts increases acceptance rate and throughput compared to argmax alone - #8

feat: one-sided target probability acceptance for MTP drafts increases acceptance rate and throughput compared to argmax alone#8

sujitvasanth wants to merge 4 commits into

AtomicBot-ai:feature/turboquant-kv-cacheAtomicBot-ai/atomic-llama-cpp-turboquant:feature/turboquant-kv-cachefrom

sujitvasanth:feat/draft-p-acceptsujitvasanth/atomic-llama-cpp-turboquant:feat/draft-p-acceptCopy head branch name to clipboard