Simple implementation of Speculative Sampling in NumPy for GPT-2.

Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

Transformer related optimization, including BERT, GPT