MachineHack_LLM

Results

The project's optimization efforts have yielded impressive results:

• 65% Speedup: The model's response time is significantly faster, making it suitable for real-time applications.

• Improved Accuracy: The model's answers are more precise and contextually relevant.

Technologies Used

• DistilBERT
• Intel Extension for PyTorch
• Intel Neural Compressor
• Python

Demo Application

DEMO

Demo Video

Click Here to Watch Demo Video

Process Flow