Boulder AI Assistant (Whatsapp Bot) 🚀

Generated using Ideogram

Description

This is a personal playground project, that uses OpenAI's Assistant Api, DALL-E and ElevenLabs text to speech, in hacky ways, tied together with whatsapp-web.js

Demo

Screenshots

Video

boulder-screen-capture.mp4

Features

• OpenAI's Assistant name Boulder persona inspired by Bastion Game
• Message handling
• Reacting to messages using OpenAI function calling capability
• Speech to text which uses whisper-1 model under the hood.
• Text to speech processing, customer voice inspired by Rucks from Bastion using ElevenLabs voice cloning
• image generation using DALLE-2 eg.. /imagine an astronaut lounging in space, tropical, pixel art
• Bot can respond to messages in 1on1 or in groups
• Automating whatsapp using https://wwebjs.dev/