Linguapix App - Sustainability and Cultural Heritage with AI

Live Demo

STREAMLIT App

Introduction

Welcome to the Linguapix App! Our mission is to bridge linguistic gaps by providing seamless translation and subtitling services for videos from international languages such as French and English to local Benin languages, including Yoruba, Fon, and Dendi. We leverage advanced AI models to ensure our translations are accurate and culturally relevant. Additionally, our app offers image generation capabilities in native languages and integrates video dubbing functionality, allowing users to replace audio tracks with localized content. Through these features, we aim to promote inclusivity and accessibility by making digital content more accessible to diverse linguistic communities in Benin.

Features

• Video Translation and Subtitling: Translate and subtitle videos from French and English to Yoruba, Fon, and Dendi.
• Image Generation: Create visuals in native languages.
• Video Dubbing: Replace original audio tracks with localized content in Yoruba, Fon, and Dendi.
• AI-Driven Accuracy: Leverage advanced AI models for accurate and culturally relevant translations.

Technologies Used

• ChatGPT: For natural language processing and understanding.
• ModernMT: For high-quality machine translation.
• Neoform-AI: For automatic speech recognition.
• FFmpeg: For video processing and manipulation.
• Transformers: For various AI model implementations.
• Python: As the main programming language for backend development.

Installation

Prerequisites

• Node.js
• npm (Node Package Manager)
• Python (for AI model dependencies)
• FFmpeg (for video processing)

Steps

1. Clone the repository:

   git clone https://github.com/tommydebisi/linguapix
   cd linguapix-app

2. Install dependencies:

   pip install -r requirements.txt
   npm install ffmpeg

3. Run app in streamlit

Usage

1. Upload a video: Upload your video in either French or English.

2. Select the target language: Choose the target language for translation (Yoruba, Fon, or Dendi).

3. Generate subtitles: The app will generate and overlay subtitles in the selected language.

4. Image generation: Utilize the image generation feature to create visuals in the native language (Yoruba).

5. Video dubbing: Replace the original audio track with a localized version (To be added).

Contributing

We welcome contributions! Please follow these steps to contribute:

1. Fork the repository.
2. Create a new branch (git checkout -b feature/YourFeature).
3. Commit your changes (git commit -m 'Add YourFeature').
4. Push to the branch (git push origin feature/YourFeature).
5. Open a pull request.

Contact

If you have any questions or feedback, feel free to reach out to us:

• Email: tommydebisi@gmail.com
• GitHub: tommydebisi