DermaAI is a deep learning-based web application that performs automated skin lesion segmentation and classification using dermoscopic images.
The system helps in early detection of melanoma by providing:
- Fast predictions
- Lightweight deployment
- Clinically meaningful insights
Users can upload an image and receive:
- Segmentation mask
- Classification (Benign / Malignant)
- Confidence score
- Clinical recommendation
- 🧠 Two-stage AI pipeline (Segmentation + Classification)
- 🖼️ Lesion segmentation using U-Net / ResUNet
- 🔍 Classification using EfficientNet-B0 / ResNet-18
- ⚡ Fast inference (< 3 seconds on CPU)
- 🌐 Full-stack web app (React + FastAPI)
- 📊 Confidence score with probability visualization
- 🩺 Clinical recommendation system
- 📄 Downloadable report (PDF)
User Image → Preprocessing → Segmentation Model (U-Net)
→ Masked ROI → Classification Model → Prediction
→ Result Dashboard (Frontend)
Frontend:
- React.js
- Tailwind CSS
Backend:
- FastAPI
Machine Learning:
- PyTorch (Training)
- ONNX Runtime (Inference)
Deployment:
- Docker
- Nginx
Dataset:
- ISIC 2018 / 2019 / 2020
| Component | Model Used |
|---|---|
| Segmentation | ResUNet (U-Net + ResNet-18) |
| Classification | EfficientNet-B0 / ResNet-18 |
| Loss Function | Dice Loss + Focal Loss |
| Optimization | ONNX Export + INT8 Quantization |
- Dice Score: ≥ 0.85
- IoU: ≥ 0.78
- AUC-ROC: ≥ 0.88
- Inference Time: < 3 seconds (CPU)
DermaAI/
├── frontend/ # React frontend
├── backend/ # FastAPI backend
├── models/ # Trained models (ONNX / PyTorch)
├── data/ # Dataset (not included in repo)
├── notebooks/ # Training & experimentation
├── requirements.txt
└── README.md
git clone https://github.com/your-username/DermaAI.git
cd DermaAIcd backend
pip install -r requirements.txt
uvicorn app:app --reloadcd frontend
npm install
npm start- 👨⚕️ Dermatologists – AI-assisted triage tool
- 🎓 Students – Learning medical AI systems
- 🔬 Researchers – Model experimentation & benchmarking
This project is a research prototype and not a certified medical device. Predictions are advisory only and should not replace professional medical diagnosis.
- Multi-class classification (beyond benign/malignant)
- Transformer-based models (SegFormer, Swin-UNet)
- Mobile deployment (on-device inference)
- Real-time camera input
- Clinical compliance (HIPAA/DISHA)
- ISIC (International Skin Imaging Collaboration) Dataset
- PyTorch
- FastAPI
- ONNX Runtime
If you like this project, consider giving it a ⭐ on GitHub!

