Skip to content

FLock-io/private_AI_experiment

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Private AI Appliance

An offline-capable, battery-powered AI device for privacy-first environments.

Overview

The Private AI Appliance delivers local AI capabilities without cloud dependency. All processing happens on-device, ensuring complete data privacy. The system runs on Raspberry Pi CM5 hardware and supports both portable and stationary use cases.


Tiers

Basic Tier

For: Individual users needing portable AI assistance

Capabilities:

  • Conversational AI (text chat)
  • Voice input/output (speech-to-text, text-to-speech)
  • Image understanding and analysis
  • OCR - Extract text from photos and documents (NEW)
  • Code generation and assistance

Use Cases:

  • Privacy-conscious consumers (complete offline operation)
  • Safety & rescue operations (disaster zones without infrastructure)
  • Remote/off-grid work (100% offline functionality)
  • Education/exam settings (no internet = no cheating)
  • Tourism (multilingual travel companion)
  • Photo text extraction (signs, menus, documents)

Premium Tier

For: Power users and professionals needing document intelligence

Capabilities:

  • Everything in Basic tier, plus:
  • Advanced OCR (tables, formulas, charts, batch processing)
  • RAG (Retrieval-Augmented Generation) - Chat with your documents
  • Document analysis and semantic search
  • 24/7 agent scheduling
  • Higher quality AI model (9B vs 4B parameters)

Use Cases:

  • Legal professionals (document analysis in constrained networks)
  • Healthcare workers (secure patient data handling)
  • Researchers (document corpus analysis)
  • Business professionals (intelligent document processing)
  • Writers and analysts (research synthesis)

Enterprise Tier

For: Organizations needing compliance and scale

Capabilities:

  • Everything in Premium tier, plus:
  • Audit logging and compliance reporting
  • User management and RBAC
  • Device clustering (federated search)
  • Seal recognition (document authentication)
  • Enterprise SLA and support

Use Cases:

  • Enterprise secure AI deployment
  • Compliance-regulated industries (HIPAA, GDPR)
  • Multi-user team environments
  • High-security government use

Models & Hardware

Tier Hardware Primary Model OCR Model RAM Storage
Basic Raspberry Pi CM5 8GB Qwen 3.5 4B (2.9GB) PaddleOCR-VL-1.5 (1.2GB) 8GB 64GB eMMC
Premium Raspberry Pi CM5 16GB + NVMe Qwen 3.5 9B (5.8GB) PaddleOCR-VL-1.5 (1.2GB) 16GB 128GB NVMe
Enterprise CM5 Cluster / Custom Qwen 3.5 9B/27B PaddleOCR-VL-1.5 16GB+ 256GB+ NVMe

Model Specifications

Qwen 3.5 4B (Basic)

  • 4 billion parameters, Q4_K_M quantization
  • Native vision capabilities (multimodal)
  • 201 languages supported
  • ~18-22 tokens/second on Pi 5
  • Apache 2.0 license

Qwen 3.5 9B (Premium/Enterprise)

  • 9 billion parameters, Q4_K_M quantization
  • Superior vision quality (70.1% MMMU-Pro)
  • Enhanced reasoning and coding capabilities
  • ~10-14 tokens/second on Pi 5

PaddleOCR-VL-1.5 (All Tiers)

  • 0.9 billion parameters, GGUF format for llama.cpp
  • 94.5% accuracy on OmniDocBench v1.5 (SOTA)
  • 20+ languages (English, Chinese, Japanese, Korean, Arabic, Hindi, German, Spanish, French, etc.)
  • Supports: text, tables, formulas, charts, handwriting

Pricing

DIY Kits

Tier Price Includes
Basic $249 CM5 8GB, carrier board, case, antenna
Premium $649 CM5 16GB, NVMe carrier, active cooling, case
Enterprise $1,049 Dual CM5 cluster, 512GB NVMe, rack mount

Assembled Units

Tier Price Includes
Basic $449 Fully assembled, tested, 1-year warranty
Premium $949 Fully assembled, NVMe installed, premium cooling
Enterprise $1,549 Cluster setup, configured, enterprise support

Software

  • All tiers: One-time purchase, no subscription fees
  • Enterprise: Optional support contracts available
  • No cloud costs: Everything runs locally, forever

Technical Highlights

  • Offline-First: Works 100% without internet
  • Privacy-First: No data leaves the device
  • Battery-Powered: 4-8 hours continuous use
  • WiFi Access Point: Connect any device via PrivateAI-XXXX
  • Open Source: Core software under Apache 2.0
  • Expandable: Add custom models via USB/NVMe

Quick Start

# Connect to device WiFi
# Open browser to 192.168.4.1
# Download models (one-time)
# Start chatting - completely offline

Documentation


Last updated: April 2026

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors