AI-Services

AI Services, part of the IBM Open-Source AI Foundation for Power, deliver pre-built AI capabilities and integration with inferencing solutions like Red Hat AI Inference Server. Optimized for IBM Spyre™ on Power, they enable fast deployment and support models such as LLMs, embeddings, and re-rankers—helping enterprises scale AI efficiently.

📺 Demo

AIServicesGA3-TechDemo063026.mp4

Quick Start

Installation

For detailed platform-specific installation instructions, see Installation Guide.

Run the binary to get started

% ai-services --help
A CLI tool for managing AI Services infrastructure.

Usage:
  ai-services [command]

Available Commands:
  application Deploy and monitor the applications
  bootstrap   Initializes AI Services infrastructure
  catalog     Manage the AI Services catalog
  completion  Generate the autocompletion script for the specified shell
  help        Help about any command
  version     Prints CLI version with more info

Flags:
  -h, --help      help for ai-services
  -v, --version   version for ai-services

Use "ai-services [command] --help" for more information about a command.

---

Repository Structure

project-ai-services/
├── services/          # Backend microservices
│   ├── common/        # Shared library
│   ├── chatbot/       # RAG chatbot service
│   ├── digitize/      # Document ingestion
│   ├── summarize/     # Summarization service
│   └── similarity/    # Similarity search
├── ui/                # Frontend applications
│   ├── chatbot/       # Chatbot UI
│   ├── digitize/      # Digitize UI
│   └── catalog/       # Catalog UI
├── images/            # Container base images
│   ├── service-base/  # Base image for AI services
│   ├── postgres/      # PostgreSQL image
│   ├── litellm/       # LiteLLM proxy
│   ├── caddy/         # Caddy proxy
│   └── tools/         # Utility tools
└── ai-services/       # CLI tool

Service Architecture

The repository follows a microservices architecture with:

• Layered Container Images: service-base → services-common → individual services
• Independent Services: Each service has its own Containerfile, Makefile, and versioning
• Shared Common Layer: Common utilities and dependencies in services/common/
• Clean Boundaries: No cross-service dependencies, all shared code in common layer

Service Images:

• chatbot-service - RAG chatbot backend
• digitize-service - Document ingestion and processing
• summarize-service - Text summarization
• similarity-service - Semantic similarity search

UI Images:

• chatbot-ui - Chatbot web interface
• digitize-ui - Document upload interface
• catalog-ui - Service catalog interface