Architecture Overview

Tools

  1. ReactJs/Next.js
  2. Nest.JS
  3. Python
  4. Ollama (LLMs Local Model Management)
  5. LiteLLM Gateway
  6. Cloud LLM (Gemini/GPT/etc.)
  7. Workflow N8N
  8. RabbitMQ
  9. PostgreSQL + pgvector
  10. Huawei Cloud

Web Admin Portal Implementation

Feature

  1. Admin Management
  2. User Management
  3. Organizations
  4. Project Management
  5. Service Management
  6. System Usage
  7. Object Store
  8. Audit Logs
  9. Settings (Roles/Email Domain Whitelist)
  10. etc.

Use-case:

Example:

Chat/Search

I want to know balance my leave in Phincon? -> AI ?? -> No asware or not have knowledge / hallucinations

With RAG (Retrieval-augmented generation)

Admin Add Document Knowledge about Company or DB employee
Then upload -> AI with RAG -> Save to DB PG Vector -> AI have knowledge search Result found.