// Project 01
Self-Hosted Enterprise AI Agent Platform
// Headline number
Ask the company
know-how + tools for every employee
// Architecture
live · 15 nodes · 15 edges
Built a self-hosted GCP AI assistant with vLLM on GPU nodes, scale-to-zero serving, RAG over enterprise sources and a governed text-to-SQL layer over BigQuery and MySQL. A Python and FastAPI backend uses a Pydantic AI agent, with Qdrant, Postgres and Redis running on GKE through OpenTofu, Helm and Ansible.
// The problem
Give every employee an assistant over Slack, Jira, Confluence and a curated know-how base, with intelligent tools, that keeps data in-house, respects permissions, and only pays for GPUs while someone is using it.
// My approach
Scale-to-zero vLLM on GKE L4 and Qdrant hybrid search with ACL filters inside the query. A Pydantic AI agent streams over FastAPI SSE, deployed or destroyed with one OpenTofu, Helm and Ansible command.
// Stack
// Outcome
- GPU cost proportional to usage through scale-to-zero
- One-command deploy and full destroy
- Permission filtering on retrieval from day one