1f:I[93483,["/_next/static/chunks/1717luvc.zivw.js","/_next/static/chunks/026djt3x5ju8u.js","/_next/static/chunks/0zbm8aof9p5y2.js","/_next/static/chunks/11yr-1v0xh629.js","/_next/static/chunks/0n4z.7yu76je-.js","/_next/static/chunks/02k~2aux01el1.js","/_next/static/chunks/019.rlaql29~a.js","/_next/static/chunks/0cb0~tv4pl9gg.js","/_next/static/chunks/0sb8fd0tp5cf4.js","/_next/static/chunks/0lne7878vfzl4.js","/_next/static/chunks/0udx0e9zoi4~p.js"],"default"] 21:I[27201,["/_next/static/chunks/1717luvc.zivw.js","/_next/static/chunks/026djt3x5ju8u.js","/_next/static/chunks/0zbm8aof9p5y2.js","/_next/static/chunks/11yr-1v0xh629.js","/_next/static/chunks/0n4z.7yu76je-.js","/_next/static/chunks/02k~2aux01el1.js","/_next/static/chunks/019.rlaql29~a.js","/_next/static/chunks/0cb0~tv4pl9gg.js","/_next/static/chunks/0sb8fd0tp5cf4.js","/_next/static/chunks/0lne7878vfzl4.js"],"IconMark"] 20:T51f,

Overview

DocSoft is a production-grade, multi-tenant Retrieval-Augmented Generation (RAG) API built to serve isolated document knowledge bases per tenant, with automated deployment and rigorous evaluation of answer quality.

What it does

- Deployed as a FastAPI microservice, containerized with Docker

- Automated CI/CD pipeline (GitHub Actions → Render) for zero-touch deployments

- Tenant isolation enforced via API keys, so each customer's data and queries stay siloed

- Vector search powered by Pinecone, with LangChain orchestrating retrieval and generation via the Gemini API

Key engineering work

- Load testing: Stress-tested the service under concurrent traffic and uncovered an unhandled rate-limit failure mode (HTTP 429 escalating to 500) starting at just 5 concurrent users. Measured latency at 1.48s p50 / 2.16s p95.

- Evaluation harness: Built a deterministic evaluation framework to prove the value of retrieval — the RAG-grounded pipeline correctly answered 6/6 factual questions the base LLM alone got 0/6 on, and correctly declined to answer when context was insufficient (avoiding hallucination).

Stack

Python, FastAPI, Docker, LangChain, Google Gemini API, Pinecone, GitHub Actions