Skip to content

OFFGRID

OFFGRID-GPT: offline-first field-aid AI. Runs with zero network using local RAG over PDFs and OCR/STT/TTS; switches to vLLM or llama.cpp when available. Fast, auditable, ready for field demos.

Core trick

Runs local RAG over PDFs with OCR and speech I/O, switching inference backend between llama.cpp and vLLM by availability.

Tags

Team