AgentOps
AgentOps uses a CrewAI multi-agent pipeline to autonomously detect, diagnose, and fix ML production issues.
Core trick
Compares live feature-drift metrics against baselines, then a RAG-backed investigator passes findings to a remediator that files fixes.
Description
AgentOps uses a CrewAI multi-agent pipeline to autonomously detect, diagnose, and fix ML production issues.
Three agents work in sequence:
- Monitor pulls metrics and feature drift from Snowflake, detecting anomalies against baselines
- Investigator performs root cause analysis using RAG over runbooks and past incidents
- Remediator executes fixes via Composio integrations with Slack and GitHub
Each agent builds on the previous agent's output—mimicking how an on-call engineer triages, diagnoses, and resolves
issues.
A React dashboard provides human-in-the-loop oversight: approving actions, monitoring agent progress via live
streaming, and initiating investigations.
README excerpt
# AgentOps — Autonomous MLOps Platform
> From alert to resolution in minutes, not hours.
AgentOps is an autonomous MLOps platform that detects model degradation in production, diagnoses root causes using internal knowledge bases, and remediates issues — all with human approval gates for high-risk actions.
Built for the [Llama Lounge Agentic Hackathon](https://cerebralvalley.ai/e/llama-lounge-agentic-hackathon/details) (Feb 28, 2026).
## Architecture
```
┌─────────────────────────────────────────────────────────┐
│ React Dashboard (Vite + Tailwind) │
│ Metrics │ Alerts │ Investigation │ Actions │ Crew AI │
│ ↕ SSE real-time streaming │
└────────────────────────┬────────────────────────────────┘
│ REST + SSE
┌────────────────────────▼────────────────────────────────┐
│ FastAPI Backend (:8080) │
└────────────────────────┬────────────────────────────────┘
│
┌────────────────────────▼────────────────────────────────┐
│ CrewAI Multi-Agent Orchestration │
│ │
│ ┌──────────┐ ┌──────────────┐ ┌──────────────┐ │
│ │ Monitor │──▶│ Investigator │──▶│ Remediator │ │
│ │ Agent │ │ Agent │ │ Agent │ │
│ └────┬─────┘ └──────┬──────┘ └──────┬───────┘ │
│ │ │ │ │
└───────┼──────