pandaprobe

git clone https://github.com/chirpz-ai/pandaprobe.git
cd pandaprobe
./start.sh

sequenceDiagram participant Client as 📡 SDK / HTTP Client participant API as ⚡ FastAPI participant Auth as 🔐 Auth Service participant IdP as 🌐 Supabase / Firebase participant Identity as 👥 Identity Service participant Trace as 🫆 Trace Service participant Eval as 🧪 Eval Service participant DB as 🗄️ PostgreSQL participant Redis as 📮 Redis participant Worker as ⚙️ Celery Worker participant LLM as 🤖 LLM Engine (LiteLLM) Note over Client,API: Management Plane (Bearer token) Client->>API: Authorization: Bearer <idp_token> API->>Auth: Verify token Auth->>IdP: Validate with provider IdP-->>Auth: User identity Auth-->>API: Authenticated user API->>Identity: /user, /organizations, /projects Identity->>DB: Read / write DB-->>Identity: Result Identity-->>Client: Response Note over Client,API: Data Plane (API key) Client->>API: X-API-Key + X-Project-Name API->>Identity: Resolve org & project Identity-->>API: Project context API->>Trace: POST /traces Trace->>Redis: Enqueue ingestion job Redis-->>Client: 202 Accepted Redis->>Worker: Pick up job Worker->>DB: Persist trace + spans API->>Trace: GET /traces, /sessions Trace->>DB: Query with filters DB-->>Trace: Rows Trace-->>Client: Paginated response API->>Eval: POST /evaluations Eval->>Redis: Enqueue eval job Redis-->>Client: 202 Accepted Redis->>Worker: Pick up job Worker->>LLM: LLM-as-a-judge call LLM-->>Worker: Verdict + score Worker->>DB: Persist evaluation result