deepeval 开源项目推荐（257 个）

kanchengw /cnllm

适用于中国大型语言模型的Python工具包，具备灵活批处理能力、结构化实时可视化和自动累积流媒体，并对厂商原生参数验证提供明确反馈。

bansalkanav /GenAI-AgenticAI-From-Zero-to-Production

Learn GenAI and Agentic AI from Zero to Production

SDETBMan /qa-automation-portfolio

26-framework SDET monorepo: Playwright, Selenium, Cypress, Cucumber, Postman, FastAPI, Pact, AI/LLM eval (DeepEval), agentic AI (LangChain, LangGraph, DSPy, Claude), k6, flakiness detection, site monitoring, failure triage, QMS evidence (ISO 9001/SOC 2), dependency audit · GitHub Actions · DataDog · Terraform IaC

avnlp /rag-pipelines

Advanced RAG pipelines for medical (HealthBench, MedCaseReasoning, MetaMedQA, PubMedQA) and financial (FinanceBench, Earnings Calls) QA. LangGraph orchestration + BAML structructed generation, Milvus Hybrid search (Dense + BM25 + RRF), three-layer Metadata Enrichment, Contextual AI instruction-following reranker, and DeepEval evaluation.

avnlp /dspy-opt

Advanced RAG pipeline optimization framework using DSPy. Implements modular RAG pipelines with Query-Rewriting, Sub-Query Decomposition, and Hybrid Search via Weaviate. Automates prompt tuning and few-shot selection using GEPA, SIMBA, MIPRO, COPRO, and BootstrapFewShot optimizers on datasets like FreshQA, HotpotQA, TriviaQA, Wikipedia and PubMedQA.

messeb /py-deepeval-behave-bdd-testing-example

An example that combines Behave (BDD testing) with DeepEval (LLM evaluation) to create human-readable, stakeholder-friendly tests for AI Agents / chatbots.

awslabs /uaef

Universal Agent Evaluation Framework (UAEF) is a framework-agnostic evaluation system for AI agents. Invoke any agent and score it on multiple metrics spanning tool calling, response quality, safety, performance, and reasoning. Track experiments against baselines, catch regressions automatically, and get LLM-generated insights.

MERakram /Advanced-RAG-monorepo

🚀 Production-ready modular RAG monorepo: Local LLM inference (vLLM) • Hybrid retrieval with Qdrant • Semantic caching • Docling document parsing • Cross-encoder reranking • DeepEval evaluation • Full observability with Langfuse • Open WebUI chat interface • OpenAI-compatible API • Fully Dockerized

jianjian12138 /agent-testing-handbook

Agent 测试转型手册：资深自动化测试工程师的 AI QE 学习路径 + 练手代码

avnlp /biothink

Self-Reflective Question Answering for Biomedical Reasoning. GRPO fine-tuning via QLoRA & Unsloth with rewards for correctness, relevance, groundness, utility & XML structure. Structured think → answer → self-reflection with context grading, relevance assessment & groundness evaluation. DeepEval LLM-as-a-Judge (GEval, Faithfulness, Relevancy).

plwslpld-arch /eval-harness-internals

面向开发者的中文 Eval Harness 源码教材：解析 lm-evaluation-harness、Inspect AI、OpenAI Evals、Promptfoo、DeepEval 与 Harbor，覆盖任务、运行、评分、统计与发布门禁。

augustineuzokwe /rtia

Multi-agent LangGraph app turning raw requirements into backlog-ready user stories, ACs, and test cases. Live Gemini-Flash CI eval gate + nightly N=10 adversarial regression.

himanshu231204 /prompt-engineering-mastery

Production-grade prompt engineering curriculum — 7 modules covering foundations, reasoning, RAG, security, and evaluation. Model-agnostic (OpenAI/Anthropic/Ollama), runnable notebooks, mini-projects, Mermaid diagrams. Not prompt tips — prompt engineering as a discipline.

advien /poar-research-assistant

AI research assistant for prosthetics, orthotics & rehabilitation robotics papers. RAG pipeline with streaming citations, structured summaries, terminology extraction, and paper comparison. Built with Next.js 15, Claude, pgvector. Includes observability tracing and DeepEval evaluation pipeline.

h00w /PromptPulse

Automated, production-grade CI/CD evaluation pipeline for Hugging Face chatbots using DeepEval and dynamic JSON test datasets.

YuvrajSingh-mist /ASCIITermDraw-Benchmark

TermDraw-Bench: a benchmark for whether LLMs and VLMs can generate and edit structured ASCII diagrams. 80 tasks across 4 categories, scored by a DeepEval LLM judge.

siavash-debug /proofdesk

RAG assistant for accurate, cited search over credential/certificate documents — built with formal evaluation and hallucination-resistant retrieval

jesrav /evaltrack

Pytest plugin that records, gates and tracks your LLM evals in the CI you already have.

adityapradhan202 /BNS-LexAI

BNS-LexAI is an AI-powered legal information and case understanding assistant.

JohnRitchie /qa-llm-guard

该项目在 GitHub 上没有填写描述