71 tools · Browse 71 observability AI artifacts on Unfragile.
LLM eval & testing toolkit
基于 Playwright 和AI实现的闲鱼多任务实时/定时监控与智能分析系统，配备了功能完善的后台管理UI。帮助用户从闲鱼海量商品中，找到心仪产品。
⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载，你的 AI 舆情监控助手与热点筛选工具！聚合多平台热点 + RSS 订阅，支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI 分析简报直推手机，也支持接入 MCP 架构，赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ，数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Self-hosted AI agent orchestration platform: dispatch tasks, run multi-agent workflows, monitor spend, and govern operations from one mission control dashboard.
AI observability with data quality monitoring and secure statistical profiling.
MLOps API for experiment tracking and model management.
ML experiment tracking — logging, sweeps, model registry, dataset versioning, LLM tracing.
Query Sentry issues, errors, and stack traces via MCP.
AI gateway — retries, fallbacks, caching, guardrails, observability across 200+ LLMs.
Manage PagerDuty incidents, alerts, and on-call schedules via MCP.
LLM evaluation and tracing platform — automated metrics, prompt management, CI/CD integration.
OpenTelemetry-based LLM observability with automatic instrumentation.
Scalable experiment tracking and model registry API.
Metadata store for ML experiments at scale.
ML experiment tracking — rich metadata logging, comparison tools, model registry, team collaboration.
Open-source ML lifecycle platform — experiment tracking, model registry, serving, LLM tracing.
© 2026 Unfragile. Stronger through disorder.