The request "annotations" is ambiguous: it could mean adding metadata or labels to data, or annotating code and traces. Several sources offer annotation features, most directly Langfuse, which provides annotation queues for human review and scoring of traces 4, and Replicate, which runs models via API that can be used for annotation work 7. Which platform or constraint you have in mind (for example, LLM trace annotation, code comments, or database metadata) would help narrow this down.
A question back: Do you mean annotating LLM traces, adding labels or comments to code, or annotating database schema metadata?
- 1
Langfuselangfuse.comfound in code, not yet checked
Open-source platform where annotation queues collect traces or observations for human review and scoring 4.
+30 community tools built for it
for agents: createAnnotationQueue · getAnnotationQueue · createAnnotationQueueItem
- 2
GitHubgithub.comverified and signed
Developer platform with a skill that adds educational comments to a file and an AI comment labeler that generates comments from labels 1.
official:MCP server · @github/mcp-registrySDK · @github/copilot-sdklibrary · CodeQL: StubCLI · specifyrepository · copilot-engine-sdk+2,577 community tools built for it
for agents: arize-annotation · add-educational-comments · github/ai-assessment-comment-labeler
- 3
Bitbucket APIbitbucket.orgverified and signed
Bitbucket API exposes operations to list, get and delete annotations on code reports 5.
official:API · Bitbucket API+78 community tools built for it
for agents: getAnnotation · getAnnotationsForReport · deleteAnnotation
- 4
Oracleoracle.comfound in code, not yet checked
Fetches Oracle 23ai annotations on tables, views and their columns through an MCP action 6.
official:MCP server · mcpSDK · oracledbrepository · oci-python-sdkskill · db+134 community tools built for it
for agents: adp_get_annotations · start-notification-stream · Oracle
Sources
- 1GitHub · Change is constant. GitHub keeps you ahead. · GitHub · GitHubgithub.com · read 2026-10-29
- 4Langfuse: Open Source Agent Evals & Observabilitylangfuse.com · read 2026-10-29
- 5Bitbucket | Git solution for teams using Jirabitbucket.org · read 2026-10-29
- 6Oracleoracle.com ·
- 7Replicate - Run AI with an APIreplicate.com · read 2026-10-29
For agents: the 10 actions behind this answer
arize-annotation · arize-annotation verified and signed
Creates and manages annotation configs (categorical, continuous, freeform label schemas) and annotation queues (human review workflows) on Arize. Applies human annotations to project spans via the Python SDK. Use when the user mentions annotation config, annotation queue, label schema, human feedbac
annotations · typing verified and signed
radar-get-annotations · Cloudflare API verified and signed
Get latest annotations
createAnnotationQueue · langfuse found in code, not yet checked
Create an annotation queue, a worklist that collects trace or observation items for human review and scoring.
getAnnotation · Bitbucket API verified and signed
Get an annotation
adp_get_annotations · mcp found in code, not yet checked
Fetch Oracle 23ai annotations on a table/view and its columns — useful for NL→SQL.
avivga/zerodim · avivga/zerodim verified and signed
Disentangled face manipulation using CLIP-based annotations
annotations · JetBrains.Annotations verified and signed
patch_session_annotations · agent-control-plane found in code, not yet checked
Merges key-value annotation pairs into a session's annotations field. Annotations are arbitrary string metadata — a programmable state store scoped to the session lifetime.
pyrefly-type-coverage · pyrefly-type-coverage verified and signed
Migrate a file to use stricter Pyrefly type checking with annotations required for all functions, classes, and attributes.
Labels are the instruments' verdict and are never changed by ranking. Agents and robots get this same answer as JSON at /api/v1/find?q=…&answer=1 and through the MCP server.