Skip to main content
LangSmith allows you to manually annotate traces with feedback within the application. This can be useful for adding context to a trace, such as a user’s comment or a note about a specific issue. You can annotate a trace either inline or by sending the trace to an annotation queue, which allows you to closely inspect and log feedbacks to runs one at a time. Feedback tags are associated with your workspace.
You can attach user feedback to ANY intermediate run (span) of the trace, not just the root span.This is useful for critiquing specific parts of the LLM application, such as the retrieval step or generation step of the RAG pipeline.
To annotate a trace inline, open the three-dot menu (...) in the trace view for any particular run that is part of the trace, then click Notes. This will open up a pane that allows you to choose from feedback tags associated with your workspace and add a score for particular tags. You can also add a standalone comment. Follow Set up feedback criteria to set up feedback tags for your workspace. You can also set up new feedback criteria from within the pane itself. Annotation sidebar You can use the labeled keyboard shortcuts to streamline the annotation process.
Connect these docs to Claude, VSCode, and more via MCP for real-time answers.
Edit this page on GitHub or file an issue.