LangSmith (MCP Server) — MCP Servers

Overview

LangSmith is a product by LangChain that provides teams with tools to debug, evaluate, and monitor the performance of AI applications — including agents built with or without the LangChain framework. It offers tracing of application behavior, evaluation with human feedback or automated “LLM-as-judge”, prompt testing/versioning, dashboarding, and alerting. It supports features like self-hosting for enterprises, controlling where data is stored, and monitoring business-relevant metrics. The “LangSmith MCP Server” is a specific component under active development: a Model Context Protocol (MCP) server that connects language models with the LangSmith platform to fetch conversation history, manage prompts, and integrate analytics. It allows MCP-compatible clients to interact with LangSmith for getting prompt templates, thread histories, datasets, and examples.

Key Features

Use Cases