LangSmith

Trace, debug, evaluate, and monitor LLM applications with LangSmith. Covers tracing, datasets, evals, prompt management, and production monitoring.

FundamentalsTopics 1–9

·What Is LangSmith?
·Setting Up Tracing
·Traces and Runs
·Projects and Workspaces
·The Trace UI
·Tagging and Metadata
·Annotating Runs
·Sharing Traces
·Hub Prompt Management

Start Fundamentals →

IntermediateTopics 10–17

·Datasets and Examples
·Creating Evaluators
·Running Evaluations
·Custom Metrics
·Comparing Models
·Regression Testing
·Feedback Collection
·Online Evaluation

Start Intermediate →

ProductionTopics 18–25

·Production Monitoring
·Alerting on Metrics
·Cost Tracking
·Prompt Versioning in Production
·A/B Testing Prompts
·CI/CD Integration
·Multi-Team Workflows
·LangSmith SDK Deep Dive

Start Production →