Skip to content
Prompty Workshop
AI-Assisted Evaluation
Initializing search
Prompty Workshop
Welcome
1. Core Concepts
1. Core Concepts
1. Introduction
2. Specification
3. Tooling
4. Runtime
2. Prompty Quickstart
2. Prompty Quickstart
Create Prompty
Configure Models
Create Sample
Run Prompty
3. Prompt Engineering
3. Prompt Engineering
System Context
Prompt Instructions
Model Parameters
Add Data
4. Model Choice
4. Model Choice
Open AI
Azure Open AI
Azure Serverless
GitHub Marketplace
5. Observability
5. Observability
Prompty Tracing
Trace Decorators
Trace Runs
Open Telemetry
6. Testing
6. Testing
Hardcoded Input
Sample File
Commandline Input
Function Call
7. Compostion
7. Compostion
Prompty + Data Binding
Prompty + RAG Pattern
Prompty + Evaluation
Prompty + Multi-Agent
8. Evaluation
8. Evaluation
AI-Assisted Evaluation
Evaluation Metrics
Evaluation Test Data
Evaluation Workflow
AI-Assisted Evaluation