Cookbooks — Scorecard AI

Welcome to the Scorecard Cookbooks. Here you’ll find code and guides for accomplishing common tasks with the Scorecard API and SDKs. To run these examples, you’ll need a Scorecard account and associated API key (create an account here).

Most code examples are written in Python, though the concepts can be applied in any language.

Scorecard Recipes

E2E Text Extraction and Vector Search Python Demo

Anthropic Retrieval Augmented Generation (RAG) Example

Create a Testset with Custom Schema

Multi-Message Prompt using Scorecard SDK

Prompt with Custom Variables using Scorecard SDK

Heuristic Scoring Example - Exact String Match

Tracing with Scorecard - Python Demo

Tracing with Scorecard - Node Demo

Prompt Management Example

Using Second-Party Metrics from MLflow

Using Second-Party Metrics from RAGAS