Technical System Overview

Scorecard Workflow

The process of using the Scorecard platform consists of three general steps:

  1. Ingest your data and add Testcases into Scorecard
  2. Execute your Testcases on your LLM application
  3. Score the responses of your LLM application
Scorecard WorkflowThe Overall Scorecard Workflow

Step 1: Ingestion

As first step, you add the data and interesting Testcases that are representative of your LLM use case in the Scorecard platform.

Ingesting Testcases into ScorecardIngesting Testcases into Scorecard

Step 2: Execution

As second step, you run the defined Testcases against your LLM application.

Executing Your LLM App With ScorecardExecuting Your LLM App With Scorecard

Step 3: Scoring

As third and final step, the inputs and LLM-produced outputs for each Testcase will be scored - either automatically via Scorecard AI models or manually via your subject-matter experts.

Scoring Your LLM App With ScorecardScoring Your LLM App With Scorecard
Built with