Summarization — Earnings Reports
Financial document summarization eval. Tests factual consistency and numerical accuracy against source documents.
Status
PASSCases
96
Visibility
Public
Baseline
run-008
Target Setup
OpenAI
Auth: Server KeyModel: gpt-4oHealth: Not Tested
Thresholds
Pass Rate Min92%
Faithfulness Min0.88
PII Max0
Secrets Max0
Jailbreak Max0
Policy Configuration
PIIBlocking
SecretsBlocking
JailbreakMonitor
ToxicityMonitor
Case Uploads
No uploads yet. Upload a template file to add cases to this suite.