Files
Johannes Daxböck bd808e84bf ref(evals): Tighten file assertions, minimize soft assertions
Prefix config keys with `config.` to ensure they appear as actual
config lines rather than in comments. Keep soft assertions to one
per scenario for semantic detection only. Relax sinatra file placement
to allow extracted initializer files.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-06-15 15:00:38 -07:00

26 lines
764 B
JSON

{
"name": "sinatra-basic",
"given": "A Sinatra 4 application with Puma, no existing monitoring",
"prompt": "Set up Sentry for this Sinatra application. Add error monitoring, tracing, and logging. Use the SENTRY_DSN environment variable.",
"fixture": "sinatra-basic",
"files": [
{
"path": "config.ru",
"contains": [
"Sentry::Rack::CaptureExceptions"
],
"excludes": []
},
{
"path": "Gemfile",
"contains": ["sentry-ruby"],
"excludes": ["sentry-rails", "sentry-sidekiq"]
}
],
"should_not_exist": [],
"soft_assertions": [
{ "criterion": "Sentry.init is called somewhere with config.dsn set to SENTRY_DSN and config.traces_sample_rate configured" }
],
"negative_assertions": []
}