Tim Pietrusky 140f53f402 test(flash): make dev-loop eval a live integration test
Per request: evals should run against real infra, no mocks. Reworks the
dev-loop eval from description-grade to a live run graded on observed runtime
results, and commits a self-contained buggy fixture project.

- add flash/evals/fixtures/dev-loop/main.py: an Endpoint with an intentional
  module-level VOL referenced in the handler (NameError on the remote worker
  under flash dev; flash deploy masks it)
- rewrite dev-loop-iteration.eval.md: Setup (RUNPOD_API_KEY, real worker, cost),
  observed-result assertions (background dev server, real port from log,
  file-namespaced /main/predict route, verbatim NameError from worker logs,
  hot-reload fix, real HTTP 200, undeploy), and Cleanup
2026-06-22 13:50:59 +02:00
2026-04-14 15:04:11 -07:00
2026-02-03 15:20:19 +01:00

Runpod Agent Skills

Skills for AI agents to manage GPU workloads on Runpod.

Available Skills

flash

Complete knowledge of the runpod-flash framework - SDK, CLI, architecture, deployment, and codebase. Use when working with runpod-flash code, writing @remote functions, configuring resources, debugging deployments, or understanding the framework internals.

runpodctl

Manage GPU pods, serverless endpoints, templates, volumes, and models.

Installation

npx skills add runpod/skills

Works with Claude Code, Cursor, GitHub Copilot, Windsurf, Cline, and 17+ other AI agents.

Setup

runpodctl doctor

Usage

Ask your AI agent:

  • "Create a pod with an RTX 4090"
  • "List my pods"
  • "What GPUs are available?"
  • "Show my account balance"
  • "Deploy a serverless endpoint"

URLs

Pod URLs

Access exposed ports on your pod:

https://<pod-id>-<port>.proxy.runpod.net

Example: https://abc123xyz-8888.proxy.runpod.net

Serverless URLs

https://api.runpod.ai/v2/<endpoint-id>/run        # Async request
https://api.runpod.ai/v2/<endpoint-id>/runsync    # Sync request
https://api.runpod.ai/v2/<endpoint-id>/health     # Health check
https://api.runpod.ai/v2/<endpoint-id>/status/<job-id>  # Job status

Structure

flash/
└── SKILL.md
runpodctl/
└── SKILL.md

License

Apache-2.0

S
Description
runpodctl: Runpod CLI for managing GPU/CPU workloads from the terminal — pods, serverless endpoints, templates, network volumes, Hub deploys, models, SSH, and file…; flash: runpod-flash — code-first serverless: write Python locally, run it on remote Runpod GPUs/CPUs with flash dev (hot-reload + live worker logs), then `flash…; companion-clis: Companion CLIs for Runpod workflows — HuggingFace, GitHub, Docker, and AWS. Use the ComfyUI model-repair guide in runpod-templates instead when an impor…
Readme Apache-2.0 1.2 MiB
Languages
Python 93.8%
Shell 4.7%
Dockerfile 1.5%