inference-smoke-tests — community inference-smoke-tests, geppetto, community, ide skills

v1.0.0
GitHub

About this Skill

Perfect for AI Agents needing automated inference smoke testing capabilities with GPT3 tooling Run repeatable inference smoke tests using geppetto/pinocchio example binaries (single-pass, streaming, tool-loop, OpenAI Responses thinking) including tmux-driven TUI tests. Use when refactors touch

go-go-golems go-go-golems
[0]
[0]
Updated: 3/12/2026

Killer-Skills Review

Decision support comes first. Repository text comes second.

Reference-Only Page Review Score: 7/11

This page remains useful for operators, but Killer-Skills treats it as reference material instead of a primary organic landing page.

Original recommendation layer Concrete use-case guidance Explicit limitations and caution Locale and body language aligned
Review Score
7/11
Quality Score
39
Canonical Locale
en
Detected Body Locale
en

Perfect for AI Agents needing automated inference smoke testing capabilities with GPT3 tooling Run repeatable inference smoke tests using geppetto/pinocchio example binaries (single-pass, streaming, tool-loop, OpenAI Responses thinking) including tmux-driven TUI tests. Use when refactors touch

Core Value

Empowers agents to run smoke tests using a bundled script with geppetto and pinocchio, leveraging OpenAI API and Claude credentials for seamless execution, and providing a quick start guide and manual checklist for test execution in golang

Ideal Agent Persona

Perfect for AI Agents needing automated inference smoke testing capabilities with GPT3 tooling

↓ Capabilities Granted for inference-smoke-tests

Automating inference smoke tests for GPT3 models
Generating test execution reports using the bundled script
Debugging inference issues with the manual checklist in playbook.md

! Prerequisites & Limits

  • Requires OpenAI API Key
  • Requires Claude credentials
  • Needs golang environment for execution

Why this page is reference-only

  • - The underlying skill quality score is below the review floor.

Source Boundary

The section below is imported from the upstream repository and should be treated as secondary evidence. Use the Killer-Skills review above as the primary layer for fit, risk, and installation decisions.

After The Review

Decide The Next Action Before You Keep Reading Repository Material

Killer-Skills should not stop at opening repository instructions. It should help you decide whether to install this skill, when to cross-check against trusted collections, and when to move into workflow rollout.

Install Path

Start With Installation And Validation

If this skill is worth continuing with, the next step is to confirm the install command, CLI write path, and environment validation.
Trusted Recheck

Cross-Check Against Trusted Picks

If you are still comparing multiple skills or vendors, go back to the trusted collection before amplifying repository noise.
Workflow

Move To Workflow Collections For Team Rollout

When the goal shifts from a single skill to team handoff, approvals, and repeatable execution, move into workflow collections.
Labs Demo

Browser Sandbox Environment

⚡️ Ready to unleash?

Experience this Agent in a zero-setup browser environment powered by WebContainers. No installation required.

Boot Container Sandbox

FAQ & Installation Steps

These questions and steps mirror the structured data on this page for better search understanding.

? Frequently Asked Questions

What is inference-smoke-tests?

Perfect for AI Agents needing automated inference smoke testing capabilities with GPT3 tooling Run repeatable inference smoke tests using geppetto/pinocchio example binaries (single-pass, streaming, tool-loop, OpenAI Responses thinking) including tmux-driven TUI tests. Use when refactors touch

How do I install inference-smoke-tests?

Run the command: npx killer-skills add go-go-golems/geppetto/inference-smoke-tests. It works with Cursor, Windsurf, VS Code, Claude Code, and 19+ other IDEs.

What are the use cases for inference-smoke-tests?

Key use cases include: Automating inference smoke tests for GPT3 models, Generating test execution reports using the bundled script, Debugging inference issues with the manual checklist in playbook.md.

Which IDEs are compatible with inference-smoke-tests?

This skill is compatible with Cursor, Windsurf, VS Code, Trae, Claude Code, OpenClaw, Aider, Codex, OpenCode, Goose, Cline, Roo Code, Kiro, Augment Code, Continue, GitHub Copilot, Sourcegraph Cody, and Amazon Q Developer. Use the Killer-Skills CLI for universal one-command installation.

Are there any limitations for inference-smoke-tests?

Requires OpenAI API Key. Requires Claude credentials. Needs golang environment for execution.

↓ How To Install

  1. 1. Open your terminal

    Open the terminal or command line in your project directory.

  2. 2. Run the install command

    Run: npx killer-skills add go-go-golems/geppetto/inference-smoke-tests. The CLI will automatically detect your IDE or AI agent and configure the skill.

  3. 3. Start using the skill

    The skill is now active. Your AI agent can use inference-smoke-tests immediately in the current project.

! Reference-Only Mode

This page remains useful for installation and reference, but Killer-Skills no longer treats it as a primary indexable landing page. Read the review above before relying on the upstream repository instructions.

Upstream Repository Material

The section below is imported from the upstream repository and should be treated as secondary evidence. Use the Killer-Skills review above as the primary layer for fit, risk, and installation decisions.

Upstream Source

inference-smoke-tests

Install inference-smoke-tests, an AI agent skill for AI agent workflows and automation. Review the use cases, limitations, and setup path before rollout.

SKILL.md
Readonly
Upstream Repository Material
The section below is imported from the upstream repository and should be treated as secondary evidence. Use the Killer-Skills review above as the primary layer for fit, risk, and installation decisions.
Supporting Evidence

Inference Smoke Tests

Run the fast suite (geppetto non-TUI + pinocchio agent TUI) via the bundled script:

bash
1bash geppetto/.codex/skills/inference-smoke-tests/scripts/run_smoke.sh --quick

If you need the full manual checklist, open:

geppetto/.codex/skills/inference-smoke-tests/references/playbook.md

Preconditions

  • Ensure OPENAI_API_KEY is set (for OpenAI Chat + OpenAI Responses).
  • Ensure Claude credentials are available (e.g. ANTHROPIC_API_KEY) if you want the Claude tool-calling smoke step to pass.
  • Ensure tmux is installed (required for non-interactive TUI runs).
  • Expect costs: these tests make real API calls.

Workflow Decision Tree

  1. Validate provider “thinking” streaming (Responses)?
  • Run geppetto/cmd/examples/openai-tools in --mode thinking.
  1. Validate tool loop orchestration?
  • Run geppetto/cmd/examples/generic-tool-calling.
  1. Validate Bubble Tea TUI event flow (thinking deltas + final)?
  • Run pinocchio/cmd/agents/simple-chat-agent in tmux.
  1. Validate Claude tool calling?
  • Run geppetto/cmd/examples/claude-tools with --ai-api-type claude --ai-engine claude-haiku-4-5.
  1. Validate multi-turn chat state persistence?
  • Run pinocchio TUI chat in tmux (manual) and/or pinocchio webchat in browser (manual).

What “Benefits From InferenceState” (Rules of Thumb)

Already benefits (multi-turn, cancel-sensitive, tool-loop, strict provider validation):

  • pinocchio TUI chat (pinocchio/cmd/pinocchio … --chat)
  • pinocchio agent TUI (pinocchio/cmd/agents/simple-chat-agent …)
  • pinocchio webchat (pinocchio/cmd/web-chat)
  • geppetto example runners that execute via geppetto/pkg/inference/core.Session

Could benefit (optional; mainly consistency/cancel):

  • pinocchio/cmd/examples/simple-redis-streaming-inference (transport-focused; currently eng.RunInference direct)
  • pinocchio/cmd/examples/simple-chat (exercises PinocchioCommand runner; could benefit indirectly if that runner standardizes on InferenceState)

Does not apply (not an inference runner):

  • geppetto/cmd/examples/citations-event-stream

Troubleshooting (Common Failure Modes)

“OpenAI Responses 400” errors

  • Re-run with higher logging:
    • Add --log-level debug --with-caller where supported.
  • Confirm you’re using the correct provider mode:
    • --ai-api-type openai-responses
  • If the error mentions invalid parameter support (e.g., temperature unsupported), it’s model-dependent; reduce parameters and retry.

TUI doesn’t submit the prompt

  • Some TUIs submit on Tab (not Enter).
  • Always capture logs to a file and confirm inference actually ran (look for EventPartialCompletionStart, EventFinal).

References

When you need copy/paste commands for the full sweep, read:

  • geppetto/.codex/skills/inference-smoke-tests/references/playbook.md

When you need to find new example entry points, search:

bash
1rg -n "cmd/examples" -S geppetto/cmd/examples pinocchio/cmd/examples
2rg -n "cmd/agents" -S pinocchio/cmd/agents

Related Skills

Looking for an alternative to inference-smoke-tests or another community skill for your workflow? Explore these related open-source skills.

View All

openclaw-release-maintainer

Logo of openclaw
openclaw

Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

★ 333.8k
⑂ 0
AI

widget-generator

Logo of f
f

Generate customizable widget plugins for the prompts.chat feed system

★ 149.6k
⑂ 0
AI

flags

Logo of vercel
vercel

The React Framework

★ 138.4k
⑂ 0
Browser

pr-review

Logo of pytorch
pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

★ 98.6k
⑂ 0
Developer