Skip to content

docs(smart-set-agent): add Verify-MCP step, Scenarios section, and workflow cross-links#886

Open
charankamarapu wants to merge 5 commits into
mainfrom
docs/smart-set-agent-scenarios
Open

docs(smart-set-agent): add Verify-MCP step, Scenarios section, and workflow cross-links#886
charankamarapu wants to merge 5 commits into
mainfrom
docs/smart-set-agent-scenarios

Conversation

@charankamarapu

Copy link
Copy Markdown
Contributor

Why

Comparing the two agent docs, keploy-cloud/smart-set-agent was missing important content the mature quickstart/k8s-proxy-llm-workflow page has — most notably a Scenarios ("Putting it together") section and the Verify-MCP step. This adds them, adapted to the smart-set substrate.

Changes

  1. Verify the MCP wiring (before you install the skill) — a step to confirm the agent can reach the Keploy MCP tools before installing the skill (the docs: web ui, update readme, fix routing issue #1 onboarding failure otherwise), incl. the lean-dispatcher note.
  2. Scenarios — 8 worked prompt → agent decision → outcome walkthroughs, one per case the skill classifies, using the correct smart-set tools:
    • regression (agent refuses to edit the test), value drift (respBody), non-deterministic field (noiseJson), shape drift (responseJson, schema_ref recompute), SchemaRefConflict (resolve the twin), mock drift (upsertSmartMock), obsolete endpoint (setSmartTestCaseObsolete), and new endpoint (Routine B upload). The additive-fields-don't-fail nuance is called out.
  3. Related workflows — cross-links to the general LLM-workflow page (for per-editor MCP config + phase-by-phase Routines) and the manual developer-workflow page.

The embedded Skill reference is untouched.

🤖 Generated with Claude Code

…lated-workflow cross-links

The smart-set-agent guide lacked the worked-scenarios and MCP-verification
content the k8s-proxy-llm-workflow page has. Add, adapted to the smart-set
substrate:
- 'Verify the MCP wiring' step before install (catch mis-wired MCP early).
- 'Scenarios' section: 8 worked case walkthroughs (regression-refusal, value,
  noise, shape, SchemaRefConflict, mock drift, obsolete, Routine B new endpoint)
  using smart-set tools (updateSmartTestCase/upsertSmartMock/setSmartTestCaseObsolete).
- 'Related workflows' cross-links to the LLM-workflow (general) and manual
  developer-workflow pages.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Charan Kamarapu <charan@Charan-VM.keploy.io>
Copilot AI review requested due to automatic review settings July 6, 2026 09:30

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Charan Kamarapu and others added 4 commits July 6, 2026 16:53
… LLM Workflow page

Places keploy-cloud/smart-set-agent directly beneath quickstart/k8s-proxy-llm-workflow
in the K8s Proxy sidebar group (removed from the keploy-cloud group) so the
agent guide sits next to the workflow it belongs to.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Charan Kamarapu <charan@Charan-VM.keploy.io>
… reference

Replace the trimmed 72-line Skill reference with the complete 203-line skill
(numbered hard rules + Phase A1-A5 Routine detail) that the smart-set matrix
was validated against. Uses a 4-backtick fence since the skill contains
``` code blocks.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Charan Kamarapu <charan@Charan-VM.keploy.io>
…e Scenarios after Skill reference

- Rename title + sidebar_label to LLM Workflow (Smart Tests) so it reads as the
  smart-set sibling of the k8s-proxy LLM Workflow page.
- Reorder to match the LLM Workflow page's flow: skill (Skill reference) ->
  Scenarios -> Related workflows.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Charan Kamarapu <charan@Charan-VM.keploy.io>
…start / Step 1-3)

Restructure the setup half to match quickstart/k8s-proxy-llm-workflow so the two
agent guides read consistently:
- Before you start, Step 1 - Wire up the Keploy MCP server (per-editor config
  table + JSON config + Verify MCP), Step 2 - Install the skill, Step 3 - Use
  the two prompts (Prompt A/B phase tables) — Step 1 kept identical; Step 2/3
  adapted to smart-set (skill paths, smart-set prompts, Case A/B/C tools).
- Smart-set-specific sections kept: Key concepts, Replay flags, Limitations,
  Skill reference, Scenarios, Related workflows.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Charan Kamarapu <charan@Charan-VM.keploy.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants