dsh-llm-verifier-pro avatar

dsh-llm-verifier-pro

LLM-as-a-Verifier plugin for DeepSeek Harness — fine-grained reward tools (verify_compare / verify_select / verify_track) with Probabilistic Pivot Tournament, plus a Best-of-N conversation mode with a Web settings panel.

PluginAI ModelsWeb search
Verification
L4 · Install tested
Passed
Risk
Low
Health
Active
Trust
Silver

What it doesAI

Provides fine-grained LLM-as-a-verifier reward tools with tournament evaluation and Best-of-N conversation mode.

  • Fine-grained verification tools: verify_compare, verify_select, verify_track
  • Probabilistic Pivot Tournament for robust comparison
  • Best-of-N conversation mode with Web settings panel

AI-generated from the repo README — for reference only.

Installation

dsh plugin --profile web add github:jmche/dsh-llm-verifier-pro

security scan passed · default branch source

Install method: GitHub · sandbox install ok, web smoke failed (L5)

Verification & Compatibility

Grouped by plugin version: each card lists the dsh versions actually tested against that artifact version and their install verdicts (L5 wins). Untested combinations are omitted — absence means untested, never assumed compatible. L1–L3 are a plugin-level static archive (independent of the dsh version — the same verdict on every dsh row): they sit in each row's level grid next to L4/L5, marked "static", while their evidence is stored once per plugin inside that row's "checks & evidence" instead of being duplicated per version.

External credentials (plugin-level): none detected

Install compatibility matrix (rows = plugin versions〔latest 5〕, columns = dsh versions〔latest 5〕)
At-a-glance → evidence in the cards below
plugin \ dshdsh 0.1.3-alpha.2
current
artifact version unstated

✓ = L5 runtime verified · ◐ = L4 testing (install passed · L5 runtime pending) · ○ not a dsh plugin (nothing mounts) · ✗ failed · · untested (never assumed compatible)

Install compatibility (by plugin version, dsh versions within)
Legend:✓ L5 runtime verified◐ L4 testing · install passed○ no plugin features✗ failed
artifact version unstatedgithub1 failed2026-09-09

https://github.com/jmche/dsh-llm-verifier-pro

dsh 0.1.3-alpha.2current2026-09-09L5 · failed
Environment & artifact
  • • Node.js: v24.14.0
  • • DSH: 0.1.3-alpha.2
  • • Plugin artifact: github · https://github.com/jmche/dsh-llm-verifier-pro (version unstated)
Levels (L1–L3 plugin-level static archive · L4/L5 newest real verdicts for this combination)
L1 static
Passed
L2 static
Passed
L3 static
Passed
L4 sandbox
Passed
L5 runtime
Failed
Sandbox install failed
L5 · failed

ID: dsh-llm-verifier-pro@8c767e@dsh0.1.3-alpha.2 · profile: l4-sandbox

Issued: 2026-09-09 · expires: 2026-09-16

View checks & evidence
L1 · Found✓ Passed
L2 · Structured✓ Passed
L3 · Install spec✓ Passed
L4 · Install tested✓ Passed
Install executed in confined sandbox✓ Passed
Source: Windows ACL sandbox · Method: sandbox install run · Captured 2026-09-09
spec github:jmche/dsh-llm-verifier-pro · channel GitHub source · outcome ran · exit 0
check took: 2.1s
Install succeeded✓ Passed
Source: Windows ACL sandbox · Method: sandbox install run · Captured 2026-09-09
spec github:jmche/dsh-llm-verifier-pro · channel GitHub source · outcome ran · exit 0
check took: 2.1s
Installed artifact confirmed✓ Passed
Source: Windows ACL sandbox · Method: sandbox install run · Captured 2026-09-09
spec github:jmche/dsh-llm-verifier-pro · channel GitHub source · outcome ran · exit 0
check took: 2.1s
L5 · Run tested✕ Failed
Sandbox install passed✓ Passed
Source: Windows ACL sandbox · Method: sandbox install run · Captured 2026-09-09
spec github:jmche/dsh-llm-verifier-pro · install mode reused L4 scratch
check took: 0ms
Web boot ready✕ Failed
plugin tree failed to load
HTTP endpoint served✕ Failed

L1–L3 are plugin-level static conclusions (baseline, identical across dsh versions): evidence is stored once per plugin.

Author badges

Embed the official badges in your README to showcase security & install-test status:

dsh.so risk
`[![dsh.so risk](https://www.dsh.so/badge/dsh-llm-verifier-pro.svg)](https://www.dsh.so/artifact/dsh-llm-verifier-pro/)`
dsh.so install
`[![dsh.so install](https://www.dsh.so/badge/install/dsh-llm-verifier-pro.svg)](https://www.dsh.so/artifact/dsh-llm-verifier-pro/)`

Security Report

Automated static scan, not manual review.

DSH.SO VETPASSED6a17f5
Automated review · daily
PASSED

Vet static analysis found no suspicious behavior — verdict is clean.

0 critical·0 high·0 medium
plugin version0.1.0dsh manifest
scanned version0.1.0git2026-09-10
current version0.1.0same version
vet verdictclean · git

Vet is an AST static scan (npm artifact or git source).

Disclaimer: automated static analysis, not a security guarantee. Always review what you install.

Risk details

No critical or warning findings.

Activity

Last commit 2026-09-02 · activity: Active

• Repo created: 2026-09-08

• Stars: ★ 0 · Forks: 0

• Health: Active — committed within last 30 days

Source

GitHub: github.com/jmche/dsh-llm-verifier-pro

Was this page helpful?