Sealmark
Automated re-test on 2026-11-20: not checked by hand, and not yet reviewed by the maintainers.

Results / @keepstateai/cli

@keepstateai/cli

version tested 0.1.46npmtested 2026-11-20Sealmark 1.0.1methodology 0.3-draftSTANDARD run37 tools

Sealmark's automated test of @keepstateai/cli 0.1.46 on 2026-11-20 gave it grade D, its lowest test-area grade (protocol D). None of the 37 tools could be called with default settings, so this grade covers the handshake and tool metadata only. Of its 6 checks, 3 passed, 1 failed and 2 inconclusive. 3 more checks are advisory, and advisory checks never change a grade: 1 passed and 2 not applicable. The run used Sealmark 1.0.1 with the standard settings. The grade includes a finding under private disclosure; it still counts in full.

D

Grade D

The server's grade is its lowest test-area grade. How grading works

The grade includes a finding under private disclosure. It still counts in full.

None of the 37 tools could be called with default settings, so this grade covers the handshake and tool metadata only.

Grade by test area

D
Protocol3/4 points · capped at Dcritical: tool-poisoningincludes a finding under private disclosure

Protocol checks

CheckVerdictWhat happened
protocol
Valid MCP handshake and tool schemas
pass
handshake ok, 37 well-formed tool(s)
tool-poisoningcritical
No tool-poisoning indicators in tool metadata
fail
A security finding is being reported to the maintainer privately. Details will be published when it is fixed or 90 days after the report (disclosure policy).
robust-input
Survives malformed tool input
pass
108 invalid call(s) rejected cleanly
secret-echocritical
No environment secret echoed in responses
pass
Details held back while a security finding in this test area is reported privately.
instructions-hygiene (advisory)
Server instructions name only tools that exist
pass
the instructions name no tool the server lacks
refusal-quality (advisory)
Refusals say what to do next
n/a
no refusal was recorded in this run, so there is nothing to judge

Effects checks

CheckVerdictWhat happened
annotation-honestycritical
Read-only tools change nothing
inconclusive
every control call failed, so the read-only annotation could not be checked
openworld-honesty
Closed-world tools stay on the machine
inconclusive
every control call failed, so the closed-world annotation could not be checked
undeclared-writes (advisory)
Unannotated tools leave the sandbox unchanged
n/a
every tool carries annotations, nothing to check

Each check id links to what it tests and how to fix a failure. The same text is in sealmark explain <id>.

What was not covered

Grade over time

Since the run on

Same as that run: the same grade in every test area, the same server version (0.1.46), the same Sealmark version (1.0.1).

  1. –did not run
  2. –did not run
  3. Dv0.1.45Sealmark 1.0.1
  4. Dv0.1.46Sealmark 1.0.1
  5. Dv0.1.46Sealmark 1.0.1

Package facts

License
MIT

From npm, checked 22 Nov 2026. Plain facts about the package; they play no part in the grade.

Run it yourself

The command for this run is withheld while a security finding is reported privately. It is published with the report, when the finding is fixed or 90 days after the report.

Grade alerts

One email when the grade of @keepstateai/cli changes after a re-test. Nothing else, and every email has a link to stop them.

Each of 613 verdicts was checked independently, and Sealmark was wrong on some: how reliable Sealmark is.

Is this wrong?

Reply to our private report or email disclosure@sealmark.dev and we will recheck it. Maintainers can ask for their server to be removed.

If we were wrong, we correct the page and add your reply. Security findings go to the maintainer privately first; see the disclosure policy.