Sealmark

MCP conformance testing

Sealmark is an open-source command-line tool that checks how an MCP server behaves. It starts the server, calls its tools with fixed inputs (no language model in the loop), checks what actually happened, and prints a letter grade per test suite with the evidence behind it.

Run it in one command

npx sealmark run --start "<command that starts your server>"

Needs Node.js. Other ways to run it (a URL, a config file, CI) are in the quickstart.

What it checks

Protocol hygiene (the core suite) for every server, then suites for what the tools do when the server has them: database, files, git, network, HTTP, commands and side effects. Each check is listed with its evidence in the check reference; the rules for grading are in the methodology.

What the grades mean, and do not

A grade is for one version with one configuration. An A means these checks passed; it is not a security audit or an endorsement. A server that is only graded on protocol hygiene says little about its tools, and the result page says so.

See real results

273 public MCP servers have a results page with every check and its evidence: browse the graded servers. To compare Sealmark with the official Inspector and conformance suite, read Sealmark compared with other MCP testing tools.

Questions

What is MCP conformance testing?

Running a Model Context Protocol server and checking that it behaves correctly, both at the protocol level (initialize, tool listing, valid results) and in what its tools actually do (for example, that a read-only tool does not write).

How do I test an MCP server?

Run npx sealmark run --start "<command that starts your server>" from a terminal with Node.js. Sealmark starts your server, probes it, and prints a letter grade per test suite with the evidence.

Does Sealmark use an AI model to judge the server?

No. The probes and the checks are fixed code. The same server and settings give the same grade.

Is Sealmark free?

Yes. It is open source under Apache-2.0 and there is no paid tier.

Canonical page: https://sealmark.dev/mcp-conformance-testing/