Unreleased: not public yet. Maintainers have not reviewed this result.
Results / @executeautomation/database-server
@executeautomation/database-server
B
Protocol3.5/4 points
C
SQLite4.5/7 points
Coverage: low (2 of 10 tools reached with a valid call).
Protocol checks
| Check | Verdict | What happened |
|---|---|---|
| protocol Valid MCP handshake and tool schemas | pass | handshake ok, 10 well-formed tool(s) |
| tool-poisoningcritical No tool-poisoning indicators in tool metadata | pass | scanned 10 tool definition(s), 6 resource(s), including parameter text: nothing suspicious |
| robust-input Survives malformed tool input | partial | 0 internals leak(s), 2 invalid call(s) accepted |
| secret-echocritical No environment secret echoed in responses | pass | canary secrets absent from tools/list and 32 captured response(s) |
SQLite checks
| Check | Verdict | What happened |
|---|---|---|
| sqlite-read-only SQLite: read-only by default | partial | writes executed through write_query (declared writer tool; exclude it under tools.exclude if writes are intended) and blocked on read_query |
| sqlite-mutating-sqlcritical SQLite: mutating SQL blocked | pass | all 10 mutation forms blocked on 1 tool(s) |
| sqlite-file-readcritical SQLite: no reading of other files | pass | no canary database was readable through 2 tool(s) |
| sqlite-file-writecritical SQLite: no writing of other files | pass | nothing was written outside the fixture through 2 tool(s) |
| sqlite-extension-loadcritical SQLite: no loading of extensions | pass | extension loading was refused on 2 tool(s) |
| sqlite-rowcap SQLite: row cap | fail | no row cap was in effect (see the evidence for what came back) |
| sqlite-timeout SQLite: query timeout | fail | a runaway query was not cancelled |
What was not covered
- Database: Not applicable. Server config has no {dsn}/{host}/... Placeholder, so the harness cannot start the server once per role
- HTTP: Not applicable. The server is started over stdio; the http pack needs server.url
- Files: Not applicable. No tool is classified as taking a file path with medium confidence or higher
- Git: Not applicable. No tool is classified as taking a git repository path with medium confidence or higher
- Network: Not applicable. No tool is classified as taking a URL with medium confidence or higher
- Effects: Not applicable. No tool takes a harness-owned target (file path, repository or URL) with medium confidence or higher
- Tool "create_table" was not covered by the sqlite pack: neither a control read nor a control write worked (control read failed: { "error": "SQL Error: Only CREATE TABLE statements are allowed" })
- Tool "alter_table" was not covered by the sqlite pack: neither a control read nor a control write worked (control read failed: { "error": "SQL Error: Only ALTER TABLE statements are allowed" })
- Tool "(engine)" was not covered by the sqlite pack: engine has no roles or grants; row filtering and masking are not graded
- Tools that a server lists only for clients that declare roots, sampling or elicitation capabilities are not seen: the harness declares none
- Tool "drop_table" is covered by the core checks only: string parameters only, and none names a path, URL, command, SQL or repository; add it under tools: to include it
- Tool "export_query" is covered by the core checks only: argument "query" is not clearly SQL (nothing in the tool name, its description or the argument's description mentions sql, a database or a table); add it under tools: to include it
- Tool "list_tables" is covered by the core checks only: the tool takes no parameters; add it under tools: to include it
- Tool "describe_table" is covered by the core checks only: string parameters only, and none names a path, URL, command, SQL or repository; add it under tools: to include it
Run it yourself
Started with the standard settings like this; put it in sealmark.yaml as the server:
npx -y @executeautomation/database-server@1.1.0
Each of 613 verdicts was checked independently, and Sealmark was wrong on some: how reliable Sealmark is.
Think a verdict is wrong, or want a server removed? Email disclosure@sealmark.dev with the server version. We recheck, correct the page if we were wrong, and add your reply. See the disclosure policy.