Nonobench

by @mauricekleine · io.github.mauricekleine/nonobench

An open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20.

OnlineRemote
Category
Developer tools
Connection
Remote (HTTP)
Tools
11 reported
Status
Online

Connect it to your AI

Claude Code

claude mcp add --transport http nonobench https://www.nonobench.com/mcp

Claude, ChatGPT, Cursor and other apps

Add it as a custom connector with this URL (Streamable HTTP):

https://www.nonobench.com/mcp

Cursor, VS Code and other apps (mcp.json)

{
  "mcpServers": {
    "nonobench": {
      "url": "https://www.nonobench.com/mcp"
    }
  }
}

Tools it offers

11 tools, as the server itself reported during our check on Oct 31, 2026.

  • get_leaderboardModels ranked by accuracy; defaults to all effort levels for compatibility.
  • list_providersProvider ids, names, families and variant counts.
  • list_familiesModel families, available efforts and best variants.
  • compare_modelsSide-by-side core overall and per-size accuracy, cost, latency and token results for model or family names.
  • get_model_resultsAccuracy, cost, latency and token use for one model, broken down by grid size.
  • list_puzzlesThe benchmark puzzles with their ids and row/column clues.
  • get_puzzleOne puzzle, including the clue text models were prompted with. The reference solution is only included on request; some puzzles have several valid solutions.
  • check_solutionCheck a grid against a puzzle's clues, using the same rule as the benchmark grader. Reports which rows and columns do not match.
  • get_puzzle_resultsPer-model outcomes for one puzzle. Answers are omitted unless requested.
  • get_model_puzzlesWhich puzzles one model solved, missed, timed out on, or has not run.
  • list_runsIndividual benchmark runs (one model on one puzzle), optionally with the raw prompt and model output.

Questions

What is the Nonobench MCP server?

An open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20. It is made by @mauricekleine and listed in the official MCP Registry as io.github.mauricekleine/nonobench. MCP (Model Context Protocol) is the open standard that lets AI apps like Claude, ChatGPT and Cursor use outside tools.

How do I add Nonobench to Claude?

In the Claude app or claude.ai, open Settings, then Connectors, choose "Add custom connector" and paste https://www.nonobench.com/mcp. In Claude Code, run: claude mcp add --transport http nonobench https://www.nonobench.com/mcp

How do I add Nonobench to ChatGPT?

ChatGPT can use remote MCP servers as connectors. In ChatGPT settings, under Apps and Connectors, turn on developer mode if asked, create a new connector and paste https://www.nonobench.com/mcp.

How do I add Nonobench to Cursor?

Open Cursor settings, go to MCP, choose "Add new MCP server" (or edit ~/.cursor/mcp.json) and add: { "mcpServers": { "nonobench": { "url": "https://www.nonobench.com/mcp" } } }

Does Nonobench work right now?

Yes. It responded when we last checked on 31 Oct 2026. We check remote MCP servers every day.

What can Nonobench do?

It gives your AI 11 tools, including get_leaderboard, list_providers, list_families, compare_models, get_model_results. The full list is on this page.

Is this your server? Get the badge for your README
chen.media/mcp badge

Markdown (GitHub README)

[![Listed on chen.media/mcp](https://chen.media/mcp/badge/github-mauricekleine-nonobench.svg)](https://chen.media/mcp/github-mauricekleine-nonobench)

HTML (switches to dark mode on its own)

<a href="https://chen.media/mcp/github-mauricekleine-nonobench"><picture><source media="(prefers-color-scheme: dark)" srcset="https://chen.media/mcp/badge/github-mauricekleine-nonobench.svg?theme=dark"><img src="https://chen.media/mcp/badge/github-mauricekleine-nonobench.svg" alt="Listed on chen.media/mcp" height="40"></picture></a>

More in Developer tools

See all