llms.txt generator

Read a public sitemap and write an llms.txt index, plus an optional llms-full.txt.

Fetches a public URL

Use from your agent

Streamable HTTP at https://benchline.fabwaseem.com/mcp. No key. The tool name is generate_llms_txt.

mcp.jsonjson
1{
2 "mcpServers": {
3 "benchline": {
4 "url": "https://benchline.fabwaseem.com/mcp"
5 }
6 }
7}
tools/calljson
1{
2 "jsonrpc": "2.0",
3 "id": 1,
4 "method": "tools/call",
5 "params": {
6 "name": "generate_llms_txt",
7 "arguments": {
8 "siteName": "example",
9 "summary": "example",
10 "pages": [
11 {
12 "url": "https://example.com/file",
13 "title": "example",
14 "description": "",
15 "excerpt": ""
16 }
17 ]
18 }
19 }
20}

How it works

Generate a spec-compliant llms.txt and an optional llms-full.txt from a public sitemap, with an editable preview.

  1. 01

    Enter a site or paste URLs

    Submit one public site URL, or switch to manual mode and paste up to 30 page URLs.

  2. 02

    Read the sitemap

    The server fetches robots.txt and sitemap.xml, including Sitemap entries in robots.txt. If those are missing, it collects links from the homepage.

  3. 03

    Review and download

    Titles and meta descriptions are grouped into sections. Edit the preview, then copy or download llms.txt and the optional llms-full.txt.

FAQ