113 lines
7.4 KiB
Markdown
113 lines
7.4 KiB
Markdown
|
|
# smolboid: signed twtxt over smolmail
|
||
|
|
|
||
|
|
smolboid is a small daemon that serves [twtxt](https://twtxt.readthedocs.io/) feeds for many users and lets them publish and manage their feed by sending ordinary [smolmail](https://code.randogoth.com/randogoth/smolmail). A post is a mail body; management rides custom frontmatter fields. Every published record carries the author's own smolmail payload signature, so any reader can verify authorship offline against the author's key alone — the host can withhold records but cannot forge one. No extra client tool is needed: any conformant smolmail client can post, and legacy twtxt and Yarn clients read the feeds unchanged.
|
||
|
|
|
||
|
|
The workspace is `core/`, the feed format and verification library with no I/O, and `daemon/`, the server binary. [audit.md](audit.md) records the security audit, its findings and the test suites that prove them.
|
||
|
|
|
||
|
|
## Build and test
|
||
|
|
|
||
|
|
devbox manages the toolchain; every script runs in it.
|
||
|
|
|
||
|
|
```
|
||
|
|
devbox run build # compile the workspace
|
||
|
|
devbox run test # unit, property and vector tests
|
||
|
|
devbox run vectors # regenerate and pin core/vectors.json
|
||
|
|
devbox run rig # end-to-end against a local bunshin, the fumi CLI as author
|
||
|
|
devbox run stress # mail flood, quotas, reply budget, HTTP load
|
||
|
|
devbox run pentest # adversarial probes, raw sockets and real mail
|
||
|
|
devbox run audit-deps # cargo audit over the dependency tree
|
||
|
|
```
|
||
|
|
|
||
|
|
## Running an instance
|
||
|
|
|
||
|
|
The daemon holds one smolmail identity — a 32-byte master key — and one mailbox, e.g. `twtxt@smol.place`. Bootstrap its mailbox once with the fumi CLI against the same key and store, because the first server pin and the registration are operator actions:
|
||
|
|
|
||
|
|
```
|
||
|
|
smolboid keygen /srv/smolboid/master.key
|
||
|
|
fumi --key /srv/smolboid/master.key --db /srv/smolboid/data/mail.db trust smol.place <server-key-b32>
|
||
|
|
fumi --key /srv/smolboid/master.key --db /srv/smolboid/data/mail.db register twtxt@smol.place
|
||
|
|
```
|
||
|
|
|
||
|
|
Then configure and serve. The config file is one flat `key = value` list; anything unset keeps its default:
|
||
|
|
|
||
|
|
```
|
||
|
|
# smolboid.toml
|
||
|
|
listen = 127.0.0.1:8080 # HTTP listener for the feeds
|
||
|
|
base_url = https://smol.place # the origin the feeds' # url metadata carries
|
||
|
|
smolmail_host = smol.place # the host serving the daemon's mailbox
|
||
|
|
mailbox = twtxt # local part of the mailbox, for display
|
||
|
|
master = /srv/smolboid/master.key
|
||
|
|
data = /srv/smolboid/data # state.json, mail.db and feeds/
|
||
|
|
poll_secs = 60 # fetch interval
|
||
|
|
timeout = 30 # smolmail network timeout, seconds
|
||
|
|
posts_per_day = 50 # per-feed daily quota
|
||
|
|
reposts_per_day = 50
|
||
|
|
cap_bytes = 1048576 # per-feed size cap, default 1 MiB
|
||
|
|
```
|
||
|
|
|
||
|
|
```
|
||
|
|
smolboid serve --config smolboid.toml
|
||
|
|
```
|
||
|
|
|
||
|
|
Admission is by accept token: an author's mail is only processed once the operator admits them, which also creates their feed at the fixed path and sends a welcome mail carrying the token.
|
||
|
|
|
||
|
|
```
|
||
|
|
smolboid admit --config smolboid.toml tobias@smol.place # verify, accept, create the feed
|
||
|
|
smolboid block --config smolboid.toml tobias@smol.place # withdraw the token
|
||
|
|
smolboid check /srv/smolboid/data/feeds/tobias.txt # verify a feed's records, nonzero on forged ones
|
||
|
|
```
|
||
|
|
|
||
|
|
## The author's side
|
||
|
|
|
||
|
|
Post by sending the twt as the mail body, from any smolmail client. Fetch the daemon's welcome mail first — it carries the accept token that moves your posts out of the requests tier.
|
||
|
|
|
||
|
|
```
|
||
|
|
fumi send twtxt@smol.place --body "hello smolverse"
|
||
|
|
```
|
||
|
|
|
||
|
|
Management travels as frontmatter fields, which fumi emits with `--header`:
|
||
|
|
|
||
|
|
| Field | Value | Effect |
|
||
|
|
| --- | --- | --- |
|
||
|
|
| `Twt-Nick` | 1-30 bytes of `[a-z0-9-]` | Set the display nick; the feed path never changes |
|
||
|
|
| `Twt-Delete` | a record timestamp | Remove that post or repost |
|
||
|
|
| `Twt-Repost` | `<mention> <#hash>` | Publish a repost |
|
||
|
|
| `Twt-Prune` | `fifo` or `off` | Choose what a full feed does: prune its oldest records, or reject new ones (the default) |
|
||
|
|
|
||
|
|
```
|
||
|
|
fumi send twtxt@smol.place --header Twt-Delete:2026-10-01T12:47:00Z --body ""
|
||
|
|
```
|
||
|
|
|
||
|
|
The rules the daemon enforces: text is at most 160 Unicode code points and 640 bytes and may not contain TAB, LF, CR or U+2028; the timestamp is the mail's own time, pinned by the signature, so a same-second resend is rejected with a reply — wait a second and resend; at 90% of the size cap the daemon mails a warning naming the cap and both prune modes. Error replies are subject to the address's rules: at most ten per sender per hour, never twice for the same rejected payload.
|
||
|
|
|
||
|
|
## What a feed looks like
|
||
|
|
|
||
|
|
A standard twtxt file plus `# smol:` comment lines. Legacy clients ignore them; smol-aware clients verify.
|
||
|
|
|
||
|
|
```
|
||
|
|
# nick = tobias
|
||
|
|
# url = https://smol.place/twtxt/tobias.txt
|
||
|
|
# smol:author = tobias@smol.place
|
||
|
|
# smol:host_key = <52-char base32>
|
||
|
|
2026-10-01T12:47:00Z hello smolverse
|
||
|
|
# smol:mail <sender b32> <epk b32> <signature b32>
|
||
|
|
```
|
||
|
|
|
||
|
|
Each record's signature covers the smolmail payload bytes: the author's key, the record's timestamp, and the text in one of the two canonical forms a real client emits (bare, or with the ordinary send's `Reply-To` block). The verifier rebuilds those bytes from the record itself plus the feed's metadata, tries each `smol:host_key` as the recipient, and marks the record verified, unsigned or invalid. `smolboid check` reports exactly that.
|
||
|
|
|
||
|
|
Feeds are served at `GET /twtxt/<username>.txt` (`HEAD` answers with the same headers, no body) with a strong SHA-256 ETag, `Last-Modified`, `Cache-Control: max-age=300` and `Access-Control-Allow-Origin: *`; `If-None-Match` takes precedence over `If-Modified-Since`, and both answer 304. Unknown and missing feeds are 404; the listener sheds concurrent-connection floods with 503 and closes stalled connections after ten seconds.
|
||
|
|
|
||
|
|
## The deployment trust contract
|
||
|
|
|
||
|
|
Read this before running an instance on the public internet.
|
||
|
|
|
||
|
|
**TLS is your job.** The listener is plain HTTP. The `base_url` above assumes TLS termination at a reverse proxy in front of the daemon; pointed at the internet directly, it serves feeds — public data — in cleartext, and a network attacker could serve stale or substituted feeds to readers. Terminate TLS upstream, or front the daemon with whatever serves the rest of your domain.
|
||
|
|
|
||
|
|
**The first pin is on you.** Bootstrap is trust-on-first-use: `fumi trust` pins your smolmail server's Noise static key and `smolboid admit` resolves each author on their own server with the same semantics. A lying DNS path fails closed at the pin mismatch, but the *first* pin you enter is taken on faith. Verify the server key and your authors' keys out of band before admitting them; `smolboid admit` prints each resolved key.
|
||
|
|
|
||
|
|
**The master key is the whole identity.** The 32-byte master at 0600 is the only secret on disk — everything else under `data/` is public keys, counters and ledgers. Back it up, because a lost master means a new identity and a new `smol:host_key` in every feed; a stolen one means an attacker can register the daemon's mailbox elsewhere and post as it, though they cannot forge the authors' records already published.
|
||
|
|
|
||
|
|
**One domain per instance.** The feed path is fixed to the author's smolmail username, and discovery resolves `user@domain` to `https://domain/twtxt/<username>.txt`, so one instance serves one domain; multiple domains run multiple daemons.
|
||
|
|
|
||
|
|
**Authors own their words, not your storage.** An admitted author can fill their quota daily and switch to FIFO pruning; `cap_bytes` is the bound. Unadmitted senders publish nothing and draw no reply, and their mail never leaves the requests tier.
|