mc-webui Architecture

September 11, 2026 · View on GitHub

Technical documentation for mc-webui, covering system architecture, project structure, and internal APIs.

Table of Contents


Tech Stack

  • Backend: Python 3.11+, Flask, Flask-SocketIO (gevent), SQLite
  • Frontend: HTML5, Bootstrap 5, vanilla JavaScript, Socket.IO client
  • Deployment: Docker / Docker Compose (Single-container architecture)
  • Communication: Direct hardware access (USB, BLE, or TCP) via meshcore library
  • Data source: SQLite Database (./data/meshcore/<pubkey_prefix>.db)

Container Architecture

mc-webui uses a single-container architecture for simplified deployment and direct hardware communication:

┌─────────────────────────────────────────────────────────────┐
│                     Docker Network                           │
│                                                              │
│  ┌───────────────────────────────────────────────────────┐   │
│  │                       mc-webui                        │   │
│  │                                                       │   │
│  │  - Flask web app (Port 5000)                          │   │
│  │  - DeviceManager (Direct USB/BLE/TCP access)          │   │
│  │  - Database (SQLite)                                  │   │
│  │                                                       │   │
│  └─────────┬─────────────────────────────────────────────┘   │
│            │                                                 │
└────────────┼─────────────────────────────────────────────────┘


      ┌──────────────┐
      │ USB/BLE/TCP  │
      │    Device    │
      └──────────────┘

Three transport options are supported with the following priority: BLE > TCP > Serial (USB). Set the MC_BLE_ADDRESS or MC_TCP_HOST environment variable to activate BLE or TCP transport respectively; otherwise, USB serial is used by default.

This v2 architecture eliminates the need for a separate bridge container and relies on the native meshcore Python library for direct communication, ensuring lower latency and greater stability.

Docker Entrypoint (BLE cleanup)

scripts/docker-entrypoint.sh runs before the Flask app starts. When MC_BLE_ADDRESS is set, it uses D-Bus to check if BlueZ has an active session to the device and disconnects it. BlueZ auto-reconnects trusted devices, which leaves stale GATT notification handles that block bleak from establishing a new session. A clean disconnect at startup ensures the app starts with a fresh BLE state.

Multi-architecture Images

Official images are built via GitHub Actions for linux/amd64, linux/arm64, and linux/arm/v7 (Raspberry Pi 2/3/4/5 supported). Build dependencies (gcc, python3-dev, libjpeg-dev, zlib1g-dev) are installed and then purged to keep the final image size small while still compiling Pillow and pycryptodome from source when wheels are unavailable (notably on arm/v7). GHA layer cache (cache-from / cache-to) speeds up subsequent rebuilds. Images are pushed to both Docker Hub (mawoj/mc-webui) and GitHub Container Registry (ghcr.io/marekwo/mc-webui), with latest tag on main and dev tag on the dev branch.


DeviceManager Architecture

The DeviceManager handles the connection to the MeshCore device via a direct session:

  • Single persistent session - One long-lived connection utilizing the meshcore library
  • Event-driven - Subscribes to device events (e.g., incoming messages, advert receptions, ACKs) and triggers appropriate handlers
  • Direct Database integration - Seamlessly syncs contacts, messages, and device settings to the SQLite database
  • Real-time messages - Instant message processing via callback events without polling
  • Thread-safe queue - Commands are serialized to prevent device lockups
  • Auto-restart watchdog - Monitors connection health and restarts the session on crash
  • BLE keepalive & reconnect - When using Bluetooth transport, a 60s keepalive loop detects "zombie" connections (reads still succeed but writes silently fail). On disconnect or keepalive failure, the manager marks the session as permanently failed and the /health endpoint returns 503, letting the Docker healthcheck trigger a fast container restart (~5s) to get a clean BLE state rather than attempting unreliable in-process reconnects
  • Echo correlation - Sent channel messages pre-compute their expected pkt_payload using the channel secret and send timestamp (±3s for clock drift), so incoming echoes are matched exactly instead of only by 1-byte channel hash (prevents misattribution when two messages go out simultaneously on the same channel). Every recent send stays armed in _pending_echoes (one entry per message, capped at 32) rather than a single slot, so a resend or a back-to-back send can no longer swallow another message's echo; exact matching stays valid for 5 min because repeats do arrive minutes late, while the loose channel-hash fallback (no secret available) keeps its 60s window since it can grab a foreign message. A resend re-arms correlation from _payload_from_raw_packet(raw_packet) when the message has no pkt_payload yet, which is what lets it recover the badge of a message that missed its own echo
  • Per-channel region scope - Before each channel send, the channel's mapped region scope key (16 bytes) is pushed to the firmware via CMD_SET_FLOOD_SCOPE_KEY (54). The scope-set + send pair is serialised under a _send_lock so concurrent sends on different channels can't swap each other's scope. Channels without a mapping get an all-zero key so a previously-set scope doesn't leak across channels
  • Per-send channel-secret refresh - Channel indices on the device compact down after a deletion, so the boot-time _load_channel_secrets() cache can drift. send_channel_message calls _refresh_channel_secret(idx) first (one extra get_channel(idx) round-trip) to fetch the current secret straight from firmware, update the in-memory cache and DB if they had drifted, and use it for the pkt_payload echo correlation
  • Liveness telemetry - Tracks _last_rx_at (bumped on every RX_LOG_DATA event) and _consecutive_stats_failures (incremented on get_stats_* / get_bat exceptions, cleared on success). Surfaced via /health/strict for the external watchdog
  • TCP self-heal - A _liveness_watcher_loop task on the DM event loop calls force_reconnect() when no RX event has arrived for HEALTH_STRICT_MAX_RX_STALE_SEC (5 min). send_channel_message also detects empty-string concurrent.futures.TimeoutError from set_flood_scope_key (the symptom of a degraded long-lived TCP) and runs an in-place reconnect + one retry before failing. A 30 s cooldown and _reconnect_lock prevent churn; _intentional_disconnect keeps the DISCONNECTED handler from racing the reconnect. The watcher keeps re-checking staleness even after _connected has gone False, so a single failed reconnect (e.g. an empty self_info) no longer silently stops all further healing for non-BLE transports
  • Raw packet resend - Own channel sends capture a full hex wire snapshot (header + transport_codes + path_len + encrypted payload) into channel_messages.raw_packet, rebuilt from the actual pkt_payload once echo correlation resolves it and honouring the device's cached path_hash_mode. resend_channel_message() re-broadcasts that snapshot verbatim via CMD_SEND_RAW_PACKET (0x41) so repeaters dedupe by packet hash (Mesh::hasSeen) and only previously-unreached nodes pick it up. Requires companion firmware ≥1.16 (fw_ver_code ≥ 13), gated via the cached supports_raw_resend flag captured from the connect-time DEVICE_INFO event. Self-echoes of a resend (the firmware seen-table can evict the hash within minutes on a busy mesh) are detected by recomputing the expected pkt_payload and matching an existing own row, so a resend never reappears as an inbound message from yourself. The guard does not compare the sender's name, so a resend of a message sent before a rename is recognised too
  • Own name follows a rename - The firmware writes _prefs.node_name in front of every channel message it sends, while own rows are stored under DeviceManager.device_name and their raw_packet snapshot and echo candidates are built from it, so the two must agree byte for byte: a copy left stale by a rename made Resend broadcast a second packet under the old name. set_param('name') cuts the name to the firmware's 31 bytes on a character boundary (the firmware cuts mid-character, and the lib drops the fragment on read-back), holds _send_lock across set_name and a SELF_INFO re-read — also when the reply was an error or never came, since the device may have taken the name anyway — and adopts what the device reports through _set_device_name(), which _connect() uses as well. That updates runtime_config and emits device_name on /chat; the main page applies it to the navbar (#navDeviceName), MC_CONFIG.deviceName (the label of a message being sent) and the mention rule, and loadStatus() does the same from /api/status once device_name_source is device, for a page that missed the event

Observer (MQTT packet capture)

app/observer.py (ObserverManager) implements a meshcore-packet-capture-compatible observer on top of the existing device session — no second connection and no device-side enable command (the firmware pushes RX_LOG_DATA for every overheard frame):

  • Hot path_on_rx_log_data hands every packet (all payload types, before the GRP_TXT echo gate) to handle_raw_packet(): pure CPU work (header/path decode, firmware-exact packet hash, JSON build) plus a non-blocking paho publish(), wrapped in its own try/except so observer failures can never affect chat
  • One paho-mqtt client per enabled broker, each with its own network thread (loop_start), auto-reconnect with backoff, QoS 0 (no backlog during outages), retained online/offline status plus an LWT on meshcore[/IATA/PUBKEY]/status; packets go to .../packets (flat meshcore/packets|status when IATA is unset)
  • Wire-format fidelity — the decode/hash/format functions are verbatim ports of upstream meshcore-packet-capture (including legacy path-length fallbacks and the publish-with-defaults quirk for unknown payload versions), validated byte-identical against live packets from the reference observer network
  • Configobserver_brokers table plus the observer_settings JSON key (enabled, iata, advert_interval_hours) in app_settings; every mutating API call triggers reload() on a daemon thread (the client list is swapped atomically and the hot path reads it lock-free), so changes apply without restart
  • Advert scheduler — an observer-owned daemon thread checks every 10 minutes and sends a flood advert once advert_interval_hours has elapsed since the observer_last_advert_at timestamp persisted in app_settings (restart-safe)
  • Live statusobserver_status events on the /chat namespace (throttled to one per 2 s on the packet path) drive the Settings-tab badges and counters; GET /api/observer/status returns the full merged view

Diagnostic capture (support bundle)

app/diagnostics.py (DiagnosticsManager) records a bounded window of device traffic into a zip the user can hand to a maintainer who has no access to their machine. It answers a question the database cannot: whether a missing route badge means "nobody repeated it" or "the repeat never crossed the companion link".

  • Why the device counter matterslogRxRaw() in the firmware pushes every overheard packet through writeFrame(), which drops the frame when its 4-entry queue is full and ignores the return value, so the loss is invisible to the host (no log, no counter). Drain rates differ hugely: USB writes with no queue, WiFi/TCP sends one frame per main-loop pass, BLE at most one per 60 ms (BLE_WRITE_MIN_INTERVAL). The capture brackets its window with get_device_stats() calls and samples again every 60 s, so stats.packets.recv delta versus the number of RX-log frames actually captured turns that invisible loss into a measurement
  • Hot path — the same threading contract as the Observer, for the same reason. record() builds one dict and appends to a deque; no disk, no network, no locks. threading.Event.set() is deliberately avoided (it takes a lock), so the writer polls at 0.4 s instead of being signalled. Call sites test the plain recording attribute before building arguments, so an idle capture costs one attribute load
  • Taps_on_rx_log_data (before the empty-payload guard, so the frame count matches what the device counted), _process_echo (match rule that fired, plus a snapshot of the pending-send list — that is what explains a non-match), and send_channel_message (expected payloads, raw_packet, region scope). A logging.Handler mirrors log records through the same queue; it uses a no-op lock object rather than lock = None, because Python 3.13's Handler.handle() uses with self.lock
  • Log level — a capture raises the root logger to DEBUG for its duration and restores it on stop. Without that, a server at the default INFO emits none of the lines the echo correlator writes about its own decisions, and the log file is worthless
  • Writer thread — one per session, owns every file handle, demultiplexes log records into log.txt and everything else into events.jsonl, enforces the caps, and performs the whole finalize-and-zip sequence. Stopping never runs on the caller's thread: a request thread raises a flag and joins, so both a user stop and an auto-stop finalise through the same path
  • Caps and retention — 5/15/30/60 min and 25 MB (hard limit 100 MB), whichever fills first; at most 10 captures kept, oldest pruned on start. /data is the user's config directory, so these are not optional
  • Contentsmeta.json (versions, transport, device, options, counters, stop reason), stats_before.json / stats_after.json, events.jsonl, log.txt. Every timestamp is UTC epoch seconds, stated in meta.json, because the DB writes UTC and container logs are local time
  • Privacy — the capture contains the plaintext of every message received while recording, plus contact names and public keys. This is stated in the UI and confirmed before upload. Channel secrets and broker credentials are never included; ciphertext payloads are enough for correlation analysis
  • UploadPOST /api/upload against a Zipline instance: bare authorization token (no Bearer), one multipart file field, x-zipline-original-name: true, link read from .files[0].url (the older files: ["url"] shape is accepted too). The default URL ships in the code; the token never does — this repository is public, so a baked-in write token would let anyone upload anything. The user pastes a token handed to them out-of-band, and the API is write-only for it
  • Offline analysisscripts/diag_report.py <capture.zip> prints the frame-loss comparison, per-interval detail, inter-frame gap distribution, and a per-sent-message verdict (echo heard / heard but not correlated, with the pending list / no echo at all). It reads nothing but the capture

Repeater administration (My Repeaters)

The /repeaters (list) and /repeaters/manage (per-repeater tools) panels are standalone iframe pages built on the companion protocol's remote-request commands plus the repeater text CLI:

  • Serialization — the companion firmware tracks a single pending remote request (each new send silently clears the previous one), so every repeater operation runs under DeviceManager._repeater_lock (180 s acquire timeout; a held lock returns {'busy': True} → HTTP 429). This also guards against two browser tabs operating at once
  • Login sessionsrepeater_login() waits for LOGIN_SUCCESS filtered by the contact's pubkey_prefix and stores {is_admin, permissions, logged_in_at} in the in-memory _repeater_sessions dict (cleared on logout/app restart; the UI auto-relogs with the saved password). All remote endpoints fail fast with 401 need_login when no session exists — a repeater only answers pubkeys in its ACL, so requesting without a login would just burn a multi-minute timeout. A wrong password is indistinguishable from an unreachable repeater (the firmware never replies to failed logins), so timeout messages always name both causes
  • CLI reply correlationrepeater_cmd_wait() sends one text command and blocks for its reply. Replies arrive as CONTACT_MSG_RECV with txt_type=1 (CLI_DATA) and carry no protocol-level correlation, so correlation = the repeater lock (single command in flight) + a single-slot waiter matched against the sender's 12-hex pubkey prefix at the top of _on_dm_received. Matched replies are consumed there and never stored as chat DMs; unmatched CLI replies keep the legacy behavior (stored as a DM) so the Console's fire-and-forget cmd flow is unchanged. Wait time derives from the device-suggested timeout (clamped 10–45 s)
  • Settings batches — reads run sequential get <field> commands per section and parse the firmware's > value replies, reporting per-field errors without failing the batch; writes send only dirty fields and classify each reply as ok (starts with ok/password now), reboot_required (reply mentions reboot — e.g. set radio), or failed (anything else, surfaced verbatim). Connection-level failures abort the rest of the batch
  • Regions — the repeater's flood-scope map, edited over text CLI (region ...). Two firmware facts drive the design. put/remove/allowf/denyf mutate the map in RAM only and are lost on reboot until region save writes flash, so the UI stages edits behind an explicit Save and warns before navigating away; region default is the exception (the firmware calls saveRegions() itself) and so never sets the dirty flag. The bare region reply is an indented tree — indent = nesting depth, ^ = home region, trailing F = flood allowed — capped at 160 bytes by exportTo(reply, 160), so _parse_region_tree() strips the suffixes right-to-left (a region may legitimately be named F or end in ^) and _region_tree_truncated() reports a clipped tail rather than hiding it. Names are validated with the shared is_valid_region_name() before any command is built, which also blocks CLI injection through a name. A repeater that answers Err - ... (a region with children, an unknown name) is enforcing its own rule rather than failing as a transport, so that comes back 200 with ok: false like the sibling /action and /neighbours/remove endpoints — dirty stays false and the caller reads ok. move re-parents through region put <name> <parent> and is the one action that reads before it writes, because two firmware behaviours make a blind put unsafe: the only cycle check is region->id == parent_id, so moving a region into its own descendant is accepted and detaches that branch from the wildcard root — it vanishes from printChildRegions() while still holding table slots and still matching in findMatch() (which scans the flat array, so forwarding never loops); and the put branch sets region->flags = 0, silently re-allowing flood on a denied region. One region read supplies both the descendant set and the pre-move flag, and a denyf follow-up restores the latter. The binary AnonReqType.REGIONS request is deliberately unused here: it answers with exportNamesTo(), a flat list of allowed names with no hierarchy, deny flags or home marker
  • Role gating — the firmware silently drops text CLI from non-admin logins (which would surface as a timeout), so the CLI/Settings/Actions endpoints reject guest sessions with 403 up front instead
  • Actions whitelistadvert.zerohop, advert (flood), clock sync, reboot. reboot never replies (the firmware restarts immediately without building one), so a clean send followed by silence is reported as success. Text erase is firmware-gated to the USB serial console (sender_timestamp == 0), hence no erase in the UI

Demo mode (MC_DEMO)

app/demo_guard.py turns a publicly shared instance read-only. User-facing guide: demo-mode.md.

  • Default deny, not a blacklist — an @api_bp.before_request hook refuses every non-GET on /api/* unless the path is on WRITE_ALLOWLIST (sending, resending, read markers, and the two unlock endpoints). An endpoint added later is therefore locked without anyone touching this module, which matters because six mutating endpoints already had no frontend caller and would never have made a hand-written blacklist. A short READ_DENYLIST covers the GETs that hand out secrets (repeater passwords, backup list/download, capture download, /api/logs) since the write guard never sees them
  • Two bypasses of the HTTP layer, both closed separately — the console is a Socket.IO event (send_command on /console), not a route, so it is guarded in handle_send_command against CONSOLE_READONLY; the log viewer is guarded at the /logs connect handshake by returning False
  • Unlock is stateless — the cookie holds HMAC(MC_DEMO_UNLOCK_CODE, "mc-webui-demo-unlock-v1"), compared with hmac.compare_digest. No session, and deliberately not Flask's session, whose SECRET_KEY is a hardcoded public constant. Changing the code invalidates every issued cookie
  • Trusted networks refuse to match through a proxy — when a request carries X-Forwarded-For/X-Real-IP/Forwarded/CF-Connecting-IP and MC_TRUST_PROXY is off, remote_addr belongs to the proxy or tunnel rather than the visitor, so it is not matched against MC_DEMO_TRUSTED_NETS. Without this, publishing through a LAN-hosted tunnel while trusting the LAN would unlock the instance for every visitor at once. log_startup_state() reports the resulting configuration at boot
  • Frontend is advisorydemo-lock.js (loaded from _head_i18n.html, so it reaches all eight entry points including the six iframes) disables controls inside [data-demo-lock], removes [data-demo-lock="hide"], re-applies through a MutationObserver for JS-rendered buttons, and turns any 403 demo_locked response into a toast. The flags reach templates through the inject_globals context processor and JS through /api/status

Reading API responses (fetchJson)

app/static/js/fetch-utils.js is loaded from _head_i18n.html, so window.fetchJson exists on all eight entry points, the six iframes included. It replaces the const resp = await fetch(u); const data = await resp.json(); pair at 88 call sites across the frontend.

The reason is what happens when the app is not what answers. An instance published through a reverse proxy with an access list, or through Cloudflare Zero Trust, gets an HTML login or error page in place of JSON as soon as that session expires — and resp.json() then throws SyntaxError: Unexpected token '<', "<!DOCTYPE "..., which several panes printed at the user verbatim (diagnosed 2026-09-08: the origin had answered a clean {"success": false, "error": "No reply from repeater within 10s"} 504, the browser never saw it).

fetchJson() returns the parsed body, so the usual data.success / data.error checks are unchanged, and reports every other outcome in the same shape the API itself uses — {success: false, error, http_status, non_json | offline} — so no call site needs a second branch. An error the API sent as JSON is passed through untouched, keeping the server's own wording. A 401/403 with a non-JSON body is called out as an expired login rather than a generic failure, since that is the case a user can act on. Call sites that deliberately inspect the response (resp.ok, resp.status, blob(), uploads) still use fetch directly.

Adverts are unvalidated mesh input, and a packet corrupted in flight can carry a latitude of 1642 or a longitude of -1768. One such entry blanks a whole map: Leaflet clamps latitude when projecting but not longitude, so fitBounds() zooms out until the impossible point is on screen and every real marker ends up several world-widths outside the viewport. This is not theoretical — a tester's cache held two of them among 2131 contacts, and both his contacts map and Path Analyzer were unusable because of it.

app/geo.py and app/static/js/geo-utils.js hold the single definition of a usable position, applied in four places so no one miss can blank a map again:

  • On writeDatabase.upsert_contact() stores NULL instead of an out-of-range, non-finite or unparseable coordinate, and drops both components together (half a position is not a position). The contact itself is still kept: only its claimed location is discarded
  • On API output — every response that feeds a map (/api/contacts/cached?format=full, /api/contacts/detailed, /api/repeaters, /api/repeaters/<pk>/neighbours, /api/device/info, /api/contacts/preview-cleanup) is scrubbed again. upsert_contact merges with COALESCE, so a bad value already in a row is sticky — the output scrub is what heals a cache poisoned by an older build, with no migration and nothing for the user to do
  • In the browserhasValidGps() / withValidGps() replaced eight hand-copied variants of the same check across six JS files. They were not equivalent: paGeoContact() in the Path Analyzer rejected only an exact 0/0 pair, so it alone accepted a longitude of exactly zero and placed those nodes off west Africa, stretching routes across the map. fitMapToPoints() filters the point list, checks bounds.isValid() and caps maxZoom
  • Per marker — the marker loops catch per entry, so anything that still slips through costs its own pin rather than the whole map

A corrupted type (61, 126, 152 and 210 have all been seen) is logged but stored raw. It already renders as UNKNOWN and is filtered out of the maps; normalising it to 0 would be worse, because 0 maps to COM in the type-label table and would promote garbage onto the map.

Path Analyzer

The /path-analyzer panel (standalone iframe page, path-analyzer.js) is a read-only analysis view over data the app already collects — no new tables, no background work:

  • Data sourceGET /api/path-analyzer/messages?days=N joins channel_messages with echoes (path hex + SNR + per-echo hash_size, keyed by pkt_payload). Echoes are fetched with db.get_echoes_for_payloads() — chunked IN queries (≤500 params, under SQLite's host-parameter limit) via idx_echoes_pkt — deliberately avoiding the per-message echo query the older /api/messages path still does. The pkt_payload reconstruction (raw_json text → channel-secret AES/HMAC compute) is shared with /api/messages via the _get_row_pkt_payload() helper
  • All filtering/stats/map/routes logic is client-side over the bulk payload (hundreds of KB for 7 days — fine on a LAN): filters operate on per-hop tokens split with each echo's own hash_size (mixed 1/2/3-byte networks are real), so SQL-side token filtering was rejected. Every view always reflects the active filters for free
  • Four views share the one payload: Messages (hop-by-hop echo detail), Repeaters (per-hash relay/SNR stats), Routes (consecutive hop-segment n-grams — user-selectable length 2–4, counted anywhere in a path), and Map (Leaflet path drawing). The repeater filter accepts a >-chained sequence (each element a hash prefix or contact name) matched as consecutive hops; Routes rows write such a sequence into that filter on click
  • Deep linkGET /path-analyzer?hash=<packet_hash>&path=<echo path hex> opens straight on the Map view with that message selected and that exact echo drawn. Used by the chat path popup (app.jsopenPathInAnalyzer stashes {hash, path} in window.paDeepLink; the modal's show.bs.modal handler builds the iframe URL). On load the analyzer resolves the message by packet_hash, widening the time range once to 7 days if it isn't in the current window, and matches the echo by raw path hex (fallback: shortest routed echo)
  • Map layers — three L.layerGroups added in draw order (base repeater markers → alternative echoes → selected path), both extras gated by opt-in checkboxes in a topright L.Control (the shared filter bar is wrong for view-specific state). Alternative echoes are coloured by their index in echoView, so a hue survives changing which echo is primary; segments are deduplicated against a Set of endpoint-pair keys that the primary path fills first, so alternatives render only where they diverge instead of underneath the primary line. Toggling calls paRenderMapView(false) — a full re-render (the sidebar swatches must follow) with fitBounds suppressed, so overlay changes never discard the user's viewport
  • Filter persistence — toolbar controls plus the Routes segment length are mirrored into localStorage under mc-webui-pa-filters (browser-local working set, deliberately not device state in SQLite). Only user-driven handlers write, via paApplyAndSaveFilters(), so programmatic changes — notably the deep link forcing 7 days — never overwrite the stored set; restore is skipped entirely when paDeepLink is present, and stored <select> values that no longer exist as options are ignored. paRestoreFilters() ends with paReadFilters() so paFilters, the Clear button, and the mobile badge match the restored DOM before the first render
  • SNR attribution — echo SNR is measured at our receiver, so stats credit it to the final hop only; intermediate hops get relay counts but never SNR
  • Hash→contact resolution — pubkey-prefix match against /api/contacts/cached?format=full (memoized per token). 1-byte hashes collide by design; the map renders unresolved hops as amber candidate markers with manual pick, and the repeater-name filter is intentionally inclusive over candidates
  • Legacy rows whose pkt_payload cannot be recomputed (missing channel secret) are returned with packet_hash: null and no echoes rather than dropped

Project Structure

mc-webui/
├── Dockerfile                      # Main app Docker image
├── docker-compose.yml              # Single-container orchestration
├── app/
│   ├── __init__.py
│   ├── main.py                     # Flask entry point + Socket.IO handlers
│   ├── config.py                   # Configuration from env vars
│   ├── database.py                 # SQLite database models and CRUD operations
│   ├── device_manager.py           # Core logic for meshcore communication
│   ├── observer.py                 # Observer: MQTT packet-capture publishing
│   ├── diagnostics.py              # Diagnostic capture (support bundle + upload)
│   ├── demo_guard.py               # Demo mode: read-only guard for a public instance
│   ├── geo.py                      # Coordinate sanity checks for advert positions
│   ├── contacts_cache.py           # Persistent contacts cache (DB-backed)
│   ├── read_status.py              # Server-side read status manager (DB-backed)
│   ├── notify_profiles.py          # Notification profiles: rule matching, validation, storage
│   ├── version.py                  # Git-based version management
│   ├── migrate_v1.py               # Migration script from v1 flat files to v2 SQLite
│   ├── meshcore/
│   │   ├── __init__.py
│   │   ├── cli.py                  # Meshcore library wrapper interface
│   │   └── parser.py               # Data parsers
│   ├── archiver/
│   │   └── manager.py              # Archive scheduler and management
│   ├── routes/
│   │   ├── __init__.py
│   │   ├── api.py                  # REST API endpoints
│   │   └── views.py                # HTML views
│   ├── static/                     # Frontend assets (CSS, JS, images, vendors)
│   │   ├── js/fab-utils.js         # Floating-button drag/collapse/sizing helpers
│   │   └── js/geo-utils.js         # Shared GPS validation + safe fitBounds for every map
│   └── templates/                  # HTML templates
├── docs/                           # Documentation
├── scripts/
│   ├── diag_report.py              # Offline analyser for a diagnostic capture
│   ├── update.sh                   # Update a git checkout (pull + rebuild)
│   ├── docker-entrypoint.sh        # Container startup (BLE cleanup)
│   ├── updater/                    # Remote update webhook service
│   │   ├── updater.py              # Host webhook; picks the update path per install
│   │   ├── update-image.sh         # Update a Docker Hub install (pull + recreate)
│   │   └── install.sh              # systemd installer; also runs from curl | sudo bash
│   └── watchdog/                   # Container health monitor
└── README.md

Database Architecture

mc-webui v2 uses a robust SQLite Database with WAL (Write-Ahead Logging) enabled.

Location: ./data/meshcore/<pubkey_prefix>.db

Key tables:

  • messages - All channel and direct messages (with FTS5 index for full-text search)
  • contacts - Contact list with sync status, types, block/ignore flags, no_auto_flood flag
  • channels - Channel configuration and keys
  • echoes - Sent message tracking and repeater paths, hash_size for path_hash_mode, transport_codes (the packet's region-scope stamp, NULL when unscoped)
  • direct_messages - DM messages with delivery tracking (delivery_status, delivery_attempt, delivery_max_attempts, delivery_path)
  • acks - DM delivery status
  • settings - Application settings (migrated from .webui_settings.json)
  • regions - User-curated MeshCore flood scopes (name, key_hex, is_default)
  • channel_scopes - Per-channel region mapping (channel_idxregion_id, CASCADE on region delete; absent row = no override → firmware default applies)
  • read_status - Per-channel read counters, favorites and notification mode (is_favorite pins channels in the sidebar/dropdown sort order; is_muted + notify_profile form one three-way state — muted / every message / only messages passing that profile — and are always written together)
  • app_settings.notification_profiles - JSON list of notification profiles (id, name, match = any|all, rules[] of {type: mention|text|sender, value}); evaluated in notify_profiles.py for unread counts and, with the same rules, in app.js for the browser notification
  • analyzers - User-configured MeshCore Analyzer services (name, url_template with {packetHash} placeholder, is_default, is_disabled; partial unique index enforces a single default)
  • observer_brokers - MQTT brokers for the Observer packet-capture feature (name, host, port, username, password — stored plaintext, use_tls, tls_verify, is_disabled)
  • repeaters - Repeaters saved in the My Repeaters panel (public_key PK, password — stored plaintext per the observer_brokers precedent, added_at, last_login_at, last_login_role). Everything else about a repeater (name, path, position) comes from the device contact at read time

direct_messages gained a delivery_path_hash_size column (auto-migrated, defaults to 1) so reloaded DM bubbles render multi-byte routes correctly. The path_len column on channel_messages, direct_messages, and paths now stores the raw firmware byte (masked hop count plus path_hash_mode in the upper bits), recombined at write time via pack_path_len(); the API endpoints decode it back into path_hash_size on read. channel_messages also gained a raw_packet column (the full hex wire snapshot captured at send time, indexed by idx_cm_pkt on pkt_payload for fast self-echo lookups) that powers raw resend; it is NULL for received and pre-migration rows, so the resend button stays disabled there.

echoes gained a transport_codes column (auto-migrated, NULL for pre-migration rows): the 4 header bytes a TRANSPORT_FLOOD / TRANSPORT_DIRECT packet carries after the header byte, which _on_rx_log_data used to discard. The first two are the sender's region-scope stamp — TransportKey::calcTransportCode, the first 2 bytes of HMAC-SHA256(scope_key, payload_type || payload) with 0x0000/0xFFFF bumped to 0x0001/0xFFFE — and the second pair is a reply code the companion firmware leaves at zero. The region name never travels, so _resolve_message_region() in api.py recomputes the code for every row of the regions table (calc_transport_code() / match_region_by_transport_code() in app/meshcore/regions.py, shared with the raw-resend packet builder) and reports the one that reproduces it as region on /api/messages and /api/messages/meta. The code is read from the first echo that recorded one; own rows fall back to the raw_packet snapshot, so they resolve before any echo. A message stamped with a region the instance has not configured, or a private $name region whose key is not derivable, simply gets no region.

The use of SQLite allows for fast queries, reliable data storage, full-text search, and complex filtering (such as contact ignoring/blocking) without the risk of file corruption inherent to flat JSON files.

Retention scheduler

Retention is enabled by default with 90 / 90 / 60 / 30 days for channel_messages / direct_messages / advertisements / diagnostics. The job runs daily at 03:30 local (TZ from .env) and cleanup_old_messages() also deletes from echoes, paths, and acks (the diagnostic tables — historically the bulk of DB size). When at least 1 000 rows are removed in a pass, the scheduler immediately runs VACUUM to reclaim file space (a SQLite DELETE only marks pages free).

The retention/cleanup scheduler runs APScheduler jobs in worker threads, so each job is decorated with @_with_app_context and the Flask app is passed in via set_flask_app(); the init_*_schedule() callers also wrap themselves in app.app_context() so the boot-time read of current_app.db doesn't blow up with "Working outside of application context".

The archiver builds the .msgs path from device_name, but the meshcore library strips non-ASCII when writing the file (so a device renamed to include an emoji breaks the strict path match). The archiver now falls back to globbing the data directory for a single non-archive .msgs file when the expected path is missing — mirroring migrate_v1.

The channels API reads from the channels DB table rather than iterating device slots. _load_channel_secrets() syncs the table on every device connect (and prunes stale rows), set_channel() / remove_channel() update it synchronously with the device, and _refresh_channel_secret() refreshes individual rows on per-send refresh. This makes /api/channels a single sub-millisecond SELECT and unaffected by device responsiveness — the original symptom (only "Public" showing up after a refresh when the device briefly stalls) is gone.


API Reference

Messages

MethodEndpointDescription
GET/api/messagesList messages (?archive_date, ?days, ?channel_idx)
POST/api/messagesSend message ({text, channel_idx, reply_to?})
GET/api/messages/updatesCheck for new messages (smart refresh)
GET/api/messages/<id>/metaGet message metadata (echoes, paths)
POST/api/messages/<id>/resendRe-broadcast an own channel message verbatim via CMD_SEND_RAW_PACKET (same packet hash, so unreached repeaters pick it up). 400 for not-own / missing raw_packet snapshot / disconnected / firmware < 1.16, 404 for unknown id
GET/api/messages/searchFull-text search (?q=, ?channel_idx=, ?limit=)
GET/api/path-analyzer/messagesBulk channel messages across all channels with batched echo data (?days=1..30, default 3); powers the Path Analyzer panel (GET /path-analyzer)

Contacts

MethodEndpointDescription
GET/api/contactsList contacts
GET/api/contacts/detailedFull contact data (includes protection, ignore, block flags)
GET/api/contacts/cachedGet cached contacts (superset of device contacts)
POST/api/contacts/deleteSoft-delete contact ({selector})
POST/api/contacts/cached/deleteDelete cached contact
GET/api/contacts/protectedList protected public keys
POST/api/contacts/<key>/protectToggle contact protection
POST/api/contacts/<key>/ignoreToggle contact ignore
POST/api/contacts/<key>/blockToggle contact block
GET/api/contacts/blocked-namesGet blocked names count
POST/api/contacts/block-nameBlock a name pattern
GET/api/contacts/blocked-names-listList blocked name patterns
POST/api/contacts/preview-cleanupPreview cleanup criteria
POST/api/contacts/cleanupRemove contacts by filter
GET/api/contacts/cleanup-settingsGet auto-cleanup settings
POST/api/contacts/cleanup-settingsUpdate auto-cleanup settings
GET/api/contacts/pendingPending contacts (?types=1&types=2)
POST/api/contacts/pending/approveApprove pending contact
POST/api/contacts/pending/rejectReject pending contact
POST/api/contacts/pending/clearClear all pending contacts
POST/api/contacts/manual-addAdd contact from URI or params
POST/api/contacts/<key>/push-to-devicePush cached contact to device
POST/api/contacts/<key>/move-to-cacheMove device contact to cache
GET/api/contacts/repeatersList repeater contacts (for path picker)
GET/api/contacts/<key>/pathsGet contact paths
POST/api/contacts/<key>/pathsAdd path to contact
PUT/api/contacts/<key>/paths/<id>Update path (star, label)
DELETE/api/contacts/<key>/paths/<id>Delete path
POST/api/contacts/<key>/paths/reorderReorder paths
POST/api/contacts/<key>/paths/<id>/applyPush a configured path to the firmware as the active route (mirrors change_path); invalidates the contacts cache
POST/api/contacts/<key>/paths/reset_floodReset to FLOOD routing
POST/api/contacts/<key>/paths/set_directSet the device path to Direct (empty path → out_path_len = 0); configured paths are kept
POST/api/contacts/<key>/paths/clearClear all paths
GET/api/contacts/<key>/no_auto_floodGet "Keep path" flag
PUT/api/contacts/<key>/no_auto_floodSet "Keep path" flag

Channels

MethodEndpointDescription
GET/api/channelsList all channels
POST/api/channelsCreate new channel (idempotent — returns existing slot if name already used)
POST/api/channels/joinJoin existing channel (idempotent unless explicit index overrides)
DELETE/api/channels/<index>Remove channel
GET/api/channels/<index>/qrQR code (?format=json|png)
GET/api/channels/mutedGet muted channels
POST/api/channels/<index>/muteSet mute ({muted: bool}); unmuting lands on "every message"
PUT/api/channels/<index>/notificationsSet notification mode ({mode: muted|all|profile, profile_id?}); the one endpoint the bell menu uses
GET/api/channels/scopesBulk per-channel region mapping for UI
PUT/api/channels/<index>/scopeAssign/clear region scope ({region_id: int|null})
GET/api/channels/favoritesList favorite channel indices
POST/api/channels/<index>/favoriteSet favorite state ({favorite: bool})

Notification profiles

MethodEndpointDescription
GET/api/notification-profilesList profiles, plus device_name (what a mention rule looks for)
POST/api/notification-profilesCreate ({name, match: any|all, rules: [{type, value?}]}); names unique, case-insensitive
PUT/api/notification-profiles/<id>Replace name, match mode and rules
DELETE/api/notification-profiles/<id>Delete; channels using it revert to every message, returned as cleared_channels

Per-channel assignment is reported by GET /api/read_status and GET /api/messages/updates as channel_notify_profiles ({"<idx>": "<id>"}); the latter also counts a profiled channel's unread messages through the profile.

Regions (MeshCore flood scopes)

MethodEndpointDescription
GET/api/regionsList the device's region registry
POST/api/regionsCreate region ({name}); key derived as SHA256('#'+name)[:16]
DELETE/api/regions/<id>Delete region; CASCADE clears channel mappings; if it was the firmware default, clears it on device
POST/api/regions/<id>/defaultMark default in DB AND push to firmware (CMD_SET_DEFAULT_FLOOD_SCOPE = 63, requires firmware v1.15+)
DELETE/api/regions/defaultClear default region in DB and on firmware

The PUT /api/channels/<index>/scope endpoint accepts any index in [0, device_manager._max_channels) (40 on current firmwares; falls back to 8 if the DM is unreachable).

Analyzers

MethodEndpointDescription
GET/api/analyzersList configured analyzer services
POST/api/analyzersCreate analyzer ({name, url_template}); template must contain {packetHash}
PUT/api/analyzers/<id>Update analyzer (name / url / is_disabled)
DELETE/api/analyzers/<id>Delete analyzer
POST/api/analyzers/<id>/defaultMark as default (enforced single-default via partial unique index)
DELETE/api/analyzers/defaultClear the default analyzer

The backend no longer ships a pre-built analyzer_url per message — channel-message payloads include packet_hash instead, and the frontend substitutes {packetHash} in the chosen URL template at click time. The Letsmesh Analyzer is not a hardcoded pseudo-row: seed_default_analyzers() inserts it as an ordinary analyzers row exactly once per install (guarded by the analyzer_letsmesh_seeded flag in app_settings), so it can be renamed, disabled, or deleted like any user entry. The row stores is_disabled (not is_enabled); the UI inverts it on read/write so the switch reads "Enabled", which is why no data migration was needed.

Observer

MethodEndpointDescription
GET/api/observer/settingsGet observer settings (enabled, iata, advert_interval_hours)
POST/api/observer/settingsPartial update; IATA must be empty or exactly 3 letters, interval 0-8760 h
GET/api/observer/brokersList MQTT brokers (passwords never returned; a has_password flag instead)
POST/api/observer/brokersCreate broker ({name, host, port?, username?, password?, use_tls?, tls_verify?})
PUT/api/observer/brokers/<id>Partial update; omitted password keeps the stored one, empty string clears it
DELETE/api/observer/brokers/<id>Delete broker
GET/api/observer/statusSettings + broker rows merged with live connection state and packet counters

Every mutating endpoint hot-reloads the ObserverManager, so broker and setting changes take effect without an app restart.

Diagnostics (support capture)

MethodEndpointDescription
GET/api/diagnostics/statusLive capture state, stored captures, upload config (never the token), and the allowed duration choices
POST/api/diagnostics/startBegin recording ({duration_min, max_mb, debug_logs, note}; 409 when one is already running). Caps are re-clamped server-side
POST/api/diagnostics/stopStop and finalise; blocks until the zip is written (409 when idle)
GET/api/diagnostics/captures/<id>/downloadDownload a stored capture
POST/api/diagnostics/captures/<id>/uploadSend a capture to the configured share service, returns the link
DELETE/api/diagnostics/captures/<id>Delete a stored capture
POST/api/diagnostics/upload-settingsSave share URL / token ({url, token}; the token is write-only, an absent key keeps the stored one)

GET /api/status also carries diagnostics_recording, which drives the recording marker in the chat status bar.

My Repeaters (repeater administration)

MethodEndpointDescription
GET/api/repeatersSaved repeaters merged with device contact truth (?refresh=true bypasses the contacts cache)
POST/api/repeatersAdd a repeater ({public_key}; 409 when already saved)
GET/api/repeaters/<pk>Single merged entry + login session state
PUT/api/repeaters/<pk>Set or clear the saved password ({password}; empty string clears)
DELETE/api/repeaters/<pk>Remove from the list (device contact untouched)
GET/api/repeaters/<pk>/passwordSaved password (empty string when none); prefills the login-retry prompt for the trusted local UI
POST/api/repeaters/<pk>/loginLog in with {password?, save?} — omitted password uses the saved one
GET/api/repeaters/<pk>/sessionIn-memory session state (logged_in, is_admin, permissions)
POST/api/repeaters/<pk>/logoutLog out and drop the session
GET/api/repeaters/<pk>/statusBinary status request (battery, radio, packet stats)
GET/api/repeaters/<pk>/clockRepeater clock (LE epoch from req_basic_sync)
GET/api/repeaters/<pk>/telemetryAll Cayenne LPP channels
GET/api/repeaters/<pk>/neighboursZero-hop neighbours enriched with contact names/positions
POST/api/repeaters/<pk>/neighbours/removeDrop one neighbour ({prefix: <hex>}) or all of them (empty prefix); admin only
POST/api/repeaters/<pk>/cliText CLI command ({command}{output, elapsed_ms}); admin only
GET/api/repeaters/<pk>/settingsRead one settings section (?section=basic|radio|location|features|network|advert|operator|advanced) as a get batch; admin only
POST/api/repeaters/<pk>/settingsApply dirty fields ({values}) as a set batch with per-field ok|failed|reboot_required results; admin only
POST/api/repeaters/<pk>/actionOne-shot action ({action: zerohop_advert|flood_advert|discover_neighbours|clock_sync|reboot}); admin only
GET/api/repeaters/<pk>/regionsRegion map: the parsed region tree plus the default flood scope; admin only
POST/api/repeaters/<pk>/regionsOne region action ({action: add|remove|move|allow_flood|deny_flood|set_home|set_default|clear_default|save, name?, parent?}); admin only

Error mapping is shared across the family: 401 need_login (no session), 403 (guest on an admin endpoint), 429 (another repeater operation in progress — single firmware request slot), 503 (device not connected), 504 (timeout: repeater unreachable or wrong password — indistinguishable by protocol). Passwords are never returned by any GET (password_set boolean only). The panels are served by GET /repeaters and GET /repeaters/manage?pubkey=<64-hex>.

Direct Messages

MethodEndpointDescription
GET/api/dm/conversationsList DM conversations
GET/api/dm/messagesGet messages (?conversation_id=, ?limit=)
POST/api/dm/messagesSend DM ({recipient, text})
GET/api/dm/updatesCheck for new DMs
GET/api/dm/auto_retryGet DM retry configuration
POST/api/dm/auto_retryUpdate DM retry configuration

Device & Settings

MethodEndpointDescription
GET/api/statusConnection status (device name, transport type, serial port / BLE address). When connected also surfaces fw_ver_code, supports_raw_resend, path_hash_mode, and path_hash_size so the frontend can show/hide the raw-resend button and verify the resend snapshot's hash size
GET/api/device/infoDevice information
GET/api/device/statsDevice statistics
GET/api/device/settingsGet device settings
POST/api/device/settingsUpdate device settings
GET/api/device/configGet device configuration (name, coords, advert_loc_policy, path_hash_mode, radio params, tx_power)
POST/api/device/configUpdate device configuration from Settings > Device tab. Subset of fields incl. path_hash_mode (0=1B, 1=2B, 2=3B)
POST/api/device/commandExecute command (advert, floodadv)
GET/api/device/commandsList available special commands
GET/api/chat/settingsGet chat settings (quote length, route popup timeout/no-autoclose)
POST/api/chat/settingsUpdate chat settings
GET/api/ui/settingsGet UI settings (toast timeout, no-autoclose, position)
POST/api/ui/settingsUpdate UI settings
GET/api/retention-settingsGet message retention settings
POST/api/retention-settingsUpdate retention settings

Archives & Backup

MethodEndpointDescription
GET/api/archivesList archives
POST/api/archive/triggerManual archive
GET/api/backup/listList database backups
POST/api/backup/createCreate database backup
GET/api/backup/downloadDownload backup file
GET/api/db/sizeCurrent DB file size (bytes)
POST/api/db/vacuumKick off SQLite VACUUM in a worker thread. Returns 202 immediately; 409 if already running. The kickoff endpoint deliberately splits from polling so reverse proxies with ~30 s idle timeouts can't kill it mid-rewrite
GET/api/db/vacuum/statusPoll vacuum progress: {running, elapsed_seconds, size_before, size_after}

Health endpoints

These are top-level routes (not under /api/), consumed by Docker's healthcheck and the host-level watchdog.

MethodEndpointDescription
GET/healthLenient liveness check. Returns 503 only when BLE reconnection has permanently failed (so Docker triggers a container restart to clear BLE state). Returns 200 otherwise
GET/health/strictStrict device-health check for the external watchdog. JSON response. Returns 503 when (a) BLE permanently failed, (b) _consecutive_stats_failures ≥ 5, or (c) transport is serial/usb/tcp and no RX event for > HEALTH_STRICT_MAX_RX_STALE_SEC (5 min). Returns 200 with the same counters when healthy

Other

MethodEndpointDescription
GET/api/read_statusGet server-side read status
POST/api/read_status/mark_readMark messages as read
POST/api/read_status/mark_all_readMark all messages as read
GET/api/versionGet app version
GET/api/check-updateCheck for available updates
GET/api/updater/statusGet updater service status
POST/api/updater/triggerTrigger remote update
GET/api/advertisementsGet recent advertisements
POST/api/demo/unlockDemo mode: exchange {code} for the unlock cookie (403 on a wrong code, after a 1 s delay)
POST/api/demo/lockDemo mode: drop the unlock cookie
GET/api/console/historyGet console command history
POST/api/console/historySave console command
DELETE/api/console/historyClear console history
GET/api/console/outputGet persisted console output transcript (capped at 500 entries)
POST/api/console/outputAppend entry to transcript
DELETE/api/console/outputClear transcript
GET/api/logsGet application logs

WebSocket API

All Socket.IO clients (/chat, /console, /logs) use the default transports: connect over long-polling, then upgrade to a real WebSocket. Where the upgrade is blocked (a reverse proxy that drops the Upgrade header) the client stays on polling by itself, so no configuration is needed either way.

From 2026-06-07 to 2026-07-31 the clients pinned transports: ['polling'], upgrade: false, because the Werkzeug server then had no WebSocket support and every io() upgrade attempt returned HTTP 500, producing a reconnect loop and 10–15 s freezes on app load. That stopped being true when python-engineio==4.8.1 was pinned (2026-07-14) and pulled in simple-websocket, which teaches Werkzeug to serve WebSockets.

Do not re-pin polling. Long-polling holds one HTTP connection open per tab for the life of the tab, and browsers allow only six concurrent HTTP/1.1 connections per origin across all tabs. Three open tabs therefore consumed the whole pool, and every other request — including ones the server answered in 10 ms — waited tens of seconds in the browser's queue for a free connection. Measured with three tabs open: /health took a 14.7 s median from inside a tab while answering in 11 ms to a client outside the browser at the same instant; after the upgrade the same probe reads 12 ms. A WebSocket is not part of that HTTP pool, so upgrading is what releases it.

Console Namespace (/console)

Interactive console via Socket.IO WebSocket connection.

Client → Server:

  • send_command - Execute command ({command: "infos"})

Server → Client:

  • console_status - Connection status
  • command_response - Command result ({success, command, output})

Chat Namespace (/chat)

Real-time message delivery via Socket.IO.

Server → Client:

  • new_channel_message - New channel message received
  • new_dm_message - New DM received
  • message_echo - Echo/ACK update for sent message (includes hash_size)
  • dm_ack - DM delivery confirmation
  • dm_retry_status - Real-time retry progress (dm_id, attempt, max_attempts)
  • dm_retry_failed - All retry attempts exhausted (dm_id)
  • dm_delivered_info - Delivery details after ACK (dm_id, attempt, max_attempts, path, hash_size)
  • path_changed - Contact path discovered/updated (public_key)
  • observer_status - Observer live state (enabled, running, reason, packet counters, per-broker connected/last_error)

Logs Namespace (/logs)

Real-time log streaming via Socket.IO.

Server → Client:

  • log_line - New log line

The MemoryLogHandler filters werkzeug access-log records for /socket.io/ and /api/logs/ paths before buffering/broadcasting. Clients still open on long-polling before upgrading, and stay there wherever the upgrade is blocked; without this filter every poll is logged, the broadcast wakes the pending poll, the client re-polls immediately, and an open System Log tab spins at 10+ requests/sec.


Versioning & Releases

Two identities, deliberately separate — app/version.py exposes both:

SourceLooks likeUsed for
RELEASE_VERSIONVERSION file at the repo root2.1.0What users and testers quote; the git tag; the GitHub release
VERSION_STRINGgit commit date + short hash2026.07.26+95d96ecPinning down an exact deploy; what /api/check-update compares

Resolution order is unchanged: app/version_frozen.py (written by python -m app.version freeze, which scripts/update.sh runs before every rebuild) wins over live git, which wins over the built-in fallbacks. RELEASE_VERSION is read from the VERSION file and only overridden by the frozen file, so a frozen file written before releases existed still yields a correct release number. The container has no git and no .git, hence COPY VERSION ./ in the Dockerfile — without it a plain docker compose build would report 0.0.0.

Both values ship in GET /api/version (release and version) and in the template context ({{ release }}, {{ version }}). The menu shows the release number first with the build underneath; #versionText deliberately still holds the build string, because the remote-update poller compares it to detect that the server came back on a new build.

Cutting a release:

  1. On dev: bump VERSION, and title the pending docs/whatsnew.md section ## <version> — <date> (open a fresh ## Unreleased above it)
  2. Merge devmain
  3. On main: ./scripts/release.sh — validates the number, refuses a dirty tree, a non-main branch, or an existing tag, extracts the notes from that whatsnew section, then tags v<version>, pushes it, and publishes the GitHub release via gh. --dry-run prints the notes and changes nothing
  4. Deploy as usual (mcupdate), which freezes the version into the image

Numbering is SemVer read through an operator's eyes: MAJOR when a deploy needs manual action (new env var, migration, breaking config), MINOR for new features, PATCH for fixes only. Releases start at 2.1.0 — the v2 line has been in production since 2026-03-28, and the pre-migration 1.x line preceded it, so 1.x would have been ambiguous. (The v1 and v2 archive branches were removed on 2026-08-03; both tips are ancestors of main, so that history is still reachable there.) Everything before 2.1.0 is dated but untagged.


Offline Support

The application works completely offline without internet connection. Vendor libraries (Bootstrap, Bootstrap Icons, Socket.IO, Emoji Picker) are bundled locally. A Service Worker provides hybrid caching to ensure functionality without connectivity.


Share Tokens & Cards

In-chat sharing of contacts, channels and positions. app/static/js/share-tokens.js owns the formats (pure logic, no DOM), message-utils.js renders the cards, share-composer.js provides the button and pickers.

The formats are fixed by interop

Canonical spec: docs/qr_codes.md in the MeshCore Core repo. These are what the official app emits, so they are not open to redesign.

KindWire formatBytes
Contact<64-hex-pubkey:type:name> — a compact token, not a URI~68 + name
Channelmeshcore://channel/add?name=&secret=&region_scope=~96
Locationbare lat,lon, six decimals~20

type: 1 = Companion, 2 = Repeater, 3 = Room Server, 4 = Sensor. secret is 32 hex characters. region_scope is optional (official app v1.47.0+), carried as #pl and displayed without the hash.

Why contacts do not use the URI form. meshcore://contact/add?name=…&public_key=…&type=1 costs 153 bytes with a name like MarWoj 💡📱 mobile, and the channel packet budget is 135 (DM 150). The compact token is 91. The URI form is still parsed — QR codes and "biz cards" carry it — but never emitted.

Parsing must precede HTML escaping

processMessageContent() is the single rendering hook shared by channel chat and DMs, but escaping is its step 0, and a token cannot survive the passes that follow:

  • escaping rewrites a channel URI's & as &amp;
  • processChannelLinks turns a #channel name inside the URI into a link
  • processMentions consumes an @ in a contact name
  • the contact token's closing > collides with quote syntax

So tokens are lifted out before escaping and replaced with \uE000<n>\uE001 placeholders — private-use-area characters that no pass can match and escapeHtml() passes through untouched. The finished card markup is spliced back in as the last step, and is therefore trusted HTML that must not be escaped again: every value inside a card is escaped by its builder.

Cards render into .message-content / .dm-content, never .message-meta, which refreshMessagesMeta() rewrites in place after render. Those containers are white-space: pre-wrap, so a card resets it and takes a definite width — with only a max-width, the shrink-to-fit message bubble makes the inner flex row wrap labels mid-phrase.

Per-page environment

Card state resolution and actions come from window.MCShareHooks, installed separately by app.js and dm.js, because the DM panel is an iframe with no access to the parent's contact caches, channel list or map modal. Every hook is optional: without them a card still renders and falls back to the "not known yet" state, which is safe because the add endpoints are idempotent.

Hooks: lookupContact(pubkey), lookupChannel({name, secret}), selfPosition(), openMap(label, lat, lon), onContactsChanged(), onChannelJoined(channel, name), applyChannelScope(channel, scope).

The DM panel carries its own #shareMapModal rather than reaching for the parent's map, since stacking a Bootstrap modal over the DM modal across a frame boundary needs the backdrop z-index workaround.

Targets

Contacts are added with POST /api/contacts/manual-add and target: 'cache' — DB only, no device write, works while disconnected, and reports updated / renamed. Rename-on-known-key falls out of Database.upsert_contact, whose upsert overwrites a non-empty name and keeps source='device' sticky. Channels use POST /api/channels/join, which needs the secret under the name key (the URI calls it secret).

A shared region_scope names a region, but scopes are stored by region id, so the name must already exist in the local registry — and the registry starts empty. A region's 16-byte scope key cannot be derived from its name, so an unknown scope raises a toast rather than being invented.

Guarding against false positives

Bare coordinates are the risky format. The pattern requires three or more decimal places on both numbers, validates ranges, rejects 0,0 (the firmware's "unset" marker), refuses matches abutting a word character, and skips anything inside a URL span. Without that, "1,5 osoby" and "wersja 2,10" become location cards and a Google Maps link gets torn in half.

i18n note

Never compose an i18n key (t('share.type.' + n)). scripts/i18n_check.py cannot resolve it, so a missing translation passes the check and only surfaces in the browser — which is exactly how share.card.private_channel shipped missing during development. Spell the key as a literal on every branch.