One schema-bump release (recall-index schema 3, entity-index schema 2; old
recall indexes rebuild automatically, no vault migration):
- Local-first recall index: the live BM25 index lives in the machine state dir
(keyed by endpoint hash); capture's upkeep is a zero-network atomic file
write, no advisory lock — replacing the O(vault) GET/PUT-whole-index round
trip per write. The vault copy is a snapshot (sweep + session-end) used to
seed fresh machines / catch up after another client swept
(ECHO_RECALL_SYNC_HOURS, default 24). The read path never PUTs the vault.
- Incremental sweep: entity + recall meta carry 16-char content hashes;
`sweep --fast` fetches only new/gone/hash-missing notes plus a rotating
weekday shard (--all-shards forces everything); deletions drop from both
indexes; index-only so no --apply gate. `load` auto-runs it past
ECHO_FAST_SWEEP_DAYS (7); doctor reports index freshness. Obsidian-side
edits now reach the indexes without manual maintenance.
- Stemming + alias expansion: echo_stem.py (conservative Porter-lite, unit-
tested families + over-stemming guards) applied at index AND query time;
a query fuzzy-matching an entity folds its title/alias vocabulary into the
BM25 query at half weight — expansion can only boost docs containing the
terms. capture hashes the note's FINAL content (auto-link reordered first).
Eval gold set 8 -> 14 queries (6 paraphrases): recall@5/MRR 1.00/1.00 vs
keyword baseline 0.75/0.79. +3 unit tests, +10 e2e; test harnesses now isolate
ECHO_STATE_DIR. All seven suites green.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Three independently useful changes (IMPROVEMENT-PLANS #1/#3/#7), no schema changes:
- load --brief: token-budgeted cold-start digest (facts full, last-10 observations,
scope+freshness, last session's key sections, agent-log lines, inbox count;
ECHO_LOAD_BUDGET ~8000 chars, lowest-priority-first trimming). SessionStart hook
injects the brief form; /echo-load keeps the full dump. All load reads (+ the
sessions listing, which also feeds the heartbeat fallback) fetched in parallel.
- Offline capture durability: a fully-offline capture queues the WHOLE op as one
semantic record; flush replays it through capture so routing/gate/aliasing re-run
against the current index; a gate stop on replay is kept + flagged
(needs_attention, surfaced by flush and load), never landed blind; update-path
and ensure_daily_log writes ride safe_request; same-args captures dedupe.
- session-end: one call, one lock — session log -> agent-log line -> reflect
proposals (gate-aware) -> optional scope set -> heartbeat LAST as the commit
marker; dry-run default; ECHO_NOW pins HHMM; validation runs before any write.
Stop hook nudge names the command and recognizes it as reflected.
- Fix: main() now catches the __main__ twin-module EchoError (via RuntimeError +
.code) so helper-module errors exit with their intended codes, not tracebacks.
+19 e2e checks; all suites green. Plans renumbered: MCP container is 2.2.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Seeds archive/notes/README.md and asserts vault_lint flags retired-path —
fails against the pre-1.6.0 linter, passes with the retired-first check.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Live 1.5.0 use caught the gate blocking a decision note over the single
vault-common token "echo" (min-normalized overlap gives any one-token
entity a 1.0 score). New echo_index.gate_candidates() + token_df():
- gate blocks same-kind candidates only; cross-kind name collisions
(a decision titled after its project) warn instead of blocking
- a lone shared token blocks only when unique to that entity (df == 1);
multi-token overlaps still block
fuzzy_candidates (advisory warnings) and exit-76/--merge-into/--force
semantics unchanged. +3 offline unit tests, gate e2e cases restructured
+2 new; verified live both directions. All suites green.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Jason Stedwell