Small models, local first
projectsSmall Tools, Long HorizonsBuild Your Own Second Brainaicomputer science
Summary
A local pipeline that indexes my notes and answers questions without leaving the machine. Slower, and worth it.
Setup
Embeddings computed on write, stored beside the notes as plain files. The index is rebuildable from scratch in under a minute.
Outcome
Answer quality is clearly below a hosted model. Trust in the answers is clearly above, because I can read the retrieved passages.