Beacon

A polite async crawler, a boilerplate stripper, a positional inverted index, a postings codec (delta, varint, bitpacking), BM25, PageRank over sparse matrices, a gradient-boosted learning-to-rank reranker, a query parser with spellcheck and autocomplete, and a sharded fan-out/merge layer.

beacon-search-console wires all nine together through their documented on-disk contracts and serves 181 pages crawled live from docs.python.org. beacon-search-engine-at-scale then rebuilds the substrate — object storage, a message queue, a service registry, map-reduce indexing — for a few million pages. No Elasticsearch, no Lucene.