How we build spectral intelligence.
Notes on systems, algorithms, and the engineering choices behind ArrowSpace. Written for the teams shipping embedding-heavy software in production.
Genefold First Principles: From Entropy to Epiplexity
Entropy measures uncertainty. But not all uncertainty is learnable. When compute is finite, the question shifts from how much uncertainty exists to how much structure we can extract per FLOP.
Genefold First Principles: Depletion of Uncertainty
Entropy is the irreducible uncertainty of the source. Cross-entropy measures how close the model's distribution is to the truth — training depletes the gap: the KL divergence.
Designing ArrowSpace and graph wiring
How graph wiring in the feature-space Laplacian powers spectral indexing for vector retrieval, and what the experimental evidence shows on CVE and TREC-COVID.