Spyglass
Spyglass is a research filesystem-metadata search system that partitions indexes by namespace and retains incremental versions for historical queries.
The WAFL crawler compares snapshot metadata blocks. Collection and index application are separate: batched updates can leave search results stale. [1]
Each partition has a baseline and incremental indexes. Queries apply retained increments chronologically; version collapsing advances the baseline, while checkpointing saves selected index copies. [1]
Relations
Limitations
- Distributed indexing was future work, not an evaluated implementation. [1]
- Search-result authorization and the search interface were future work; the prototype evaluation does not establish secure multi-user search. [1]
Citations
Further reading
Sources & caveats
- Historical Linux user-space prototype with RPC-based WAFL collection; evaluated on Ubuntu 7.10. No benchmark reproduction.