spyglass · research

Spyglass

Spyglass is a research filesystem-metadata search system that partitions indexes by namespace and retains incremental versions for historical queries.

The WAFL crawler compares snapshot metadata blocks. Collection and index application are separate: batched updates can leave search results stale. [1]

Each partition has a baseline and incremental indexes. Queries apply retained increments chronologically; version collapsing advances the baseline, while checkpointing saves selected index copies. [1]

Relations

related
Storage snapshot, inotify, Full-path indexing, Backup catalog

Limitations

  • Distributed indexing was future work, not an evaluated implementation. [1]
  • Search-result authorization and the search interface were future work; the prototype evaluation does not establish secure multi-user search. [1]

Citations

  1. Leung, Shao, Bisson, Pasupathy and Miller. Spyglass. FAST 2009, pp. 153-166, sections 2.2, 3.2-4 and 6. (accessed 2026-11-21)

Further reading

  1. Hesela: index source intervals and retained history (accessed 2026-11-21)
Sources & caveats
  • Historical Linux user-space prototype with RPC-based WAFL collection; evaluated on Ubuntu 7.10. No benchmark reproduction.

JSON: /data/terms/spyglass.json

Published by Hesela team · Updated

Report a correction · Editorial standards · Reuse guidance

Cite this page
Hesela team. Spyglass. Hesela. 2026-11-21. https://hesela.dev/terms/spyglass/