mirror of
https://github.com/versity/scoutfs.git
synced 2026-01-07 20:45:18 +00:00
68f7d1f2d0
This walks the meta_seq from 0, or, a passed in number to the current meta_seq, and polls further advances, until it approaches (but doesn't reach) the current stable meta_seq. Inodes found in the index will be tested to see if they return -ESTALE when open_by_handle_at(). If they do, further tests assure the file exists and can be resolved. If that happens to be the case, we ftrace the open_by_handle_at() on the inode, and write out the tracefile. The program can be ^C'd and will print out how far in the meta_seq it got, so it can be resumed where it left off. If tracing happens to be on while a TERM or INT signal is received, we immediately turn off tracing again. The program runs without producing needless terminal output. If traces are generated, the file name is printed out. If the program terminates, for whatever reason, it prints out how far it has advanced through the meta_seq, and that information can be used to resume testing from there on. The program can be run in tailing (normal) mode, the default, and continue to wait for new work to appear. Alternatively, the command line option `-e` tells the program to stop execution once the current stable meta_seq has been reached. Signed-off-by: Auke Kok <auke.kok@versity.com>
Introduction
scoutfs is a clustered in-kernel Linux filesystem designed to support large archival systems. It features additional interfaces and metadata so that archive agents can perform their maintenance workflows without walking all the files in the namespace. Its cluster support lets deployments add nodes to satisfy archival tier bandwidth targets.
The design goal is to reach file populations in the trillions, with the archival bandwidth to match, while remaining operational and responsive.
Highlights of the design and implementation include:
- Fully consistent POSIX semantics between nodes
- Atomic transactions to maintain consistent persistent structures
- Integrated archival metadata replaces syncing to external databases
- Dynamic seperation of resources lets nodes write in parallel
- 64bit throughout; no limits on file or directory sizes or counts
- Open GPLv2 implementation
Community Mailing List
Please join us on the open scoutfs-devel@scoutfs.org mailing list hosted on Google Groups