9f10aebc66
The commit adds a functionality for `pytest` and `test.py` to run `vector-search-validator` in `sudo unshare` environment. There are already two tests - first parametrized `test_validator.py::test_validator[test-case-name]` (run validator) and second `test_cargo_toml.py::test_cargo_toml` (check if the current `Cargo.toml` for validator is correct). Documentation for these tests are provided in `README.md`.
vector-search-validator tests for Scylla and Vector Store
vector-search-validator is a testing tool for validating the functionality of
integration between Scylla and Vector Store. Such integration depends on the
Scylla cluster and the Vector Store nodes and also on the DNS service. For this
reason we run vector-search-validator in a network and storage linux
namespace to separate it from the host environment. vector-search-validator
contains DNS server and all tests in one binary. It uses external scylla and
vector-store binaries.
The test_validator.py::test_validator[test-case] is the entry point for
running the tests. It is parametrized with name of the test case. Available
test cases are taken dynamically from the vector-search-validator binary.
To run test with dev Scylla and test case cql run the following command in
the dbuild environment (non dbuild environment is not supported currently, as
test needs to have sudo permissions without password):
$ pytest --mode=dev test/vector_search_validator/test_validator.py::test_validator[cql]
To run all tests with dev Scylla run the following command:
$ pytest --mode=dev test/vector_search_validator/test_validator.py
$ pytest --mode=dev test/vector_search_validator/test_validator.py::test_validator
You can tests with custom filters supported by validator. To run filtered tests
with dev Scylla run the following command:
$ pytest --mode=dev test/vector_search_validator/test_validator.py --filters filter1,filter2,...
Logs are stored in
testlog/{mode}/vector_search_validator/{test-case}-{run_id}/ directory.
Implementing new test cases on the Scylla repository side means adding new test
in crate crates/validator-scylla.