808b29885f
build_mode fixture have dynamic scope. It depends how the pytest is executed. When it executed through test.py scope will be session and since it's broader that package everything work fine. While with pure pytest it will fail because build_mode will have module scope. This fix allows to run tests with pure pytest, this needed for migration test to be executed by pytest runner instead test.py.
vector-search-validator tests for Scylla and Vector Store
vector-search-validator is a testing tool for validating the functionality of
integration between Scylla and Vector Store. Such integration depends on the
Scylla cluster and the Vector Store nodes and also on the DNS service. For this
reason we run vector-search-validator in a network and storage linux
namespace to separate it from the host environment. vector-search-validator
contains DNS server and all tests in one binary. It uses external scylla and
vector-store binaries.
The test_validator.py::test_validator[test-case] is the entry point for
running the tests. It is parametrized with name of the test case. Available
test cases are taken dynamically from the vector-search-validator binary.
To run test with dev Scylla and test case cql run the following command in
the dbuild environment (non dbuild environment is not supported currently, as
test needs to have sudo permissions without password):
$ pytest --mode=dev test/vector_search_validator/test_validator.py::test_validator[cql]
To run all tests with dev Scylla run the following command:
$ pytest --mode=dev test/vector_search_validator/test_validator.py
$ pytest --mode=dev test/vector_search_validator/test_validator.py::test_validator
You can tests with custom filters supported by validator. To run filtered tests
with dev Scylla run the following command:
$ pytest --mode=dev test/vector_search_validator/test_validator.py --filters filter1,filter2,...
Logs are stored in
testlog/{mode}/vector_search_validator/{test-case}-{run_id}/ directory.
Implementing new test cases on the Scylla repository side means adding new test
in crate crates/validator-scylla.