0
Fork 0
mirror of https://github.com/project-zot/zot.git synced 2024-12-16 21:56:37 -05:00
zot/test/blackbox
Andrei Aaron 6115eed4ec
refactor(makefile): consolidate the make targets used for bats tests (#1746)
New examples of running tests:

1. To run a specific bats file (with and without verbose output):
make run-blackbox-tests BATS_TEST_FILE_PATH=test/blackbox/delete_images.bats
make run-blackbox-tests BATS_TEST_FILE_PATH=test/blackbox/delete_images.bats BATS_VERBOSITY=2

2. To run the CI tests (with and without verbose output)
make run-blackbox-ci
make run-blackbox-ci BATS_VERBOSITY=2

BATS_TEST_FILE_PATH is used to pass on the test file to run using `run-blackbox-tests`
BATS_VERBOSITY controls the verbosity of the bats framework output, if unspecified the output only
contains test results and failure message in case of failures.
If BATS_VERBOSITY is 1, then also show commands as they are executed.
If BATS_VERBOSITY is 2, on top of the above it also shows output of passed tests.

Other changes in this PR:
- Update some of the tests to show logs after the run ends.
- Run the linters before the tests, as it saves time on failures when running in GH

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>
2023-09-07 21:06:21 +03:00
..
annotations.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
anonymous_policy.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
cloud_only.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
cve.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
delete_images.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
detect_manifest_collision.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
garbage_collect.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
helpers_cloud.bash fix: bats test refactoring (#1731) 2023-08-30 12:24:28 -07:00
helpers_scrub.bash fix: bats test refactoring (#1731) 2023-08-30 12:24:28 -07:00
helpers_wait.bash fix: bats test refactoring (#1731) 2023-08-30 12:24:28 -07:00
helpers_zot.bash fix: bats test refactoring (#1731) 2023-08-30 12:24:28 -07:00
metadata.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
metrics.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
pushpull.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
pushpull_authn.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
pushpull_running_dedupe.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
referrers.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
restore_s3_blobs.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
scrub.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
sync.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
sync_docker.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
sync_harness.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00
sync_replica_cluster.bats refactor(makefile): consolidate the make targets used for bats tests (#1746) 2023-09-07 21:06:21 +03:00