0
Fork 0
mirror of https://github.com/project-zot/zot.git synced 2025-04-15 03:03:03 -05:00
zot/pkg/storage
Andrei Aaron 05823cd74f
redis driver for blob cache information and metadb (#2865)
* feat: add redis cache support

https://github.com/project-zot/zot/pull/2005
Fixes https://github.com/project-zot/zot/issues/2004

* feat: add redis cache support

Currently, we have dynamoDB as the remote shared cache but ideal only
for the cloud use case.
For on-prem use case, add support for redis.

Signed-off-by: Ramkumar Chinchani <rchincha@cisco.com>

* feat(redis): added blackbox tests for redis

Signed-off-by: Petu Eusebiu <peusebiu@cisco.com>

* feat(redis): dummy implementation of MetaDB interface for redis cache

Signed-off-by: Alexei Dodon <adodon@cisco.com>

* feat: check validity of driver configuration on metadb instantiation

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat: multiple fixes for redis cache driver implementation

- add missing method GetAllBlobs
- add redis cache tests, with and without mocking

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): redis implementation for MetaDB

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): use redsync to block concurrent write access to the redis DB

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): update .github/workflows/cluster.yaml to also test redis

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(metadb): add keyPrefix parameter for redis and remove unneeded method meta.Crate()

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): support RedisCluster configuration and add unit tests

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): more tests for redis metadb implementation

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): add more examples and update examples/README.md

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): move option parsing and redis client initialization under pkg/api/config/redis

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* chore(cachedb): move Cache interface to pkg/storage/types

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): reorganize code in pkg/storage/cache.go

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): call redis.SetLogger() with the zot logger as parameter

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

* feat(redis): rename pkg/meta/redisdb to pkg/meta/redis

Signed-off-by: Andrei Aaron <aaaron@luxoft.com>

---------

Signed-off-by: Ramkumar Chinchani <rchincha@cisco.com>
Signed-off-by: Petu Eusebiu <peusebiu@cisco.com>
Signed-off-by: Alexei Dodon <adodon@cisco.com>
Signed-off-by: Andrei Aaron <aaaron@luxoft.com>
Co-authored-by: a <a@tuxpa.in>
Co-authored-by: Ramkumar Chinchani <rchincha@cisco.com>
Co-authored-by: Petu Eusebiu <peusebiu@cisco.com>
Co-authored-by: Alexei Dodon <adodon@cisco.com>
2025-01-30 11:00:52 -08:00
..
cache redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
common feat: add support for docker images (#2714) 2024-10-31 09:44:04 +02:00
constants redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
gc feat: add support for docker images (#2714) 2024-10-31 09:44:04 +02:00
imagestore redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
local redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
s3 redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
types redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
cache.go redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
cache_benchmark_test.go redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
cache_test.go redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
README.md refactor(cache): rewrote/refactored cachedb functionality to use interface (#667) 2022-11-02 15:53:08 -07:00
scrub.go ci(deps): upgrade golangci-lint (#2556) 2024-07-29 10:32:51 -07:00
scrub_test.go redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00
storage.go feat: add support for docker images (#2714) 2024-10-31 09:44:04 +02:00
storage_controller.go Catalog content discovery (#2782) 2024-12-19 09:38:35 -08:00
storage_test.go redis driver for blob cache information and metadb (#2865) 2025-01-30 11:00:52 -08:00

zot currently supports two types of underlying filesystems:

  1. local - a locally mounted filesystem

  2. remote - a remote filesystem such as AWS S3

The cache database can be configured independently of storage. Right now, zot supports the following database implementations:

  1. BoltDB - local storage. Set the "cloudCache" field in the config file to false. Example: examples/config-boltdb.json