0
Fork 0
mirror of https://github.com/verdaccio/verdaccio.git synced 2025-01-06 22:40:26 -05:00
verdaccio/packages/plugins/aws-storage
Juan Picado 459b6fa72b
refactor: search v1 endpoint and local-database (#2340)
* Refactor local-storage async

refactor local storage search stream

Remove async from local-storage, refactor search with streams

refactor search with undici fetch

finish search refactor

stream multiple request to single stream

refactor storage types

remove async dependency #1225

add score and refactor metadata

remove old search async

fix missing stream local data

clean up

clean up

refactor folder search

format

fix some test

fix issue on publish

filter preview

update ci

delete package folder refactor

refactor get packages methods

fix tests

fix lock file

add changeset

fix test windows

disable some test

update package json versions

* fix merge

* fix e2e cli

* restore e2e

* Update process.ts

* Update process.ts

* add improvement

* format

* Update utils.ts

* test

* test

* Update search.spec.ts

* Update search.spec.ts

* Update search.spec.ts

* test

* Update ci.yml

* clean up

* fix tests

* Update tags.ts

* Update index.spec.ts

* document changeset

* format
2021-09-08 19:06:37 +02:00
..
src refactor: search v1 endpoint and local-database (#2340) 2021-09-08 19:06:37 +02:00
tests refactor: search v1 endpoint and local-database (#2340) 2021-09-08 19:06:37 +02:00
.babelrc refactor: relocate verdaccio-aws-storage plugin (#1977) 2021-04-09 17:54:23 +02:00
.eslintrc refactor: relocate verdaccio-aws-storage plugin (#1977) 2021-04-09 17:54:23 +02:00
CHANGELOG.md chore: update versions (6-next) (#2245) 2021-05-24 09:01:22 +02:00
jest.config.js refactor: relocate verdaccio-aws-storage plugin (#1977) 2021-04-09 17:54:23 +02:00
LICENSE refactor: relocate verdaccio-aws-storage plugin (#1977) 2021-04-09 17:54:23 +02:00
package.json Indiescripter/update mostly e2e test deps (#2401) 2021-09-02 06:44:46 +02:00
README.md refactor: relocate verdaccio-aws-storage plugin (#1977) 2021-04-09 17:54:23 +02:00
tsconfig.build.json refactor: relocate verdaccio-aws-storage plugin (#1977) 2021-04-09 17:54:23 +02:00
tsconfig.json chore: add update-ts-references (#2168) 2021-04-09 17:54:44 +02:00

verdaccio-aws-s3-storage

📦 AWS S3 storage plugin for Verdaccio

verdaccio (latest) CircleCI Known Vulnerabilities codecov backers discord MIT node

Twitter followers Github backers stackshare

This plugin was forked based on verdaccio-s3-storage built in Typescript + other features added along the time. Both plugins might have vary in behaviour since then, we recommend use the AWS plugin on this repo due is under control of Verdaccio community and constantly upated.

See it in action

Basic Requirements

  • AWS Account (in case you are using the cloud)
  • Verdaccio server (4.0) (for 3.x use verdaccio-s3-storage instead)
npm install -g verdaccio

Usage

npm install verdaccio-aws-s3-storage

This will pull AWS credentials from your environment.

In your verdaccio config, configure

store:
  aws-s3-storage:
    bucket: your-s3-bucket
    keyPrefix: some-prefix # optional, has the effect of nesting all files in a subdirectory
    region: us-west-2 # optional, will use aws s3's default behavior if not specified
    endpoint: https://{service}.{region}.amazonaws.com # optional, will use aws s3's default behavior if not specified
    s3ForcePathStyle: false # optional, will use path style URLs for S3 objects
    accessKeyId: your-access-key-id # optional, aws accessKeyId for private S3 bucket
    secretAccessKey: your-secret-access-key # optional, aws secretAccessKey for private S3 bucket
    sessionToken: your-session-token # optional, aws sessionToken for private S3 bucket

The configured values can either be the actual value or the name of an environment variable that contains the value for the following options:

  • bucket
  • keyPrefix
  • region
  • endpoint
  • accessKeyID
  • secretAccessKey
  • sessionToken
store:
  aws-s3-storage:
    bucket: S3_BUCKET # If an environment variable named S3_BUCKET is set, it will use that value. Otherwise assumes the bucket is named 'S3_BUCKET'
    keyPrefix: S3_KEY_PREFIX # If an environment variable named S3_KEY_PREFIX is set, it will use that value. Otherwise assumes the bucket is named 'S3_KEY_PREFIX'
    endpoint: S3_ENDPOINT # If an environment variable named S3_ENDPOINT is set, it will use that value. Otherwise assumes the bucket is named 'S3_ENDPOINT'
    ...

store properties can be defined for packages. The storage location corresponds to the folder in s3 bucket.

packages:
  '@scope/*':
    access: all
    publish: $all
    storage: 'scoped'
  '**':
    access: $all
    publish: $all
    proxy: npmjs
    storage: 'public'

Developer Testing

In case of local testing, this project can be used self-efficiently. Four main ingredients are as follows:

  • config.yaml, see verdaccio documentation
  • The provided docker file allows to test the plugin, with no need for main verdaccio application
  • The provided docker-compose also provides minio in orchestration as a local substitute for S3 backend
  • Create and set content of registry.envs as follows. This file does not exist on the repo and should be generated manually after cloning the project.
AWS_ACCESS_KEY_ID=foobar
AWS_SECRET_ACCESS_KEY=1234567e
AWS_DEFAULT_REGION=eu-central-1
AWS_S3_ENDPOINT=https://localhost:9000/
AWS_S3_PATH_STYLE=true

Execute the docker image for testing

You need the latest docker installed in your computer

docker-compose up

By default there is no bucket created, you might need to browse http://127.0.0.1:9000/minio/ and create the example bucket manually named rise and then restart docker-compose up.

The default values should work out of the box. If you change anything, make sure the corresponding variables are set in other parts of the ingredient as well.