Commit graph

47 commits

Author SHA1 Message Date
HFO4
8443a30fb1 Feat: support chunk size option in policy 2022-02-10 19:31:06 +08:00
AaronLiu
056de22edb
Feat: aria2 download and transfer in slave node (#1040)
* Feat: retrieve nodes from data table

* Feat: master node ping slave node in REST API

* Feat: master send scheduled ping request

* Feat: inactive nodes recover loop

* Modify: remove database operations from aria2 RPC caller implementation

* Feat: init aria2 client in master node

* Feat: Round Robin load balancer

* Feat: create and monitor aria2 task in master node

* Feat: salve receive and handle heartbeat

* Fix: Node ID will be 0 in download record generated in older version

* Feat: sign request headers with all `X-` prefix

* Feat: API call to slave node will carry meta data in headers

* Feat: call slave aria2 rpc method from master

* Feat: get slave aria2 task status
Feat: encode slave response data using gob

* Feat: aria2 callback to master node / cancel or select task to slave node

* Fix: use dummy aria2 client when caller initialize failed in master node

* Feat: slave aria2 status event callback / salve RPC auth

* Feat: prototype for slave driven filesystem

* Feat: retry for init aria2 client in master node

* Feat: init request client with global options

* Feat: slave receive async task from master

* Fix: competition write in request header

* Refactor: dependency initialize order

* Feat: generic message queue implementation

* Feat: message queue implementation

* Feat: master waiting slave transfer result

* Feat: slave transfer file in stateless policy

* Feat: slave transfer file in slave policy

* Feat: slave transfer file in local policy

* Feat: slave transfer file in OneDrive policy

* Fix: failed to initialize update checker http client

* Feat: list slave nodes for dashboard

* Feat: test aria2 rpc connection in slave

* Feat: add and save node

* Feat: add and delete node in node pool

* Fix: temp file cannot be removed when aria2 task fails

* Fix: delete node in admin panel

* Feat: edit node and get node info

* Modify: delete unused settings
2021-10-31 09:41:56 +08:00
HFO4
4e2f243436 Feat: support using SharePoint site to store files 2021-03-12 17:05:13 +08:00
HFO4
bd2bdf253b Feat: using custom reverse proxying in OneDrive file downloading 2020-12-08 17:30:22 +08:00
HFO4
a5805b022a Feat: enable using LAN endpoint in serverside request of OSS policy (#399) 2020-11-29 19:15:35 +08:00
Loyalsoldier
79b8784934
Comply with Golang semantic import versioning (#630)
* Code: compatible with semantic import versioning

* Tools & Docs: compatible with semantic import versioning

* Clean go.mod & go.sum
2020-11-21 17:34:55 +08:00
HFO4
95f318e069 Feat: adapt minio for S3 policy and fix listing files 2020-10-26 15:06:02 +08:00
HFO4
77394313aa Fix: S3 adaption for minio 2020-10-11 13:05:14 +08:00
ZZF
dd50ef1c25
添加S3策略的支持 (#425)
* 添加亚马逊S3策略的支持

* 添加CDN支持,公有目录删除无用参数

* 增加Region
2020-06-05 14:45:24 +08:00
HFO4
e8a6df9a86 Feat: import file from existing outer folder 2020-05-02 10:22:28 +08:00
HFO4
304e7b502c Feat: thumbnail support for COS policy 2020-04-22 11:09:33 +08:00
HFO4
514e069113 Refactor: decide if there is a thumbnail based on the file extension 2020-04-22 11:04:35 +08:00
HFO4
b6e1e04ce0 Fix: panic while decompress files / Cannot edit policy 2020-03-11 09:34:29 +08:00
HFO4
45ec4b3f8b Fix: wrong upload URL for cos policy 2020-03-10 19:15:09 +08:00
HFO4
c4eada2723 Modify: oss handle sign URL 2020-02-27 15:12:15 +08:00
HFO4
f1ef21e195 Feat: add local policy 2020-02-26 15:11:06 +08:00
HFO4
4c530a26a0 Test: pkg/task / Fix: failed test due to policy cache 2020-02-07 11:47:52 +08:00
HFO4
fc5b7d42c8 Test: pkg/task 2020-02-06 16:01:06 +08:00
HFO4
e722c33cd5 Feat: task queue / compression task 2020-02-02 14:40:07 +08:00
HFO4
94b13393a9 Feat: hash id decode and verification 2020-01-26 14:57:07 +08:00
HFO4
8d437a451c Feat: COS credential / upload callback 2020-01-23 12:38:32 +08:00
HFO4
588514b4e0 Test: get filesystem from callback context 2020-01-22 14:41:12 +08:00
HFO4
d3f132de6d Fix: thumbnails for 21Vianet OneDrive 2020-01-22 08:58:59 +08:00
HFO4
06ff8b5a50 Feat: get OneDrive thumbnails 2020-01-21 13:27:20 +08:00
HFO4
6aee31341f Feat: async monitor OneDrive resume upload progress 2020-01-21 11:49:46 +08:00
HFO4
807aa5ac18 Feat: OneDrive OAuth / refresh token 2020-01-19 12:52:36 +08:00
HFO4
fa3b51096a Feat: upyun download / thumb / sign 2020-01-18 14:08:43 +08:00
HFO4
f7ecbce64c Feat: generate upload credentials for upyun 2020-01-17 14:05:51 +08:00
HFO4
83a17645a1 Feat: Put file in oss handler 2020-01-17 10:52:43 +08:00
HFO4
dd198becce Feat: client-upload file in oss 2020-01-16 13:36:13 +08:00
HFO4
90f82100cf Feat: put / get file in qiniu policy 2020-01-15 16:03:23 +08:00
HFO4
e8d21b1e9b Feat: qiniu upload & callback 2020-01-15 10:14:15 +08:00
HFO4
37e78cb39b Feat: generate upload server url from policy 2020-01-13 10:03:45 +08:00
HFO4
6b6bfb4c6b Modify: FileName header in remote put request should be urlencoded 2020-01-13 09:47:04 +08:00
HFO4
c23d129dbb Modify: use path package in app level 2020-01-04 16:21:43 +08:00
HFO4
35c2a5c977 Test: filesystem/Preview 2019-12-31 13:31:20 +08:00
HFO4
8a262a15d5 Modify: Decide whether to redirect when previewing based on storage policy 2019-12-31 13:09:26 +08:00
HFO4
132c7a8fcb Feat: file uploading in slave mode 2019-12-28 13:14:00 +08:00
HFO4
afc0b647ca Fix: failed unit test / Feat: support TTL in redis cache 2019-12-13 13:22:10 +08:00
HFO4
cb61945125 Feat: redis driver for cache 2019-12-09 15:20:02 +08:00
HFO4
7375cc01f1 Feat: cache in-memory store 2019-12-05 17:01:14 +08:00
HFO4
93010e3525 Feat: delete objects 2019-11-30 15:09:56 +08:00
HFO4
451bdb4ee1 Modify: parameters in headers should be URIEncoded 2019-11-25 21:12:28 +08:00
HFO4
88a543ef74 Feat: {path} marker in name rule representing the virtual path of the file 2019-11-19 16:42:36 +08:00
HFO4
aa17aa8e6a Feat: after uploading hooks and checks 2019-11-18 19:09:56 +08:00
HFO4
99e7eecab7 Feat: file upload handler 2019-11-17 13:50:14 +08:00
HFO4
4309653160 Feat: model/policy 2019-11-14 14:18:10 +08:00