Infrastructure/Cloudreve
0
Fork 0
Code Issues Pull requests Activity
613 commits 10 branches 42 tags 15 MiB
Commit graph

262 commits

Author SHA1 Message Date
HFO4
af4d9767c2 Fix: slave node cannot transfer files to other slave node 2021-11-30 19:26:07 +08:00
HFO4
3948ee7f3a Fix: use X-Cr- as custom header prefix 2021-11-23 21:22:23 +08:00
HFO4
700e13384e Fix: using url escape instead of unescape in remote handler (#1051) 2021-11-22 20:23:34 +08:00
HFO4
9056ef9171 Test: new changes in 3.4.0 2021-11-20 16:59:29 +08:00
HFO4
532bff820a Test: new modifications in filesystem pkg 2021-11-16 20:54:21 +08:00
kikoqiu
54ed7e43ca
Feat: improve thumbnails proformance and GC for local policy (#1044) 
* thumb generating improvement

Replace "github.com/nfnt/resize" with "golang.org/x/image/draw". Add thumb task queue to avoid oom when batch thumb operation

* thumb improvement

* Add some tests for thumbnail generation
 2021-11-11 17:45:22 +08:00
HFO4
e41ec9defa Refactor: move slave pkg inside of cluster 
Test: middleware for node communication
 2021-11-08 19:54:26 +08:00
AaronLiu
056de22edb
Feat: aria2 download and transfer in slave node (#1040) 
* Feat: retrieve nodes from data table

* Feat: master node ping slave node in REST API

* Feat: master send scheduled ping request

* Feat: inactive nodes recover loop

* Modify: remove database operations from aria2 RPC caller implementation

* Feat: init aria2 client in master node

* Feat: Round Robin load balancer

* Feat: create and monitor aria2 task in master node

* Feat: salve receive and handle heartbeat

* Fix: Node ID will be 0 in download record generated in older version

* Feat: sign request headers with all `X-` prefix

* Feat: API call to slave node will carry meta data in headers

* Feat: call slave aria2 rpc method from master

* Feat: get slave aria2 task status
Feat: encode slave response data using gob

* Feat: aria2 callback to master node / cancel or select task to slave node

* Fix: use dummy aria2 client when caller initialize failed in master node

* Feat: slave aria2 status event callback / salve RPC auth

* Feat: prototype for slave driven filesystem

* Feat: retry for init aria2 client in master node

* Feat: init request client with global options

* Feat: slave receive async task from master

* Fix: competition write in request header

* Refactor: dependency initialize order

* Feat: generic message queue implementation

* Feat: message queue implementation

* Feat: master waiting slave transfer result

* Feat: slave transfer file in stateless policy

* Feat: slave transfer file in slave policy

* Feat: slave transfer file in local policy

* Feat: slave transfer file in OneDrive policy

* Fix: failed to initialize update checker http client

* Feat: list slave nodes for dashboard

* Feat: test aria2 rpc connection in slave

* Feat: add and save node

* Feat: add and delete node in node pool

* Fix: temp file cannot be removed when aria2 task fails

* Fix: delete node in admin panel

* Feat: edit node and get node info

* Modify: delete unused settings
 2021-10-31 09:41:56 +08:00
AaronLiu
65c4367689
Revert "delete $name policy (#831)" (#961) 
This reverts commit e6959a5026.
 2021-07-30 11:22:18 +08:00
Songtao
e6959a5026
delete $name policy (#831) 2021-07-11 14:32:47 +08:00
HFO4
8659bdcf77 Fix: unable to read file from UPYUN (#472, #472, #836) 2021-05-11 21:52:55 +08:00
HFO4
96712fb066 Feat: use RFC3339 time format in returned results (#811) 2021-04-03 16:57:13 +08:00
HFO4
c0f7214cdb Revert "Fix: OSS SDK will encode all object key (#694)" 
This reverts commit 270f617b and fix #802
 2021-03-22 16:22:21 +08:00
HFO4
595f4a1350 Test: get parament source in OneDrive handler 2021-03-21 14:32:10 +08:00
HFO4
a5f80a4431 Feat: get permanent URL for OneDrive policy 2021-03-20 12:33:39 +08:00
ihipop
270f617b9d
Fix: OSS SDK will encode all object key (#694) 
(cherry picked from commit b9cd82b849065f0d1ad093708f09c8722339bf2a)
 2021-03-16 21:56:14 -08:00
HFO4
170f2279c1 Fix: failed to get thumbnails under global OneDrive policy 2021-03-14 11:03:10 +08:00
HFO4
4e2f243436 Feat: support using SharePoint site to store files 2021-03-12 17:05:13 +08:00
HFO4
a93b964d8b Modify: OneDrive file URL cache will refreshed after file is updated 2021-03-03 17:07:26 +08:00
HFO4
4cf6c81534 Fix: failed unit test 2021-03-02 12:32:34 +08:00
HFO4
5a66af3105 Fix: failed unit test 2021-03-02 12:21:43 +08:00
HFO4
fc5c67cc20 Feat: disable overwrite for OneDrive policy 2021-03-01 13:27:18 +08:00
HFO4
5e226efea1 Feat: disable overwrite for non-updating put request, only works under local,slave,OneDrive,OSS policy. (#764) 2021-03-01 13:03:49 +08:00
HFO4
e699287ffd Modify: mark as success when deleting a file that does not exist; 
Fix: minio is not usable in S3 policy
Modify: use batch request to delete S3 files
 2021-02-28 16:48:51 +08:00
Breeze Chen
488e62f762
Fix qiniu last modify time. (#691) 2021-01-06 17:01:24 +08:00
HFO4
5b44606276 Test: replace cdn proxy url for OneDrive policy 2020-12-08 17:31:37 +08:00
HFO4
bd2bdf253b Feat: using custom reverse proxying in OneDrive file downloading 2020-12-08 17:30:22 +08:00
HFO4
7279be2924 Fix: user storage might be returned twice when OneDrive uploading canceled in WebDAV requests 2020-12-01 19:22:52 +08:00
HFO4
a5805b022a Feat: enable using LAN endpoint in serverside request of OSS policy (#399) 2020-11-29 19:15:35 +08:00
HFO4
d97bc26042 Fix: add recycleLock preventing recycle FileSystem used by another goroutine 2020-11-21 19:32:25 +08:00
Loyalsoldier
79b8784934
Comply with Golang semantic import versioning (#630) 
* Code: compatible with semantic import versioning

* Tools & Docs: compatible with semantic import versioning

* Clean go.mod & go.sum
 2020-11-21 17:34:55 +08:00
HFO4
746aa3e8ef Test: s3 policy 2020-10-26 15:33:28 +08:00
HFO4
95f318e069 Feat: adapt minio for S3 policy and fix listing files 2020-10-26 15:06:02 +08:00
HFO4
77394313aa Fix: S3 adaption for minio 2020-10-11 13:05:14 +08:00
ZZF
dd50ef1c25
添加S3策略的支持 (#425) 
* 添加亚马逊S3策略的支持

* 添加CDN支持，公有目录删除无用参数

* 增加Region
 2020-06-05 14:45:24 +08:00
HFO4
a7ba357cb8 Fix: hash mark in file name lead to 404 error (#405) 2020-05-30 19:35:28 +08:00
HFO4
5af3c4e244 Fix: directory renaming should not be limited by file extensions (#395) 2020-05-19 11:25:01 +08:00
HFO4
280308bc05 Modify: increase OneDrive client uploading chunk size to 100MB 2020-05-13 09:09:11 +08:00
HFO4
e8a6df9a86 Feat: import file from existing outer folder 2020-05-02 10:22:28 +08:00
HFO4
79daf92896 Test: List files in OneDrive 2020-05-01 09:22:27 +08:00
HFO4
8a2be58ef3 Feat: List files in OneDrive 2020-04-30 11:45:35 +08:00
HFO4
ce7784090f Feat: List files in upyun bucket 2020-04-30 10:37:48 +08:00
HFO4
dfb663a6e0 Feat: List files in Qiniu bucket 2020-04-29 10:37:15 +08:00
HFO4
cfaf20926f Feat: List files in COS bucket 2020-04-29 10:36:52 +08:00
HFO4
305497e7cb Test: oss.List 2020-04-29 09:18:26 +08:00
HFO4
52c2422be9 Feat: list oss files 2020-04-28 11:43:32 +08:00
HFO4
1afc750dae Modify: create folder if not exist while importing files 2020-04-28 10:47:40 +08:00
HFO4
960c886496 Test: slave side list file 2020-04-28 10:16:04 +08:00
HFO4
5d579cdadc Feat: slave side list file 2020-04-28 10:02:53 +08:00
HFO4
36e5b31f73 Modify: add recursive options for list method 
Test: local.List
 2020-04-27 10:31:34 +08:00