Infrastructure/Cloudreve
0
Fork 0
Code Issues Pull requests Activity
646 commits 10 branches 42 tags 15 MiB
Commit graph

50 commits

Author SHA1 Message Date
HFO4
c89327631e Fix: panics inside of task was not correctly logged into DB 
Feat: slave node use new API to upload file to master
 2022-03-13 16:20:50 +08:00
HFO4
9136f3caec Fix: while placeholder file got conflict, original file might be deleted 2022-03-13 16:19:05 +08:00
HFO4
b96019be7c Feat: client method to upload file from master node to slave node 2022-03-13 16:16:58 +08:00
HFO4
e0714fdd53 Feat: process upload callback sent from slave node 2022-03-03 19:17:25 +08:00
HFO4
4925a356e3 Enable overwrite for non-first chunk uploading request 2022-03-03 19:15:25 +08:00
HFO4
118d738797 Feat: support apply append mode and overwrite mode for FileStream 2022-02-28 17:49:00 +08:00
HFO4
521c5c8dc4 Feat: use transactions to manipulate user's used storage 2022-02-27 14:24:17 +08:00
HFO4
2811ee3285 Feat: slave policy creating upload session API 2022-02-27 14:22:09 +08:00
HFO4
3444b4a75e Feat: chunk upload handling for local policy 2022-02-27 14:13:39 +08:00
HFO4
c301bd6045 Feat: API for receiviing chunk data 2022-02-27 14:11:01 +08:00
HFO4
72173bf894 Refactor: create placeholder file and record upload session id in it 2022-02-27 14:07:12 +08:00
HFO4
6fdf77e00e Feat: support setting "last modified" props when creating upload session 2022-02-27 14:05:21 +08:00
HFO4
e37e93a7b6 Feat: create hidden file when creating upload session 2022-02-27 14:04:30 +08:00
HFO4
868a88e5fc Refactor: use universal FileHeader when handling file upload, remove usage of global ctx with FileHeader, SavePath, DisableOverwrite 2022-02-27 14:03:07 +08:00
HFO4
8443a30fb1 Feat: support chunk size option in policy 2022-02-10 19:31:06 +08:00
HFO4
de9c41082c Feat: create upload session and pre-upload check 2022-02-10 19:30:08 +08:00
HFO4
855c9d92c4 Feat: get policy from directory props / Feat: return source enabled flag in file list 2022-02-10 19:25:38 +08:00
AaronLiu
056de22edb
Feat: aria2 download and transfer in slave node (#1040) 
* Feat: retrieve nodes from data table

* Feat: master node ping slave node in REST API

* Feat: master send scheduled ping request

* Feat: inactive nodes recover loop

* Modify: remove database operations from aria2 RPC caller implementation

* Feat: init aria2 client in master node

* Feat: Round Robin load balancer

* Feat: create and monitor aria2 task in master node

* Feat: salve receive and handle heartbeat

* Fix: Node ID will be 0 in download record generated in older version

* Feat: sign request headers with all `X-` prefix

* Feat: API call to slave node will carry meta data in headers

* Feat: call slave aria2 rpc method from master

* Feat: get slave aria2 task status
Feat: encode slave response data using gob

* Feat: aria2 callback to master node / cancel or select task to slave node

* Fix: use dummy aria2 client when caller initialize failed in master node

* Feat: slave aria2 status event callback / salve RPC auth

* Feat: prototype for slave driven filesystem

* Feat: retry for init aria2 client in master node

* Feat: init request client with global options

* Feat: slave receive async task from master

* Fix: competition write in request header

* Refactor: dependency initialize order

* Feat: generic message queue implementation

* Feat: message queue implementation

* Feat: master waiting slave transfer result

* Feat: slave transfer file in stateless policy

* Feat: slave transfer file in slave policy

* Feat: slave transfer file in local policy

* Feat: slave transfer file in OneDrive policy

* Fix: failed to initialize update checker http client

* Feat: list slave nodes for dashboard

* Feat: test aria2 rpc connection in slave

* Feat: add and save node

* Feat: add and delete node in node pool

* Fix: temp file cannot be removed when aria2 task fails

* Fix: delete node in admin panel

* Feat: edit node and get node info

* Modify: delete unused settings
 2021-10-31 09:41:56 +08:00
Loyalsoldier
79b8784934
Comply with Golang semantic import versioning (#630) 
* Code: compatible with semantic import versioning

* Tools & Docs: compatible with semantic import versioning

* Clean go.mod & go.sum
 2020-11-21 17:34:55 +08:00
HFO4
4d70f9fa3e Fix: get execute file path dynamically 2020-03-11 10:32:35 +08:00
HFO4
c30c19ca3e Feat: create SFC for oss callback 2020-03-01 16:25:56 +08:00
HFO4
e8c4660c38 Feat: check policy update before upload 2020-02-27 17:12:59 +08:00
HFO4
c4eada2723 Modify: oss handle sign URL 2020-02-27 15:12:15 +08:00
HFO4
44d6ca487c Feat: mount storage policy for folders in WebDAV 2020-02-13 15:27:40 +08:00
HFO4
91e202c7e6 Feat: decompression task 2020-02-03 13:23:33 +08:00
HFO4
e722c33cd5 Feat: task queue / compression task 2020-02-02 14:40:07 +08:00
HFO4
dc32e85492 Fix: capacity should be returned back when put failed 2020-01-25 10:40:53 +08:00
HFO4
8d437a451c Feat: COS credential / upload callback 2020-01-23 12:38:32 +08:00
HFO4
0d2e3cc717 Test: Onedrive.OAuth 2020-01-22 10:50:47 +08:00
HFO4
dd5f6e3d25 Feat: onedrive client upload / callback 2020-01-20 14:34:21 +08:00
HFO4
fa3b51096a Feat: upyun download / thumb / sign 2020-01-18 14:08:43 +08:00
HFO4
5befbc21d0 Feat: upyun callback & authentication 2020-01-18 10:40:03 +08:00
HFO4
f7ecbce64c Feat: generate upload credentials for upyun 2020-01-17 14:05:51 +08:00
HFO4
e8d21b1e9b Feat: qiniu upload & callback 2020-01-15 10:14:15 +08:00
HFO4
c23d129dbb Modify: use path package in app level 2020-01-04 16:21:43 +08:00
HFO4
a75be3a927 Add: GetIntSetting helper 2020-01-02 12:44:53 +08:00
HFO4
ee08821361 Feat: remote delete file / Fix: broken Filesystem recycle in upload request 2020-01-01 20:15:05 +08:00
HFO4
d29b7ef6f8 Feat: auth for remote callback / Modify: use map to store hooks in filesystem 2019-12-30 19:08:38 +08:00
HFO4
2b8921e9fd Fix: untracked files 2019-12-28 15:54:16 +08:00
HFO4
132c7a8fcb Feat: file uploading in slave mode 2019-12-28 13:14:00 +08:00
HFO4
6470340104 Add: upload controller in slave mode 2019-12-27 21:15:05 +08:00
HFO4
9fdf2fe7ab Feat: adapt major methods of WebDAV for Cloudreve file system 2019-12-17 12:02:50 +08:00
HFO4
8bf2966d46 Feat: update file content 2019-12-15 14:01:37 +08:00
HFO4
36d5f51495 Feat: sign file source url 2019-12-10 17:10:34 +08:00
HFO4
9bb432c220 Feat: download file with speed limit 2019-11-27 13:10:19 +08:00
HFO4
29def02489 Fix: upload was marked canceled when small file uploaded 2019-11-27 12:49:31 +08:00
HFO4
4156a71adf Feat: file download in service level 2019-11-26 20:59:57 +08:00
HFO4
0cb80f69f5 Modify: split hooks into small modules 2019-11-26 11:42:26 +08:00
HFO4
9d8a462dc4 Remove: mutipart file upload 2019-11-22 14:56:46 +08:00
HFO4
438ce02420 Modify: re-organize structure of filesystem 2019-11-20 15:53:00 +08:00