Commit graph

54 commits

Author SHA1 Message Date
HFO4
118d738797 Feat: support apply append mode and overwrite mode for FileStream 2022-02-28 17:49:00 +08:00
HFO4
2811ee3285 Feat: slave policy creating upload session API 2022-02-27 14:22:09 +08:00
HFO4
7dd636da74 Feat: upload session recycle crontab job / API for cleanup all upload session 2022-02-27 14:16:36 +08:00
HFO4
3444b4a75e Feat: chunk upload handling for local policy 2022-02-27 14:13:39 +08:00
HFO4
72173bf894 Refactor: create placeholder file and record upload session id in it 2022-02-27 14:07:12 +08:00
HFO4
e37e93a7b6 Feat: create hidden file when creating upload session 2022-02-27 14:04:30 +08:00
HFO4
868a88e5fc Refactor: use universal FileHeader when handling file upload, remove usage of global ctx with FileHeader, SavePath, DisableOverwrite 2022-02-27 14:03:07 +08:00
HFO4
de9c41082c Feat: create upload session and pre-upload check 2022-02-10 19:30:08 +08:00
HFO4
532bff820a Test: new modifications in filesystem pkg 2021-11-16 20:54:21 +08:00
HFO4
e41ec9defa Refactor: move slave pkg inside of cluster
Test: middleware for node communication
2021-11-08 19:54:26 +08:00
AaronLiu
056de22edb
Feat: aria2 download and transfer in slave node (#1040)
* Feat: retrieve nodes from data table

* Feat: master node ping slave node in REST API

* Feat: master send scheduled ping request

* Feat: inactive nodes recover loop

* Modify: remove database operations from aria2 RPC caller implementation

* Feat: init aria2 client in master node

* Feat: Round Robin load balancer

* Feat: create and monitor aria2 task in master node

* Feat: salve receive and handle heartbeat

* Fix: Node ID will be 0 in download record generated in older version

* Feat: sign request headers with all `X-` prefix

* Feat: API call to slave node will carry meta data in headers

* Feat: call slave aria2 rpc method from master

* Feat: get slave aria2 task status
Feat: encode slave response data using gob

* Feat: aria2 callback to master node / cancel or select task to slave node

* Fix: use dummy aria2 client when caller initialize failed in master node

* Feat: slave aria2 status event callback / salve RPC auth

* Feat: prototype for slave driven filesystem

* Feat: retry for init aria2 client in master node

* Feat: init request client with global options

* Feat: slave receive async task from master

* Fix: competition write in request header

* Refactor: dependency initialize order

* Feat: generic message queue implementation

* Feat: message queue implementation

* Feat: master waiting slave transfer result

* Feat: slave transfer file in stateless policy

* Feat: slave transfer file in slave policy

* Feat: slave transfer file in local policy

* Feat: slave transfer file in OneDrive policy

* Fix: failed to initialize update checker http client

* Feat: list slave nodes for dashboard

* Feat: test aria2 rpc connection in slave

* Feat: add and save node

* Feat: add and delete node in node pool

* Fix: temp file cannot be removed when aria2 task fails

* Fix: delete node in admin panel

* Feat: edit node and get node info

* Modify: delete unused settings
2021-10-31 09:41:56 +08:00
HFO4
595f4a1350 Test: get parament source in OneDrive handler 2021-03-21 14:32:10 +08:00
HFO4
a5f80a4431 Feat: get permanent URL for OneDrive policy 2021-03-20 12:33:39 +08:00
HFO4
170f2279c1 Fix: failed to get thumbnails under global OneDrive policy 2021-03-14 11:03:10 +08:00
HFO4
4e2f243436 Feat: support using SharePoint site to store files 2021-03-12 17:05:13 +08:00
HFO4
a93b964d8b Modify: OneDrive file URL cache will refreshed after file is updated 2021-03-03 17:07:26 +08:00
HFO4
fc5c67cc20 Feat: disable overwrite for OneDrive policy 2021-03-01 13:27:18 +08:00
HFO4
e699287ffd Modify: mark as success when deleting a file that does not exist;
Fix: minio is not usable in S3 policy
Modify: use batch request to delete S3 files
2021-02-28 16:48:51 +08:00
HFO4
5b44606276 Test: replace cdn proxy url for OneDrive policy 2020-12-08 17:31:37 +08:00
HFO4
bd2bdf253b Feat: using custom reverse proxying in OneDrive file downloading 2020-12-08 17:30:22 +08:00
Loyalsoldier
79b8784934
Comply with Golang semantic import versioning (#630)
* Code: compatible with semantic import versioning

* Tools & Docs: compatible with semantic import versioning

* Clean go.mod & go.sum
2020-11-21 17:34:55 +08:00
HFO4
280308bc05 Modify: increase OneDrive client uploading chunk size to 100MB 2020-05-13 09:09:11 +08:00
HFO4
79daf92896 Test: List files in OneDrive 2020-05-01 09:22:27 +08:00
HFO4
8a2be58ef3 Feat: List files in OneDrive 2020-04-30 11:45:35 +08:00
HFO4
36e5b31f73 Modify: add recursive options for list method
Test: local.List
2020-04-27 10:31:34 +08:00
HFO4
f7311f906b Feat: add List method to Handler interface / implement local.List 2020-04-24 11:08:07 +08:00
HFO4
8c7d075484 Fix: repeated return of capacity when OneDrive WebDAV upload canceled 2020-04-07 10:51:54 +08:00
yeungc
6285e45e34
Fix: filename and code typo (#260)
* Rename handller.go to handler.go

* Rename handller.go to handler.go

* Rename handller_test.go to handler_test.go

* Rename handller.go to handler.go

* Rename handller.go to handler.go

* Rename handller.go to handler.go

* Rename handller.go to handler.go

* Fix typo
2020-03-23 13:44:59 +08:00
HFO4
87fde687eb Fix: files with percent sign (%) cannot be deleted in OneDrive 2020-03-18 10:42:41 +08:00
HFO4
0eb04ed0ea Feat: cache for OneDrive META request 2020-03-18 09:35:00 +08:00
HFO4
36cec067d9 Fix: OneDrive monitoring should continue when error occurs 2020-03-12 15:56:06 +08:00
HFO4
5363b90167 Test: options / WebDAV middleware 2020-02-21 11:16:25 +08:00
HFO4
16613a6113 Modify: return parent folder id while listing objects 2020-02-07 13:54:37 +08:00
HFO4
4c530a26a0 Test: pkg/task / Fix: failed test due to policy cache 2020-02-07 11:47:52 +08:00
HFO4
1a93c9a2b9 Feat: retry for Onedrive SimpleUpload 2020-02-05 15:17:49 +08:00
HFO4
491e4de9de Feat: download torrent / multiple file / select file 2020-02-05 15:11:34 +08:00
HFO4
3ed84ad5ec Feat: validate / cancel task while downloading file in aria2 2020-02-05 12:58:26 +08:00
HFO4
fe8f1b1ef5 Feat: creat uri aria2 download task 2020-02-04 15:29:52 +08:00
HFO4
7804b4efb1 Fix: Onedrive have batch requests limit for 20 per request 2020-02-04 10:48:26 +08:00
HFO4
91e202c7e6 Feat: decompression task 2020-02-03 13:23:33 +08:00
HFO4
68704f8646 Feat: options to disable preview in file sharing 2020-01-29 11:03:09 +08:00
HFO4
c34f211d7e Feat: get source url in COS 2020-01-25 11:20:31 +08:00
HFO4
dc32e85492 Fix: capacity should be returned back when put failed 2020-01-25 10:40:53 +08:00
HFO4
e894450d5e Modify: cancel race test 2020-01-22 15:11:03 +08:00
HFO4
4baddecd8e Fix: ignore data-race detector in onedrive tests 2020-01-22 15:06:56 +08:00
HFO4
a70bc7b908 Fix: ignore data-race detector in onedrive tests 2020-01-22 14:52:05 +08:00
HFO4
8672042d61 Test: onedrive related 2020-01-22 14:26:13 +08:00
HFO4
0d2e3cc717 Test: Onedrive.OAuth 2020-01-22 10:50:47 +08:00
HFO4
d3f132de6d Fix: thumbnails for 21Vianet OneDrive 2020-01-22 08:58:59 +08:00
HFO4
752ce5ce62 Feat: resume upload in server side 2020-01-21 15:36:04 +08:00