Penpot/penpot
0
Fork 0
mirror of https://github.com/penpot/penpot.git synced 2025-01-09 08:20:45 -05:00
Code Issues Activity
penpot/backend/resources/climit.edn

31 lines
663 B
Clojure
Raw Normal View History

:tada: Add robust concurrency limiter for RPC
2022-10-16 16:44:16 -05:00
;; Example climit.edn file
:recycle: Refactor cocurrency model on backend Mainly the followin changes: - Pass majority of code to the old and plain synchronous style and start using virtual threads for the RPC (and partially some HTTP server middlewares). - Make some improvements on how CLIMIT is handled, simplifying code - Improve considerably performance reducing the reflection and unnecesary funcion calls on the whole stack-trace of an RPC call. - Improve efficiency reducing considerably the total threads number.
2023-03-02 10:57:28 -05:00
;; Required: permits
;; Optional: queue, ommited means Integer/MAX_VALUE
;; Optional: timeout, ommited means no timeout
;; Note: queue and timeout are excluding
:recycle: Fix some fundamental bugs on climit module The climit previously of this commit is heavily used inside a transactions, so in heavy contention operation such that file thumbnail creation can cause a db pool exhaust. This commit fixes this issue setting up a better resource limiting mechanism that works outside the transactions so, contention will no longer hold an open connection/transaction. It also adds general improvement to the traceability to the climit mechanism: it now properly logs the profile-id that is currently cause some contention on specific resources. It also add a general/root climit that is applied to all requests so if someone start making abussive requests, we can clearly detect it.
2024-01-27 16:33:52 -05:00
{:update-file/global {:permits 20}
:update-file/by-profile
:sparkles: Make the RPC climit subsystem more robust
2023-11-24 08:53:16 -05:00
{:permits 1 :queue 5}
:recycle: Refactor cocurrency model on backend Mainly the followin changes: - Pass majority of code to the old and plain synchronous style and start using virtual threads for the RPC (and partially some HTTP server middlewares). - Make some improvements on how CLIMIT is handled, simplifying code - Improve considerably performance reducing the reflection and unnecesary funcion calls on the whole stack-trace of an RPC call. - Improve efficiency reducing considerably the total threads number.
2023-03-02 10:57:28 -05:00
:recycle: Fix some fundamental bugs on climit module The climit previously of this commit is heavily used inside a transactions, so in heavy contention operation such that file thumbnail creation can cause a db pool exhaust. This commit fixes this issue setting up a better resource limiting mechanism that works outside the transactions so, contention will no longer hold an open connection/transaction. It also adds general improvement to the traceability to the climit mechanism: it now properly logs the profile-id that is currently cause some contention on specific resources. It also add a general/root climit that is applied to all requests so if someone start making abussive requests, we can clearly detect it.
2024-01-27 16:33:52 -05:00
:process-font/global {:permits 4}
:process-font/by-profile {:permits 1}
:recycle: Refactor cocurrency model on backend Mainly the followin changes: - Pass majority of code to the old and plain synchronous style and start using virtual threads for the RPC (and partially some HTTP server middlewares). - Make some improvements on how CLIMIT is handled, simplifying code - Improve considerably performance reducing the reflection and unnecesary funcion calls on the whole stack-trace of an RPC call. - Improve efficiency reducing considerably the total threads number.
2023-03-02 10:57:28 -05:00
:sparkles: Make the RPC climit subsystem more robust
2023-11-24 08:53:16 -05:00
:process-image/global {:permits 8}
:recycle: Fix some fundamental bugs on climit module The climit previously of this commit is heavily used inside a transactions, so in heavy contention operation such that file thumbnail creation can cause a db pool exhaust. This commit fixes this issue setting up a better resource limiting mechanism that works outside the transactions so, contention will no longer hold an open connection/transaction. It also adds general improvement to the traceability to the climit mechanism: it now properly logs the profile-id that is currently cause some contention on specific resources. It also add a general/root climit that is applied to all requests so if someone start making abussive requests, we can clearly detect it.
2024-01-27 16:33:52 -05:00
:process-image/by-profile {:permits 1}
:sparkles: Make the RPC climit subsystem more robust
2023-11-24 08:53:16 -05:00
:recycle: Fix some fundamental bugs on climit module The climit previously of this commit is heavily used inside a transactions, so in heavy contention operation such that file thumbnail creation can cause a db pool exhaust. This commit fixes this issue setting up a better resource limiting mechanism that works outside the transactions so, contention will no longer hold an open connection/transaction. It also adds general improvement to the traceability to the climit mechanism: it now properly logs the profile-id that is currently cause some contention on specific resources. It also add a general/root climit that is applied to all requests so if someone start making abussive requests, we can clearly detect it.
2024-01-27 16:33:52 -05:00
:auth/global {:permits 8}
:root/global
{:permits 40}
:root/by-profile
{:permits 10}
:file-thumbnail-ops/global
{:permits 20}
:sparkles: Make the RPC climit subsystem more robust
2023-11-24 08:53:16 -05:00
:file-thumbnail-ops/by-profile
:sparkles: Add proper climit configuration for file-thumbnails
2023-11-08 09:15:09 -05:00
{:permits 2}
:sparkles: Make the RPC climit subsystem more robust
2023-11-24 08:53:16 -05:00
:submit-audit-events/by-profile
:recycle: Refactor cocurrency model on backend Mainly the followin changes: - Pass majority of code to the old and plain synchronous style and start using virtual threads for the RPC (and partially some HTTP server middlewares). - Make some improvements on how CLIMIT is handled, simplifying code - Improve considerably performance reducing the reflection and unnecesary funcion calls on the whole stack-trace of an RPC call. - Improve efficiency reducing considerably the total threads number.
2023-03-02 10:57:28 -05:00
{:permits 1 :queue 3}}
Reference in a new issue Copy permalink