Skip to content

Commit 96ff96e

Browse files
fix: add reset_llm_concurrency() for per-job isolation
If job A calls set_llm_concurrency(), the limit bleeds into job B in pooled server mode. Adding a reset function allows the factory dispose chain to restore the default between jobs. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 0fb419a commit 96ff96e

1 file changed

Lines changed: 8 additions & 0 deletions

File tree

packages/uipath-platform/src/uipath/platform/chat/llm_throttle.py

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -47,3 +47,11 @@ def set_llm_concurrency(limit: int) -> None:
4747
_llm_concurrency_limit = limit
4848
_llm_semaphore = None
4949
_llm_semaphore_loop = None
50+
51+
52+
def reset_llm_concurrency() -> None:
53+
"""Reset LLM concurrency to default for per-job isolation."""
54+
global _llm_concurrency_limit, _llm_semaphore, _llm_semaphore_loop
55+
_llm_concurrency_limit = DEFAULT_LLM_CONCURRENCY
56+
_llm_semaphore = None
57+
_llm_semaphore_loop = None

0 commit comments

Comments
 (0)