Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Prepare chunks in a worker process #8618

Merged
merged 24 commits into from
Nov 28, 2024
Merged

Prepare chunks in a worker process #8618

Show file tree
Hide file tree
Changes from 14 commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
57d250f
Add new worker (docker compose)
azhavoro Oct 23, 2024
db3b6fc
wip
azhavoro Oct 30, 2024
5ca10b2
wip
azhavoro Oct 30, 2024
75877f3
wip
azhavoro Oct 30, 2024
6c5eeed
revert some changes
azhavoro Oct 30, 2024
c8aacdf
Fix unit, sdk pytorch tests. Add custom ttl for previews
azhavoro Oct 31, 2024
e8d0a53
Merge branch 'develop' into az/worker_for_chunks
azhavoro Oct 31, 2024
0e6c847
fix helm tests
azhavoro Oct 31, 2024
c1e1f9f
Fix comments
azhavoro Nov 5, 2024
32bb9d3
fix tests
azhavoro Nov 6, 2024
297021e
Merge remote-tracking branch 'origin' into az/worker_for_chunks
azhavoro Nov 6, 2024
55be434
Fix tests
azhavoro Nov 7, 2024
f536d70
Add changelog note
azhavoro Nov 7, 2024
72cb469
Attempting to reduce resources during tests
azhavoro Nov 7, 2024
353a44e
fixed comments
azhavoro Nov 11, 2024
9e7893e
t
azhavoro Nov 12, 2024
06125ca
Merge remote-tracking branch 'develop' into az/worker_for_chunks
azhavoro Nov 13, 2024
1831cc4
Fix comments
azhavoro Nov 14, 2024
980a8cc
fix import
azhavoro Nov 14, 2024
27f0a7b
check ts for static chunk
azhavoro Nov 14, 2024
3e74587
delete unused import
azhavoro Nov 14, 2024
9d692f4
fix duplicated values in helm test config
azhavoro Nov 14, 2024
c66681f
Apply comments
azhavoro Nov 19, 2024
61e37b3
Merge branch 'develop' into az/worker_for_chunks
azhavoro Nov 28, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 27 additions & 3 deletions .vscode/launch.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@
// For more information, visit: https://go.microsoft.com/fwlink/?linkid=830387
"version": "0.2.0",
"configurations": [

{
"name": "REST API tests: Attach to server",
"type": "debugpy",
Expand Down Expand Up @@ -168,7 +169,7 @@
"CVAT_SERVERLESS": "1",
"ALLOWED_HOSTS": "*",
"DJANGO_LOG_SERVER_HOST": "localhost",
"DJANGO_LOG_SERVER_PORT": "8282"
"DJANGO_LOG_SERVER_PORT": "8282",
},
"args": [
"runserver",
Expand All @@ -178,7 +179,7 @@
],
"django": true,
"cwd": "${workspaceFolder}",
"console": "internalConsole"
"console": "internalConsole",
},
{
"name": "server: chrome",
Expand Down Expand Up @@ -360,6 +361,28 @@
},
"console": "internalConsole"
},
{
"name": "server: RQ - chunks",
"type": "debugpy",
"request": "launch",
"stopOnEntry": false,
"justMyCode": false,
"python": "${command:python.interpreterPath}",
"program": "${workspaceFolder}/manage.py",
"args": [
"rqworker",
"chunks",
"--worker-class",
"cvat.rqworker.SimpleWorker"
],
"django": true,
"cwd": "${workspaceFolder}",
"env": {
"DJANGO_LOG_SERVER_HOST": "localhost",
"DJANGO_LOG_SERVER_PORT": "8282"
},
"console": "internalConsole"
},
{
"name": "server: migrate",
"type": "debugpy",
Expand Down Expand Up @@ -553,7 +576,8 @@
"server: RQ - scheduler",
"server: RQ - quality reports",
"server: RQ - analytics reports",
"server: RQ - cleaning"
"server: RQ - cleaning",
"server: RQ - chunks",
]
}
]
Expand Down
4 changes: 4 additions & 0 deletions changelog.d/20241107_154537_andrey_worker_for_chunks.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
### Changed

- Chunks are now prepared in a separate worker process
(<https://github.com/cvat-ai/cvat/pull/8618>)
Loading
Loading